Strengths
- Apache 2.0 license
- Function calling and structured outputs
- Adjustable reasoning effort
- Can be fine-tuned
Best For
- Self-hosted and on-premises deployment
- Fast inference on Groq
- Agents with tool use
Run It in EDDI
The fastest route is the Manager: open the agent wizard or the Platform Operator and pick the provider and model. To configure it yourself, follow these steps for the provider you want.
Groq · type: "groq"
Model ids: openai/gpt-oss-120b, openai/gpt-oss-20b
1. Store the credential
Add the provider's API key to the Secrets Vault in the Manager, or with PUT /secretstore/secrets/default/groq-key, under the name used below. Configurations reference it as ${vault:…}, so the key never appears in plain text.
${vault:groq-key}2. Configure the LLM task
Use this as the langchain.json of the agent's workflow, or paste the parameters into the LLM editor in the Manager.
{
"tasks": [
{
"actions": [
"send_message"
],
"id": "chat",
"type": "groq",
"parameters": {
"apiKey": "${vault:groq-key}",
"modelName": "openai/gpt-oss-120b",
"systemMessage": "You are a helpful assistant",
"addToOutput": "true"
}
}
]
}Or create the whole agent in one call
setup_agent writes the rules, LLM configuration and workflow, then deploys the agent. Call it over MCP or POST /administration/agents/setup.
setup_agent(
agentName: "My openai/gpt-oss-120b agent",
systemPrompt: "You are a helpful assistant.",
provider: "groq",
model: "openai/gpt-oss-120b",
apiKey: "${vault:groq-key}"
)Amazon Bedrock · type: "bedrock"
Model ids: openai.gpt-oss-120b-1:0
1. Store the credential
This provider does not use an API key: Amazon Bedrock authenticates through the AWS credential chain: environment variables, an IAM role, or ~/.aws/credentials.
2. Configure the LLM task
Use this as the langchain.json of the agent's workflow, or paste the parameters into the LLM editor in the Manager.
{
"tasks": [
{
"actions": [
"send_message"
],
"id": "chat",
"type": "bedrock",
"parameters": {
"modelId": "openai.gpt-oss-120b-1:0",
"region": "us-east-1",
"maxTokens": "16384",
"systemMessage": "You are a helpful assistant",
"addToOutput": "true"
}
}
]
}Related Models
Sources
The facts on this page come from the vendor's documentation, checked on 2026-09-30. Models change quickly, so confirm limits with the vendor before you rely on them. Prices are not listed here: see the vendor's pricing page.