Skip to content
🚀 EDDI 6.5.0

19 LLM providers, knowledge bases that crawl your site and read your files, and conversations that follow compatible agent versionsWhat's new

Managed Cloud Get Started
All models
GoogleRuns locally

Gemma (Gemma 4, Gemma 3)

Google's open-weight family, from edge-sized models to a 31B dense and a 26B mixture-of-experts model in Gemma 4.

Strengths

  • Open weights, Gemma 4 under Apache 2.0
  • Function calling for agents
  • Image input on every size
  • Runs on modest hardware

Best For

  • On-device and edge deployment
  • Self-hosted agents
  • Question answering and summaries

Run It in EDDI

The fastest route is the Manager: open the agent wizard or the Platform Operator and pick the provider and model. To configure it yourself, follow these steps for the provider you want.

Ollama (local) · type: "ollama"

Model ids: gemma3:4b

1. Store the credential

This provider does not use an API key: Ollama needs no key. Point baseUrl at your Ollama server; with EDDI's Ollama overlay it is http://ollama:11434.

2. Configure the LLM task

Use this as the langchain.json of the agent's workflow, or paste the parameters into the LLM editor in the Manager.

{
  "tasks": [
    {
      "actions": [
        "send_message"
      ],
      "id": "chat",
      "type": "ollama",
      "parameters": {
        "baseUrl": "http://ollama:11434",
        "model": "gemma3:4b",
        "timeout": "120000",
        "systemMessage": "You are a helpful assistant",
        "addToOutput": "true"
      }
    }
  ]
}

Notes for EDDI

  • Runs fully offline once the model is downloaded, so it suits air-gapped deployments.

Related Models

Sources

The facts on this page come from the vendor's documentation, checked on 2026-09-30. Models change quickly, so confirm limits with the vendor before you rely on them. Prices are not listed here: see the vendor's pricing page.

Vendor documentation ↗