Ollama (local)
in NextOS.

01Supported models

Every model
this plugin lists.

qwen3

Qwen 3 (tools + thinking, if installed)

tools

llama3.1

Llama 3.1 8B (tools, if installed)

tools

llama3.2

Llama 3.2 3B (small + tools, if installed)

tools

mistral-nemo

Mistral Nemo 12B (tools, if installed)

tools

02Bring your own key, or hosted

How you
pay for it.

Ollama (local) runs bring-your-own-key only: add your key in Settings > API keys, or send it per-request over the gateway.

• —Full tool calling - agents can use every app and MCP tool through this provider
• —No provider-hosted web search
• —No provider-hosted URL fetch

03Governance

The same controls
as every provider.

• —Restrict which providers and models a team may use at all - an allowed list on the org policy, enforced on every gateway call
• —Set a default model the whole workspace inherits, with per-agent pins for the job that needs a different one
• —Per-org and per-key budgets and rate limits, checked before a call reaches the provider
• —Guardrails (PII redaction, prompt-injection screening) applied to every request and response, regardless of provider
• —A full audit trail of governance and budget events, in the team's activity log

04Over the gateway

One endpoint,
OpenAI-compatible.

curl https://jonkum.in/api/v1/chat/completions \
  -H "Authorization: Bearer ngk_..." \
  -H "X-Provider-Key: your-ollama-key" \
  -H "Content-Type: application/json" \
  -d '{"model":"ollama/qwen3","messages":[{"role":"user","content":"..."}]}'

Omit X-Provider-Key to run on the account's hosted allowance instead, where the plan supports it. See the gateway page for the full API.

05Every other provider

• Anthropic→
• Mistral→
• OpenAI→
• Perplexity→