Provider Guide

Step-by-step setup guides for all supported LLM providers.

Anthropic Claude

# 1. Get your API key from https://console.anthropic.com
# 2. Configure in config.json:

{
  "anthropic": { "kind": "anthropic", "model": "claude-sonnet-4-20250514", "apiKey": "sk-ant-..." }
}

Recommended models: claude-sonnet-4-20250514, claude-haiku-4-5, claude-opus-4-5

OpenAI

# 1. Get your API key from https://platform.openai.com/api-keys
# 2. Configure:

{
  "openai": { "kind": "openai", "model": "gpt-4o", "apiKey": "sk-..." }
}

Recommended models: gpt-4o, gpt-4o-mini, gpt-4-turbo

Google Gemini

# 1. Get your API key from https://aistudio.google.com/apikey
# 2. Configure:

{
  "google": { "kind": "google", "model": "gemini-2.0-flash", "apiKey": "..." }
}

Recommended models: gemini-2.0-flash, gemini-2.5-pro

Mistral AI

# 1. Get your API key from https://console.mistral.ai
# 2. Configure:

{
  "mistral": { "kind": "mistral", "model": "mistral-large-latest", "apiKey": "..." }
}

Groq

# 1. Get your API key from https://console.groq.com
# 2. Configure (OpenAI-compatible):

{
  "groq": { "kind": "groq", "model": "llama-3.3-70b-versatile", "apiKey": "gsk_..." }
}

DeepSeek

# 1. Get your API key from https://platform.deepseek.com
# 2. Configure (OpenAI-compatible):

{
  "deepseek": { "kind": "deepseek", "model": "deepseek-chat", "apiKey": "sk-..." }
}

OpenRouter

# 1. Get your API key from https://openrouter.ai/keys
# 2. Configure (OpenAI-compatible):

{
  "openrouter": { "kind": "openrouter", "model": "openai/gpt-4o", "apiKey": "..." }
}

OpenRouter gives access to 200+ models from various providers.

xAI (Grok)

# 1. Get your API key from https://x.ai/api
# 2. Configure (OpenAI-compatible):

{
  "xai": { "kind": "xai", "model": "grok-2-latest", "apiKey": "..." }
}

Together AI

# 1. Get your API key from https://api.together.ai/settings/api-keys
# 2. Configure (OpenAI-compatible):

{
  "together": { "kind": "together", "model": "meta-llama/Llama-3.3-70B-Instruct-Turbo", "apiKey": "..." }
}

AWS Bedrock

# 1. Set up AWS credentials with Bedrock access
# 2. Configure:

{
  "bedrock": { "kind": "bedrock", "model": "anthropic.claude-3-5-sonnet-20240620-v1:0", "apiKey": "AKIA...", "secretKey": "...", "baseUrl": "us-east-1" }
}

Cohere

# 1. Get your API key from https://dashboard.cohere.com/api-keys
# 2. Configure:

{
  "cohere": { "kind": "cohere", "model": "command-r-plus", "apiKey": "..." }
}

Ollama (Local)

# 1. Install Ollama from https://ollama.com
# 2. Pull a model:
ollama pull llama3.2

# 3. Configure:

{
  "ollama": { "kind": "ollama", "model": "llama3.2", "baseUrl": "http://localhost:11434" }
}

Ollama runs entirely locally — no API key needed.