Skip to main content
Reference

Supported providers

You can configure an upstream for 10 built-in providers and 25 OpenAI-compatible vendors, and for any other OpenAI-compatible endpoint through Custom OpenAI-compatible. Each row is a provider you can configure an upstream for. For how each provider family authenticates, see Supported providers in Providers; for a vendor's endpoints, pinned hosts, and quota signals, see the vendor catalog.

Providers​

ProviderIdKindTierWire formatsAuthenticationZero data retentionNo prompt trainingJurisdictionFeatured
AnthropicanthropicBuilt-infirst-classAnthropic MessagesAPI key—YesUSYes
OpenAI (API key)openaiBuilt-infirst-classOpenAI Chat Completions, OpenAI ResponsesAPI key—YesUSYes
Azure OpenAIazure (alias azure-openai)Built-infirst-classOpenAI Chat Completions, OpenAI ResponsesAPI key or managed identityYesYesUSYes
AWS Bedrock (OpenAI-compatible models)aws-bedrock (alias bedrock)Built-infirst-classOpenAI Chat CompletionsAWS credentialsYesYesUSYes
OpenRouter (free and paid models)openrouterVendorfirst-classAnthropic Messages, OpenAI Chat CompletionsAPI key———Yes
Google Vertexgoogle-vertex (alias vertex)Built-infirst-classGemini generateContentGoogle Application Default CredentialsYesYesUSYes
Alibaba Cloud Model Studio (Qwen)alibabaVendorcommunityOpenAI Chat CompletionsAPI key————
AWS Bedrock (Anthropic Claude — Sonnet, Haiku, Opus)aws-bedrock-anthropicBuilt-infirst-classAnthropic MessagesAWS credentialsYesYesUS—
Baseten Model APIsbasetenVendorcommunityOpenAI Chat CompletionsAPI key————
CerebrascerebrasVendorfirst-classOpenAI Chat CompletionsAPI key——US—
CoherecohereVendorcommunityOpenAI Chat CompletionsAPI key————
DeepInfradeepinfraVendorcommunityOpenAI Chat CompletionsAPI key————
DeepSeekdeepseekVendorfirst-classAnthropic Messages, OpenAI Chat CompletionsAPI key——CN—
Fireworks AIfireworksVendorfirst-classAnthropic Messages, OpenAI Chat CompletionsAPI key——US—
GitHub Copilotgithub-copilotBuilt-infirst-classOpenAI Chat CompletionsEach developer's own sign-in——US—
Google GeminigeminiVendorfirst-classOpenAI Chat CompletionsAPI key————
Google Vertex (Anthropic Claude)google-vertex-anthropicBuilt-infirst-classAnthropic MessagesGoogle Application Default CredentialsYesYesUS—
GroqgroqVendorfirst-classOpenAI Chat CompletionsAPI key——US—
Hugging Face Inference ProvidershuggingfaceVendorcommunityOpenAI Chat CompletionsAPI key————
LiteLLMlitellmBuilt-infirst-classOpenAI Chat CompletionsOptional API key————
MiniMaxminimaxVendorcommunityAnthropic Messages, OpenAI Chat CompletionsAPI key————
Mistral AImistralVendorfirst-classOpenAI Chat CompletionsAPI key——EU—
Moonshot (Kimi)moonshotVendorfirst-classAnthropic Messages, OpenAI Chat CompletionsAPI key——CN—
Nebius Token FactorynebiusVendorcommunityOpenAI Chat CompletionsAPI key————
Novita AInovitaVendorcommunityOpenAI Chat CompletionsAPI key————
NVIDIA NIMnvidia-nimVendorcommunityOpenAI Chat CompletionsAPI key————
OllamaollamaVendorlocalAnthropic Messages, OpenAI Chat CompletionsNone————
OpenAI (ChatGPT OAuth — Codex)chatgpt-oauthBuilt-infirst-classOpenAI ResponsesEach developer's own sign-in——US—
PerplexityperplexityVendorfirst-classOpenAI Chat CompletionsAPI key——US—
SambaNova CloudsambanovaVendorcommunityOpenAI Chat CompletionsAPI key————
Sarvam AIsarvamVendorcommunityOpenAI Chat CompletionsAPI key————
Together AItogetherVendorfirst-classOpenAI Chat CompletionsAPI key——US—
vLLMvllmVendorlocalAnthropic Messages, OpenAI Chat CompletionsOptional API key————
xAIxaiVendorfirst-classOpenAI Chat CompletionsAPI key——US—
Z.ai (GLM)zaiVendorfirst-classAnthropic Messages, OpenAI Chat CompletionsAPI key——CN—
Custom OpenAI-compatiblecustomCustomcustomOpenAI Chat CompletionsAPI key————

LiteLLM is configured in the config file only; neither the setup wizard nor Settings → Providers offers it.

Columns​

  • Kind: Built-in for a provider AIControls handles natively, Vendor for an entry in the vendor catalog, and Custom for any other OpenAI-compatible endpoint. A Custom upstream's provider name is custom:<host>, such as custom:llm.example.com.
  • Tier: first-class is every built-in provider, and each hosted vendor with tested endpoints, pricing, and, where the vendor reports them, its own credit and quota signals. community vendors have a complete catalog entry but aren't tested on a schedule. local is a model server you run, such as Ollama or vLLM, at any URL. custom takes any URL. See Tiers.
  • Wire formats: the request formats the provider serves. A client that sends another format is translated where AIControls supports it; see Cross-format routing.
  • Authentication: what an upstream for the provider needs. Each developer's own sign-in means each developer's AI tool sends its own credential, so no key is stored.
  • Zero data retention, No prompt training, Jurisdiction: the provider's default data-handling guarantees, which data-handling policies check. They are defaults, not facts about your account: the jurisdiction of an Azure resource or an AWS region is where you deployed it. Set the upstream's capabilities to match its region and the terms of your own agreement with the provider. A Google Vertex upstream takes its jurisdiction from the region in its URL; see Jurisdiction of a Google Vertex upstream. A dash means the provider makes no such guarantee by default, or, for Jurisdiction, that it has no default jurisdiction.
  • Featured: the provider is marked featured in the provider catalog API, which lists featured providers first.