Skip to content

Providers

parseforge speaks to eighteen LLM providers through a common interface (RegexBuilder for naming, and the same provider name/model/api-key shape for generation). Install the extra for whichever one you use — see Installation.

At a glance

Provider Extra Auth Default model
Anthropic anthropic ANTHROPIC_API_KEY claude-haiku-4-5-20251001
OpenAI openai OPENAI_API_KEY gpt-5.4-mini
DeepSeek deepseek DEEPSEEK_API_KEY deepseek-v4-flash
Groq groq GROQ_API_KEY llama-3.1-8b-instant
xAI xai XAI_API_KEY grok-3-mini
Together together TOGETHER_API_KEY meta-llama/Llama-3.1-8B-Instruct-Turbo
Fireworks fireworks FIREWORKS_API_KEY accounts/fireworks/models/llama-v3p1-8b-instruct
Perplexity perplexity PERPLEXITY_API_KEY sonar
OpenRouter openrouter OPENROUTER_API_KEY google/gemini-2.5-flash-lite
Moonshot moonshot MOONSHOT_API_KEY moonshot-v1-8k
Cerebras cerebras CEREBRAS_API_KEY llama3.1-8b
Mistral mistral MISTRAL_API_KEY mistral-small-latest
Cohere cohere COHERE_API_KEY command-light
Gemini gemini GEMINI_API_KEY gemini-2.5-flash
Azure OpenAI azure see below (no fixed catalog — deployment name instead)
Vertex AI vertexai see below gemini-2.5-flash
Amazon Bedrock bedrock see below anthropic.claude-haiku-4-5-v1:0
Oracle Cloud (OCI) oci see below meta.llama-3.3-70b-instruct

--api-key/api_key= always falls back to that provider's own env var — only needed on a naming cache miss, since a cache hit never touches the LLM at all. --model/model= defaults to the table above if omitted.

Non-standard auth providers

Fourteen providers fit the plain --api-key/--model shape. Four don't:

Azure OpenAI

No public base_url (it's your own Azure resource) and no fixed model catalog (an account-specific deployment name replaces it):

parseforge name --provider azure --api-key $AZURE_API_KEY \
  --endpoint https://my-resource.openai.azure.com \
  --deployment my-gpt4-deployment \
  show version
Flag Env var fallback
--api-key AZURE_API_KEY
--endpoint AZURE_ENDPOINT
--api-version AZURE_API_VERSION
--deployment AZURE_DEPLOYMENT (replaces --model)

Vertex AI

No API key at all — authenticates through GCP's own Application Default Credentials — and needs a project and region instead:

parseforge name --provider vertexai \
  --gcp-project my-project --gcp-location us-central1 \
  show version
Flag Env var fallback
--gcp-project VERTEXAI_PROJECT
--gcp-location VERTEXAI_REGION

Serves the same Gemini model catalog as the native Gemini provider above, just through GCP's separate enterprise billing.

Amazon Bedrock

No API key — authenticates via AWS's own credential chain (env vars, ~/.aws/credentials, or an IAM role) — and only needs a region:

parseforge name --provider bedrock --region us-east-1 show version
Flag Env var fallback
--region BEDROCK_REGION, then BEDROCK_DEFAULT_REGION

Oracle Cloud Infrastructure (OCI)

No API key — signs each request cryptographically against local credentials in ~/.oci/config (DEFAULT profile) — and needs both a region and a compartment ID (the OCID of the compartment/tenancy to bill and scope requests to):

parseforge name --provider oci \
  --region us-ashburn-1 --compartment-id ocid1.compartment.oc1..xxxx \
  show version
Flag Env var fallback
--region OCI_REGION, then whatever region is already set in ~/.oci/config
--compartment-id OCI_COMPARTMENT_ID

Naming vs. generation providers

run/trial split naming and generation into separate provider configs (--naming-* vs. plain --*/generation flags) — they default to the same provider, but you can point them at two different ones, e.g. a cheap fast model for naming (cached after the first call, so cost matters less) and a stronger model for generation. Every flag above has a --naming- equivalent. See the CLI Guide for the full flag list.