HuggingFace

HuggingFace Inference Providers is a multi-provider broker. One HF token at https://router.huggingface.co/v1 routes requests to whichever inference shop hosts the requested model — Groq, Together, Fireworks, Cerebras, Nebius, Hyperbolic, SambaNova, etc. The wire is OpenAI-compatible.

Why pick this over a direct vendor? A customer who wants Llama on Groq, Mistral on Together, and Qwen on Fireworks needs three separate accounts and three jambonz credentials when going direct. With HF Providers, one HF token covers all of them, and you switch backends just by changing the model id.

The tradeoff: you don’t get the absolute cheapest per-token pricing — HF takes a small markup on top of provider rates. For production scale, going direct to your chosen provider may save money. For prototyping and multi-vendor testing, HF wins on convenience.

Get credentials

1. Sign in at https://huggingface.co.
2. Open Settings → Access Tokens (direct link: https://huggingface.co/settings/tokens).
3. Click + Create new token. Name it (e.g. jambonz). Pick token type Read — that’s enough for Inference Providers.
4. Copy the hf_... string.

Configure in jambonz

In the portal: Account → LLM Services → + Add LLM Service → HuggingFace Inference Providers.

Click Test to verify.

Use in an agent verb

1
session.agent({
2
  llm: {
3
    vendor: 'huggingface',
4
    model: 'meta-llama/Llama-3.3-70B-Instruct',
5
    llmOptions: {
6
      systemPrompt: 'You are a helpful voice assistant.',
7
    },
8
  },
9
  stt: { vendor: 'deepgram', language: 'en-US' },
10
  tts: { vendor: 'cartesia', voice: 'sonic-english' },
11
  turnDetection: 'krisp',
12
  bargeIn: { enable: true },
13
  actionHook: '/agent-complete',
14
}).send();

Model field syntax

The model value is a canonical HF model id (<org>/<model>), optionally with a routing-hint suffix:

The provider chosen is reported in the x-inference-provider response header. Useful for diagnosing latency anomalies — if you expected Cerebras and got Groq, you know the routing kicked in differently.

Available Models

Browse HuggingFace’s full Inference Providers model list (filterable by provider) or read the Inference Providers documentation for the routing model. Common picks for voice agents:

Quirks & errors