Baseten

Baseten hosts open-weight models (DeepSeek, GLM, Kimi, MiniMax, Nemotron, GPT-OSS, …) behind an OpenAI-compatible API. Two surfaces are supported:

• Model APIs (default) — https://inference.baseten.co/v1. A shared, curated catalog of hosted models. GET /v1/models returns the live list.
• Bridge / Direct — https://bridge.baseten.co/v1/direct. Routes to a dedicated deployment you’ve spun up in your Baseten account.

The wire is OpenAI-compatible (chat completions, streaming, tools), so the integration is straightforward.

Get credentials

1. Sign in at https://app.baseten.co.
2. Open Settings → API Keys (direct link).
3. Create a key and copy the value.

Configure in jambonz

In the portal: Account → LLM Services → + Add LLM Service → Baseten.

Click Test to verify.

Use in an agent verb

1
session.agent({
2
  llm: {
3
    vendor: 'baseten',
4
    model: 'deepseek-ai/DeepSeek-V3.1',
5
    llmOptions: {
6
      systemPrompt: 'You are a helpful voice assistant.',
7
    },
8
  },
9
  stt: { vendor: 'deepgram', language: 'en-US' },
10
  tts: { vendor: 'cartesia', voice: 'sonic-english' },
11
  turnDetection: 'krisp',
12
  bargeIn: { enable: true },
13
  actionHook: '/agent-complete',
14
}).send();

Available models

The current Model APIs catalog includes (curated subset — check /v1/models for the live list):

For dedicated deployments via the Bridge endpoint, the model value is whatever model id your deployment serves.

Quirks & errors