Cerebras - Inference.net Documentation

1

Get your API keys

You need two keys:

Inference Catalyst project API key — from your dashboard under API Keys
Cerebras API key — from your Cerebras dashboard

2

Set environment variables

export INFERENCE_API_KEY=<your-project-api-key>
export CEREBRAS_API_KEY=<your-cerebras-api-key>

3

Update your code

Point the SDK at the gateway. Your project API key goes in apiKey, and your Cerebras key goes in x-inference-provider-api-key.

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inference.net/v1",
  apiKey: process.env.INFERENCE_API_KEY,
  defaultHeaders: {
    "x-inference-provider-api-key": process.env.CEREBRAS_API_KEY,
    "x-inference-provider": "cerebras",
    "x-inference-environment": process.env.NODE_ENV,
  },
});

const response = await client.chat.completions.create({
  model: "llama3.1-8b",
  messages: [{ role: "user", content: "Hello" }],
}, {
  headers: { "x-inference-task-id": "default" },
});

import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.inference.net/v1",
    api_key=os.environ["INFERENCE_API_KEY"],
    default_headers={
        "x-inference-provider-api-key": os.environ["CEREBRAS_API_KEY"],
        "x-inference-provider": "cerebras",
        "x-inference-environment": env = os.getenv("APP_ENV", "development"),
    },
)

response = client.chat.completions.create(
    model="llama3.1-8b",
    messages=[{"role": "user", "content": "Hello"}],
    extra_headers={"x-inference-task-id": "default"},
)

curl https://api.inference.net/v1/chat/completions \
  -H "Authorization: Bearer $INFERENCE_API_KEY" \
  -H "x-inference-provider-api-key: $CEREBRAS_API_KEY" \
  -H "Content-Type: application/json" \
  -H "x-inference-provider: cerebras" \
  -H "x-inference-environment: production" \
  -H "x-inference-task-id: default" \
  -d '{
    "model": "llama3.1-8b",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

​Setup

Setup