Groq

1

Get your API keys

You need two keys:

Inference Catalyst project API key — from your dashboard under API Keys
Groq API key — from your Groq console

2

Set environment variables

export INFERENCE_API_KEY=<your-project-api-key>
export GROQ_API_KEY=<your-groq-api-key>

3

Update your code

Point the SDK at the gateway. Your project API key goes in apiKey, and the x-inference-provider-url header tells the gateway to forward requests to Groq.

TypeScript
Python
cURL

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inference.net/v1",
  apiKey: process.env.INFERENCE_API_KEY,
  defaultHeaders: {
    "x-inference-provider-api-key": process.env.GROQ_API_KEY,
    "x-inference-provider-url": "https://api.groq.com/openai/v1",
    "x-inference-environment": process.env.NODE_ENV,
  },
});

const response = await client.chat.completions.create({
  model: "llama-3.3-70b-versatile",
  messages: [{ role: "user", content: "Hello" }],
}, {
  headers: { "x-inference-task-id": "default" },
});

import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.inference.net/v1",
    api_key=os.environ["INFERENCE_API_KEY"],
    default_headers={
        "x-inference-provider-api-key": os.environ["GROQ_API_KEY"],
        "x-inference-provider-url": "https://api.groq.com/openai/v1",
        "x-inference-environment": env = os.getenv("APP_ENV", "development"),


    },
)

response = client.chat.completions.create(
    model="llama-3.3-70b-versatile",
    messages=[{"role": "user", "content": "Hello"}],
    extra_headers={"x-inference-task-id": "default"},
)

curl https://api.inference.net/v1/chat/completions \
  -H "Authorization: Bearer $INFERENCE_API_KEY" \
  -H "x-inference-provider-api-key: $GROQ_API_KEY" \
  -H "Content-Type: application/json" \
  -H "x-inference-provider-url: https://api.groq.com/openai/v1" \
  -H "x-inference-environment: production" \
  -H "x-inference-task-id: default" \
  -d '{
    "model": "llama-3.3-70b-versatile",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

Integrations

Model providers

Frameworks

Setup

Integrations

Model providers

Frameworks

​Setup

Setup