Get Started
Install CLI
The Inference CLI (inf) drives Inference platform from the terminal. It serves two main paths:
- Instrument your codebase so every LLM call your app makes is captured in Gateway —
inf instrumenthands the job to an AI coding agent (Claude Code, OpenCode, or Codex) and walks you through the diff. - Operate the platform programmatically — browse models, manage rubrics and eval runs, upload and materialize datasets, queue and monitor training runs, and inspect captured inferences, traces, and spans without opening the dashboard.
inf instrument rewrites an app's LLM clients for observability. The coding-agent commands rewire a coding agent's own model traffic through the Inference.net gateway.
Sign up for an account at Inference.net to get started.
The CLI is currently in beta. Please report any issues you find.
Quick Start
Install
npm install -g @inference/cliSign in
inf auth loginCheck status
inf auth statusRun inf --help at any time to see every command. Having trouble? Send us a message or tag us at x.com/@inference_net.
Global Options
These flags work on every command.
| Flag | Description |
|---|---|
--json | Output as JSON (preserves full UUIDs for scripting) |
-v, --verbose | Verbose debug output |
-p, --project <id> | Override the active project for this invocation |
-t, --team <id> | Override the active team for this invocation |
-V, --version | Show CLI version |
-h, --help | Show help |
Tables show UUIDs as readable 8-character prefixes. For scripting, always use --json — it preserves full UUIDs so you can round-trip values between commands (e.g. inf dataset list --json | jq -r '.[0].id' | xargs inf dataset get).
Commands
| Command | Description |
|---|---|
inf instrument | Instrument your codebase for Inference platform observability using an AI agent |
inf claude / inf codex / inf grok / inf opencode / inf pi | Route a coding agent's model traffic through the Inference.net gateway |
inf auth | Sign in, sign out, check authentication status, and show who you are |
inf team | List, switch between, create teams, and invite members |
inf project | List, switch between, and inspect projects, across teams |
inf api-key | Create, list, and revoke project API keys |
inf models | Browse callable models with capabilities and pricing |
inf eval | Manage rubrics, launch eval runs, inspect results |
inf dataset | Upload JSONL data, create eval/training datasets, download |
inf training | Queue training runs, monitor progress, view logs, and poll status |
inf inference | View inference requests and responses captured by Gateway |
inf trace | Browse trace trees, timelines, facets, and exports |
inf span | Search spans and inspect span IO, attributes, events, and links |
inf dashboard | Launch the interactive terminal dashboard |
Explore the CLI
Instrument your codebase
Hand your project to an AI coding agent that wires up Inference platform for you.
Coding Agents
Route Claude Code, Codex, Grok, OpenCode, and Pi through the Inference.net gateway.
Authentication
Browser and headless authentication, env vars, and config.
Teams
List, switch, create teams, and invite members.
Projects
Switch between projects and inspect the active project, across teams.
API Keys
Create, list, and revoke project API keys.
Models
Browse callable models, capabilities, and pricing.
Evals
Manage rubrics, launch eval runs, and inspect results.
Datasets
Upload JSONL files and materialize eval or training datasets.
Training
Queue training runs, monitor progress, view logs, and poll for completion.
Inferences
Inspect request and response payloads captured by Gateway.
Traces
Browse trace trees, timelines, facets, and exports from the terminal.
Spans
Search spans and inspect captured IO, attributes, events, and links.
TUI Dashboard
Interactive terminal UI for training runs, evals, datasets, and inferences.
Usage telemetry
The CLI reports anonymized usage events so we can prioritize the commands our customers actually rely on.
- What we capture: the command name, CLI version, OS and CPU architecture,
the JavaScript runtime, and the flag names (never flag values) you used.
When you run the CLI inside a git repository we also capture the repo
owner/nameand current branch from youroriginremote — this is most useful forinf instrument, where we want to understand which codebases Inference platform gets wired into. - What we never capture: argument values, environment variables, file contents, API keys, or any data you pass to a command.
- When we don't capture anything: events are only sent once you are
authenticated. Commands run before
inf auth login/inf auth set-keyemit no events. - How it works: events are sent fire-and-forget over tRPC with a short timeout, so telemetry never slows down or blocks your command. Failures are silent.