Get Started
Install CLI
The Inference CLI (inf) drives Inference platform from the terminal. It serves two main paths:
- Instrument your codebase so every LLM call your app makes is captured in Gateway —
inf instrumenthands the job to an AI coding agent (Claude Code, OpenCode, or Codex) and walks you through the diff. - Operate the platform programmatically — browse models, manage rubrics and eval runs, upload and materialize datasets, queue and monitor training runs, and inspect captured inferences, traces, and spans without opening the dashboard.
inf instrument rewrites an app's LLM clients for observability. Routing a coding agent's own model traffic through the Inference.net gateway is the fast CLI's job, not inf's.
Sign up for an account at Inference.net to get started.
The CLI is currently in beta. Please report any issues you find.
Quick Start
Install
npm install -g @inference/cliSign in
inf auth loginCheck status
inf auth statusRun inf --help at any time to see every command. Having trouble? Send us a message or tag us at x.com/@inference_net.
Every command group below also exposes the full REST surface of its API resource as generated inf <group> <verb> commands, rendered directly from the Inference API. These aren't documented one-by-one here — discover them with inf <group> --help. For example, inf deployment --help lists generated verbs like versions, update, and public-identifier-available alongside the hand-written ones.
Global Options
These flags work on every command.
| Flag | Description |
|---|---|
--json | Output as JSON (preserves full UUIDs for scripting) |
-v, --verbose | Verbose debug output |
-p, --project <id> | Override the active project for this invocation |
-t, --team <id> | Override the active team for this invocation |
-V, --version | Show CLI version |
-h, --help | Show help |
Tables show UUIDs as readable 8-character prefixes. For scripting, always use --json — it preserves full UUIDs so you can round-trip values between commands (e.g. inf dataset list --json | jq -r '.[0].id' | xargs inf dataset get).
Commands
| Command | Description |
|---|---|
inf instrument | Instrument your codebase for Inference platform observability using an AI agent |
inf auth | Sign in, sign out, check authentication status, and show who you are |
inf update | Upgrade a globally installed CLI to the latest version |
inf team | List, switch between, create teams, and invite members |
inf project | List, switch between, and inspect projects, across teams |
inf api-key | Create, list, and revoke project API keys |
inf models | Browse callable models with capabilities and pricing |
inf eval | Manage rubrics, launch eval runs, inspect results |
inf rubric | Inspect eval rubrics and their versions |
inf compare | Inspect AutoEvals analysis runs, list eval groups, poll runs |
inf dataset | Upload JSONL data, create eval/training datasets, download |
inf training | Queue training runs, monitor progress, view logs, and poll status |
inf training-eval | Inspect mid-training evals and manage reusable training recipes |
inf deployment | Create, inspect, watch, and archive model deployments |
inf agent | Inspect auto-discovered agents and their execution stats |
inf task | Inspect and manage a project's tasks |
inf signals | Create LLM classifiers that label spans/traces/sessions, plus alerts |
inf notifications | Inspect notification types and email/Slack preferences |
inf integration | Inspect external integrations connected to your team (Slack) |
inf slack | Inspect and manage a team's Slack integration |
inf github | Inspect a team's GitHub integration |
inf search | Search across agents, deployments, datasets, and rubrics |
inf starter-template | Browse starter templates and track provisioning |
inf upload | Inspect inference uploads (status, list, download URL) |
inf worker | Inspect v1 worker instances and their logs |
inf account-deletion | Schedule deletion of your account, a project, or a team |
inf inference | View inference requests and responses captured by Gateway |
inf trace | Browse trace trees, timelines, facets, and exports |
inf span | Search spans and inspect span IO, attributes, events, and links |
inf analyze-harness | Run HALO agent-trace analyses and read the resulting reports |
inf dashboard | Launch the interactive terminal dashboard |
This table covers the most-used command groups. More exist — including deployments, signals, tasks, compare, and others — so run inf --help for the full list.
Explore the CLI
Instrument your codebase
Hand your project to an AI coding agent that wires up Inference platform for you.
Coding Agents
Route Claude Code, Codex, Grok, OpenCode, and Pi through the Inference.net gateway with the fast CLI.
Authentication
Browser and headless authentication, env vars, and config.
Teams
List, switch, create teams, and invite members.
Projects
Switch between projects and inspect the active project, across teams.
API Keys
Create, list, and revoke project API keys.
Models
Browse callable models, capabilities, and pricing.
Evals
Manage rubrics, launch eval runs, and inspect results.
Datasets
Upload JSONL files and materialize eval or training datasets.
Training
Queue training runs, monitor progress, view logs, and poll for completion.
Inferences
Inspect request and response payloads captured by Gateway.
Traces
Browse trace trees, timelines, facets, and exports from the terminal.
Spans
Search spans and inspect captured IO, attributes, events, and links.
Analyze Harness
Run HALO agent-trace analyses, schedule recurring reports, and read the reports.
TUI Dashboard
Interactive terminal UI for training runs, evals, datasets, and inferences.
Deployments
Create, inspect, watch, and archive model deployments.
Signals
LLM classifiers that label spans, traces, and sessions — plus alerts.
Compare
Inspect AutoEvals runs, eval groups, and poll runs to completion.
Usage telemetry
The CLI reports anonymized usage events so we can prioritize the commands our customers actually rely on.
- What we capture: the command name, CLI version, OS and CPU architecture,
the JavaScript runtime, and the flag names (never flag values) you used.
When you run the CLI inside a git repository we also capture the repo
owner/nameand current branch from youroriginremote — this is most useful forinf instrument, where we want to understand which codebases Inference platform gets wired into. - What we never capture: argument values, environment variables, file contents, API keys, or any data you pass to a command.
- When we don't capture anything: events are only sent once you are
authenticated. Commands run before
inf auth login/inf auth set-keyemit no events. - How it works: events are sent fire-and-forget over tRPC with a short timeout, so telemetry never slows down or blocks your command. Failures are silent.