Check out the newest way to compare different models for a task/agent harness: AutoEvals

Get Started

Install CLI

The Inference CLI (inf) drives Inference platform from the terminal. It serves two main paths:

  1. Instrument your codebase so every LLM call your app makes is captured in Gateway — inf instrument hands the job to an AI coding agent (Claude Code, OpenCode, or Codex) and walks you through the diff.
  2. Operate the platform programmatically — browse models, manage rubrics and eval runs, upload and materialize datasets, queue and monitor training runs, and inspect captured inferences, traces, and spans without opening the dashboard.

inf instrument rewrites an app's LLM clients for observability. Routing a coding agent's own model traffic through the Inference.net gateway is the fast CLI's job, not inf's.

Sign up for an account at Inference.net to get started.

The CLI is currently in beta. Please report any issues you find.

Quick Start

Install

npm
npm install -g @inference/cli

Sign in

inf auth login

Check status

inf auth status

Run inf --help at any time to see every command. Having trouble? Send us a message or tag us at x.com/@inference_net.

Every command group below also exposes the full REST surface of its API resource as generated inf <group> <verb> commands, rendered directly from the Inference API. These aren't documented one-by-one here — discover them with inf <group> --help. For example, inf deployment --help lists generated verbs like versions, update, and public-identifier-available alongside the hand-written ones.

Global Options

These flags work on every command.

FlagDescription
--jsonOutput as JSON (preserves full UUIDs for scripting)
-v, --verboseVerbose debug output
-p, --project <id>Override the active project for this invocation
-t, --team <id>Override the active team for this invocation
-V, --versionShow CLI version
-h, --helpShow help

Tables show UUIDs as readable 8-character prefixes. For scripting, always use --json — it preserves full UUIDs so you can round-trip values between commands (e.g. inf dataset list --json | jq -r '.[0].id' | xargs inf dataset get).

Commands

CommandDescription
inf instrumentInstrument your codebase for Inference platform observability using an AI agent
inf authSign in, sign out, check authentication status, and show who you are
inf updateUpgrade a globally installed CLI to the latest version
inf teamList, switch between, create teams, and invite members
inf projectList, switch between, and inspect projects, across teams
inf api-keyCreate, list, and revoke project API keys
inf modelsBrowse callable models with capabilities and pricing
inf evalManage rubrics, launch eval runs, inspect results
inf rubricInspect eval rubrics and their versions
inf compareInspect AutoEvals analysis runs, list eval groups, poll runs
inf datasetUpload JSONL data, create eval/training datasets, download
inf trainingQueue training runs, monitor progress, view logs, and poll status
inf training-evalInspect mid-training evals and manage reusable training recipes
inf deploymentCreate, inspect, watch, and archive model deployments
inf agentInspect auto-discovered agents and their execution stats
inf taskInspect and manage a project's tasks
inf signalsCreate LLM classifiers that label spans/traces/sessions, plus alerts
inf notificationsInspect notification types and email/Slack preferences
inf integrationInspect external integrations connected to your team (Slack)
inf slackInspect and manage a team's Slack integration
inf githubInspect a team's GitHub integration
inf searchSearch across agents, deployments, datasets, and rubrics
inf starter-templateBrowse starter templates and track provisioning
inf uploadInspect inference uploads (status, list, download URL)
inf workerInspect v1 worker instances and their logs
inf account-deletionSchedule deletion of your account, a project, or a team
inf inferenceView inference requests and responses captured by Gateway
inf traceBrowse trace trees, timelines, facets, and exports
inf spanSearch spans and inspect span IO, attributes, events, and links
inf analyze-harnessRun HALO agent-trace analyses and read the resulting reports
inf dashboardLaunch the interactive terminal dashboard

This table covers the most-used command groups. More exist — including deployments, signals, tasks, compare, and others — so run inf --help for the full list.

Explore the CLI

Usage telemetry

The CLI reports anonymized usage events so we can prioritize the commands our customers actually rely on.

  • What we capture: the command name, CLI version, OS and CPU architecture, the JavaScript runtime, and the flag names (never flag values) you used. When you run the CLI inside a git repository we also capture the repo owner/name and current branch from your origin remote — this is most useful for inf instrument, where we want to understand which codebases Inference platform gets wired into.
  • What we never capture: argument values, environment variables, file contents, API keys, or any data you pass to a command.
  • When we don't capture anything: events are only sent once you are authenticated. Commands run before inf auth login / inf auth set-key emit no events.
  • How it works: events are sent fire-and-forget over tRPC with a short timeout, so telemetry never slows down or blocks your command. Failures are silent.

On this page