Command Reference
Compare
Inspect AutoEvals analysis runs, list their eval groups, and poll runs to completion.
AutoEvals runs automated evaluations over an agent's recent traffic. Use inf compare to inspect an analysis run's status and outputs, list the eval run groups it launched, and poll a run to completion. The old name inf autoevals remains as an alias.
Quickstart
# Inspect a run and its eval run groups
inf compare get <run-id>
inf compare groups <run-id>
# Poll a run to completion (exits 0 on success)
inf compare poll <run-id>inf compare get
Show one analysis run's status, stage, and outputs.
inf compare get <run-id>Arguments
| Argument | Required | Description |
|---|---|---|
runId | Yes | AutoEvals analysis run ID |
inf compare groups
List a run's eval run groups and their eval runs — one group per rubric.
inf compare groups <run-id>Arguments
| Argument | Required | Description |
|---|---|---|
runId | Yes | AutoEvals analysis run ID |
inf compare poll
Poll an analysis run until it reaches a terminal status (success or error).
inf compare poll <run-id>Arguments
| Argument | Required | Description |
|---|---|---|
runId | Yes | AutoEvals analysis run ID |
Options
| Flag | Required | Description | Default |
|---|---|---|---|
--interval <seconds> | No | Poll interval | 15 |
--timeout <minutes> | No | Give up after this many minutes | 45 |
Generated REST verbs
inf compare also exposes the broader AutoEvals API as generated commands — runs-list, runs-start-user, runs-cancel, insights, get-insight, usage, settings, update-settings, eval-usage-estimate, and more. Run inf compare --help to list them and their flags.
Related commands
inf evalruns manual eval runs against rubrics.