Check out the newest way to compare different models for a task/agent harness: AutoEvals

Command Reference

Training Evals & Recipes

Inspect mid-training evals and manage reusable training recipes.

Two related training-side command groups, kept separate from inf training so their verbs get their own namespace.

inf training-eval

Inspect and re-run a training job's mid-training evals.

inf training-eval list     # List a training job's mid-training evals
inf training-eval logs     # Logs for one mid-training eval (paginated)
inf training-eval refire   # Re-run a mid-training eval from a prior eval

Run inf training-eval <verb> --help for each verb's flags (a training job / eval ID is required).

inf training-recipe

Manage reusable training recipes (a config that can be re-applied to new training jobs).

inf training-recipe list                     # List public and project recipes for the active team
inf training-recipe get ...                  # Get a recipe with its base/judge model names
inf training-recipe update ...               # Update a project training recipe

Run inf training-recipe <verb> --help for each verb's flags.

  • inf training queues and monitors the training runs these evals and recipes belong to.

On this page