Check out the newest way to compare different models for a task/agent harness: AutoEvals

Command Reference

Gravity

Test Gravity ad webhook implementations against signed sample calls.

Gravity ad webhooks receive a signed pre-request call before an ad-supported generation runs and a signed post-request call after it finishes. inf gravity webhook-tests sends sample calls to your URLs exactly as the inference engine does and reports whether the engine would accept each answer. It runs from the CLI or REST (POST /api/rest/gravity/webhook-tests) only; it is not exposed as an MCP tool.

Access. Available only to members of Gravity's team. inf gravity appears in inf --help only after you sign in (inf auth login, inf auth set-key) or switch (inf team switch, inf project switch) to an eligible team; other callers get an unknown-command error from the CLI and 403 FORBIDDEN from REST.

inf gravity webhook-tests

Send signed sample calls to one or both webhook URLs and print a per-call report.

# Test both hooks with a freshly generated signing secret
inf gravity webhook-tests \
  --pre-request-url https://ads.example.com/pre \
  --post-request-url https://ads.example.com/post

# Sign with your own secret and a custom prompt
inf gravity webhook-tests \
  --pre-request-url https://ads.example.com/pre \
  --signing-secret whsec_<base64> \
  --messages '[{"role":"user","content":"Best running shoes?"}]' \
  --model <model>

Calls are signed per Standard Webhooks v1 (webhook-id, webhook-timestamp, webhook-signature) with the test secret, never the production one. Redirects are not followed. The report includes the generated secret, so your verifier can check the signature.

FlagDescription
--pre-request-url <url>Public HTTPS URL of your pre-request hook
--post-request-url <url>Public HTTPS URL of your post-request hook
--signing-secret <secret>whsec_-prefixed Standard Webhooks secret to sign with; omit to get a generated one
--messages <json>Chat messages for the sample request (JSON array)
--model <model>Model name for the sample request

Pass at least one URL. The partner integration guide covers the payload contracts and how to verify signatures.

On this page