Skip to main content
Catalyst Gateway captures LLM requests flowing through your products. It stores the raw request, response, and metadata associated with each invocation of an LLM. Recorded data is used to provide in-depth metrics and visibility into your LLM token usage, cost, latency, and error rates, across all your providers in a single, unified view. Additionally, this data is used to power downstream model evaluation and training. Catalyst Gateway supports all major LLM providers and frameworks. For agents, tools, framework runs, and custom orchestration, Catalyst Tracing captures full trace trees and individual spans in addition to gateway inferences. View the integrations guide for in-depth instructions.

​
Key concepts

​
Next steps

Set up tasks

Group your LLM calls by objective.

Integrate with your LLM provider

Connect your app and start capturing traffic.

Metrics Explorer

See your LLM usage dashboards.

Inference Viewer

Browse individual LLM calls.

Trace CLI

Inspect trace trees, span timelines, facets, and exports from the terminal.