Analytics
The Analytics tab on Evaluations (/evaluations) shows how your AI evals are performing over the selected time range. Use the filter bar to change the window.
If no evaluation engine is configured yet, you see Set up Evaluations with steps to open Configuration, enable evaluators, and turn on Auto Evaluation or run evals from Telemetry. CTA: Open Configuration.
Evaluation coverage
Section titled “Evaluation coverage”The panel at the top says how spans are evaluated for the environment you are viewing:
- Evaluated as it arrived; content not stored — your organization does not store prompts and responses, so spans are judged as they arrive. The panel counts, for the period, spans evaluated, skipped by sample, not evaluated: content expired before evaluation, failed and over budget, and reminds you that SDK apps must capture content (
OTEL_INSTRUMENTATION_GENAI_CAPTURE_MESSAGE_CONTENT=true) for their spans to be evaluated. See Evaluated as it arrives. - Evaluated from stored traces — content is stored and the scheduled evaluation reads it.
Summary tiles
Section titled “Summary tiles”| Tile | Meaning |
|---|---|
| Evaluations / Active | Activity in the selected range |
| Traces evaluated | How many traces received evaluation results |
| Executions | Total evaluator runs |
| Total cost | Spend attributed to evaluations |
| Avg pass rate | Average pass rate across evaluators |
| Scores marked as failed | Failed scores in the range |
| Auto executions | Runs tagged from Auto Evaluation |
| Evaluators | Count of evaluators in play |
Charts include Pass rate and Executions over time (via the embedded evaluations dashboard).
Evaluators table
Section titled “Evaluators table”Section title: Evaluators. Columns include Evaluation, Matcher, Executions, Pass rate, and Pass rate trend. Matcher shows linked Rule Engine rules when present, or * for default.
Empty copy: No evaluation results in this time range.