> ## Documentation Index
> Fetch the complete documentation index at: https://docs.openlit.io/llms.txt
> Use this file to discover all available pages before exploring further.
# Overview
> LLM evaluation in OpenLIT - AI evals for hallucination, bias, toxicity, and custom criteria under Monitor → Evaluations
**Evaluations** (`/evaluations`) is OpenLIT's LLM evaluation surface under **Monitor**. Score production traces with an LLM-as-a-judge, enable built-in or custom evaluators, schedule Auto Evaluation, and review pass-rate analytics - or run the same criteria [programmatically via the SDK](/latest/sdk/quickstart-programmatic-evals) for offline CI/CD gates.
Open it from **Monitor → Evaluations**. The page has three tabs:
Pass rates, executions, cost, and evaluator results over time
Enable built-in types or create custom evaluators
Judge model, Vault API key, Auto Evaluation schedule and sampling
Default tab is **Analytics**. Use `?tab=evaluators` or `?tab=configuration` for the others.
## Find the right feature
| If you want to... | Use this |
| ------------------------------------------------------- | ------------------------------------------------------------------------------------------ |
| See pass rates and spend for evals | [Analytics](/latest/openlit/evaluations/analytics) |
| Turn on hallucination, bias, toxicity, or a custom type | [Evaluators](/latest/openlit/evaluations/evaluators) |
| Schedule Auto Evaluation or set the judge model | [Configuration](/latest/openlit/evaluations/configuration) |
| Score one trace on demand | [LLM-as-a-Judge](/latest/openlit/evaluations/llm-as-a-judge) from the trace Evaluation tab |
| Rate a trace yourself | [Manual Feedback](/latest/openlit/evaluations/manual-feedback) |
| Gate CI/CD on quality | [Programmatic evaluations](/latest/openlit/evaluations/programmatic-evals) |
```mermaid theme={null}
flowchart TB;
subgraph Online["Online evaluation - production traces"]
direction LR;
A[LLM / Agent call] -->|creates| B[Trace in OpenLIT];
B -->|Auto Eval schedule or manual Run Evaluation| C[LLM Judge];
C -->|score + classification + reasoning| D[Analytics and trace detail];
end
subgraph Offline["Offline evaluation - CI/CD"]
direction LR;
E[Dataset] -->|SDK evaluate call| F[LLM Judge];
F -->|score| G[Pass / fail gate];
end
```
## Methods
Automated scoring on live traces
SDK / CI offline evaluation
Good / Bad / Neutral human ratings