analytics-dictionary / term / ai
AI evaluations (evals)
AI evaluations are tests that measure how well an AI system performs on realistic tasks.
Written by Reflective Data experts · updated Oct 5, 2026
An eval set is a collection of example inputs with expected behaviour. Running it on every change catches regressions, compares models and shows whether a new prompt really improves results.
Without evals, you are guessing.
related
AI agentAI guardrailsPrompt engineering
// how we can help
We build company brains, agent harnesses and AI bots on top of data you can trust. AI services → · The data platform behind it