Glossary term
LLM-as-a-judge
Using a language model to score or compare outputs of an AI system against criteria.
Model-graded evaluation scales review of free-text outputs such as answers and summaries.
It has known biases and must be calibrated against human judgement before its scores are trusted for decisions.
Turning concepts into a working system?
We help teams choose the right pattern and build it with evaluation from day one.