AI Glossary

Benchmark

A defined set of tasks and scoring rules used to measure and compare AI systems. A high score shows skill on those tasks, not necessarily on others.

See also

  • Evaluation

    A test that measures how well a model or an AI system does a particular job, often run again after each change to catch anything that got worse.

Source: Liang et al., Holistic Evaluation of Language Models (2022) (opens in a new tab)

Cite this term.

CC BY 4.0, attribution required.

This term

Orbyt Labs, Benchmark (AI Glossary), Oct 18, 2026. https://www.orbytlabs.ai/orbyt-collective/glossary/benchmark

The dataset (JSON)

Orbyt Labs Glossaries (Oct 19, 2026), https://www.orbytlabs.ai/glossary#dataset

Last updated .