Evaluations & benchmarks
Sources are over 18 months old.
Publication dates and source age
Sources counted: 2
Newest dated source: 2024-07
Assessed at this edition's evidence cutoff: 2026-09-15. 18-month boundary: 2025-03-15.
Publication age does not tell us whether a claim is still valid. Reading an old source again does not make its publication date newer. An update date does not establish that the passage we used was updated.
Open in the glossary Reading notes · Structured record
In plain language
Tests used to learn what a system does well, where it fails and under which conditions. [1]
Reference this explanation or suggest a correction
Link to this explanation · Suggest a correction · How corrections work
Limits & distinctions
A good result covers the tested conditions. It does not settle performance on every task or certify the whole application as safe. [1] [2]
Reference this explanation or suggest a correction
Link to this explanation · Suggest a correction · How corrections work
A fuller explanation
An evaluation defines tasks and ways to judge the results. A benchmark offers shared tasks or measures for comparison. Different tests may examine accuracy, consistency, harmful outputs or resource use. [1]
Reference this explanation or suggest a correction
Link to this explanation · Suggest a correction · How corrections work
How it relates to the map
When reading a score, ask which tasks, models, instructions and measures were compared. [1]
Reference this explanation or suggest a correction
Link to this explanation · Suggest a correction · How corrections work
Share this page
https://theaiatlas.org/ideas/evaluation/
Download a share image · Vector image
Image previews are summaries. Keep the page link so readers can check the evidence.
Sources and what we read
1. Holistic Evaluation of Language Models
Source is over 18 months old.
Publication dates and source age
Sources counted: 1
Newest dated source: 2022-11-16
Assessed at this edition's evidence cutoff: 2026-09-15. 18-month boundary: 2025-03-15.
Publication age does not tell us whether a claim is still valid. Reading an old source again does not make its publication date newer. An update date does not establish that the passage we used was updated.
Read the abstract and version history, including multiple use cases and metrics, standardized comparisons and acknowledged coverage gaps. Used for evaluation principles; historical model scores are not presented as current rankings.
2. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile
Source is over 18 months old.
Publication dates and source age
Sources counted: 1
Newest dated source: 2024-07
Assessed at this edition's evidence cutoff: 2026-09-15. 18-month boundary: 2025-03-15.
Publication age does not tell us whether a claim is still valid. Reading an old source again does not make its publication date newer. An update date does not establish that the passage we used was updated.
Read introduction, section 2.2 on confabulation, and selected MEASURE actions 2.3, 2.5, 2.6, 2.7 and 2.9 concerning evaluation evidence, generalization, citations, generated-code review and safeguards. A voluntary risk-management profile; no claim that all 64 pages or every referenced study was reviewed.
Edition and machine-readable evidence
Content version 0.20.0. Evidence cutoff 2026-09-15; this does not mean every source was read on that day.
Pinned complete dataset · Complete evidence page · Agent consumption guide