Oct 6 edition/Reporting & analysis
ResearchModels

ResearchPapers, evidence & method

Reddit post charts four years of AI progress across seven capabilities, adjusted for benchmark changes

A community post on r/ArtificialInteligence presents four years of AI capability trends across seven areas. Its title says the figures are adjusted for changes in the benchmarks used to measure them.

THE CORE IDEA1 CORE IDEA
01

The linked post covers AI progress over four years in seven capability areas. Its title says it adjusts for changes in the underlying benchmarks, but the reviewed sources do not name the capabilities, methods or results. [1]

WHY IT MATTERS

Benchmarks get replaced or saturated over time, which makes long-run comparisons of AI progress hard. A benchmark-adjusted view across several capabilities could make trend claims more consistent, but only if its methods and data hold up to scrutiny.

None

FOLLOW THE EVIDENCE

The source trail.

Sources (1)
A LITTLE LESS NOISE. A LOT MORE CONTEXT.

Stay curious.
Follow the evidence.

Independent perspectives, the original sources, and room for the questions that don't have easy answers.

How we build the brief