howclose.to
AGI

The problemsIntelligence & MachinesAGI

Updated · July 2026

How close are we to artificial general intelligence?When will AI learn almost any thinking task?

When will AI learn almost any thinking task?How close are we to artificial general intelligence?

Frontier models saturate most static benchmarks, yet reliable long-horizon autonomy, calibrated reasoning and a shared definition of general intelligence all remain open - so any single 'percent to AGI' is a guess dressed as a number.AI can already help with many kinds of thinking, but it still makes confident mistakes and struggles to carry a big job through on its own.

Current stageEngineeringEngineering a system that works outside the labBuilding a system that works outside the lab
Read the evidence Where we stand
The path so far

Recorded milestones

  1. The transformer architecture

  2. Benchmarks saturate, autonomy lags

Open tests · conceptual branches

TODAY
  1. OPEN TEST01 ↗
    Learn many different kinds of workBroad cognitive competenceA general system should transfer what it knows to fresh problems, not need a new trick for every benchmark.Expert-level performance across diverse, contamination-resistant novel tasks
  2. OPEN TEST02 ↗
    Finish long jobs without hand-holdingLong-horizon autonomyThe measured span an agent can complete on its own is still counted in hours, not days.Reliably plan and finish multi-day digital projects with sparse supervision
  3. OPEN TEST03 ↗
    Stay reliable when things get weirdCalibrated reliabilityBeing capable is not enough if unusual inputs still produce confident, costly errors.Predictable, well-calibrated, corrigible behavior under distribution shift and adversarial pressure
TODAY
OPEN TEST01 ↗
Learn many different kinds of workBroad cognitive competenceA general system should transfer what it knows to fresh problems, not need a new trick for every benchmark.Expert-level performance across diverse, contamination-resistant novel tasks
OPEN TEST02 ↗
Finish long jobs without hand-holdingLong-horizon autonomyThe measured span an agent can complete on its own is still counted in hours, not days.Reliably plan and finish multi-day digital projects with sparse supervision
OPEN TEST03 ↗
Stay reliable when things get weirdCalibrated reliabilityBeing capable is not enough if unusual inputs still produce confident, costly errors.Predictable, well-calibrated, corrigible behavior under distribution shift and adversarial pressure
Milestones are in recorded order. Open tests are separate questions, not a forecast.Milestones are in date order. Open tests are separate tests, not a promise.

The path shows Benchmarks saturate, autonomy lags. Open thresholds are separate tests in a conceptual map, not a forecast. No single percentage represents progress.

01 · Where we standWhere we stand

Where we standWhere we stand

The current stage, the evidence recorded, and the single threshold that gates the next stage.The stage reached, the evidence recorded, and the one test still blocking the next step.

What the evidence has shownWhat the evidence has shown

AI can already help with many kinds of thinking, but it still makes confident mistakes and struggles to carry a big job through on its own.Frontier models saturate most static benchmarks, yet reliable long-horizon autonomy, calibrated reasoning and a shared definition of general intelligence all remain open - so any single 'percent to AGI' is a guess dressed as a number.

0 of 3 tests recorded0 of 3 thresholds achieved open
Learn many different kinds of workBroad cognitive competenceOpen test
Finish long jobs without hand-holdingLong-horizon autonomyOpen test
Stay reliable when things get weirdCalibrated reliabilityOpen test

The next testBlocking threshold

Learn many different kinds of workBroad cognitive competence

ARC-AGI-2 and held-out expert evals resistant to training-data leakageARC-AGI-2 and held-out expert evals resistant to training-data leakage

02 · Thresholds & evidenceThresholds & evidence

What would count as proof?What would count as proof?

A clear test, the evidence behind it, and the limits of the claim.A clear test, the evidence behind it, and what it still leaves open.

Open test

Learn many different kinds of workBroad cognitive competence

A general system should transfer what it knows to fresh problems, not need a new trick for every benchmark.Expert-level performance across diverse, contamination-resistant novel tasks

Next test ARC-AGI-2 and held-out expert evals resistant to training-data leakage

Still to demonstrateWhat this does not establishA separate system can still have different conditions and results.The named measurement has no wider implication until the supporting system test is also shown.

View every evidence record

Open test

Learn many different kinds of workBroad cognitive competence

A general system should transfer what it knows to fresh problems, not need a new trick for every benchmark.Expert-level performance across diverse, contamination-resistant novel tasks

Next test: ARC-AGI-2 and held-out expert evals resistant to training-data leakage

Open test

Finish long jobs without hand-holdingLong-horizon autonomy

The measured span an agent can complete on its own is still counted in hours, not days.Reliably plan and finish multi-day digital projects with sparse supervision

Next test: METR 50%-task time horizon extending from hours to multi-day tasks

Open test

Stay reliable when things get weirdCalibrated reliability

Being capable is not enough if unusual inputs still produce confident, costly errors.Predictable, well-calibrated, corrigible behavior under distribution shift and adversarial pressure

Next test: Pre-registered external safety and calibration evaluations on frontier deployments

03 · The recordThe record

The record behind the verdictThe record behind the verdict

Major milestones and smaller context events share one source-linked record. Scheduled targets are marked separately from recorded events.Milestones, smaller events and setbacks share one sourced record. Scheduled targets are marked separately from recorded events.

Event key
TheoryExperimentFundingSetbackPolicyDeployment Future / scheduled
1950-19733 events1 shown

The symbolic dream

This record spans “Turing asks "Can machines think?"” to “The perceptron learns from data”.

1950
Turing asks "Can machines think?"
Alan Turing's paper proposes the Imitation Game (Turing Test) as an operational bar for machine intelligence.
1956
The Dartmouth workshop names the fieldTheory
A summer workshop at Dartmouth College coins the term "artificial intelligence" and launches AI as a formal research discipline.
1958
The perceptron learns from data
Frank Rosenblatt builds the perceptron, an early trainable artificial neural network that adjusts its own weights to classify inputs.
1974-19963 events1 shown

Winters and the wilderness

This record spans “The first AI winter sets in” to “The second AI winter”.

1974
The first AI winter sets in
After the critique of perceptrons and the pessimistic Lighthill report, funding and optimism collapse for roughly a decade.
1986
Backpropagation revives neural netsTheory
Rumelhart, Hinton, and Williams popularize backpropagation, making it practical to train multi-layer networks and reigniting connectionism.
1987
The second AI winter
The specialized LISP-machine market collapses and expert-system hype deflates, triggering a second multi-year funding drought.
1997-20162 events2 shown

Machines that learn

This record spans “Deep Blue beats Kasparov” to “AlexNet ignites the deep-learning era”.

1997
Deep Blue beats KasparovExperiment
IBM's Deep Blue defeats reigning world chess champion Garry Kasparov, the first computer to beat a champion under tournament conditions.
2012
AlexNet ignites the deep-learning eraExperiment
A deep convolutional network wins the ImageNet competition by a huge margin, proving GPU-trained neural nets on big data beat hand-engineered vision.
2017-202918 events4 shown

Foundation models and agents

This record spans “The transformer architecture” to “Forecast: "weakly general" AI” and includes scheduled targets.

2017
The transformer architectureTheory
"Attention Is All You Need" introduces the transformer, the attention-based architecture that underpins virtually every modern large language model.
2019
GPT-2 shows scale generates fluent text
OpenAI's GPT-2 produces coherent long-form text and is released in staged fashion over stated misuse concerns, foreshadowing the scaling era.
2020
GPT-3 and few-shot learning
The 175-billion-parameter GPT-3 performs many tasks from a few examples in its prompt, demonstrating emergent capability from raw scale.
2022
ChatGPT reaches the publicDeployment
OpenAI releases ChatGPT, and a conversational, instruction-tuned LLM reaches mainstream users, becoming one of the fastest-growing apps ever.
2023
GPT-4 clears broad exam benchmarks
GPT-4 scored 298/400, about the 90th percentile, on a simulated Uniform Bar Exam and improved sharply over GPT-3.5 across many academic tests. This was broad benchmark performance, not AGI, and the report still described the model as unreliable.
2023
SWE-bench tests repository-scale coding
SWE-bench introduced 2,294 real GitHub issues from 12 Python repositories. The best system tested in the original paper, Claude 2, resolved only 1.96%, exposing how far code generation was from dependable software work.
2024
Formal systems reach IMO silver standard
AlphaProof and AlphaGeometry 2 solved four of six 2024 International Mathematical Olympiad problems for 28/42, one point below gold. Humans first translated the problems into formal languages, and some solutions took up to three days.
2024
Reasoning models and agents arrive
OpenAI's o1 spends inference-time "thinking" before answering, opening the o-series reasoning line that powers more autonomous agentic systems.
2025
AI task-time-horizon doubles ~every 7 monthsExperiment
METR finds the length of software tasks AI can finish at 50% reliability has grown exponentially, doubling roughly every seven months since 2019.
2025
Benchmarks saturate while autonomy lags
Frontier models top out static benchmarks like MMLU and ARC-AGI-1, yet still struggle with long-horizon autonomy, exposing a gap between test scores and real agency.
2025
Real-world coding trial finds a slowdown
In a randomized trial, 16 experienced open-source developers completed 246 issues 19% more slowly when allowed to use early-2025 AI tools. METR cautions that this was one historical, setting-specific result, not a verdict on all developers or later systems.
2025
Natural-language system reaches IMO gold standard
An advanced Gemini Deep Think system solved five of six 2025 IMO problems for 35/42. IMO graders certified the proofs, which were produced in natural language within the 4.5-hour contest limit; this was a closed competition task, not autonomous research.
2025
ARC-AGI-2 improves, but grand prize stays open
The ARC Prize competition winner scored 24.03% on the private evaluation at about $0.20 per task. The best verified commercial model reached 37.6% and a costlier refinement system 54%; the 85% grand-prize threshold remained unmet.
2026
METR expands its autonomy ruler
Time Horizon 1.1 expanded from 170 to 228 mainly software, machine-learning and cybersecurity tasks. Claude Opus 4.5's estimated 50%-success horizon was 320 minutes, with wide uncertainty and only five measured human baselines among 31 tasks estimated at eight hours or longer.
2026
ARC-AGI-3 exposes an interactive gap
ARC-AGI-3 introduced instruction-free interactive environments that require exploration and adaptation. Humans scored 100% while the reported frontier baseline scored 0.51%, a separate test that cannot be compared directly with ARC-AGI-1 or ARC-AGI-2 percentages.
2026
MirrorCode tests whole-program reconstruction
MirrorCode asked agents to recreate complete programs from their behavior without source code. Its strongest model passed 56% across 25 targets and nearly reproduced the 16,000-line gotree toolkit, but used unusually precise executable feedback and large budgets; the claimed weeks of human work were estimates, not completed trials.
2026
GPT-6 Astra scores 62.7% on ARC-AGI-3We are here
ARC Prize verified 62.7% on the semi-private set with its Standard harness, up from 7.8% for the best model in July, and 99.9% with a Provider Adapter harness that keeps the model's own reasoning state between turns. The two harnesses are not comparable. ARC Prize said at launch that saturating ARC-AGI-3 would not be proof of AGI.
2028
Forecast: "weakly general" AIPolicyTarget
The Metaculus community's aggregate forecast places the arrival of a publicly known "weakly general" AI in the late 2020s, around 2028.
2016-20292 events1 shown

Additional records

This record spans “AlphaGo defeats Lee Sedol” to “Projected: AI handles week-long tasks” and includes scheduled targets.

2016
AlphaGo defeats Lee SedolExperiment
DeepMind's AlphaGo beats top Go professional Lee Sedol 4-1, mastering a game long considered a landmark for intuition and search.
2029
Projected: AI handles week-long tasksExperimentTarget
Extrapolating METR's seven-month doubling implies agents could autonomously complete software tasks that take humans days or weeks by the end of the decade.
— end of record · 28 events shown —
04 · The dataThe data

The data behind the verdictThe data behind the verdict

Read each measure with its units, conditions, uncertainty and source; targets remain distinct from observations.Read each chart with its conditions, limits and source. Future targets remain distinct from recorded results.

The length of job an AI model can finish on its own has doubled about every four months since 2023.The length of job an AI model can finish on its own has doubled about every four months since 2023.

log scale · minutes by year

GPT-2 · 3 s · Feb 2019 · interval 0.6–8.4 s · verified by METR

The length of job an AI model can finish on its own has doubled about every four months since 2023.1 second1 minute1 houra workday (8 h)1 day×2 every ~4.0 months · fitted 2023–2026, not a forecastGPT-2: 3 s · Feb 2019 · interval 0.6–8.4 sGPT-3 (davinci-002): 8.4 s · May 2020 · interval 5.4–13 sGPT-3.5 Turbo Instruct: 36 s · Mar 2022 · interval 16–67 sGPT-4: 4 min · Mar 2023 · interval 1.9–8 minGPT-4 (1106): 4 min · Nov 2023 · interval 1.9–8.4 minClaude 3 Opus: 4 min · Mar 2024 · interval 1.7–8.8 minGPT-4 Turbo: 3.7 min · Apr 2024 · interval 2–6.7 minGPT-4o: 7 min · May 2024 · interval 4–13 minClaude 3.5 Sonnet (Jun 2024): 11 min · Jun 2024 · interval 5.5–22 mino1-preview: 20 min · Sep 2024 · interval 12–33 minClaude 3.5 Sonnet (Oct 2024): 21 min · Oct 2024 · interval 10–41 mino1: 39 min · Dec 2024 · interval 21–65 minClaude 3.7 Sonnet: 1 h · Feb 2025 · interval 0.6–1.7 ho3: 2 h · Apr 2025 · interval 1.2–3.2 hClaude Opus 4: 1.7 h · May 2025 · interval 1–2.7 hClaude Opus 4.1: 1.7 h · Aug 2025 · interval 1–2.7 hGPT-5: 3.4 h · Aug 2025 · interval 1.9–6.8 hGemini 3 Pro: 3.7 h · Nov 2025 · interval 2.3–6.3 hGPT-5.1 Codex Max: 3.7 h · Nov 2025 · interval 2.2–6.6 hClaude Opus 4.5: 4.9 h · Nov 2025 · interval 2.7–10 hGPT-5.2: 5.9 h · Dec 2025 · interval 3.3–14 hClaude Opus 4.6: 12 h · Feb 2026 · interval 5.3–61 hGPT-5.3 Codex: 5.8 h · Feb 2026 · interval 3.2–14 hGemini 3.1 Pro: 6.4 h · Feb 2026 · interval 3.9–12 hGPT-5.4: 5.7 h · Mar 2026 · interval 3.1–13 h17 h · Apr 2026Claude Mythos Preview (early): 17 h · Apr 2026 · interval 8.5–55 hYear
Log-scale line joins each new longest record; all observations remain individual dots.

First record

GPT-2

3 s · Feb 2019

observed · Verified by METR

Published interval: 0.6–8.4 s

Latest record

Claude Mythos Preview (early)

17 h · Apr 2026

observed · Verified by METR

Published interval: 8.5–55 h

View data table
All plotted observations
SeriesDateValueStatusCondition / labelVerificationCICensoringSource
Task length an AI finishes alone2019.130.05 minutesobservedGPT-2verified · METR0.01–0.14 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2020.380.14 minutesobservedGPT-3 (davinci-002)verified · METR0.09–0.22 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2022.210.6 minutesobservedGPT-3.5 Turbo Instructverified · METR0.26–1.12 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2023.213.99 minutesobservedGPT-4verified · METR1.93–8 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2023.884.04 minutesobservedGPT-4 (1106)verified · METR1.87–8.44 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2024.213.95 minutesobservedClaude 3 Opusverified · METR1.71–8.76 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2024.293.73 minutesobservedGPT-4 Turboverified · METR1.98–6.74 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2024.386.99 minutesobservedGPT-4overified · METR4–12.91 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2024.4611.4 minutesobservedClaude 3.5 Sonnet (Jun 2024)verified · METR5.49–22.38 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2024.7120.33 minutesobservedo1-previewverified · METR11.72–33.38 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2024.7920.52 minutesobservedClaude 3.5 Sonnet (Oct 2024)verified · METR10.14–40.82 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2024.9638.83 minutesobservedo1verified · METR21.16–64.95 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2025.1360.39 minutesobservedClaude 3.7 Sonnetverified · METR33.01–104.23 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2025.29119.73 minutesobservedo3verified · METR74.62–190.94 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2025.38100.37 minutesobservedClaude Opus 4verified · METR59.99–163.45 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2025.63100.47 minutesobservedClaude Opus 4.1verified · METR59.27–159.45 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2025.63203.01 minutesobservedGPT-5verified · METR112.64–405.55 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2025.88224.33 minutesobservedGemini 3 Proverified · METR139.57–379.24 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2025.88223.71 minutesobservedGPT-5.1 Codex Maxverified · METR134.31–396.21 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2025.88292.99 minutesobservedClaude Opus 4.5verified · METR161.72–623.7 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2025.96352.25 minutesobservedGPT-5.2verified · METR198.07–815.18 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2026.13718.81 minutesobservedClaude Opus 4.6verified · METR316.69–3633.79 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2026.13349.53 minutesobservedGPT-5.3 Codexverified · METR194.91–816.35 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2026.13384.15 minutesobservedGemini 3.1 Proverified · METR233.5–694.75 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2026.21341.74 minutesobservedGPT-5.4verified · METR186.58–768.78 minutesnoneSeries · Task length an AI finishes alone
Task length an AI finishes alone2026.291044.78 minutesobservedClaude Mythos Preview (early)verified · METR508.88–3304.26 minutesnoneSeries · Task length an AI finishes alone
AS OF 2026-04-07

Methods & conditions

Under the measurement.

The boundary of a measurement changes what it means.

Technical note 1 of 9

Autonomy gains depend on the time window

Method and conditions

TH1.1's full 2019-2025 fitted doubling time remains about 196 days, but its post-2023 estimate shortened from 165.3 to 130.8 days and its post-2024 estimate from 108.9 to 88.6 days. These rates are sensitive to task selection and should not be extrapolated as physical laws.

Source notes

Technical notes and sources

Each note keeps its authored method, conditions and citations available for review.

Autonomy gains depend on the time window

TH1.1's full 2019-2025 fitted doubling time remains about 196 days, but its post-2023 estimate shortened from 165.3 to 130.8 days and its post-2024 estimate from 108.9 to 88.6 days. These rates are sensitive to task selection and should not be extrapolated as physical laws.

Long-task baselines are mostly estimated

Only 5 of TH1.1's 31 tasks estimated at eight hours or longer have measured human baselines; the rest use expert estimates. The suite covers mainly software engineering, machine learning and cybersecurity, not general intellectual work.

What a time horizon measures

A time horizon denotes the human duration of task difficulty at which fitted agent success is 50%, not how long the agent literally operates. Agents are often several times faster than the associated human time.

MirrorCode gives unusually rich feedback

MirrorCode gives agents execute-only access to the reference program, documentation, shell tools and very large inference budgets-up to one billion tokens, about $550 per task in preliminary experiments. This unusually precise, testable specification helps explain its much longer apparent horizons.

The gotree baseline is uncertain

The gotree human-duration range-2-17 weeks-comes from four informal estimates, not completed human trials. A shorter 2,000-line baseline was still only 42% complete after 20 hours.

Interactive adaptation depends on the harness

ARC-AGI-3 tests continual interactive adaptation rather than static answer production. Early replay analysis found GPT-5.5 at 0.43% and Opus 4.7 at 0.18%, failing to form correct world models or transfer level strategies. In September 2026 ARC Prize verified GPT-6 Astra at 62.7% with its Standard harness and 99.9% with a Provider Adapter harness that preserves the model's reasoning state; ARC reported that Astra built compact symbolic world models of each game.

Why the 2025 IMO result is stronger

The 2025 IMO result is technically stronger than the 2024 silver result: it worked end-to-end in natural language within 4.5 hours, whereas the 2024 systems needed human translation into formal languages and as much as three days. The IMO validated the submitted proofs, not Google's model or experimental process.

Productivity estimates remain inconclusive

METR's attempted late-2025 productivity follow-up produced raw estimates of 18% speedup for returning developers and 4% for new recruits, but both confidence intervals included zero and METR judged selection and time-reporting biases too severe for a reliable magnitude.

Benchmark errors limit headline scores

Static benchmark quality is itself a constraint: Stanford's 2026 review reports invalid-question estimates ranging from 2% on MMLU Math to 42% on GSM8K, reinforcing that saturated scores should not directly set an AGI percentage.

05 · The rulersThe rulers

Every test we can still hold it toThe tests — and who leads each one

Each row is an independent benchmark: its verified frontier, any named human mark, and how much ruler remains. Solid dots are steward-verified; dashed circles are lab claims. No row is averaged into another.Each row is one test. A solid dot is independently checked; a dashed circle is a company claim. We never add the rows into one big number.

  1. Brand-new visual puzzlesARC-AGI-2

    95%
    human panelhuman 66
    ARC-AGI-2GPT-6 Astra (Max)
    Engineer detail · representative record, conditions and limitations
    Representative recordGPT-6 Astra (Max) · 95 % of tasks

    OpenAI · 2026-09 · verified · ARC Prize Foundation

    ARC Prize semi-private verified result. Claude Opus 5.5 (High) scored 93.3 and GPT-6 Sol (Max) 89.6. The competition threshold applies to the private evaluation under its efficiency limits.

    Evaluation conditions

    Abstract reasoning on novel grid tasks designed to resist memorisation.Puzzles the model has not seen before.

    Steward: ARC Prize Foundation. Updated 2026-09-30.

    Sources and methods

    ARC Prize semi-private verified result. Claude Opus 5.5 (High) scored 93.3 and GPT-6 Sol (Max) 89.6. The competition threshold applies to the private evaluation under its efficiency limits.

    Source record ↗human panel source ↗2026 prize threshold source ↗

    Limitations

    Public and private evaluation scores are not interchangeable.

    A high score on one static puzzle suite is not a measure of general intelligence.

  2. Learning by playingARC-AGI-3

    62.7%
    human referencehuman 100
    ARC-AGI-3GPT-6 Astra (Max)
    Engineer detail · representative record, conditions and limitations
    Representative recordGPT-6 Astra (Max) · 62.71 % score

    OpenAI · 2026-09 · verified · ARC Prize Foundation

    Standard harness, the basis of earlier ARC-AGI-3 records here (GPT-5.6 Sol 7.78, Claude Opus 5 30.16). With ARC's Provider Adapter harness, which keeps the model's own reasoning state between turns, the same model scored 99.95 (High). The two harnesses are not comparable.

    Evaluation conditions

    Interactive adaptation in unfamiliar environments rather than static answer production.Figuring out a new game by trying things, without instructions.

    Steward: ARC Prize Foundation. Updated 2026-09-30.

    Sources and methods

    Standard harness, the basis of earlier ARC-AGI-3 records here (GPT-5.6 Sol 7.78, Claude Opus 5 30.16). With ARC's Provider Adapter harness, which keeps the model's own reasoning state between turns, the same model scored 99.95 (High). The two harnesses are not comparable.

    Source record ↗human reference source ↗

    Limitations

    Scores depend heavily on the harness: GPT-6 Astra scored 62.7% with ARC's Standard harness and 99.9% with the Provider Adapter harness in the same verification.

    ARC Prize says a high ARC-AGI-3 score is not by itself proof of general intelligence; the benchmark is still new.

  3. Questions at the edge of human knowledgeHumanity's Last Exam

    54.8%
    Humanity's Last ExamGPT-6 Astra
    Engineer detail · representative record, conditions and limitations
    Representative recordGPT-6 Astra · 54.8 % correct

    OpenAI · 2026-09 · verified · Scale SEAL

    Published interval: 52.86–56.74 % correct

    Scale SEAL leaderboard as read 30 Sep 2026 (last updated 17 Sep 2026). Next: Claude Fable 5.1 (xhigh) 46.50 ±2.00 and Gemini 3.1 Pro Preview 46.44 ±1.96. Lab-run HLE numbers use other harnesses and are not comparable.

    Evaluation conditions

    Expert-written questions intended to test frontier knowledge and reasoning.Very hard questions written by experts in many subjects.

    Steward: Scale SEAL. Updated 2026-09-30.

    Sources and methods

    Scale SEAL leaderboard as read 30 Sep 2026 (last updated 17 Sep 2026). Next: Claude Fable 5.1 (xhigh) 46.50 ±2.00 and Gemini 3.1 Pro Preview 46.44 ±1.96. Lab-run HLE numbers use other harnesses and are not comparable.

    Source record ↗

    Limitations

    The score is specific to the benchmark setup; it is not a cross-domain capability percentage.

    Confidence intervals mean nearby entries may not support a meaningful ranking.

  4. Longer coding jobsSWE-bench Pro (public)

    61.5%
    SWE-bench Pro (public)Muse Spark 1.1
    Engineer detail · representative record, conditions and limitations
    Representative recordMuse Spark 1.1 · 61.5 % solved

    Meta · 2026-09 · verified · Scale SEAL

    Published interval: 58.4–64.6 % solved

    Scale SEAL public set with the mini-swe-agent harness, as read 30 Sep 2026; the page shows no update date. Scale ranks it tied first with GPT-5.4 (xHigh) at 59.10 ±3.56, so the order is not meaningful. Lab-run SWE-bench Pro numbers (e.g. 89.9 for Claude Opus 5.5) use other harnesses and are not comparable.

    Evaluation conditions

    Agent performance on long-horizon software-engineering tasks in public open-source repositories.Whether an AI agent can complete harder real coding work.

    Steward: Scale SEAL. Updated 2026-09-30.

    Sources and methods

    Scale SEAL public set with the mini-swe-agent harness, as read 30 Sep 2026; the page shows no update date. Scale ranks it tied first with GPT-5.4 (xHigh) at 59.10 ±3.56, so the order is not meaningful. Lab-run SWE-bench Pro numbers (e.g. 89.9 for Claude Opus 5.5) use other harnesses and are not comparable.

    Source record ↗

    Limitations

    This is an agent-plus-harness evaluation, not a property of the base model alone.

    The board does not compare this percentage directly with puzzle or knowledge benchmarks.

  5. The earlier puzzle setARC-AGI-1

    98.5%
    ARC-AGI-1saturatedGPT-6 Astra (High)
    Engineer detail · representative record, conditions and limitations
    Representative recordGPT-6 Astra (High) · 98.5 % of tasks

    OpenAI · 2026-09 · verified · ARC Prize Foundation

    Tied by Claude Opus 5.5 (High) at 98.5. The benchmark is saturated.

    Evaluation conditions

    The original static ARC puzzle suite, superseded by ARC-AGI-2.The first version of the visual puzzle test.

    ARC Prize explicitly described ARC-AGI-1 as saturating and raised the bar with ARC-AGI-2.

    Sources and methods

    Tied by Claude Opus 5.5 (High) at 98.5. The benchmark is saturated.

    Source record ↗

    Limitations

    ARC Prize's own transition to ARC-AGI-2 is the reason this ruler is shown as outgrown rather than as a fresh frontier.

  6. The old bug-fixing testSWE-bench Verified

    80.9%
    SWE-bench VerifiedwithdrawnGPT-5.2
    Engineer detail · representative record, conditions and limitations
    Representative recordGPT-5.2 · 80.9 % resolved

    OpenAI · 2026-02 · self-reported

    Shown as a lab-reported historical mark, not as a current verified frontier.

    Evaluation conditions

    Resolving issues from public code repositories; now judged contaminated and affected by flawed tests.The old test for fixing real code bugs.

    OpenAI stopped reporting this score because contamination and flawed tests made it unreliable for frontier comparison.

    Sources and methods

    Shown as a lab-reported historical mark, not as a current verified frontier.

    Source record ↗

    Limitations

    OpenAI's audit found evidence that frontier models had seen some problems or solutions in training.

    The replacement ruler, SWE-bench Pro, is still active above.

How long a job it can finish is on a log axis — see the data figure.

solid · independently verified hollow · lab claim solid tick · human reference dashed tick · target whisker · published interval shaded · benchmark no longer discriminates

each ruler 0–100 in its own unit · never summed

View every result as a table
Every benchmark record with its conditions of trust
RulerModelLabValueCIDateVerificationConditionsCaveatsRecord noteSource
Brand-new visual puzzlesGPT-6 Astra (Max)OpenAI95 % of tasks—2026-09verified · ARC Prize FoundationPuzzles the model has not seen before.Public and private evaluation scores are not interchangeable. A high score on one static puzzle suite is not a measure of general intelligence.ARC Prize semi-private verified result. Claude Opus 5.5 (High) scored 93.3 and GPT-6 Sol (Max) 89.6. The competition threshold applies to the private evaluation under its efficiency limits.Source ↗
Learning by playingGPT-6 Astra (Max)OpenAI62.71 % score—2026-09verified · ARC Prize FoundationFiguring out a new game by trying things, without instructions.Scores depend heavily on the harness: GPT-6 Astra scored 62.7% with ARC's Standard harness and 99.9% with the Provider Adapter harness in the same verification. ARC Prize says a high ARC-AGI-3 score is not by itself proof of general intelligence; the benchmark is still new.Standard harness, the basis of earlier ARC-AGI-3 records here (GPT-5.6 Sol 7.78, Claude Opus 5 30.16). With ARC's Provider Adapter harness, which keeps the model's own reasoning state between turns, the same model scored 99.95 (High). The two harnesses are not comparable.Source ↗
How long a job it can finishGPT-2OpenAI0.05 minutes (log scale)0.01–0.14 minutes (log scale)2019-02verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishGPT-3 (davinci-002)OpenAI0.14 minutes (log scale)0.09–0.22 minutes (log scale)2020-05verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishGPT-3.5 Turbo InstructOpenAI0.6 minutes (log scale)0.26–1.12 minutes (log scale)2022-03verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishGPT-4OpenAI3.99 minutes (log scale)1.93–8 minutes (log scale)2023-03verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishGPT-4 (1106)OpenAI4.04 minutes (log scale)1.87–8.44 minutes (log scale)2023-11verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishClaude 3 OpusAnthropic3.95 minutes (log scale)1.71–8.76 minutes (log scale)2024-03verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.—Source ↗
How long a job it can finishGPT-4 TurboOpenAI3.73 minutes (log scale)1.98–6.74 minutes (log scale)2024-04verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.—Source ↗
How long a job it can finishGPT-4oOpenAI6.99 minutes (log scale)4–12.91 minutes (log scale)2024-05verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishClaude 3.5 Sonnet (Jun 2024)Anthropic11.4 minutes (log scale)5.49–22.38 minutes (log scale)2024-06verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finisho1-previewOpenAI20.33 minutes (log scale)11.72–33.38 minutes (log scale)2024-09verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishClaude 3.5 Sonnet (Oct 2024)Anthropic20.52 minutes (log scale)10.14–40.82 minutes (log scale)2024-10verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finisho1OpenAI38.83 minutes (log scale)21.16–64.95 minutes (log scale)2024-12verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishClaude 3.7 SonnetAnthropic60.39 minutes (log scale)33.01–104.23 minutes (log scale)2025-02verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finisho3OpenAI119.73 minutes (log scale)74.62–190.94 minutes (log scale)2025-04verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishClaude Opus 4Anthropic100.37 minutes (log scale)59.99–163.45 minutes (log scale)2025-05verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.—Source ↗
How long a job it can finishClaude Opus 4.1Anthropic100.47 minutes (log scale)59.27–159.45 minutes (log scale)2025-08verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.—Source ↗
How long a job it can finishGPT-5OpenAI203.01 minutes (log scale)112.64–405.55 minutes (log scale)2025-08verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishGemini 3 ProGoogle DeepMind224.33 minutes (log scale)139.57–379.24 minutes (log scale)2025-11verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishGPT-5.1 Codex MaxOpenAI223.71 minutes (log scale)134.31–396.21 minutes (log scale)2025-11verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.—Source ↗
How long a job it can finishClaude Opus 4.5Anthropic292.99 minutes (log scale)161.72–623.7 minutes (log scale)2025-11verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishGPT-5.2OpenAI352.25 minutes (log scale)198.07–815.18 minutes (log scale)2025-12verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishClaude Opus 4.6Anthropic718.81 minutes (log scale)316.69–3633.79 minutes (log scale)2026-02verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
How long a job it can finishGPT-5.3 CodexOpenAI349.53 minutes (log scale)194.91–816.35 minutes (log scale)2026-02verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.—Source ↗
How long a job it can finishGemini 3.1 ProGoogle DeepMind384.15 minutes (log scale)233.5–694.75 minutes (log scale)2026-02verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.—Source ↗
How long a job it can finishGPT-5.4OpenAI341.74 minutes (log scale)186.58–768.78 minutes (log scale)2026-03verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.—Source ↗
How long a job it can finishClaude Mythos Preview (early)Anthropic1044.78 minutes (log scale)508.88–3304.26 minutes (log scale)2026-04verified · METRThe length of a job it can finish alone about half the time.METR reports wide uncertainty for current models and warns that horizons vary sharply by domain. METR revised its own Horizon estimates down by up to 20% in March 2026; these are the corrected TH1.1 figures, re-pulled from METR's raw results file. A horizon is human task-duration at 50% success, not wall-clock autonomous runtime. The hatched range marks where this simplified display should not invite extrapolation, not a hard physical ceiling.State of the art on METR's Horizon suite at release.Source ↗
Questions at the edge of human knowledgeGPT-6 AstraOpenAI54.8 % correct52.86–56.74 % correct2026-09verified · Scale SEALVery hard questions written by experts in many subjects.The score is specific to the benchmark setup; it is not a cross-domain capability percentage. Confidence intervals mean nearby entries may not support a meaningful ranking.Scale SEAL leaderboard as read 30 Sep 2026 (last updated 17 Sep 2026). Next: Claude Fable 5.1 (xhigh) 46.50 ±2.00 and Gemini 3.1 Pro Preview 46.44 ±1.96. Lab-run HLE numbers use other harnesses and are not comparable.Source ↗
Longer coding jobsMuse Spark 1.1Meta61.5 % solved58.4–64.6 % solved2026-09verified · Scale SEALWhether an AI agent can complete harder real coding work.This is an agent-plus-harness evaluation, not a property of the base model alone. The board does not compare this percentage directly with puzzle or knowledge benchmarks.Scale SEAL public set with the mini-swe-agent harness, as read 30 Sep 2026; the page shows no update date. Scale ranks it tied first with GPT-5.4 (xHigh) at 59.10 ±3.56, so the order is not meaningful. Lab-run SWE-bench Pro numbers (e.g. 89.9 for Claude Opus 5.5) use other harnesses and are not comparable.Source ↗
The earlier puzzle setGPT-6 Astra (High)OpenAI98.5 % of tasks—2026-09verified · ARC Prize FoundationThe first version of the visual puzzle test.ARC Prize's own transition to ARC-AGI-2 is the reason this ruler is shown as outgrown rather than as a fresh frontier.Tied by Claude Opus 5.5 (High) at 98.5. The benchmark is saturated.Source ↗
The old bug-fixing testGPT-5.2OpenAI80.9 % resolved—2026-02self-reportedThe old test for fixing real code bugs.OpenAI's audit found evidence that frontier models had seen some problems or solutions in training. The replacement ruler, SWE-bench Pro, is still active above.Shown as a lab-reported historical mark, not as a current verified frontier.Source ↗
06 · What it unlocksWhat it unlocks

If the remaining tests pass.If the remaining tests pass.

Downstream capabilities remain conditional on results that are not yet in.These are possible next capabilities, conditional on results that are not yet in.

TODAY
  1. OPEN TEST01 ↗
    Learn many different kinds of workBroad cognitive competenceA general system should transfer what it knows to fresh problems, not need a new trick for every benchmark.Expert-level performance across diverse, contamination-resistant novel tasks
  2. OPEN TEST02 ↗
    Finish long jobs without hand-holdingLong-horizon autonomyThe measured span an agent can complete on its own is still counted in hours, not days.Reliably plan and finish multi-day digital projects with sparse supervision
  3. OPEN TEST03 ↗
    Stay reliable when things get weirdCalibrated reliabilityBeing capable is not enough if unusual inputs still produce confident, costly errors.Predictable, well-calibrated, corrigible behavior under distribution shift and adversarial pressure
TODAY
OPEN TEST01 ↗
Learn many different kinds of workBroad cognitive competenceA general system should transfer what it knows to fresh problems, not need a new trick for every benchmark.Expert-level performance across diverse, contamination-resistant novel tasks
OPEN TEST02 ↗
Finish long jobs without hand-holdingLong-horizon autonomyThe measured span an agent can complete on its own is still counted in hours, not days.Reliably plan and finish multi-day digital projects with sparse supervision
OPEN TEST03 ↗
Stay reliable when things get weirdCalibrated reliabilityBeing capable is not enough if unusual inputs still produce confident, costly errors.Predictable, well-calibrated, corrigible behavior under distribution shift and adversarial pressure

Possible, if the open tests pass.

  1. Faster robotics research

    This is a possible benefit only if faster robotics research works safely, reliably and at useful scale.Potential benefit only if the stated use (Faster robotics research) is demonstrated with evidence for safety, reliability, affordability and scale.

    Related problem ↗
  2. Faster longevity research

    This is a possible benefit only if faster longevity research works safely, reliably and at useful scale.Potential benefit only if the stated use (Faster longevity research) is demonstrated with evidence for safety, reliability, affordability and scale.

    Related problem ↗
  3. Accelerated science everywhere

    This is a possible benefit only if accelerated science everywhere works safely, reliably and at useful scale.Potential benefit only if the stated use (Accelerated science everywhere) is demonstrated with evidence for safety, reliability, affordability and scale.

  4. AI plasma control

    This is a possible benefit only if ai plasma control works safely, reliably and at useful scale.Potential benefit only if the stated use (AI plasma control) is demonstrated with evidence for safety, reliability, affordability and scale.

    Related problem ↗
  5. AI-designed vaccines

    This is a possible benefit only if ai-designed vaccines works safely, reliably and at useful scale.Potential benefit only if the stated use (AI-designed vaccines) is demonstrated with evidence for safety, reliability, affordability and scale.

    Related problem ↗
  6. Better neural decoders

    This is a possible benefit only if better neural decoders works safely, reliably and at useful scale.Potential benefit only if the stated use (Better neural decoders) is demonstrated with evidence for safety, reliability, affordability and scale.

    Related problem ↗
These are possible outcomes, if the open tests pass. They are conditional, not promises.
07 · The players & the moneyThe players & the money

Meet the builders.Meet the builders.

The organisations, their approaches, and the evidence behind them.The teams doing the work, the money around them, and what the record can support.

USA · company

OpenAI

Frontier multimodal and reasoning models, agent products and large-scale training infrastructure.

Funding context$122B committed capital · Mar 2026 · $852B post-money valuationCommitted capital is not cumulative funding, revenue or money already spent on compute.
Named investorsAmazon · NVIDIA · SoftBank · Microsoft

Capital is context, not a demonstration.

Company source ↗
View every builder record

OpenAI

USA · company · Frontier multimodal and reasoning models, agent products and large-scale training infrastructure.

Funding: $122B committed capital · Mar 2026 · $852B post-money valuation

Named investors: Amazon · NVIDIA · SoftBank · Microsoft

Committed capital is not cumulative funding, revenue or money already spent on compute.

Company source ↗

Anthropic

USA · company · Frontier Claude models with interpretability, alignment and model-safety research.

Funding: Series F · $13B · Sep 2025 · $183B post-money valuation

Named investors: ICONIQ · Fidelity · Lightspeed · BlackRock affiliates · Qatar Investment Authority

The reported $5B August 2025 revenue figure is an annualized run-rate, not audited full-year revenue.

Company source ↗

xAI

USA · company · Grok model family and vertically integrated large-scale training infrastructure.

Funding: Series E · $20B · Jan 2026

Named investors: Valor Equity Partners · Fidelity · Qatar Investment Authority · NVIDIA · Cisco

No cumulative total is encoded because the release does not reconcile equity, debt and infrastructure financing.

Company source ↗

Mistral AI

France · company · European frontier and open-weight models, enterprise deployment and sovereign AI tooling.

Funding: Series C · €1.7B · Sep 2025 · €11.7B post-money valuation

Named investors: ASML · Bpifrance · NVIDIA

ASML invested €1.3B; valuation is stated separately from capital raised.

Company source ↗

Google DeepMind

UK / USA · lab · Gemini frontier models, reinforcement learning, AI-for-science and robotics research.

Funding: Funding not recorded in this record.

Funded inside Alphabet; corporate capex is not a standalone lab round.

Company source ↗

Meta AI

USA · lab · Open-weight Llama models and research in multimodal, world-model and embodied AI.

Funding: Funding not recorded in this record.

Funded inside Meta; company-wide infrastructure spending is not lab funding.

Company source ↗
08 · SourcesSources

Follow the evidence.Follow the evidence.

54 sources — every figure on this page traces to one.54 sources — every figure on this page traces to one.

Source · what this page citesScope and limits
  1. 01

    Scope: Not recorded. Limit: Not recorded.

  2. 02

    Scope: Not recorded. Limit: Not recorded.

  3. 03

    OpenAI - Why Language Models Hallucinate (2025)

    Read source ↗openai.com

    Scope: Not recorded. Limit: Not recorded.

  4. 04

    Metaculus - Date of the first general AI system

    Read source ↗metaculus.com

    Scope: Not recorded. Limit: Not recorded.

  5. 05

    Timeline · Turing asks "Can machines think?"

    Read source ↗en.wikipedia.org

    Scope: Not recorded. Limit: Not recorded.

  6. 06

    Timeline · The Dartmouth workshop names the field

    Read source ↗en.wikipedia.org

    Scope: Not recorded. Limit: Not recorded.

  7. 07

    Timeline · The perceptron learns from data

    Read source ↗en.wikipedia.org

    Scope: Not recorded. Limit: Not recorded.

  8. 08

    Scope: Not recorded. Limit: Not recorded.

  9. 09

    Timeline · Backpropagation revives neural nets

    Read source ↗nature.com

    Scope: Not recorded. Limit: Not recorded.

  10. 10

    Timeline · Deep Blue beats Kasparov

    Read source ↗en.wikipedia.org

    Scope: Not recorded. Limit: Not recorded.

  11. 11

    Timeline · AlexNet ignites the deep-learning era

    Read source ↗en.wikipedia.org

    Scope: Not recorded. Limit: Not recorded.

  12. 12

    Timeline · AlphaGo defeats Lee Sedol

    Read source ↗en.wikipedia.org

    Scope: Not recorded. Limit: Not recorded.

  13. 13

    Scope: Not recorded. Limit: Not recorded.

  14. 14

    Timeline · GPT-2 shows scale generates fluent text

    Read source ↗en.wikipedia.org

    Scope: Not recorded. Limit: Not recorded.

  15. 15

    Timeline · GPT-3 and few-shot learning

    Scope: Not recorded. Limit: Not recorded.

  16. 16

    Scope: Not recorded. Limit: Not recorded.

  17. 17

    Timeline · GPT-4 clears broad exam benchmarks

    Read source ↗cdn.openai.com

    Scope: Not recorded. Limit: Not recorded.

  18. 18

    Timeline · SWE-bench tests repository-scale coding

    Scope: Not recorded. Limit: Not recorded.

  19. 19

    Timeline · Formal systems reach IMO silver standard

    Read source ↗deepmind.google

    Scope: Not recorded. Limit: Not recorded.

  20. 20

    Timeline · Reasoning models and agents arrive

    Read source ↗openai.com

    Scope: Not recorded. Limit: Not recorded.

  21. 21

    Scope: Not recorded. Limit: Not recorded.

  22. 22

    Timeline · Real-world coding trial finds a slowdown

    Scope: Not recorded. Limit: Not recorded.

  23. 23

    Timeline · Natural-language system reaches IMO gold standard

    Read source ↗deepmind.google

    Scope: Not recorded. Limit: Not recorded.

  24. 24

    Timeline · ARC-AGI-2 improves, but grand prize stays open

    Read source ↗arcprize.org

    Scope: Not recorded. Limit: Not recorded.

  25. 25

    Scope: Not recorded. Limit: Not recorded.

  26. 26

    Timeline · ARC-AGI-3 exposes an interactive gap

    Read source ↗arcprize.org

    Scope: Not recorded. Limit: Not recorded.

  27. 27

    Timeline · MirrorCode tests whole-program reconstruction

    Scope: Not recorded. Limit: Not recorded.

  28. 28

    Scope: Not recorded. Limit: Not recorded.

  29. 29

    Scope: Not recorded. Limit: Not recorded.

  30. 30

    Engineer note · What a time horizon measures

    Scope: Not recorded. Limit: Not recorded.

  31. 31

    Engineer note · MirrorCode gives unusually rich feedback

    Scope: Not recorded. Limit: Not recorded.

  32. 32

    Engineer note · Interactive adaptation remains weak

    Read source ↗arcprize.org

    Scope: Not recorded. Limit: Not recorded.

  33. 33

    Engineer note · Productivity estimates remain inconclusive

    Scope: Not recorded. Limit: Not recorded.

  34. 34

    Engineer note · Benchmark errors limit headline scores

    Read source ↗hai.stanford.edu

    Scope: Not recorded. Limit: Not recorded.

  35. 35

    companies · OpenAI

    Read source ↗openai.com

    Scope: Not recorded. Limit: Not recorded.

  36. 36

    Scope: Not recorded. Limit: Not recorded.

  37. 37

    companies · xAI

    Scope: Not recorded. Limit: Not recorded.

  38. 38

    companies · Mistral AI

    Read source ↗presse.bpifrance.fr

    Scope: Not recorded. Limit: Not recorded.

  39. 39

    companies · Google DeepMind

    Read source ↗deepmind.google

    Scope: Not recorded. Limit: Not recorded.

  40. 40

    companies · Meta AI

    Read source ↗ai.meta.com

    Scope: Not recorded. Limit: Not recorded.

  41. 41

    people · Sam Altman

    Read source ↗openai.com

    Scope: Not recorded. Limit: Not recorded.

  42. 42

    people · Dario Amodei

    Read source ↗anthropic.com

    Scope: Not recorded. Limit: Not recorded.

  43. 43

    people · Arthur Mensch

    Read source ↗mistral.ai

    Scope: Not recorded. Limit: Not recorded.

  44. 44

    Scope: Not recorded. Limit: Not recorded.

  45. 45

    market · €10B EU supercomputing and AI-factory programme

    Read source ↗digital-strategy.ec.europa.eu

    Scope: Not recorded. Limit: Not recorded.

  46. 46

    market · UK targets 420 AI ExaFLOPS of public compute by 2030

    Scope: Not recorded. Limit: Not recorded.

  47. 47

    OpenAI official site

    Read source ↗openai.com

    Scope: Not recorded. Limit: Not recorded.

  48. 48

    OpenAI logo review

    Read source ↗openai.com

    Scope: Not recorded. Limit: Not recorded.

  49. 49

    Anthropic official site

    Read source ↗anthropic.com

    Scope: Not recorded. Limit: Not recorded.

  50. 50

    xAI official site

    Scope: Not recorded. Limit: Not recorded.

  51. 51

    Mistral AI official site

    Read source ↗mistral.ai

    Scope: Not recorded. Limit: Not recorded.

  52. 52

    Mistral AI logo review

    Read source ↗mistral.ai

    Scope: Not recorded. Limit: Not recorded.

  53. 53

    Google DeepMind official site

    Read source ↗deepmind.google

    Scope: Not recorded. Limit: Not recorded.

  54. 54

    Timeline · GPT-6 Astra scores 62.7% on ARC-AGI-3

    Read source ↗arcprize.org

    Scope: Not recorded. Limit: Not recorded.

Sources describe evidence. Inclusion is not endorsement.