Rumors of AGI’s arrival have been greatly exaggerated
We recorded 15 claims from this post. 11 were checked against evidence. 4 can’t be checked. 6 more are held. Read the post at its source.
Claims from this post (15)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: UnresolvedSaid
Observation
“Such claims confuse high performance on benchmarks (often gameable) with real world flexibility, which historically has been at the center of what it means to be an artificial general intelligence.”
Our reading: Claims that AGI has already arrived confuse high performance on benchmarks, which are often gameable, with real-world flexibility, which historically has been at the center of what it means to be an AGI.
No horizon Evidence as of
Limitation: The university report provides a direct author quotation but is not the complete Nature argument.
Assessment: UnresolvedSaid
Observation
“Rumors that humanity has already achieved artificial general intelligence (AGI) have been greatly exaggerated.”
Our reading: AGI has not already been achieved; rumors that it has are greatly exaggerated.
No horizon Evidence as of
Limitation: This is a historical assessment; later model improvements do not contradict the claim.
Assessment: UnresolvedSaid
Observation
“We also show that recent claims (Chen et al., 2026) about putative success on AGI hinge on redefining what AGI has historically meant.”
Our reading: Chen et al.'s (2026) claims that AGI has been achieved depend on redefining the historical meaning of AGI.
No horizon Evidence as of
Limitation: The packet lacks the complete Chen et al. argument required by the contract.
Assessment: SupportedSaid
Observation
“Task-level performance, even when impressive, is not sufficient evidence of general intelligence.”
Our reading: Impressive task-level performance is not sufficient evidence of general intelligence.
No horizon Evidence as of
Limitation: The empirical example concerns particular systems and tasks, not every model available in February 2026.
Assessment: Can’t be checkedSaid
Observation
“Here, we argue that recent claims of achieving AGI rest on a conceptual error: conflating increasingly sophisticated statistical approximations with intelligence itself.”
Our reading: Recent claims of achieving AGI conflate sophisticated statistical approximation with intelligence itself.
No horizon
Assessment: Can’t be checkedSaid
Recommendation or value judgment
“By focusing on specific benchmarks, these definitions miss the generality that was central to the original definitions, as discussed in the next section, thereby reflecting a fundamental misunderstanding of how intelligence should be evaluated.”
Our reading: Definitions that treat AGI as strong performance on standardized benchmarks miss the generality that was central to the original definitions, and so reflect a fundamental misunderstanding of how intelligence should be evaluated.
No horizon
Assessment: SupportedSaid
Observation
“Moreover, benchmarks are often easily gamed.”
Our reading: AI benchmarks are often easily gamed.
No horizon Evidence as of
Limitation: 'Often' has no threshold. The evidence covers prominent benchmarks, not all benchmarks.
Assessment: UnresolvedSaid
Observation
“Behavioral similarity alone therefore provides no insight into whether the underlying processes support core components of general intelligence, such as judgment, error correction, or reliable generalization.”
Our reading: LLMs' behavioral similarity to humans alone gives no insight into whether they have judgment, error correction, or reliable generalization.
No horizon Evidence as of
Limitation: The strongest relevant studies use additional tests beyond behavioral similarity.
Assessment: UnresolvedSaid
Observation
“Language models, by contrast, tended to issue confident classifications in the same cases, even when uncertainty was explicitly signaled in the input.”
Our reading: In the cited direct comparison of human and LLM judgments of news source reliability, language models tended to issue confident classifications in the same cases where humans withheld or downgraded confidence, even when uncertainty was explicitly signaled in the input.
No horizon Evidence as of
Limitation: The supplementary material and usable underlying data were unavailable through the reader.
Assessment: UnresolvedSaid
Observation
“Across domains involving causality, value trade-offs, justification, and error monitoring, humans attend to reasons, stakes, and responsibility, whereas language models optimize for linguistic plausibility—structural fault lines between performance alignment and genuine evaluative competence (Quattrociocchi et al., 2025).”
Our reading: Across domains involving causality, value trade-offs, justification, and error monitoring, humans attend to reasons, stakes, and responsibility, whereas language models optimize for linguistic plausibility.
No horizon Evidence as of
Limitation: A model can be trained for correctness while still making unreliable judgments.
Assessment: SupportedSaid
Observation
“Reports that language models have produced correct proofs for isolated open problems in mathematics, including specific Erdős problems, do not alter this assessment.”
Our reading: LLM proofs of isolated open math problems, including Erdős problems, do not show general intelligence.
No horizon Evidence as of
Limitation: The 'do not alter this assessment' part is an evaluative judgment.
Assessment: SupportedSaid
Observation
“By the standards articulated in the original definitions of artificial general intelligence—robustness across environments, reliable generalization under novelty, and autonomous goal-directed behavior—current AI systems remain limited.”
Our reading: By original AGI standards, current AI systems remain limited.
No horizon Evidence as of
Limitation: The decisive benchmark results came out about five weeks after the post.
Assessment: Can’t be checkedSaid
Recommendation or value judgment
“Confusing increasingly sophisticated statistical approximation with general intelligence is therefore not only a conceptual error, but a strategic misjudgment.”
Our reading: Confusing increasingly sophisticated statistical approximation with general intelligence is not only a conceptual error but also a strategic misjudgment.
No horizon
Assessment: SupportedSaid
Observation
“Current AI systems are powerful and increasingly useful tools, but they do not exhibit the flexible, self-directed competence that the original concept of artificial general intelligence was intended to capture.”
Our reading: Current AI systems are powerful and increasingly useful tools, but they do not exhibit the flexible, self-directed competence that the original concept of AGI was intended to capture.
No horizon Evidence as of
Limitation: Most of the weight rests on one benchmark, ARC-AGI-3. Its 100% mark means matching human efficiency, not only solving the games.
Assessment: Can’t be checkedSaid
Causal claim
“As AI systems become embedded in scientific and institutional decision-making (NIST, 2023; European Commission, 2024), overestimating their cognitive capacities risks misallocating trust, responsibility, and authority.”
Our reading: Overestimating AI's cognitive capacities as it is embedded in decision-making risks misallocating trust, responsibility, and authority.
No horizon
Qualifier: as AI becomes embedded in decision-making
Held from this post (6)
These records did not pass every check, so nothing about them is published. Held is not a finding.
- The two reviews read the claim differently
- The two reviews reached different assessments. Our reading, not assessed: On the dimensions of reliability under uncertainty, resistance to systematic failure, and cross-domain transfer, current AI systems remain brittle, sensitive to prompt framing, and inconsistent outside curated evaluation settings.
- The criteria are ambiguous. Our reading, not assessed: Real-world evidence suggests flexibility, generality, and reliability remain elusive for current AI.
- The criteria are ambiguous. Our reading, not assessed: Current AI systems fall short on robustness, dependable generalization, and resistance to systematic failure, which are essential AGI criteria.
- The criteria are ambiguous. Our reading, not assessed: In recent years some have tried to redefine AGI in a way that weakens the term, and the authors see no evidence that the original standards for AGI have been met.
- The criteria are ambiguous. Our reading, not assessed: Today's LLMs lack persistent goals, struggle with long-horizon reasoning, and depend heavily on human scaffolding.