GPT-5 hot take
We recorded 8 claims from this post. 5 were checked against evidence. 3 can’t be checked. 4 more are held. Read the post at its source.
Claims from this post (8)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: SupportedSaid
Observation
“But still part of the pack, not a giant leap forward (e.g. Grok 4 beats it on ARC-AGI-2 results)”
Our reading: GPT-5 is still part of the pack rather than a giant leap forward; for example, Grok 4 beats it on ARC-AGI-2.
No horizon Evidence as of
What happened: The benchmark founder directly confirms Marcus's numerical example. This establishes accuracy ordering on this benchmark, not general model superiority. (François Chollet, )
Limitation: The broader conclusion depends on the stated comparison baseline.
Assessment: SupportedSaid
Observation
“OpenAI conveniently forgot to include this comparison (ARC-AGI-2) in their livestream recital of benchmark progress, which left the livestream looking like marketing rather than science.”
Our reading: OpenAI left the ARC-AGI-2 comparison out of its GPT-5 livestream benchmarks, which made the livestream look like marketing rather than science.
No horizon Evidence as of
What happened: The launch-day report discusses the ARC-AGI comparisons and expressly reports their omission from the presentation. It does not establish why OpenAI omitted them. (The Decoder, )
Limitation: The decisive source is contemporaneous specialist reporting rather than an independently inspected complete recording.
Assessment: SupportedSaid
Observation
“GPT-5 is obviously not AGI.”
Our reading: GPT-5 is not AGI.
No horizon Evidence as of
What happened: WIRED reports that Altman identified missing traits preventing GPT-5 from reaching AGI, including continuous learning. This supports the claim under the stated ordinary reading; it is attributed reporting rather than a primary transcript. (WIRED, )
Limitation: The outcome depends on the stated interpretation of AGI.
Assessment: Can’t be checkedSaid
Forecast
“Pricing is good, but profits may continue to be elusive; still no clear technical moat.”
Our reading: Although GPT-5 pricing is good, OpenAI's profits may continue to be elusive.
No horizon
Assessment: UnresolvedSaid
Observation
“Pricing is good, but profits may continue to be elusive; still no clear technical moat.”
Our reading: OpenAI still has no clear technical moat with GPT-5.
No horizon Evidence as of
Limitation: Competitor disclosures are self-reported.
Assessment: SupportedSaid
Observation
“What was up with multiple graphs (at least two) in which the bars didn’t match the numbers?”
Our reading: In the GPT-5 announcement, OpenAI showed at least two graphs whose bars did not match the numbers.
No horizon Evidence as of
What happened: The contemporaneous visual analysis identifies an inverted ordering in the coding-performance chart. This establishes one distinct chart whose bars conflict with its labels. (FlowingData, )
Limitation: The assessment relies on contemporaneous visual analysis and subsequent reporting because the primary video was not readable.
Assessment: Can’t be checkedSaid
Forecast
““AGI 2027” seems more and more remote by the day.”
Our reading: AGI arriving by 2027 looks increasingly unlikely.
No horizon
Assessment: Can’t be checkedSaid
Causal claim
“Gary Marcus thinks that perhaps scaling is not in fact all you need.”
Our reading: Gary Marcus thinks that perhaps scaling is not in fact all you need.
No horizon
Qualifier: perhaps
Held from this post (4)
These records did not pass every check, so nothing about them is published. Held is not a finding.
- The two reviews read the claim differently
- The two reviews reached different assessments. Our reading, not assessed: GPT-5 represents good progress on many fronts.
- The criteria are ambiguous. Our reading, not assessed: GPT-5 took almost three years and many billions of dollars, with over half a trillion dollars spent fieldwide.
- The criteria are ambiguous. Our reading, not assessed: GPT-5 appears not to have solved any of the problems Marcus predicted a couple of weeks earlier would remain unsolved.