“Update: The most popular reply to the Apple paper turned out to be an error-ridden joke.”
Our reading, the sentence that was checked:
The most popular rebuttal to the Apple reasoning paper was full of errors.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Seven replies to the viral Apple reasoning paper – and why they fall short, paragraph 17.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-seven-replies-to-the-viral-apple-121b14-a1
We recorded 17 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2025-06-12. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- The most popular reply to the Apple paper
- turned out to be
- an error-ridden joke
Our interpretation
- The apparent referent is Alex Lawsen's original paper, The Illusion of the Illusion of Thinking.
- Read 'error-ridden' as multiple substantive errors affecting its arguments, rather than typographical mistakes or disagreement with its conclusions.
- Read 'most popular' as the leading rebuttal in contemporary public circulation. Establishing that ranking requires comparative evidence.
- Treat 'joke' as rhetorical emphasis, rather than a separate claim that every argument was insincere.
- Assess the original rebuttal circulating during the June 2025 debate through the supplied June 12 post date. The update has no separately established date. Later disclosures can establish errors already present in that original version.
Counts as supported if: Identify the leading contemporaneous rebuttal and document multiple substantive errors affecting its arguments.
Counts as contradicted if: Identify the leading contemporaneous rebuttal and establish through substantive review that its alleged errors were absent or only isolated and minor, or establish that another rebuttal led public circulation.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The narrower allegation has substantial support: Lawsen acknowledged serious mistakes, and the revision changes a central token-limit argument and other technical material. This was more than a correction of typos. However, the records found establish broad circulation, not that this was the most popular reply during the relevant period. The undated update adds uncertainty about that comparison. Later independent research also supports the River Crossing objection, so the errors do not justify dismissing every argument. The full claim remains unresolved under the stated criteria.
Limitations
- The original rebuttal is the apparent referent, but the quoted sentence does not name it.
- June 18 is used conservatively for availability of the updated author account and corrected paper; their underlying errors concern the June 10 original.
- The independent follow-up is a preprint and does not comprehensively audit the rebuttal.
Evidence (3 items)
Supports the claim: Alex Lawsen, Speculative Decoding,
There was a computational complexity analysis that was just complete nonsense.
Why it matters here: This firsthand retrospective account acknowledges substantive defects in the original rebuttal, rather than merely typos. The post also describes its satirical origin and substantial circulation, but supplies no comparative popularity ranking.
- Publisher
- Alex Lawsen, Speculative Decoding
- Kind of source
- Secondary summary
- Describes events of
- Public from
Supports the claim: A. Lawsen via arXiv,
Note: The original version of this paper contained an error.
Why it matters here: The revision corrects both the assumption that models repeatedly output intermediate move lists and an inconsistency in tokens per move. Its revised calculation places physical token limits above the reported collapse point, materially weakening the original explanation. Section 6 also replaces the River Crossing complexity comparison with Blocks World.
- Publisher
- A. Lawsen via arXiv
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
Context only: Iñaki Dellibarda Varela, Pablo Romero-Sorozabal, Eduardo Rocon and Manuel Cebrian via arXiv,
Moreover, the River Crossing results initially heralded as catastrophic failures turn out to hinge upon testing unsolvable configurations.
Why it matters here: This later independent study supports a substantive objection raised by the rebuttal. It cautions against treating acknowledged errors as proof that every criticism was invalid; its later experiments are context rather than outcome evidence for the target period.
- Where
- Abstract
- Publisher
- Iñaki Dellibarda Varela, Pablo Romero-Sorozabal, Eduardo Rocon and Manuel Cebrian via arXiv
- Kind of source
- Preprint, not peer reviewed
- Describes events of
- Public from
What would settle it
A dated record of the update and comparable contemporary engagement records identifying the leading rebuttal. If they identify Lawsen's original paper, the documented substantive corrections would support the ordinary reading used here.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Seven replies to the viral Apple reasoning paper – and why they fall short
Update: The most popular reply to the Apple paper turned out to be an error-ridden joke.
- Where
- paragraph 17
- Published
- 2025-06-12
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-seven-replies-to-the-viral-apple-121b14-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.