“The measures are new, the model is new, but the stumbling block remains the same.”
Our reading, the sentence that was checked:
In the compositionality study he cites, the measures and the model are new, but the stumbling block is the same one neural networks faced in 1993.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Happy Groundhog Day, The AI Edition, paragraph 8.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-happy-groundhog-day-the-ai-edition-f55e84-a1
We recorded 12 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2023-02-03. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- the cited study of compositionality in modern architectures (scope, stated by the speaker)
From the speaker
- The measures are new
- the model is new
- the stumbling block remains the same
- Straight out of 1993
Our interpretation
- The claim concerns the particular compositionality study introduced immediately before this sentence.
- The ordinary reading of the same stumbling block is continued difficulty generalizing familiar components to unfamiliar combinations, not identical internal mechanisms or an absence of progress.
- The target is the study being discussed on the post date. Its underlying experimental period cannot be assigned until the study is identified; the post-date interval is therefore provisional.
Counts as supported if: The identified study uses newer models and measures and documents a compositional-generalization limitation materially matching one documented in the earlier literature.
Counts as contradicted if: The identified study does not document the alleged limitation, or the historical comparison misstates the earlier research.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The central source is missing: the retrieved post introduces an abstract but does not reproduce or identify it. Searches located relevant compositionality research without establishing which paper Marcus meant. Substituting a plausible paper would risk grading a different claim.
Limitations
- The target period must be refined to the study's actual research period once identified.
- Historical systematicity arguments alone do not establish this particular comparison.
Evidence (0 items)
No evidence item settled this claim by the cutoff.
What would settle it
Recover the embedded abstract or a reliable citation identifying the study, then compare its methods and findings with the earlier research.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Happy Groundhog Day, The AI Edition
The measures are new, the model is new, but the stumbling block remains the same.
- Where
- paragraph 8
- Published
- 2023-02-03
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-happy-groundhog-day-the-ai-edition-f55e84-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-happy-groundhog-day-the-ai-edition-f55e84-a1.