“What I argued in 2001, in The Algebraic Mind, still holds: symbol manipulation, in which some knowledge is represented truly abstractly in terms of variables and operations over those variables, much as we see in algebra and traditional computer programming, must be part of the mix.”
Our reading, the sentence that was checked:
As Marcus argued in The Algebraic Mind in 2001, symbol manipulation, in which some knowledge is represented truly abstractly in terms of variables and operations over them as in algebra and traditional programming, must be part of the mix.
Assessment: Can’t be checked Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, LLMs don’t do formal reasoning - and that is a HUGE problem, paragraph 24.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-llms-dont-do-formal-reasoning-and-577dc0-a2
We recorded 9 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-10-11. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Causal claim
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- as part of the mix (qualifier, stated by the speaker)
From the speaker
- What I argued in 2001, in The Algebraic Mind, still holds
- symbol manipulation
- variables and operations over those variables
- must be part of the mix
Our interpretation
- The claim says symbol manipulation 'must be part of the mix' but does not say for what goal (reliable reasoning, AGI, some benchmark) or by when.
- It is a theoretical necessity claim about AI design with no deadline or test. Present-day systems either use symbolic tools (code execution, proof checkers) or do not. Neither fact settles whether symbol manipulation is necessary.
- No plain reading yields a definite test, so the claim is treated as not adjudicable.
This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.
Current assessment
Not graded on evidence
Outcome: Can’t be checked
The statement is a recommendation, a value judgment, or too open to test. It is recorded, not scored.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
In a post dated 2024-10-11, Marcus says that symbol manipulation, with knowledge represented abstractly as variables and operations over them as in algebra and programming, 'must be part of the mix.' He does not say what it is needed for, such as reliable reasoning or a benchmark. He gives no deadline and no test. Without a stated goal, no dated evidence could show the necessity claim true or false. For that reason the claim is not graded. The evidence packet cites no outcome evidence. The two sources it considered were left unused because they could not settle a necessity claim that names no goal.
Limitations
- The packet cites no evidence about whether current AI systems use symbolic components, or how well systems without them perform.
- 'Part of the mix' is vague. It is unclear whether external tools such as code interpreters would count as symbol manipulation.
- A narrower version of the claim, naming a goal and a date, could be checked. That is not what the source says.
Evidence (0 items)
No outcome evidence: a claim of this kind is recorded and attributed, not scored.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, LLMs don’t do formal reasoning - and that is a HUGE problem
What I argued in 2001, in The Algebraic Mind, still holds: symbol manipulation, in which some knowledge is represented truly abstractly in terms of variables and operations over those variables, much as we see in algebra and traditional computer programming, must be part of the mix.
- Where
- paragraph 24
- Published
- 2024-10-11
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-llms-dont-do-formal-reasoning-and-577dc0-a2: Current. Outcome: Can’t be checked. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-llms-dont-do-formal-reasoning-and-577dc0-a2.