Even more good news for the future of neurosymbolic AI
We recorded 11 claims from this post. 8 were checked against evidence. 3 can’t be checked. 3 more are held. Read the post at its source.
Claims from this post (11)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: UnresolvedSaid
Forecast
“But anybody who thinks LLMs are a direct route to the sort AGI that could fundamentally transform society for the good is kidding themselves.”
Our reading: LLMs are not a direct route to the sort of AGI that could fundamentally transform society for the good, and anyone who thinks they are is kidding themselves.
No deadline stated Evidence as of
Limitation: The forecast's central terms remain underspecified.
Assessment: Can’t be checkedSaid
Recommendation or value judgment
“In reality, the replies to the Apple reasoning paper were weak sauce (see also this).”
Our reading: The replies to the Apple reasoning paper were weak.
No horizon
Assessment: SupportedSaid
Observation
“LLMs have persistent weaknesses around planning, reasoning and generalization.”
Our reading: LLMs have persistent weaknesses in planning, reasoning and generalization.
No horizon Evidence as of
Limitation: Generalization experiments use restricted settings.
Assessment: SupportedSaid
Observation
“Second, they show that a neurosymbolic hybrid model, which integrates both a neural networks (for pattern recognition) and a symbolic planner generalizes far better.”
Our reading: A neurosymbolic hybrid with a symbolic planner generalizes far better than VLAs on the Tower of Hanoi task.
No horizon Evidence as of
Limitation: This establishes the reported result for one simulated task and the tested configurations. It does not establish a general advantage across robotics.
Assessment: UnresolvedSaid
Observation
“LLMs are an efficient way to pattern recognition where perfect results are not required, but an inefficient way to reason a plan.”
Our reading: LLMs are efficient for imperfect pattern recognition but inefficient for reasoning out a plan.
No horizon Evidence as of
Limitation: Different efficiency baselines could produce different judgments.
Assessment: SupportedSaid
Observation
“Third, they show that the neurosymbolic hybrid was vastly more efficent in terms of energy use - by nearly two orders of magnitude.”
Our reading: The neurosymbolic hybrid used nearly two orders of magnitude less energy than the VLAs in the Tufts study.
No horizon Evidence as of
Limitation: The outcome depends on interpreting the statement as a training comparison.
Assessment: UnresolvedSaid
Observation
“You can read the full paper by Timothy Duggan, Pierrick Lorang, Hong Lu, and Matthias Scheutz, which very much vindicates the Apple reasoning paper, here.”
Our reading: The Tufts paper strongly vindicates the Apple reasoning paper's findings.
No horizon Evidence as of
Limitation: A weaker reading of vindicates as merely consistent with would receive more support.
Assessment: SupportedSaid
Observation
“Claude Code (in particular version 4.6), which does seem genuinely impressive to me and a number of friends I trust, still makes plenty of mistakes, and still can’t be trusted.”
Our reading: Claude Code (in particular version 4.6), which seems genuinely impressive to Marcus and a number of friends he trusts, still makes plenty of mistakes and still can't be trusted.
No horizon Evidence as of
Limitation: The controlled evaluation covers one programming language and a particular task suite.
Assessment: UnresolvedSaid
Observation
“It’s obviously not AGI.”
Our reading: Claude Code is not AGI.
No horizon Evidence as of
Limitation: This is an evidentiary finding, not a finding that Claude Code was AGI.
Assessment: Can’t be checkedSaid
Observation
“But there is more and more reason to think that neurosymbolic AI is a stronger starting point, with potential for better generalization and more efficient performance.”
Our reading: Evidence increasingly suggests neurosymbolic AI is a stronger starting point than pure LLMs, with potential for better generalization and efficiency.
No horizon
Qualifier: compared with LLMs
Assessment: Can’t be checkedSaid
Recommendation or value judgment
“As a society we could spend another trillion dollars pursue LLMs, or a trillion dollars seeking new, hybrid approaches. I for one know which I would pick.”
Our reading: Given a choice between spending another trillion dollars on LLMs or a trillion dollars on new hybrid approaches, Marcus says he knows which he would pick, implicitly the hybrid approaches.
No horizon
Qualifier: stated as personal preference between hypothetical investments
Held from this post (3)
These records did not pass every check, so nothing about them is published. Held is not a finding.
- The two reviews read the claim differently
- The criteria are ambiguous. Our reading, not assessed: A neurosymbolic approach is not a panacea, only a starting point.
- The two reviews read the claim differently