Contradicted claims by Gary Marcus
Deadlines are judged as of 2026-10-29. About Gary Marcus and the sources covered.
Contradicted claims by Gary Marcus (40)
The dated evidence goes against what the claim committed to, under the criteria frozen before grading.
Showing 40 of 40 claims, ordered by the date first said, newest first.
Assessment: ContradictedSaid
Observation
“It is also clear that the current administration in DC— deeply tied to the big tech companies — is unwilling to do anything about it.”
Our reading: The current US administration, closely tied to big tech, is unwilling to do anything about AI risks.
No horizon Evidence as of
Limitation: The outcome depends on reading 'anything' broadly and examining the administration's term-wide record.
Assessment: ContradictedSaid
Observation
“But the Trump administration hasn’t done a thing. No investigation, no statement, no product recall, nothing, other than to invite Sam and Jensen to a state dinner.”
Our reading: The Trump administration has taken no investigative, communicative, or recall action over the AI agent incidents.
No horizon Evidence as of
Limitation: The exact start date of the FTC probe is not public. The only timing given is 'several weeks' before September 30, and the probe was first reported after the post.
Source: BREAKING: AI agent incident toll has risen to tens of thousands
Assessment: ContradictedSaid
Observation
“And once again OpenAI concealed the crime for months, perhaps not revealing things until they were pressured into doing so.”
Our reading: OpenAI once again concealed what Marcus calls a crime, its AI agent's infiltration of an Australian government website, for months, and perhaps did not reveal it until it was pressured to.
No horizon Evidence as of
Limitation: Earlier internal knowledge, if established, could change the result.
Source: “I think the answer is we have to shut the labs down” - Jensen Huang
Assessment: ContradictedSaid
Observation
“Nobody wants this, and the economics make no sense.”
Our reading: There is essentially no public appetite for the AI data center buildout.
No horizon Evidence as of
Limitation: The survey was published on August 26, after the August 21 post, but its fieldwork falls within the assessment window [e1].
Source: Data center madness
Assessment: ContradictedSaid
Observation
“There was no new theory, no new techniques, and as impressive as it is, it is not on remotely on par with the development of calculus, algebra, logarithms, probability, the decimal system, information theory, the concept of zero.”
Our reading: Astra's results contain no new theory or techniques and are nowhere near the significance of history's major mathematical developments.
No horizon Evidence as of
Limitation: Interpretation determines the result: major general methods would be a narrower reading of techniques.
Source: OpenAI’s amazing — but vastly oversold — new model Astra
Assessment: ContradictedSaid
Observation
“Yesterday's tweet and blog were marketing, not science. Neither of those nor the 249-page math article that went with them give any information about how this was accomplished:”
Our reading: OpenAI's Astra announcement was marketing rather than science and disclosed no information about how the results were achieved.
No horizon Evidence as of
Limitation: The verdict concerns no information, not the stronger question of adequate scientific disclosure.
Source: OpenAI’s amazing — but vastly oversold — new model Astra
Assessment: ContradictedSaid
Causal claim
“The wildest stat I saw this morning was this: Nvidia is spending so much on circular financing its cash flow is headed towards zero.”
Our reading: Nvidia is spending so much on circular financing that its cash flow is headed towards zero.
No horizon Evidence as of
Limitation: This conclusion uses the ordinary meaning of circular financing as funding customers or partners.
Source: Checking the math behind OpenAI and Anthropic’s latest headlines
Assessment: ContradictedSaid
Observation
“LLMs are commodities; DeepSeek proved that.”
Our reading: LLMs are commodities, as DeepSeek demonstrated.
No horizon Evidence as of
Limitation: The demand study covers one marketplace through April 2025, not the whole market through January 13, 2026 [e2].
Assessment: ContradictedSaid
Observation
“(It’s only when ChatGPT eclipsed Meta that LeCun began to be sharply, publicly critical of LLMs)”
Our reading: LeCun began to be sharply and publicly critical of LLMs only when ChatGPT eclipsed Meta.
No horizon Evidence as of
Limitation: The decisive essay was coauthored.
Assessment: ContradictedSaid
Observation
“They do not sanity check their own work.”
Our reading: LLMs do not sanity check their own work.
No horizon Evidence as of
Limitation: SCoRe used specialized training; its results do not establish that every model checks every answer [e1].
Assessment: ContradictedSaid
Observation
“In the real world, only one theorem of middling importance (the Robbins conjecture) has ever been proved autonomously by an AI system, and that was back in 1996.”
Our reading: Only one theorem of middling importance (the Robbins conjecture, 1996) has ever been proved autonomously by an AI system.
No horizon Evidence as of
Limitation: Mathematical importance is qualitative; the sources do not supply an exact comparison with Robbins.
Source: DeepMind and OpenAI achieve IMO Gold. What does it all mean?
Assessment: ContradictedSaid
Observation
“Absolutely nothing is being done about AI-generated misinformation, political or medical.”
Our reading: Nothing is being done about political or medical AI-generated misinformation.
No horizon Evidence as of
Limitation: The measure targets caller authentication and transmission practices, not every form of misinformation.
Source: Two Years Ago Today in AI History: The Tale of An About-face in AI Regulation
Assessment: ContradictedSaid
Observation
“Now he is doing everything he can to stop AI regulation of any meaningful sort.”
Our reading: Sam Altman is doing everything he can to stop meaningful AI regulation.
No horizon Evidence as of
Limitation: OpenAI's endorsement establishes an institutional position, not a separate personal endorsement by Altman or his private beliefs.
Source: Two Years Ago Today in AI History: The Tale of An About-face in AI Regulation
Assessment: ContradictedSaid
Observation
“The shift in norms has extended to our government, too; gone are the days when Washington was afraid of the risks of AI enough to seriously consider doing anything about them.”
Our reading: Washington no longer seriously considers acting on AI risks.
No horizon Evidence as of
Limitation: Targeted measures do not establish comprehensive regulation of frontier AI developers.
Source: Two Years Ago Today in AI History: The Tale of An About-face in AI Regulation
Assessment: ContradictedSaid
Causal claim
“And they have such a superficial understanding of their own output that they can’t begin to fact check it.”
Our reading: LLMs have such a superficial understanding of their own output that they can't even begin to fact-check it.
No horizon Evidence as of
Limitation: The verdict turns on the stronger inability claim. A claim of unreliable self-checking would receive a different assessment.
Assessment: ContradictedSaid
Observation
“If the juicing of benchmarks and “blending” of test data is the primary scandal, there is a secondary scandal too: a bunch of well-paid pundits, such as Roose, Newton, and Cowen, are failing to reckon with the repeated failures of massive companies to build GPT-5.”
Our reading: A number of well-paid pundits, such as Roose, Newton and Cowen, are failing to reckon with the repeated failures of massive companies to build GPT-5, which Marcus calls a secondary scandal next to benchmark juicing.
No horizon Evidence as of
Limitation: The result depends on reading reckoning as substantive consideration, rather than agreement about how much weight setbacks deserve.
Source: Deep Learning, Deep Scandal
Assessment: ContradictedSaid
Observation
“Scaling has run out (like I said it would)”
Our reading: Scaling of LLMs has run out as of April 2025.
No horizon Evidence as of
Limitation: The assessment interprets 'run out' as cessation of meaningful capability gains, rather than poor economic returns.
Source: Scaling is over, the bubble may be deflating, LLMs still can’t reason, and you can’t trust Sam
Assessment: ContradictedSaid
Forecast
“The new administration will do everything in its power to protect businesses, and nothing to protect individuals.”
Our reading: The new administration will do everything in its power to protect businesses, and nothing to protect individuals.
Settled before its deadline Evidence as of
Limitation: The enactment records do not measure enforcement or effectiveness.
Source: Everything I warned about in Taming Silicon Valley is rapidly becoming our reality
Assessment: ContradictedSaid
Forecast
“All that we will have this year are demos.”
Our reading: In 2025, AI agents will exist only as demos.
Deadline passed Evidence as of
Limitation: The result depends on reading 'demos' as covering all AI agent products, not only general-purpose ones.
Assessment: ContradictedSaid
Observation
“The remaining thirteen it got wrong in all three attempts.”
Our reading: In the authors' 17 part-specification experiments, ChatGPT with DALL-E3 got 13 wrong in all three attempts.
No horizon Evidence as of
Limitation: This is a counting finding, not an independent visual assessment of every output.
Source: Don’t Ride This Bike! Generative AI’s persistent trouble with compositionality and parts
Assessment: ContradictedSaid
Observation
“The difference between GPT-3 and GPT-4 was by all accounts massive; the difference between GPT-4 and o1 is by all accounts modest.”
Our reading: By all accounts the difference between GPT-3 and GPT-4 was massive, while by all accounts the difference between GPT-4 and o1 is modest.
No horizon Evidence as of
Limitation: The later comparisons use GPT-4o and o1-preview, rather than original GPT-4 and a later o1 release [e1–e3].
Assessment: ContradictedSaid
Observation
“We have been told that AI will “solve physics” (per Sam Altman), make major breakthroughs in medicine, battery technology, etc, but so far none of that has materialized.”
Our reading: None of the promised AI advances, such as 'solving physics' (per Sam Altman) or major breakthroughs in medicine and battery technology, has materialized so far.
No horizon Evidence as of
Limitation: The contradiction depends on including basic medical research within medicine; the evidence does not establish transformative clinical benefits [e1, e2].
Assessment: ContradictedSaid
Observation
“In the new form, SB 1047 can basically only be used only after something really bad happens, as a tool to hold companies liable. It can no longer protect us against obvious negligence that might likely lead to great harm.”
Our reading: In its new form, SB-1047 can basically only be used after something really bad happens, as a tool to hold companies liable, and it can no longer protect against obvious negligence that might likely lead to great harm.
No horizon Evidence as of
Limitation: The decisive source is the bill sponsor's explanation, rather than a clean statutory transcription.
Assessment: ContradictedSaid
Forecast
“I fully expect that the generative AI bubble will begin to burst within the next 12 months, for many reasons:”
Our reading: The generative AI bubble will begin to burst by July 28, 2025.
Deadline passed Evidence as of
Limitation: The result depends on interpreting burst as a broad, sustained unwinding.
Source: AlphaProof, AlphaGeometry, ChatGPT, and why the future of AI is neurosymbolic
Assessment: ContradictedSaid
Observation
“The current approach has reached a plateau”
Our reading: The current generative AI approach has reached a plateau.
No horizon Evidence as of
Limitation: Arena preferences can reflect presentation as well as correctness.
Source: AlphaProof, AlphaGeometry, ChatGPT, and why the future of AI is neurosymbolic
Assessment: ContradictedSaid
Observation
“He doesn’t specify which actual restrictions in the proposal bill would “stifle AI models”.”
Our reading: Andrew Ng's critique does not identify which specific SB-1047 provisions would stifle AI model builders.
No horizon Evidence as of
Limitation: This assessment does not validate Ng's legal interpretation or his prediction about innovation.
Assessment: ContradictedSaid
Causal claim
“This is why driverless cars are still just demos, and why LLMs will never be reliable.”
Our reading: Poor generalization beyond training data is why driverless cars are still just demos.
No horizon Evidence as of
Limitation: The decisive operational account is the company's regulatory filing.
Assessment: ContradictedSaid
Observation
“In some ways we have made progress, but in the ones I keep harping on—factuality and compositionality—we have not.”
Our reading: Generative AI has made no progress on factuality and compositionality since 2022, despite progress in other respects.
No horizon Evidence as of
Limitation: The verdict depends on reading progress as measurable improvement rather than complete resolution.
Source: Horse rides Astronaut, redux
Assessment: ContradictedSaid
Observation
“As a journal reviewer, I would also note that they reported neither the p value they obtained, nor the test of statistical significance they applied; in a competent peer-reviewed journal, that’s a no-no.”
Our reading: OpenAI's paper reported neither the p value obtained nor the significance test applied, which would be unacceptable in a competent peer-reviewed journal.
No horizon Evidence as of
Limitation: The p-values are in a linked CSV rather than stated directly in footnote C.
Source: Diving deep into OpenAI’s new study on LLM’s and bioweapons
Assessment: ContradictedSaid
Observation
“I realize there’s been almost zero public disclosure of how any of the driverless car companies are using remote operators. It’s not just Cruise.”
Our reading: Driverless car companies in general have disclosed almost nothing publicly about their use of remote operators.
No horizon Evidence as of
Limitation: The result depends on reading the claim as about disclosure of operators’ roles, rather than complete quantitative transparency.
Assessment: ContradictedSaid
Observation
“Essentially none of the fancy cognitive things GPT-4 is rumored to do stand up.”
Our reading: Essentially none of the advanced cognitive abilities attributed to GPT-4 hold up under scrutiny.
No horizon Evidence as of
Limitation: The result depends on counting controlled reasoning performance among the unspecified 'fancy cognitive things'.
Source: GPT-5 and irrational exuberance
Assessment: ContradictedSaid
Observation
“None of the top labs actually is remotely transparent, governance basically doesn’t exist yet, and there are basically no safeguards actually in place.”
Our reading: None of the top AI labs is remotely transparent.
No horizon Evidence as of
Limitation: The result depends on counting substantive model disclosures as meaningful laboratory transparency.
Source: The Open Letter Controversy
Assessment: ContradictedSaid
Observation
“At present, anybody can release AI at whatever scale they like, with virtually no oversight, literally overnight.”
Our reading: At present, anybody can release AI at whatever scale they like, with virtually no oversight, literally overnight.
No horizon Evidence as of
Limitation: The assessment uses the contract’s global reading; it does not settle a United States-only claim.
Assessment: ContradictedSaid
Observation
“To my knowledge, tech companies are free to leverage a human gullibility around chatbot technologies however they like, without consequence”
Our reading: To his knowledge, tech companies can exploit human gullibility about chatbots however they like without consequence.
No horizon Evidence as of
Limitation: The action concerned data protection and vulnerable users; it was not a finding that simulated affection itself was unlawful.
Source: Don’t Go Breaking My Heart
Assessment: ContradictedSaid
Observation
“There was a lot of bluster (we will 100x the world’s productivity) but no road map.”
Our reading: The Optimus presentation contained bluster about productivity but no road map.
No horizon Evidence as of
Limitation: The delivery estimate was explicitly tentative [e1]. The evidence does not establish whether the proposed sequence or timing was later achieved.
Source: Sub-Optimal
Assessment: ContradictedSaid
Observation
“we were right to be skeptical; so far, four and half years later, Duplex hasn’t gotten a whole lot further.)”
Our reading: Four and a half years after its announcement, Google Duplex has not progressed much past its limited demo stage.
No horizon Evidence as of
Limitation: The degree of progress is qualitative.
Source: Did GoogleAI Just Snooker One of Silicon Valley’s Sharpest Minds?
Assessment: ContradictedSaid
Observation
“(LLM’s like GPT produce well-formed prose but do not produce interpretable representations of utterances that reflect structured relationships between the parts of those sentences.)”
Our reading: LLMs like GPT write well-formed prose but do not produce interpretable representations of the structured relationships between the parts of sentences.
No horizon Evidence as of
Limitation: The experiments use task-specific examples and bounded semantic-parsing domains.
Source: Three ideas from linguistics that everyone in AI should know
Assessment: ContradictedSaid
Causal claim
“Current systems simply do not postulate such cognitive models—and so, they technically can’t prove themselves wrong, because they do not even have a representation of what being “right” would look like.”
Our reading: Current systems do not postulate cognitive models, so they technically cannot prove themselves wrong, because they have no representation of what being right would look like.
No horizon Evidence as of
Limitation: The result depends on treating independently assessable self-critique as demonstrating an error.
Source: Three ideas from linguistics that everyone in AI should know
Assessment: ContradictedSaid
Causal claim
“The downstream consequence of all of this is that these models have no grasp whatsoever on truth.”
Our reading: As a downstream consequence of their lack of reference and cognitive models, large language models have no grasp whatsoever on truth.
No horizon Evidence as of
Limitation: The outcome depends on a functional reading of grasp and inclusion of fine-tuned language models.
Source: Three ideas from linguistics that everyone in AI should know
Assessment: ContradictedSaid
Forecast
“They do not gravitate towards human language, and they never develop a cohesive undestanding of the world, no matter how much experience they have.”
Our reading: Systems like GPT-3 do not gravitate towards human language, and they never develop a cohesive understanding of the world, no matter how much experience they have.
Settled before its deadline Evidence as of
Limitation: The contradiction applies to the language-learning component of the combined assertion.
Source: Noam Chomsky and GPT-3
No claims match. Remove a filter or change the search, or clear everything.