Claims checked against evidence, page 10 of 31
Claims by Gary Marcus and Ed Zitron. Deadlines are judged as of 2026-10-29.
Claims checked against evidence (3100)
Each of these claims was checked against dated evidence.
Page 10 of 31: claims 901 to 1000 of 3100, ordered by the date first said, newest first. To find a claim by its words, use search.
Assessment: ContradictedSaid
“Claude Code does not actually build unique software.”
What happened: The report documents Claude Code producing machine-checked verification code for an ANF transformation whose corresponding proof had previously been left as future work. It adapted an existing CPS proof under expert guidance, adding a distinct verified property rather than merely reproducing the template; February 23 dates the public artifact report, not an asserted exact completion day. (arXiv — Zoe Paraskevopoulou, )
Assessment: ContradictedSaid
“Every example you've read about somebody being amazed by it has built a toy app or website that's very similar to many open source projects or website templates that Anthropic trained its training data on.”
What happened: Carlini's public account identifies Claude Code sessions, provides source code, and expresses surprise at the achievement. The reported compiler functionality goes substantially beyond a small app or website, although the account also discloses dependencies, defects and extensive human work on the testing environment. (Anthropic, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Although there are some practical use cases, such as coding, it is an inherently unreliable technology.”
What happened: Developer respondents report useful applications in their work, supporting the modest assertion that practical coding uses exist. Self-selection and subjective productivity estimates limit the strength of this evidence. (Stack Overflow, )
Assessment: SupportedSaid
“It is leading some people into serious mental health issues.”
What happened: Clinicians documented hospitalization and concluded from chatlogs that the chatbot facilitated or mediated delusion formation. The same report identifies mood history, stimulant use, sleep deprivation, and a later relapse with little chatbot encouragement as important competing explanations. (Innovations in Clinical Neuroscience, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“They often produce workslop.”
What happened: The survey of 1,100 US AI users at larger employers also reports weekly cleanup and negative consequences from low-quality outputs. Together these support recurring workslop, although revision alone does not necessarily indicate poor quality. (Zapier, distributed by GlobeNewswire, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“However, benchmark success is a limited indicator of general intelligence.”
What happened: Strong GSM8K scores did not hold up under trivial changes. So the benchmark score overstated robust reasoning. (arXiv / ICLR 2025 (Mirzadeh et al., Apple), )
Assessment: SupportedSaid
“Moreover, benchmarks are often easily gamed.”
What happened: Many prominent benchmarks had flaws that allow inflated scores. One even credits empty responses, which shows gaming can be easy. (arXiv (Zhu et al., incl. Stanford, Berkeley, UK AISI researchers), )
Assessment: SupportedSaid
“Reports that language models have produced correct proofs for isolated open problems in mathematics, including specific Erdős problems, do not alter this assessment.”
What happened: Tao described the AI successes as falling on obscure problems that often have straightforward solutions. This matches the post's point that these results do not show deep, general problem-solving. (TechCrunch, )
Assessment: SupportedSaid
“Current AI systems are powerful and increasingly useful tools, but they do not exhibit the flexible, self-directed competence that the original concept of artificial general intelligence was intended to capture.”
What happened: Frontier systems scored under 1% where humans scored 100% on tasks requiring self-directed exploration and goal discovery. This is direct evidence of missing flexible, self-directed competence. (Decrypt, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Task-level performance, even when impressive, is not sufficient evidence of general intelligence.”
What happened: The paper explains how prior knowledge and training can produce task skill without establishing the ability to acquire new skills. This supports the ordinary distinction in the claim, within an explicitly stated measurement framework. (arXiv, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“By the standards articulated in the original definitions of artificial general intelligence—robustness across environments, reliable generalization under novelty, and autonomous goal-directed behavior—current AI systems remain limited.”
What happened: On a benchmark built to test generalization in novel environments, frontier systems from the period (including Claude Opus 4.6, released before the post) scored under 1%. Humans solved every environment. This is a large shortfall on the speaker's named standards. (Decrypt, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“1Some state laws are trying to address these issues, but as we know the Federal government is trying to undermine the states’ abilities to pass and enforce AI regulation.”
What happened: The order directs legal challenges and preparation of federal preemption legislation, and asks agencies to assess conditioning grants on states not enacting or enforcing conflicting AI laws. Section 8 preserves specified categories in the proposed legislation, so the effort is substantial but not universal. (The White House, )
Assessment: SupportedSaid
“Well here’s a new one, you can have OpenClaw call people, and pretend to be human.”
What happened: The released documentation provides outbound telephony, speech providers and message arguments. It establishes the calling component of the claim before publication. (OpenClaw project, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Google and Anthropic have each largely caught up; various Chinese companies are closing in.”
What happened: The original APEX-Agents evaluation places a Google model ahead of OpenAI on professional, multi-application tasks. This supports competitive capability in an important domain, although it is not a universal ranking. (arXiv; Vidgen and colleagues, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“I have been writing for a long time about how OpenAI snarfs the intellectual property of artists and writers.”
What happened: The court records that training on nine disputed song lyrics was undisputed. The following sentence dates their reproduction by the chatbot to 2024, establishing use by that year without supplying the exact training date. (Munich I Regional Court / Bavarian Ministry of Justice, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Back on planet earth, according to December’s Remote Labor Index, only 2.5% of human “online tasks” (physical tasks were excluded) could be done by AI.”
What happened: This dated December account reports the claimed top rate for RLI projects. The event date identifies December reporting of standing results, not new experiments; an institutional summary is used because a precisely dated December primary snapshot was not verified. (United Nations University Campus Computing Centre, )
Assessment: SupportedSaid
“The security of the autogenerated code is very much in question, as for example this article last week noted (precisely as this substack has long warned):”
What happened: A large test across more than 100 LLMs found vulnerabilities in 45% of cases. That is a substantial documented security problem in AI-generated code. (Veracode, )
Assessment: SupportedSaid
“The bottom line is this: LLMs are certainly coding more, but it’s not clear that the code they are creating is secure or trustworthy.”
What happened: A peer-reviewed measurement shows the share of AI-assisted code rising sharply. This supports 'LLMs are certainly coding more'. (Complexity Science Hub via EurekAlert! (study in Science), )
Assessment: SupportedSaid
“LLMs write code wicked fast, but some coders are starting to report burnout, and only relatively modest gains relative to that burnout, as a new story from Connie Loizos at Tech Crunch illustrates”
What happened: The Loizos story exists and reports an engineer at an AI-embracing tech company describing more work, not less. (TechCrunch, )
Assessment: SupportedSaid
“To his credit, Shumer is actually correct that something has changed recently. You really can let things rip more in the most recent systems.”
What happened: METR measured a record jump in autonomous task length for a late-2025 model. That shows recent systems can be left to run on longer tasks. (LessWrong (quoting METR on X), )
Assessment: SupportedSaid
“LLMs still hallucinate and continue to make boneheaded errors.”
What happened: An independent benchmark in November 2025 found that major frontier reasoning models hallucinated in more than 10% of summaries. (Vectara, )
Assessment: SupportedSaid
“And reasoning is still one of the core issues.”
What happened: A comprehensive survey from February 2026 concludes that significant reasoning failures persist in LLMs. (arXiv (Song, Han, Goodman), )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“But at the end of the day, it’s a bit of Coke vs Pepsi: two slightly different products (with their own sets of loyal fans) fighting tooth and nail for more or less the same market.”
What happened: The announcement markets coding alongside research, analysis, and document work. These functions overlap with OpenAI's contemporaneous professional assistant offering. (Anthropic, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Not an all out crash, but an unmistakable sign that its ascent has run out of gas.”
What happened: Nvidia closed at a record on Thursday, August 7, 2025, at about $180.7, implied from the Friday price and gain. This matches Marcus's 'about 181'. (Barron's (Dow Jones) via Tiger Brokers, )
Assessment: SupportedSaid
“They have also faced a lot of backlash for being reckless and irresponsible; hardly a good brand name.”
What happened: An official government statement condemns Grok's handling of intimate deepfake images and calls for regulatory action. It directly establishes prominent backlash over alleged irresponsible conduct. (UK Department for Science, Innovation and Technology, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“It has already been attacked, as researcher Michael Riegler noted yesterday on LinkedIn:”
What happened: The January 31 report covers January 28–31 and reproduces hidden instructions and API-action requests aimed at agents reading platform content. This supports the occurrence of attack attempts before the post; the event date marks the report's collection endpoint. (Michael A. Riegler and Sushant Gautam, Simula and SimulaMet; Zenodo, )
Assessment: SupportedSaid
“The catch is that agents like OpenClaw are built on a foundation of LLMs, and as we well know, LLMs hallucinate and make all kinds of hard to predict and sometimes hard to detect errors.”
What happened: The versioned documentation describes primary and fallback models and provides Claude model configurations. It establishes the language-model foundation of the agent. (OpenClaw project, )
Assessment: SupportedSaid
“OpenClaw itself is basically a cascade of LLMs.”
What happened: The versioned documentation identifies an LLM-and-tool loop as the core execution mechanism. This supports the ordinary shorthand reading of cascade, without establishing a mandatory pipeline of distinct models. (OpenClaw project, )
Assessment: SupportedSaid
“OpenClaw inherits all these weaknesses.”
What happened: Cisco describes invoking a third-party skill against OpenClaw, finding silent data exfiltration and instructions that bypassed the assistant's safety guidelines. This is direct evidence of the specified instruction-to-action weakness in the tested setup. (Cisco AI Threat and Security Research, )
Assessment: SupportedSaid
“AutoGPT had a tendency to report that it had completed tasks that it hadn’t really, and we can expect OpenClaw to do the same.”
What happened: The April 16 case reports OpenClaw claiming a CRM note was posted, while its tool ledger showed no execution and a direct CRM query showed no write. The report specifies OpenClaw 2026.4.14 and the model used. (GitHub user apoorv12, OpenClaw issue tracker, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Today’s swarms, now emerging, can coordinate fleets of synthetic personas—sometimes with persistent identities—and move in ways that are hard to distinguish from real communities.”
What happened: One operator used an LLM to run a fleet of 100+ persona accounts that engaged real users. The same report lists 'creating and maintaining consistent personas across platforms', which matches the persistent-identity claim. (Anthropic, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Venture capital is already helping industrialize astroturfing: Doublespeed, backed by Andreessen Horowitz, advertises a way to “orchestrate actions on thousands of social accounts” and to mimic “natural user interaction” on physical devices so the activity appears human.”
What happened: Establishes the named investor relationship before publication. The amount is incidental; this assessment does not grade a funding-amount claim. (The Observer, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Just a few months later, that dark prediction came to pass, as discussed here in April of 2023. (Causality was indeed hard to prove but the facts did not reflect well on the bot).”
What happened: Shows that by March 2023 a suicide was publicly linked to a chatbot, and that the reported logs did not reflect well on the bot. (Vice (Motherboard), )
Assessment: SupportedSaid
“And it’s just getting worse.”
What happened: In one day in November 2025, four new suicide cases went to court, on top of the Raine suit from August. That points to a sharp rise in reported deaths and lawsuits in late 2025. (Associated Press (via FOX19), )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“And then there is the growing problem of chatbots apparently inducing delusions in humans, that Kashmir Hill and others have been documenting.”
What happened: A study of records from about 54,000 psychiatric patients, covering up to June 2025, found a clear rise over time in documented harmful chatbot use. Worsened delusions were the main harm. (Aarhus University, )
Assessment: SupportedSaid
“By now, there have been several reports of chatbot-associated deaths (both suicide and murder), enough that wikipedia has started keeping track.”
What happened: The dated revision directly establishes Wikipedia's coverage before the post. It collects numerous reported deaths, including Setzer, Raine, Lacey, and the Greenwich murder-suicide; the event date here describes the coverage, not Lacey's death. (Wikipedia contributors, )
Assessment: SupportedSaid
“That deal was OpenAI’s to lose. And they lost it.”
What happened: The joint statement identifies Google's Gemini models and cloud technology as the basis of the next Apple Foundation Models, including personalized Siri. (Google and Apple, )
Assessment: ContradictedSaid
“LLMs are commodities; DeepSeek proved that.”
What happened: The study's January-to-April OpenRouter data show that new models do not uniformly displace competitors and that applications use different model mixes. This cuts against broad interchangeability, although the study is descriptive and covers one marketplace. (Andrey Fradkin, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Many, many people were disappointed with GPT-5, arguably among the most overhyped products in history.”
What happened: The report documents substantial launch-period dissatisfaction. Comment totals are not a count of distinct disappointed people, but the scale and described complaints support more than isolated disappointment. (Ars Technica, )
Assessment: SupportedSaid
“I warned that LLMs might plateau within a year or two, and they have, that OpenAI would be mired in a lot of litigation, and they are.”
What happened: The judicial order identifies separate news-publisher and class-action cases involved in ongoing litigation against OpenAI. Consolidating proceedings does not eliminate the underlying cases. (U.S. District Court, Southern District of New York; copy hosted by ChatGPT Is Eating the World, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Most importantly, other companies like Anthropic and Google caught up; xAI and various Chinese companies aren’t far behind.”
What happened: The accompanying comparison gives Claude Opus 4.5 and GPT-5.1 scores of 70, Gemini 3 Pro 73, Grok 4 65, and Kimi K2 Thinking 67 on the same index. This supports the leading-tier comparison and xAI's competitive position. (Artificial Analysis, )
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“His defensive, empty response to investor Brad Gerstner in which he couldn’t begin to explain how he would make financial ends meet was atrocious and utterly unconvincing.”
What happened: The report quotes Altman connecting future revenue to continued ChatGPT growth, an AI cloud business, consumer devices and scientific applications. That is a high-level account of the intended funding mechanism, although it does not reconcile future cash receipts with commitments. (Fortune, republished by Yahoo Finance, )
Assessment: SupportedSaid
“I also warned that LLMs would continue to have a truthiness problem and they have.”
What happened: OpenAI explicitly acknowledges persistent hallucinations in GPT-5. The same sentence reports improvement, which is compatible with Marcus's claim that the problem continued. (OpenAI, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Update: This is consistent with the finding of the Remote Labor Index that AI could only do about 2.5% of jobs, reported recently by the Washington Post.”
What happened: The original report states exactly the cited leading automation rate for its real-world project benchmark. It measures successful end-to-end project completion, not the percentage of all jobs that AI can perform or the value of human–AI assistance. (Center for AI Safety and Scale AI / arXiv, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“LLMs can still cannot be trusted:”
What happened: The evaluation covers 6,000 questions across six domains. Only three evaluated models scored above an index value representing equal numbers of correct and incorrect answers, supporting continued verification of factual outputs. (Artificial Analysis / arXiv, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: MixedSaid
“Deep Impact, my analysis of the DeepSeek situation and why it scared the American AI industry (clue: it's cost-related and nothing to do with "national security").”
What held: The surrounding report attributes the selloff to DeepSeek challenging incumbent products while suggesting development costs could fall rapidly. This supports the cost-related component; the quoted market loss is evidence of the reaction, not a separate financial claim being graded. (Reuters, republished by ThePrint, )
What did not: Amodei explicitly connects DeepSeek's releases to stronger export controls and discusses military dominance and US national security. This contradicts excluding security from the industry's expressed concerns, although it cannot establish his private motivation. (Dario Amodei, Anthropic CEO, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“how data center developers have no exit route, and US economic growth has become shouldered entirely by big tech.”
What happened: BEA identifies health care among the leading contributors to increased services consumption. This contradicts the ordinary claim that growth came exclusively from big tech, without establishing a company-level share of GDP growth. (U.S. Bureau of Economic Analysis, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Why LLMs just can’t stop hallucinating.”
What happened: On a summarization faithfulness benchmark, leading frontier models from several labs hallucinated in over 10% of summaries in November 2025. (Vectara, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“The market for AI compute is not actually growing. In the last two years, no new major consumers of AI compute have emerged.”
What happened: The study identifies Colossus among systems deployed in 2024 and documents its leading scale by March 2025. This establishes a major standalone consumer beyond OpenAI, Anthropic and the hyperscalers within the claimed window. (arXiv; Konstantin F. Pilz and coauthors, )
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“I want to be really, abundantly clear about what’s happening: every single stock you see “growing because of AI” outside of those selling RAM and GPUs is actually growing because of something else.”
What happened: Reuters reports an almost 9% early-trading gain after an AI-demand-driven forecast increase and connects the broader rally to AI tools and defense spending. This supports AI as a contributor, while acknowledging a material competing explanation. (Reuters, republished by Yahoo Finance, )