Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Claims checked against evidence, page 18 of 31

Claims by Gary Marcus and Ed Zitron. Deadlines are judged as of 2026-10-29.

Claims checked against evidence (3100)

Each of these claims was checked against dated evidence.

Page 18 of 31: claims 1701 to 1800 of 3100, ordered by the date first said, newest first. To find a claim by its words, use search.

  1. Assessment: SupportedSaid

    Ed Zitron

    “OpenAI burned more than $5 billion last year.”

    What happened: The reported 2024 net loss exceeds the stated threshold. This supports the passage's inclusive loss interpretation, not a claim about cash consumption. (Ars Technica, )

  2. Assessment: UnresolvedSaid

  3. Assessment: UnresolvedSaid

  4. Assessment: UnresolvedSaid

  5. Assessment: UnresolvedSaid

  6. Assessment: MixedSaid

    Ed Zitron

    “The one "big thing" that they've been able to do is to use "reasoning" to make the Large Language Models "think" (they do not have consciousness, they are not "thinking," this just means using more tokens to answer a particular question and having multiple models check the work), which mostly results in them being a bit more accurate when generating an answer, but at the expense of speed and cost.”

    What held: The developer acknowledges cost and speed limitations in the o1 discussion. This supports that part of the claim, but does not establish a universal tradeoff or predominantly small accuracy gains. (OpenAI, )

    What did not: Appendix A reports AIME pass@1 scores of 44.6 for o1-preview and 9.3 for GPT-4o, showing substantial gains on a demanding reasoning task. These selected evaluations challenge the modest-gain characterization, but cannot determine gains across all ordinary usage. (OpenAI, )

  7. Assessment: UnresolvedSaid

  8. Assessment: SupportedSaid

    Ed Zitron

    “User numbers alone tell you nothing about the sustainability or profitability of a business, or how those people use the product.”

    What happened: The disclosed figure is an aggregate weekly activity count. The inference supporting the claim is limited: this count does not encode profit, retention, purposes, or the distribution of activity across days. (PYMNTS, )

  9. Assessment: UnresolvedSaid

  10. Assessment: UnresolvedSaid

  11. Assessment: UnresolvedSaid

  12. Assessment: UnresolvedSaid

  13. Assessment: UnresolvedSaid

  14. Assessment: SupportedSaid

    Gary Marcus

    “About year ago the City of New York tried this kind of thing, with less than spectacular results:”

    What happened: The reporters tested the operating city chatbot and documented incorrect guidance about housing vouchers, cash payments, and workers’ tips. Ten staff members received the same incorrect voucher answer, supporting repeated unreliability. (The Markup, )

  15. Assessment: UnresolvedSaid

  16. Assessment: UnresolvedSaid

  17. Assessment: UnresolvedSaid

  18. Assessment: UnresolvedSaid

  19. Assessment: UnresolvedSaid

  20. Assessment: SupportedSaid

  21. Assessment: SupportedSaid

    Gary Marcus

    “Second, pure scaling will no longer be the means of attack.”

    What happened: The release documents a system combining fast responses with deeper reasoning and routing. Those mechanisms establish that GPT-5 goes beyond increasing pretraining data and parameters alone. (OpenAI, )

  22. Assessment: UnresolvedSaid

  23. Assessment: UnresolvedSaid

  24. Assessment: ContradictedSaid

    Gary Marcus

    “The new administration will do everything in its power to protect businesses, and nothing to protect individuals.”

    What happened: Trump signed legislation creating criminal prohibitions and removal obligations protecting people from nonconsensual intimate imagery. This completed action contradicts the prediction of doing nothing for individuals. (The White House, )

  25. Assessment: SupportedSaid

    Ed Zitron

    “There were multiple other companies doing exactly what GPT-3 did months before ChatGPT launched.”

    What happened: The announcement offers Jurassic-1 through an open-beta API and web environment and describes text generation, question answering, and classification. It establishes one other company's comparable functional offering well before the cutoff. (AI21 Labs, )

  26. Assessment: UnresolvedSaid

  27. Assessment: UnresolvedSaid

  28. Assessment: SupportedSaid

    Gary Marcus

    “Even the latest systems like Deep Research are still struggling in a few ways – and those ways pretty much correspond exactly to the places that I warned would be LLM’s Achilles’ Heels: hallucinations and reasoning errors.”

    What happened: The paragraph expressly identifies factual hallucinations and incorrect inferences as remaining limitations. It also reports a lower rate than existing ChatGPT models, which qualifies the severity without contradicting their continued presence. (OpenAI, )

  29. Assessment: UnresolvedSaid

  30. Assessment: UnresolvedSaid

  31. Assessment: SupportedSaid

    Gary Marcus

    “To some extent newer models are doing that.”

    What happened: Section 2.2.2 describes programmed accuracy and formatting rewards for R1-Zero, including code tests. Section 2.3.4 explicitly applies its rule-based reasoning reward methodology to R1, supporting the limited training-time combination described by Marcus. (DeepSeek-AI, arXiv, )

  32. Assessment: SupportedSaid

    Gary Marcus

    “Me, December 2022: The problem with LLMs is that they hallucinate, and their errors can be hard to catch.”

    What happened: Kubacka describes checking plausible scientific citations and discovering nonexistent articles, mismatched identifiers, and invented physics. She reports that an explanation in her own field initially made her reconsider whether the invented phenomenon existed, directly supporting the possibility of difficult-to-detect errors. (Teresa Kubacka, Lookalikes and Meanders, )

  33. Assessment: UnresolvedSaid

  34. Assessment: UnresolvedSaid

  35. Assessment: UnresolvedSaid

  36. Assessment: UnresolvedSaid

  37. Assessment: UnresolvedSaid

  38. Assessment: UnresolvedSaid

  39. Assessment: UnresolvedSaid

  40. Assessment: UnresolvedSaid

  41. Assessment: UnresolvedSaid

  42. Assessment: UnresolvedSaid

  43. Assessment: UnresolvedSaid

  44. Assessment: SupportedSaid

    Gary Marcus

    “And that’s just not realistic given the current state of AI.”

    What happened: The launch disclosure identifies source-discrimination and uncertainty-communication weaknesses directly relevant to dependable research. These support the ordinary reading that the output required substantive checking. (OpenAI, )

  45. Assessment: UnresolvedSaid

  46. Assessment: UnresolvedSaid

  47. Assessment: UnresolvedSaid

  48. Assessment: UnresolvedSaid

  49. Assessment: UnresolvedSaid

  50. Assessment: SupportedSaid

    Gary Marcus

    “The basic conjecture then — which has already been confirmed to some degree – was that LLMs would be used to write garbage content undermining the value of the internet itself.”

    What happened: NewsGuard traced a viral false psychiatrist story to a site it classified as AI-generated and documented subsequent dissemination. This is a concrete information-quality harm, although its attribution of this particular rewrite to AI is qualified. (NewsGuard, )

  51. Assessment: SupportedSaid

    Gary Marcus

    “Sam Altman just released a fancier remake Deep Research, which, like Meta’s predecessor, can write science-sounding articles on demand, on any topic of your choice.”

    What happened: The launch documentation describes user prompts producing comprehensive, cited reports across science, finance, policy, engineering, and consumer topics. This establishes the broad report-generation capability in the comparison. (OpenAI, )

  52. Assessment: UnresolvedSaid

  53. Assessment: SupportedSaid

    Gary Marcus

    “The real lesson of DeepSeek is that we can still make vast improvements in efficency.”

    What happened: The report documents the training resources of the December V3 model and compares its performance with leading models. Its resource total covers the official training stages and excludes earlier research and ablation experiments; the comparative magnitude is supplied by e2. (DeepSeek-AI / arXiv, )

  54. Assessment: SupportedSaid

    Ed Zitron

    “DeepSeek's models don't require massive new data centers (they run on the GPUs currently used to run services like ChatGPT, and can even work on more austere hardware), nor do they require an endless supply of bigger, faster NVIDIA GPUs every year to progress.”

    What happened: The report identifies the hardware actually used and describes training-efficiency improvements and deployment on H800s. It supports the existing-hardware route, although it is a company report and does not document the construction history of the facility. (DeepSeek-AI, )

  55. Assessment: UnresolvedSaid

  56. Assessment: UnresolvedSaid

  57. Assessment: UnresolvedSaid

  58. Assessment: UnresolvedSaid

  59. Assessment: UnresolvedSaid

  60. Assessment: UnresolvedSaid

  61. Assessment: UnresolvedSaid

  62. Assessment: UnresolvedSaid

  63. Assessment: SupportedSaid

    Ed Zitron

    “One thing we do know is that OpenAI and Anthropic will now have to either drop the price of accessing their models, and potentially even the cost of their subscriptions.”

    What happened: The announcement says the reduction is in effect and applies to the same o3 model. This establishes OpenAI's part of the prediction. (OpenAI, )

  64. Assessment: UnresolvedSaid

  65. Assessment: UnresolvedSaid

  66. Assessment: UnresolvedSaid

  67. Assessment: UnresolvedSaid

  68. Assessment: UnresolvedSaid

  69. Assessment: UnresolvedSaid

  70. Assessment: UnresolvedSaid

  71. Assessment: UnresolvedSaid

  72. Assessment: MixedSaid

    Ed Zitron

    “The launch of its "Operator" "agent" was a joke — a barely-functional product that is allegedly meant to control your computer and take distinct actions, but doesn't seem to work.”

    What held: The tester reports five failures involving web research and online tools. These show real launch limitations, but the small, relatively demanding task set is not a representative consumer success-rate estimate. (Zengyi Qin / Hugging Face Community, )

    What did not: Newton describes successful browser research producing walking-tour links and a completed lesson-plan task. His same review documents substantial shopping friction, so these successes limit the broad dismissal without establishing reliable autonomy. (Platformer / Casey Newton, )

  73. Assessment: UnresolvedSaid

  74. Assessment: ContradictedSaid

    Ed Zitron

    “Large Language Models (and reasoning models) are niche.”

    What happened: The November survey estimated broad public participation, with search, explanation and writing leading uses. Material qualifications in this same source are possible online-panel selection bias and light usage: its conservative weekly-use estimate was about 29%, and most adults did not use LLMs in a typical week. (Rethink Priorities, )

  75. Assessment: UnresolvedSaid

  76. Assessment: UnresolvedSaid

  77. Assessment: UnresolvedSaid

  78. Assessment: SupportedSaid

    Ed Zitron

    “Whether or not someone chooses to pay DeepSeek is largely irrelevant — someone else will take what it’s created and build their own, or people will start running their own DeepSeek instances renting GPUs from one of the various cloud computing firms.”

    What happened: Skywork records the release of its final OR1 models on May 13 and explicitly identifies DeepSeek's distilled models as their starting points. This is an actual third-party derivative release after the forecast. (Skywork AI, )

  79. Assessment: MixedSaid

    Ed Zitron

    “They're running out of training data, and the actual capabilities of these models were peaking as far back as March 2024.”

    What held: The estimate supports an approaching constraint on usable human-generated public text under continuing scaling trends. It does not show that data was already exhausted, and the discussion identifies other data sources and ways progress could continue. (Epoch AI, )

    What did not: Using its baseline testing framework, ARC Prize reports public-evaluation scores of 21.2% for o1-preview and 9% for GPT-4o. This is post-March capability progress, although the evaluator also reports substantially greater inference time. (ARC Prize, )

  80. Assessment: ContradictedSaid

    Ed Zitron

    “The current models developed by both the hyperscalers (Gemini, Llama, et. al) and multi-billion-dollar "startups" like OpenAI and Anthropic are horribly inefficient, I had just made the mistake of assuming that they'd actually tried to make them more efficient.”

    What happened: Meta describes concrete changes to parallelization, reliability, storage and training infrastructure, alongside inference optimizations. This is substantive efficiency engineering, although the improvement magnitude is company-reported. (Meta, )

  81. Assessment: SupportedSaid

    Gary Marcus

    “DeepSeek r1 is not smarter than earlier models, just trained more cheaply”

    What happened: The release report characterizes R1 as comparable to o1 overall. Its detailed results also limit that conclusion: R1 slightly exceeds o1 on AIME and exceeds several older models, while trailing o1 on several knowledge benchmarks. (DeepSeek-AI / arXiv, )

  82. Assessment: UnresolvedSaid

  83. Assessment: UnresolvedSaid

  84. Assessment: SupportedSaid

    Gary Marcus

    “It doesn't solve hallucinations or problems with reliability.”

    What happened: DeepSeek reports prompt sensitivity in the released R1 model. This establishes a continuing reliability limitation, though it does not itself measure hallucinations. (DeepSeek-AI / arXiv, )

  85. Assessment: UnresolvedSaid

  86. Assessment: UnresolvedSaid

  87. Assessment: UnresolvedSaid

  88. Assessment: SupportedSaid

    Gary Marcus

    “This morning, Nvidia is down more than 10% in pretrading.”

    What happened: The report explicitly places these losses in pre-market trading that morning. Its approximately 12% decline exceeds the claim's 10% threshold. (Associated Press, syndicated by Spectrum News NY1, )

  89. Assessment: UnresolvedSaid

  90. Assessment: SupportedSaid

    Gary Marcus

    “None of this means however that China won the AI race or even took the lead. American companies will incorporate these new results and continue to produce new results of their own.”

    What happened: NVIDIA explicitly developed a model from an R1-distilled checkpoint. Its report describes additional reinforcement-learning experiments and improved mathematics and coding results, establishing adoption and a further technical contribution. (NVIDIA Research, )

  91. Assessment: UnresolvedSaid

  92. Assessment: UnresolvedSaid

  93. Assessment: SupportedSaid

    Gary Marcus

    “On LLMs China is already catching up.”

    What happened: The preceding sentence gives end-2023 U.S.–China gaps of 17.5, 13.5, 24.3 and 31.6 percentage points on MMLU, MMMU, MATH and HumanEval. All four narrowed by end-2024, including the language, mathematics and coding measures directly relevant to this claim. (Stanford Institute for Human-Centered Artificial Intelligence, )

  94. Assessment: SupportedSaid

    Gary Marcus

    “Today he walked it back.”

    What happened: Shows that on 20 January 2025 Altman publicly said OpenAI had not built AGI and would not deploy it next month, which plays down the closeness he had suggested. (Decrypt, )

  95. Assessment: UnresolvedSaid

  96. Assessment: UnresolvedSaid

  97. Assessment: UnresolvedSaid

  98. Assessment: UnresolvedSaid

  99. Assessment: SupportedSaid

    Gary Marcus

    “And those demos won’t work all that reliably.”

    What happened: In the 2025 revision, the best agent finished only 30% of realistic workplace tasks on its own. That is far from reliable. (arXiv (Carnegie Mellon University et al.), )

  100. Assessment: UnresolvedSaid