Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Claims checked against evidence, page 8 of 31

Claims by Gary Marcus and Ed Zitron. Deadlines are judged as of 2026-10-29.

Claims checked against evidence (3100)

Each of these claims was checked against dated evidence.

Page 8 of 31: claims 701 to 800 of 3100, ordered by the date first said, newest first. To find a claim by its words, use search.

  1. Assessment: UnresolvedSaid

  2. Assessment: UnresolvedSaid

  3. Assessment: UnresolvedSaid

  4. Assessment: UnresolvedSaid

  5. Assessment: MixedSaid

    Ed Zitron

    “This does not really make sense given the fact that all support documents and the Claude website reflect that Pro users do not have access to Claude Code.”

    What held: The clarification acknowledges the public documentation problem and subsequently says the changes confused people outside the experiment. This supports the messaging criticism, not a finding that the enrollment percentage was false. (Amol Avasare, Anthropic, )

    What did not: The reporter identifies the Claude Code product page as still advertising Pro access during the episode. Publication was April 22 at 01:16 UTC, still April 21 in US timezones; the observation contradicts uniform website exclusion. (The Register, )

  6. Assessment: SupportedSaid

    Ed Zitron

    “This might sound like a good thing, but it actually means that each request using Opus 4.7 is actually 7.5 of them.”

    What happened: GitHub explicitly announced the 7.5× promotional rate. This establishes the multiplier described in the claim. (GitHub, )

  7. Assessment: ContradictedSaid

    Ed Zitron

    “The standard version of Claude Opus 4.6 has a premium request multiplier of three — meaning that, even with the promotional pricing, Claude Opus 4.7 is around 250% more expensive to use.”

    What happened: The data file records paid-plan multipliers of 3 for standard Opus 4.6 and 7.5 for Opus 4.7. These confirm the baseline but yield a 150% increase, contradicting the claimed 250% increase. (GitHub, )

  8. Assessment: UnresolvedSaid

  9. Assessment: UnresolvedSaid

  10. Assessment: UnresolvedSaid

  11. Assessment: SupportedSaid

    Gary Marcus

    “Today, even after a very strong week, Oracle stands at just $170.”

    What happened: The filing reports the market price of Oracle shares, using Bloomberg historical data. $169.81 rounds to the claimed $170. (BofA Finance LLC; filing copy hosted by Yahoo Finance, )

  12. Assessment: UnresolvedSaid

  13. Assessment: UnresolvedSaid

  14. Assessment: UnresolvedSaid

  15. Assessment: UnresolvedSaid

  16. Assessment: UnresolvedSaid

  17. Assessment: ContradictedSaid

    Ed Zitron

    “OpenAI and Anthropic need to show continued revenue growth, which means that they must have capacity available for new customers, which means that old customers will always be the first to be punished.”

    What happened: Anthropic expressly protected existing subscribers while testing a restriction on new signups. The accompanying April 22 reporting establishes the date and identifies the affected service. (Amol Avasare, Anthropic, via X, )

  18. Assessment: UnresolvedSaid

  19. Assessment: ContradictedSaid

    Ed Zitron

    “Every “AI agent” story is either about code generation, summarizing some sort of information source, or generating something based on an information source that you may or may not be able to trust.”

    What happened: This published AI-agent story describes operating a shop and executing sales, an application beyond content generation on the stated reading. The event date is the story's publication, because the claim concerns which stories existed. (Anthropic, )

  20. Assessment: UnresolvedSaid

  21. Assessment: UnresolvedSaid

  22. Assessment: UnresolvedSaid

  23. Assessment: ContradictedSaid

    Ed Zitron

    “LLMs will always hallucinate, their outputs are not trustworthy as a result, they cannot be deterministic, and any chance of any mistakes of any kind are unforgivable.”

    What happened: The authors report identical completions for Qwen3-235B-A22B-Instruct-2507 using temperature zero and batch-invariant kernels. The report explains the implementation and supplies a direct counterexample to impossibility. (Thinking Machines Lab, )

  24. Assessment: UnresolvedSaid

  25. Assessment: UnresolvedSaid

  26. Assessment: UnresolvedSaid

  27. Assessment: UnresolvedSaid

  28. Assessment: ContradictedSaid

    Ed Zitron

    “I see no scenario where costs come down, or where rate limits are eased.”

    What happened: The section specifies that its changes are effective that day. Doubling included five-hour allowances on existing plans is a direct easing after the post. (Anthropic, )

  29. Assessment: UnresolvedSaid

  30. Assessment: SupportedSaid

    Gary Marcus

    “On the darker side, it really does arm attackers to a greater degree than Mythos’s predecessors.”

    What happened: On the same 32-step attack simulation, Mythos averaged 22 completed steps, versus 16 for the next-best model, Claude Opus 4.6. Its first end-to-end completions establish stronger offensive capability in this evaluation. (UK AI Security Institute, )

  31. Assessment: UnresolvedSaid

  32. Assessment: SupportedSaid

    Gary Marcus

    “Second, they show that a neurosymbolic hybrid model, which integrates both a neural networks (for pattern recognition) and a symbolic planner generalizes far better.”

    What happened: The results report 95% versus 34% on three blocks and 78% versus zero for both VLA configurations on the unseen four-block task. (arXiv; Duggan, Lorang, Lu and Scheutz, )

  33. Assessment: SupportedSaid

    Gary Marcus

    “LLMs have persistent weaknesses around planning, reasoning and generalization.”

    What happened: The survey synthesizes recurring reasoning failures and robustness problems across studies while acknowledging substantial capability gains. It supports persistence rather than an assertion that models never reason successfully. (Transactions on Machine Learning Research; arXiv copy, )

  34. Assessment: UnresolvedSaid

  35. Assessment: SupportedSaid

    Gary Marcus

    “Third, they show that the neurosymbolic hybrid was vastly more efficent in terms of energy use - by nearly two orders of magnitude.”

    What happened: Table I gives total training energy of 68.5 and 64.9 MJ for the VLAs versus 0.85 MJ for the hybrid: about 81-fold and 76-fold reductions. Table II shows smaller execution savings; its GPU statement concerns execution only. (arXiv; Duggan, Lorang, Lu and Scheutz, )

  36. Assessment: UnresolvedSaid

  37. Assessment: UnresolvedSaid

  38. Assessment: SupportedSaid

    Gary Marcus

    “Claude Code (in particular version 4.6), which does seem genuinely impressive to me and a number of friends I trust, still makes plenty of mistakes, and still can’t be trusted.”

    What happened: The study uses Claude Code with Opus 4.6 and finds multiple final submissions that fail its correctness tests. It also reports strong performance on easy tasks and notes that many failures are near-complete solutions, limiting how broadly the failure rate can be generalized. (Zhang et al. / arXiv, )

  39. Assessment: UnresolvedSaid

  40. Assessment: SupportedSaid

    Gary Marcus

    “Still, Claude Code ain’t perfect, or even close.”

    What happened: Anthropic traces recurring problems to a change shipped March 26 that repeatedly discarded reasoning history after an idle-session threshold. This documents a material product limitation during the target month. (Anthropic, )

  41. Assessment: UnresolvedSaid

  42. Assessment: SupportedSaid

    Gary Marcus

    “Putting things differently, Anthropic, when push came to shove, went exactly where I have said for 25 years that the field needed to go: to Neurosymbolic AI.”

    What happened: The study traces requests from the language model through an explicit permission-rule engine before tool execution. This supports the combination Marcus describes under his broad definition; the neurosymbolic label is the evaluator's classification under that definition. (arXiv; Jiacheng Liu, Xiaohan Zhao, Xinyi Shang, and Zhiqiang Shen, )

  43. Assessment: UnresolvedSaid

  44. Assessment: SupportedSaid

    Gary Marcus

    “And the thing is, Claude Code is NOT a pure LLM. And it’s not pure deep learning. Not even close.”

    What happened: The study examines the leaked implementation and traces model calls, permission checks, executable tools, and returned results. These are substantive application operations beyond neural inference. (arXiv; Jiacheng Liu, Xiaohan Zhao, Xinyi Shang, and Zhiqiang Shen, )

  45. Assessment: UnresolvedSaid

  46. Assessment: UnresolvedSaid

  47. Assessment: UnresolvedSaid

  48. Assessment: UnresolvedSaid

  49. Assessment: UnresolvedSaid

  50. Assessment: UnresolvedSaid

  51. Assessment: UnresolvedSaid

  52. Assessment: UnresolvedSaid

  53. Assessment: UnresolvedSaid

  54. Assessment: UnresolvedSaid

  55. Assessment: UnresolvedSaid

  56. Assessment: SupportedSaid

    Ed Zitron

    “The above quote has been used repeatedly to suggest that Anthropic has 50% gross margins and is “profitable,” which is extremely weird in and of itself as that’s not what Dario Amodei said at all.”

    What happened: Amodei explicitly separates the illustrative numbers from information about Anthropic. The surrounding discussion frames the calculation as hypothetical industry economics rather than a current company financial disclosure. (Dwarkesh Podcast, )

  57. Assessment: ContradictedSaid

    Ed Zitron

    “The revenues are terrible, Large Language Models are yet to provide any meaningful productivity improvements, and the only reason that they’ve been able to get as far as they have is a compliant media and a venture capital environment borne of a lack of anything else to invest in.”

    What happened: The study examines an LLM-based assistant in actual customer-support work, with rollout extending into winter 2021. The estimated gain is material under the ordinary workplace reading, although it is not an economy-wide estimate. (The Quarterly Journal of Economics; author-hosted copy, )

  58. Assessment: SupportedSaid

    Ed Zitron

    “To be clear, LLMs can absolutely write code, and can absolutely create software, but neither of those mean that the code is good, stable or secure, or that the same can be said of the software they create.”

    What happened: Anthropic's generated compiler demonstrates substantive software-generation capability while retaining functional limitations. That directly fits the distinction in Zitron's sentence. (Anthropic, )

  59. Assessment: UnresolvedSaid

  60. Assessment: ContradictedSaid

  61. Assessment: UnresolvedSaid

  62. Assessment: UnresolvedSaid

  63. Assessment: UnresolvedSaid

  64. Assessment: UnresolvedSaid

  65. Assessment: UnresolvedSaid

  66. Assessment: UnresolvedSaid

  67. Assessment: UnresolvedSaid

  68. Assessment: UnresolvedSaid

  69. Assessment: UnresolvedSaid

  70. Assessment: UnresolvedSaid

  71. Assessment: UnresolvedSaid

  72. Assessment: UnresolvedSaid

  73. Assessment: SupportedSaid

    Gary Marcus

    “Right now he is in trouble. People are increasingly concerned about the economics of his company,”

    What happened: The report describes growing caution about costs and declining secondary-market demand, drawing on named marketplace operators. This supports a change in investor sentiment, though the secondary market is not representative of all investors. (Los Angeles Times / Bloomberg, )

  74. Assessment: SupportedSaid

    Ed Zitron

    “Anyway, The Information's piece also adds another fun detail - that OpenAI's margins were even worse than expected in 2025:”

    What happened: The report compares a 33 percent actual adjusted gross margin with a 46 percent target for 2025. This directly supports the claimed shortfall on the company-defined investor-reporting measure. (The Decoder, )

  75. Assessment: SupportedSaid

    Gary Marcus

    “First, Microsoft’s Mustafa Suleyman just tried to redefine superintelligence down from AI that is smarter than the smartest humans to something a lot more mundane: AI “models capable of delivering product value for millions of enterprises”.”

    What happened: The original interview immediately attributes to Suleyman an explanation of superintelligence in terms of models supplying enterprise product value. This supports Marcus’s reading as public reframing, although it does not establish a formal technical change. (The Verge, )

  76. Assessment: SupportedSaid

    Gary Marcus

    “Third, there is the well-known tendency of generative AI to be sycophantic; to tell users that their ideas were the greatest ever, even when they are not.”

    What happened: The dated 199-case snapshot tests agreement with opposing narrators while preserving the underlying dispute, finding sycophantic contradictions across all 16 configurations. Rates vary substantially, from 0.5% to 31.2%, so the evidence supports a recurring tendency rather than pervasive agreement in every model. (Lech Mazur, )

  77. Assessment: UnresolvedSaid

  78. Assessment: UnresolvedSaid

  79. Assessment: MixedSaid

    Gary Marcus

    “Every company is investing in AI, but so far most aren’t getting huge returns.”

    What held: A majority reporting minimal financial gains despite substantial investment supports the ordinary reading of the majority-returns clause. The same article describes a successful minority, so this does not imply that large returns were absent everywhere. (Boston Consulting Group, )

    What did not: Actual investment was far from universal among surveyed firms, including large firms. This directly contradicts the literal every-company clause without relying on adoption as a spending proxy. (Federal Reserve Bank of Atlanta, )

  80. Assessment: UnresolvedSaid

  81. Assessment: UnresolvedSaid

  82. Assessment: UnresolvedSaid

  83. Assessment: UnresolvedSaid

  84. Assessment: UnresolvedSaid

  85. Assessment: UnresolvedSaid

  86. Assessment: UnresolvedSaid

  87. Assessment: UnresolvedSaid

  88. Assessment: UnresolvedSaid

  89. Assessment: UnresolvedSaid

  90. Assessment: UnresolvedSaid

  91. Assessment: UnresolvedSaid

  92. Assessment: UnresolvedSaid

  93. Assessment: UnresolvedSaid

  94. Assessment: UnresolvedSaid

  95. Assessment: UnresolvedSaid

  96. Assessment: UnresolvedSaid

  97. Assessment: UnresolvedSaid

  98. Assessment: SupportedSaid

    Ed Zitron

    “The cost of tokens is not the same as the cost of serving tokens!”

    What happened: The report defines serving expense separately from token price, which it identifies as the user's payment. This directly supports the distinction in the claim. (NIST Center for AI Standards and Innovation, )

  99. Assessment: UnresolvedSaid

  100. Assessment: MixedSaid

    Ed Zitron

    “A coding model relies heavily on chain-of-thought reasoning, which means that despite the cost of tokens coming down (which does not mean the price of providing them has decreased, it’s a marketing move), models are using far, far more tokens, increasing costs across the board.”

    What held: Cursor identifies reasoning stages as important to its coding model. This supports the reliance-on-reasoning component, without establishing industry-wide token growth or costs. (Cursor, )

    What did not: This coding comparison reports better performance with fewer tokens. It contradicts an across-the-board increase in token requirements, although it does not measure aggregate provider spending. (Anthropic, )