Claims checked against evidence, page 8 of 31
Claims by Gary Marcus and Ed Zitron. Deadlines are judged as of 2026-10-29.
Claims checked against evidence (3100)
Each of these claims was checked against dated evidence.
Page 8 of 31: claims 701 to 800 of 3100, ordered by the date first said, newest first. To find a claim by its words, use search.
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: MixedSaid
“This does not really make sense given the fact that all support documents and the Claude website reflect that Pro users do not have access to Claude Code.”
What held: The clarification acknowledges the public documentation problem and subsequently says the changes confused people outside the experiment. This supports the messaging criticism, not a finding that the enrollment percentage was false. (Amol Avasare, Anthropic, )
What did not: The reporter identifies the Claude Code product page as still advertising Pro access during the episode. Publication was April 22 at 01:16 UTC, still April 21 in US timezones; the observation contradicts uniform website exclusion. (The Register, )
Assessment: SupportedSaid
“This might sound like a good thing, but it actually means that each request using Opus 4.7 is actually 7.5 of them.”
What happened: GitHub explicitly announced the 7.5× promotional rate. This establishes the multiplier described in the claim. (GitHub, )
Assessment: ContradictedSaid
“The standard version of Claude Opus 4.6 has a premium request multiplier of three — meaning that, even with the promotional pricing, Claude Opus 4.7 is around 250% more expensive to use.”
What happened: The data file records paid-plan multipliers of 3 for standard Opus 4.6 and 7.5 for Opus 4.7. These confirm the baseline but yield a 150% increase, contradicting the claimed 250% increase. (GitHub, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Today, even after a very strong week, Oracle stands at just $170.”
What happened: The filing reports the market price of Oracle shares, using Bloomberg historical data. $169.81 rounds to the claimed $170. (BofA Finance LLC; filing copy hosted by Yahoo Finance, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“OpenAI and Anthropic need to show continued revenue growth, which means that they must have capacity available for new customers, which means that old customers will always be the first to be punished.”
What happened: Anthropic expressly protected existing subscribers while testing a restriction on new signups. The accompanying April 22 reporting establishes the date and identifies the affected service. (Amol Avasare, Anthropic, via X, )
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“Every “AI agent” story is either about code generation, summarizing some sort of information source, or generating something based on an information source that you may or may not be able to trust.”
What happened: This published AI-agent story describes operating a shop and executing sales, an application beyond content generation on the stated reading. The event date is the story's publication, because the claim concerns which stories existed. (Anthropic, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“LLMs will always hallucinate, their outputs are not trustworthy as a result, they cannot be deterministic, and any chance of any mistakes of any kind are unforgivable.”
What happened: The authors report identical completions for Qwen3-235B-A22B-Instruct-2507 using temperature zero and batch-invariant kernels. The report explains the implementation and supplies a direct counterexample to impossibility. (Thinking Machines Lab, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“I see no scenario where costs come down, or where rate limits are eased.”
What happened: The section specifies that its changes are effective that day. Doubling included five-hour allowances on existing plans is a direct easing after the post. (Anthropic, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“On the darker side, it really does arm attackers to a greater degree than Mythos’s predecessors.”
What happened: On the same 32-step attack simulation, Mythos averaged 22 completed steps, versus 16 for the next-best model, Claude Opus 4.6. Its first end-to-end completions establish stronger offensive capability in this evaluation. (UK AI Security Institute, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Second, they show that a neurosymbolic hybrid model, which integrates both a neural networks (for pattern recognition) and a symbolic planner generalizes far better.”
What happened: The results report 95% versus 34% on three blocks and 78% versus zero for both VLA configurations on the unseen four-block task. (arXiv; Duggan, Lorang, Lu and Scheutz, )
Assessment: SupportedSaid
“LLMs have persistent weaknesses around planning, reasoning and generalization.”
What happened: The survey synthesizes recurring reasoning failures and robustness problems across studies while acknowledging substantial capability gains. It supports persistence rather than an assertion that models never reason successfully. (Transactions on Machine Learning Research; arXiv copy, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Third, they show that the neurosymbolic hybrid was vastly more efficent in terms of energy use - by nearly two orders of magnitude.”
What happened: Table I gives total training energy of 68.5 and 64.9 MJ for the VLAs versus 0.85 MJ for the hybrid: about 81-fold and 76-fold reductions. Table II shows smaller execution savings; its GPU statement concerns execution only. (arXiv; Duggan, Lorang, Lu and Scheutz, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Claude Code (in particular version 4.6), which does seem genuinely impressive to me and a number of friends I trust, still makes plenty of mistakes, and still can’t be trusted.”
What happened: The study uses Claude Code with Opus 4.6 and finds multiple final submissions that fail its correctness tests. It also reports strong performance on easy tasks and notes that many failures are near-complete solutions, limiting how broadly the failure rate can be generalized. (Zhang et al. / arXiv, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Still, Claude Code ain’t perfect, or even close.”
What happened: Anthropic traces recurring problems to a change shipped March 26 that repeatedly discarded reasoning history after an idle-session threshold. This documents a material product limitation during the target month. (Anthropic, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Putting things differently, Anthropic, when push came to shove, went exactly where I have said for 25 years that the field needed to go: to Neurosymbolic AI.”
What happened: The study traces requests from the language model through an explicit permission-rule engine before tool execution. This supports the combination Marcus describes under his broad definition; the neurosymbolic label is the evaluator's classification under that definition. (arXiv; Jiacheng Liu, Xiaohan Zhao, Xinyi Shang, and Zhiqiang Shen, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“And the thing is, Claude Code is NOT a pure LLM. And it’s not pure deep learning. Not even close.”
What happened: The study examines the leaked implementation and traces model calls, permission checks, executable tools, and returned results. These are substantive application operations beyond neural inference. (arXiv; Jiacheng Liu, Xiaohan Zhao, Xinyi Shang, and Zhiqiang Shen, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“The above quote has been used repeatedly to suggest that Anthropic has 50% gross margins and is “profitable,” which is extremely weird in and of itself as that’s not what Dario Amodei said at all.”
What happened: Amodei explicitly separates the illustrative numbers from information about Anthropic. The surrounding discussion frames the calculation as hypothetical industry economics rather than a current company financial disclosure. (Dwarkesh Podcast, )
Assessment: ContradictedSaid
“The revenues are terrible, Large Language Models are yet to provide any meaningful productivity improvements, and the only reason that they’ve been able to get as far as they have is a compliant media and a venture capital environment borne of a lack of anything else to invest in.”
What happened: The study examines an LLM-based assistant in actual customer-support work, with rollout extending into winter 2021. The estimated gain is material under the ordinary workplace reading, although it is not an economy-wide estimate. (The Quarterly Journal of Economics; author-hosted copy, )
Assessment: SupportedSaid
“To be clear, LLMs can absolutely write code, and can absolutely create software, but neither of those mean that the code is good, stable or secure, or that the same can be said of the software they create.”
What happened: Anthropic's generated compiler demonstrates substantive software-generation capability while retaining functional limitations. That directly fits the distinction in Zitron's sentence. (Anthropic, )
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“If that’s the case, I truly have no idea how it could’ve possibly accelerated so aggressively, and as I’ve mentioned before, there is no way to reconcile having made $5 billion in lifetime revenue as of March 9, 2026, having $14 billion in annualized revenue on February 12 2026, and having $4.5 billion in revenue for the year 2025.”
What happened: The sentence immediately preceding the quotation says cumulative revenue exceeded $5 billion; it supplies no upper bound. This permits additional revenue beyond $5 billion and defeats the asserted incompatibility of the reported figures. (U.S. District Court, Northern District of California / CourtListener RECAP, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Right now he is in trouble. People are increasingly concerned about the economics of his company,”
What happened: The report describes growing caution about costs and declining secondary-market demand, drawing on named marketplace operators. This supports a change in investor sentiment, though the secondary market is not representative of all investors. (Los Angeles Times / Bloomberg, )
Assessment: SupportedSaid
“Anyway, The Information's piece also adds another fun detail - that OpenAI's margins were even worse than expected in 2025:”
What happened: The report compares a 33 percent actual adjusted gross margin with a 46 percent target for 2025. This directly supports the claimed shortfall on the company-defined investor-reporting measure. (The Decoder, )
Assessment: SupportedSaid
“First, Microsoft’s Mustafa Suleyman just tried to redefine superintelligence down from AI that is smarter than the smartest humans to something a lot more mundane: AI “models capable of delivering product value for millions of enterprises”.”
What happened: The original interview immediately attributes to Suleyman an explanation of superintelligence in terms of models supplying enterprise product value. This supports Marcus’s reading as public reframing, although it does not establish a formal technical change. (The Verge, )
Assessment: SupportedSaid
“Third, there is the well-known tendency of generative AI to be sycophantic; to tell users that their ideas were the greatest ever, even when they are not.”
What happened: The dated 199-case snapshot tests agreement with opposing narrators while preserving the underlying dispute, finding sycophantic contradictions across all 16 configurations. Rates vary substantially, from 0.5% to 31.2%, so the evidence supports a recurring tendency rather than pervasive agreement in every model. (Lech Mazur, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: MixedSaid
“Every company is investing in AI, but so far most aren’t getting huge returns.”
What held: A majority reporting minimal financial gains despite substantial investment supports the ordinary reading of the majority-returns clause. The same article describes a successful minority, so this does not imply that large returns were absent everywhere. (Boston Consulting Group, )
What did not: Actual investment was far from universal among surveyed firms, including large firms. This directly contradicts the literal every-company clause without relying on adoption as a spending proxy. (Federal Reserve Bank of Atlanta, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“The cost of tokens is not the same as the cost of serving tokens!”
What happened: The report defines serving expense separately from token price, which it identifies as the user's payment. This directly supports the distinction in the claim. (NIST Center for AI Standards and Innovation, )
Assessment: UnresolvedSaid
Assessment: MixedSaid
“A coding model relies heavily on chain-of-thought reasoning, which means that despite the cost of tokens coming down (which does not mean the price of providing them has decreased, it’s a marketing move), models are using far, far more tokens, increasing costs across the board.”
What held: Cursor identifies reasoning stages as important to its coding model. This supports the reliance-on-reasoning component, without establishing industry-wide token growth or costs. (Cursor, )
What did not: This coding comparison reports better performance with fewer tokens. It contradicts an across-the-board increase in token requirements, although it does not measure aggregate provider spending. (Anthropic, )