Claims checked against evidence, page 18 of 31
Claims by Gary Marcus and Ed Zitron. Deadlines are judged as of 2026-10-29.
Claims checked against evidence (3100)
Each of these claims was checked against dated evidence.
Page 18 of 31: claims 1701 to 1800 of 3100, ordered by the date first said, newest first. To find a claim by its words, use search.
Assessment: SupportedSaid
“OpenAI burned more than $5 billion last year.”
What happened: The reported 2024 net loss exceeds the stated threshold. This supports the passage's inclusive loss interpretation, not a claim about cash consumption. (Ars Technica, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: MixedSaid
“The one "big thing" that they've been able to do is to use "reasoning" to make the Large Language Models "think" (they do not have consciousness, they are not "thinking," this just means using more tokens to answer a particular question and having multiple models check the work), which mostly results in them being a bit more accurate when generating an answer, but at the expense of speed and cost.”
What held: The developer acknowledges cost and speed limitations in the o1 discussion. This supports that part of the claim, but does not establish a universal tradeoff or predominantly small accuracy gains. (OpenAI, )
What did not: Appendix A reports AIME pass@1 scores of 44.6 for o1-preview and 9.3 for GPT-4o, showing substantial gains on a demanding reasoning task. These selected evaluations challenge the modest-gain characterization, but cannot determine gains across all ordinary usage. (OpenAI, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“User numbers alone tell you nothing about the sustainability or profitability of a business, or how those people use the product.”
What happened: The disclosed figure is an aggregate weekly activity count. The inference supporting the claim is limited: this count does not encode profit, retention, purposes, or the distribution of activity across days. (PYMNTS, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“About year ago the City of New York tried this kind of thing, with less than spectacular results:”
What happened: The reporters tested the operating city chatbot and documented incorrect guidance about housing vouchers, cash payments, and workers’ tips. Ten staff members received the same incorrect voucher answer, supporting repeated unreliability. (The Markup, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Instead, OpenAI will be throwing the kitchen sink at future efforts to build GPT-5 , including “test-time-compute”, a new approach that involves longer, more expensive inference times rather than “constant time inference” of GPT-4-like models, as well as (I suspect) massive amounts of synthetic data”
What happened: The release documentation describes controllable thinking time in the deployed GPT-5 API. This directly supports the forecast inclusion of additional inference-time reasoning. (OpenAI, )
Assessment: SupportedSaid
“Second, pure scaling will no longer be the means of attack.”
What happened: The release documents a system combining fast responses with deeper reasoning and routing. Those mechanisms establish that GPT-5 goes beyond increasing pretraining data and parameters alone. (OpenAI, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“The new administration will do everything in its power to protect businesses, and nothing to protect individuals.”
What happened: Trump signed legislation creating criminal prohibitions and removal obligations protecting people from nonconsensual intimate imagery. This completed action contradicts the prediction of doing nothing for individuals. (The White House, )
Assessment: SupportedSaid
“There were multiple other companies doing exactly what GPT-3 did months before ChatGPT launched.”
What happened: The announcement offers Jurassic-1 through an open-beta API and web environment and describes text generation, question answering, and classification. It establishes one other company's comparable functional offering well before the cutoff. (AI21 Labs, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Even the latest systems like Deep Research are still struggling in a few ways – and those ways pretty much correspond exactly to the places that I warned would be LLM’s Achilles’ Heels: hallucinations and reasoning errors.”
What happened: The paragraph expressly identifies factual hallucinations and incorrect inferences as remaining limitations. It also reports a lower rate than existing ChatGPT models, which qualifies the severity without contradicting their continued presence. (OpenAI, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“To some extent newer models are doing that.”
What happened: Section 2.2.2 describes programmed accuracy and formatting rewards for R1-Zero, including code tests. Section 2.3.4 explicitly applies its rule-based reasoning reward methodology to R1, supporting the limited training-time combination described by Marcus. (DeepSeek-AI, arXiv, )
Assessment: SupportedSaid
“Me, December 2022: The problem with LLMs is that they hallucinate, and their errors can be hard to catch.”
What happened: Kubacka describes checking plausible scientific citations and discovering nonexistent articles, mismatched identifiers, and invented physics. She reports that an explanation in her own field initially made her reconsider whether the invented phenomenon existed, directly supporting the possibility of difficult-to-detect errors. (Teresa Kubacka, Lookalikes and Meanders, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“And that’s just not realistic given the current state of AI.”
What happened: The launch disclosure identifies source-discrimination and uncertainty-communication weaknesses directly relevant to dependable research. These support the ordinary reading that the output required substantive checking. (OpenAI, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“The basic conjecture then — which has already been confirmed to some degree – was that LLMs would be used to write garbage content undermining the value of the internet itself.”
What happened: NewsGuard traced a viral false psychiatrist story to a site it classified as AI-generated and documented subsequent dissemination. This is a concrete information-quality harm, although its attribution of this particular rewrite to AI is qualified. (NewsGuard, )
Assessment: SupportedSaid
“Sam Altman just released a fancier remake Deep Research, which, like Meta’s predecessor, can write science-sounding articles on demand, on any topic of your choice.”
What happened: The launch documentation describes user prompts producing comprehensive, cited reports across science, finance, policy, engineering, and consumer topics. This establishes the broad report-generation capability in the comparison. (OpenAI, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“The real lesson of DeepSeek is that we can still make vast improvements in efficency.”
What happened: The report documents the training resources of the December V3 model and compares its performance with leading models. Its resource total covers the official training stages and excludes earlier research and ablation experiments; the comparative magnitude is supplied by e2. (DeepSeek-AI / arXiv, )
Assessment: SupportedSaid
“DeepSeek's models don't require massive new data centers (they run on the GPUs currently used to run services like ChatGPT, and can even work on more austere hardware), nor do they require an endless supply of bigger, faster NVIDIA GPUs every year to progress.”
What happened: The report identifies the hardware actually used and describes training-efficiency improvements and deployment on H800s. It supports the existing-hardware route, although it is a company report and does not document the construction history of the facility. (DeepSeek-AI, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“One thing we do know is that OpenAI and Anthropic will now have to either drop the price of accessing their models, and potentially even the cost of their subscriptions.”
What happened: The announcement says the reduction is in effect and applies to the same o3 model. This establishes OpenAI's part of the prediction. (OpenAI, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: MixedSaid
“The launch of its "Operator" "agent" was a joke — a barely-functional product that is allegedly meant to control your computer and take distinct actions, but doesn't seem to work.”
What held: The tester reports five failures involving web research and online tools. These show real launch limitations, but the small, relatively demanding task set is not a representative consumer success-rate estimate. (Zengyi Qin / Hugging Face Community, )
What did not: Newton describes successful browser research producing walking-tour links and a completed lesson-plan task. His same review documents substantial shopping friction, so these successes limit the broad dismissal without establishing reliable autonomy. (Platformer / Casey Newton, )
Assessment: UnresolvedSaid
Assessment: ContradictedSaid
“Large Language Models (and reasoning models) are niche.”
What happened: The November survey estimated broad public participation, with search, explanation and writing leading uses. Material qualifications in this same source are possible online-panel selection bias and light usage: its conservative weekly-use estimate was about 29%, and most adults did not use LLMs in a typical week. (Rethink Priorities, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“Whether or not someone chooses to pay DeepSeek is largely irrelevant — someone else will take what it’s created and build their own, or people will start running their own DeepSeek instances renting GPUs from one of the various cloud computing firms.”
What happened: Skywork records the release of its final OR1 models on May 13 and explicitly identifies DeepSeek's distilled models as their starting points. This is an actual third-party derivative release after the forecast. (Skywork AI, )
Assessment: MixedSaid
“They're running out of training data, and the actual capabilities of these models were peaking as far back as March 2024.”
What held: The estimate supports an approaching constraint on usable human-generated public text under continuing scaling trends. It does not show that data was already exhausted, and the discussion identifies other data sources and ways progress could continue. (Epoch AI, )
What did not: Using its baseline testing framework, ARC Prize reports public-evaluation scores of 21.2% for o1-preview and 9% for GPT-4o. This is post-March capability progress, although the evaluator also reports substantially greater inference time. (ARC Prize, )
Assessment: ContradictedSaid
“The current models developed by both the hyperscalers (Gemini, Llama, et. al) and multi-billion-dollar "startups" like OpenAI and Anthropic are horribly inefficient, I had just made the mistake of assuming that they'd actually tried to make them more efficient.”
What happened: Meta describes concrete changes to parallelization, reliability, storage and training infrastructure, alongside inference optimizations. This is substantive efficiency engineering, although the improvement magnitude is company-reported. (Meta, )
Assessment: SupportedSaid
“DeepSeek r1 is not smarter than earlier models, just trained more cheaply”
What happened: The release report characterizes R1 as comparable to o1 overall. Its detailed results also limit that conclusion: R1 slightly exceeds o1 on AIME and exceeds several older models, while trailing o1 on several knowledge benchmarks. (DeepSeek-AI / arXiv, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“It doesn't solve hallucinations or problems with reliability.”
What happened: DeepSeek reports prompt sensitivity in the released R1 model. This establishes a continuing reliability limitation, though it does not itself measure hallucinations. (DeepSeek-AI / arXiv, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“This morning, Nvidia is down more than 10% in pretrading.”
What happened: The report explicitly places these losses in pre-market trading that morning. Its approximately 12% decline exceeds the claim's 10% threshold. (Associated Press, syndicated by Spectrum News NY1, )
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“None of this means however that China won the AI race or even took the lead. American companies will incorporate these new results and continue to produce new results of their own.”
What happened: NVIDIA explicitly developed a model from an R1-distilled checkpoint. Its report describes additional reinforcement-learning experiments and improved mathematics and coding results, establishing adoption and a further technical contribution. (NVIDIA Research, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“On LLMs China is already catching up.”
What happened: The preceding sentence gives end-2023 U.S.–China gaps of 17.5, 13.5, 24.3 and 31.6 percentage points on MMLU, MMMU, MATH and HumanEval. All four narrowed by end-2024, including the language, mathematics and coding measures directly relevant to this claim. (Stanford Institute for Human-Centered Artificial Intelligence, )
Assessment: SupportedSaid
“Today he walked it back.”
What happened: Shows that on 20 January 2025 Altman publicly said OpenAI had not built AGI and would not deploy it next month, which plays down the closeness he had suggested. (Decrypt, )
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: UnresolvedSaid
Assessment: SupportedSaid
“And those demos won’t work all that reliably.”
What happened: In the 2025 revision, the best agent finished only 30% of realistic workplace tasks on its own. That is far from reliable. (arXiv (Carnegie Mellon University et al.), )
Assessment: UnresolvedSaid