Unresolved claims by Gary Marcus, page 2 of 8
Deadlines are judged as of 2026-10-29. About Gary Marcus and the sources covered.
Unresolved claims by Gary Marcus (772)
The record was checked, and the evidence available by the cutoff does not settle it. Forecasts whose deadline has not arrived are listed apart, as not yet due.
Page 2 of 8: claims 101 to 200 of 772, ordered by the date first said, newest first. To find a claim by its words, use search.
Assessment: UnresolvedSaid
Observation
“Worse, they did it in favor of someone else who took pretty similar terms and happened to have given more campaign contributions.”
Our reading: The government acted in favor of someone else (the OpenAI/Altman side) who took pretty similar terms to Anthropic's and happened to have given more campaign contributions.
No horizon Evidence as of
Limitation: Executives' personal donations are not corporate contributions.
Source: The whole thing was a scam
Assessment: UnresolvedSaid
Conditional forecast
“If anything really bad comes of pushing premature AI too hard and too fast into to the military, he will own it.”
Our reading: If pushing premature AI too hard and too fast into the military leads to something really bad, Trump will be held responsible.
No deadline stated Evidence as of
Only if: if something really bad comes of pushing premature AI too hard and too fast into the military
Assessment: UnresolvedSaid
Causal claim
“One thing that Noble doesn’t mention is why OpenAI has struggled to make a profit; in my eyes, there are three reasons, that I have emphasized here before: the product is unreliable (placing an upper bound on how much many people be willing to pay), it is expensive to operate, and they have no technical moat, which has led to price wars.”
Our reading: In Marcus's view, one reason OpenAI has struggled to make a profit is that its product is unreliable, which places an upper bound on how much many people are willing to pay for it.
No horizon Evidence as of
Limitation: General AI survey findings do not directly measure OpenAI purchasing behavior.
Assessment: UnresolvedSaid
Forecast
“But that is exactly where we are headed.”
Our reading: We are headed exactly toward a situation where one individual, a Cabinet official, decides at gunpoint on mass surveillance and AI-fueled weapons, possibly nuclear, without humans in the loop.
No deadline stated Evidence as of
Limitation: Public records cannot establish the contents of undisclosed contracts or classified implementation.
Source: America, and probably the world, stands on a precipice.
Assessment: UnresolvedSaid
Observation
“Hegsseth’s demand would in principle extend to apply Anthropic’s software to nuclear weapons without humans in the loop.”
Our reading: Hegseth's demand would in principle allow Anthropic's software to be applied to nuclear weapons without humans in the loop.
No horizon Evidence as of
Limitation: Rests on interpretation of 'lawful' and 'in principle'.
Source: America, and probably the world, stands on a precipice.
Assessment: UnresolvedSaid
Observation
“Generative AI is NOT remotely reliable enough to make life or death decisions of magnitude.”
Our reading: Generative AI is nowhere near reliable enough to make major life-or-death decisions.
No horizon Evidence as of
Limitation: The claim leaves both the application and acceptable risk unspecified.
Source: 30 seconds to midnight? 15?
Assessment: UnresolvedSaid
Observation
“Turns out it wasn’t, as Shira Ovide just reported:”
Our reading: Generative AI was not in fact contributing half of US GDP growth, contrary to the White House AI advisor's claim.
No horizon Evidence as of
Limitation: This does not validate the advisor's half-of-growth assertion.
Assessment: UnresolvedSaid
Observation
“I don’t know that Generative AI was literally a scam, but the people selling it have tried to sell it as if it were tantamount to artificial general intelligence, when it’s not.”
Our reading: Generative AI vendors have marketed it as tantamount to AGI, but it is not AGI.
No horizon Evidence as of
Limitation: Altman's quotation comes from a third-party transcript and does not establish what all vendors promised [e1].
Assessment: UnresolvedSaid
Causal claim
“Generative AI has its uses, but it hardly surprising that most business have struggled to find return on their investment, given the massive reliability issues that continue to plaguage it.”
Our reading: Most businesses have struggled to get return on generative AI investment because of its ongoing massive reliability issues.
No horizon Evidence as of
Limitation: NANDA's interviews, conference survey and public-initiative review do not establish prevalence among all generative-AI investors [e1].
Assessment: UnresolvedSaid
Observation
“Across domains involving causality, value trade-offs, justification, and error monitoring, humans attend to reasons, stakes, and responsibility, whereas language models optimize for linguistic plausibility—structural fault lines between performance alignment and genuine evaluative competence (Quattrociocchi et al., 2025).”
Our reading: Across domains involving causality, value trade-offs, justification, and error monitoring, humans attend to reasons, stakes, and responsibility, whereas language models optimize for linguistic plausibility.
No horizon Evidence as of
Limitation: A model can be trained for correctness while still making unreliable judgments.
Source: Rumors of AGI’s arrival have been greatly exaggerated
Assessment: UnresolvedSaid
Observation
“Behavioral similarity alone therefore provides no insight into whether the underlying processes support core components of general intelligence, such as judgment, error correction, or reliable generalization.”
Our reading: LLMs' behavioral similarity to humans alone gives no insight into whether they have judgment, error correction, or reliable generalization.
No horizon Evidence as of
Limitation: The strongest relevant studies use additional tests beyond behavioral similarity.
Source: Rumors of AGI’s arrival have been greatly exaggerated
Assessment: UnresolvedSaid
Observation
“We also show that recent claims (Chen et al., 2026) about putative success on AGI hinge on redefining what AGI has historically meant.”
Our reading: Chen et al.'s (2026) claims that AGI has been achieved depend on redefining the historical meaning of AGI.
No horizon Evidence as of
Limitation: The packet lacks the complete Chen et al. argument required by the contract.
Source: Rumors of AGI’s arrival have been greatly exaggerated
Assessment: UnresolvedSaid
Observation
“Language models, by contrast, tended to issue confident classifications in the same cases, even when uncertainty was explicitly signaled in the input.”
Our reading: In the cited direct comparison of human and LLM judgments of news source reliability, language models tended to issue confident classifications in the same cases where humans withheld or downgraded confidence, even when uncertainty was explicitly signaled in the input.
No horizon Evidence as of
Limitation: The supplementary material and usable underlying data were unavailable through the reader.
Source: Rumors of AGI’s arrival have been greatly exaggerated
Assessment: UnresolvedSaid
Observation
“Such claims confuse high performance on benchmarks (often gameable) with real world flexibility, which historically has been at the center of what it means to be an artificial general intelligence.”
Our reading: Claims that AGI has already arrived confuse high performance on benchmarks, which are often gameable, with real-world flexibility, which historically has been at the center of what it means to be an AGI.
No horizon Evidence as of
Limitation: The university report provides a direct author quotation but is not the complete Nature argument.
Source: Rumors of AGI’s arrival have been greatly exaggerated
Assessment: UnresolvedSaid
Observation
“Rumors that humanity has already achieved artificial general intelligence (AGI) have been greatly exaggerated.”
Our reading: AGI has not already been achieved; rumors that it has are greatly exaggerated.
No horizon Evidence as of
Limitation: This is a historical assessment; later model improvements do not contradict the claim.
Source: Rumors of AGI’s arrival have been greatly exaggerated
Assessment: UnresolvedSaid
Observation
“Scammers will be among the first to adopt these tools. And indeed they already have;”
Our reading: Scammers are among the first adopters of AI impersonation and deepfake tools and are already using them.
No horizon Evidence as of
Limitation: Actual use does not by itself establish comparative adoption order.
Source: We URGENTLY need a federal law forbidding AI from impersonating humans
Assessment: UnresolvedSaid
Observation
“Anybody’s appearance can (given sufficient data) be faked now, at any time, for almost nothing.”
Our reading: Given sufficient data, deepfake tools can now fake anybody's appearance at any time for almost no cost.
No horizon Evidence as of
Limitation: The scientific synthesis is broader than person-specific video impersonation.
Source: We URGENTLY need a federal law forbidding AI from impersonating humans
Assessment: UnresolvedSaid
Observation
“OpenAI is losing money every quarter; even by their own (optimistic) calculations, they won’t make a profit for years.”
Our reading: OpenAI loses money every quarter and, even by its own optimistic projections, will not be profitable for years.
No horizon Evidence as of
Limitation: The packet contains no comparable series of quarterly net results through October–December 2025.
Assessment: UnresolvedSaid
Conditional forecast
“If the venture capital dries up, they are toast. Talent will make a beeline for competitors.”
Our reading: If venture capital dries up, OpenAI will collapse and its talent will flee to competitors.
No deadline stated Evidence as of
Only if: if venture capital dries up
Assessment: UnresolvedSaid
Observation
“Although there is some clear value in it, the costs are high, and relative to those costs, the revenue has been modest.”
Our reading: Generative AI has some clear value, but its costs are high and its revenue has been modest relative to those costs.
No horizon Evidence as of
Limitation: The financial reporting concerns one provider.
Source: Some disconcerting facts about AI and banking that may have profound consequences
Assessment: UnresolvedSaid
Forecast
“Let me add that I do think that some form of AI will eventually actually yield the returns people were anticipating for Generative AI.”
Our reading: Some form of AI will eventually yield the returns people anticipated from generative AI.
No deadline stated Evidence as of
Limitation: Goldman Sachs provides an illustrative forecast, not realized gains or a threshold Marcus explicitly adopted.
Source: Some disconcerting facts about AI and banking that may have profound consequences
Assessment: UnresolvedSaid
Causal claim
“Me, I think the merger is really a kind of bailout, to give a lot of cash to a company that is otherwise in distress.”
Our reading: Marcus thinks the SpaceX-xAI merger is really a kind of bailout, meant to give a lot of cash to xAI, which is otherwise in distress.
No horizon Evidence as of
Limitation: The fundraising announcement does not disclose unrestricted liquidity after outstanding commitments [e2].
Assessment: UnresolvedSaid
Causal claim
“The point is that when it costs pennies to coordinate a fake mob and moments to counterfeit a human identity, the public square is left wide open to attack.”
Our reading: When it costs pennies to coordinate a fake mob and takes moments to counterfeit a human identity, the public square is left wide open to attack.
No horizon Evidence as of
Only if: it costs pennies to coordinate a fake mob
Assessment: UnresolvedSaid
Observation
“Even so-called “thinking” AI models are vulnerable to this,”
Our reading: Even so-called 'thinking' (reasoning) AI models are vulnerable to training-data poisoning by swarms.
No horizon Evidence as of
Limitation: The evidence includes no audit that names reasoning models and measures how often they repeat narratives seeded by grooming.
Assessment: UnresolvedSaid
Conditional forecast
“If we require this kind of “proof-of-human” for high-reach interactions, we make it mathematically difficult and financially ruinous for one operator to secretly run ten thousand accounts.”
Our reading: If verified-yet-anonymous proof-of-human is required for high-reach interactions, it will make it mathematically difficult and financially ruinous for one operator to secretly run ten thousand accounts.
No deadline stated Evidence as of
Only if: this kind of proof-of-human is required for high-reach interactions
Assessment: UnresolvedSaid
Observation
“OpenAI has never made a profit.”
Our reading: OpenAI has never made a profit.
No horizon Evidence as of
Limitation: The financial evidence is news reporting about statements, not directly inspected consolidated statements.
Assessment: UnresolvedSaid
Observation
“Anthropic has started to eat a lot of OpenAI’s lunch, taking a lot of corporate customers away.”
Our reading: Anthropic is taking many corporate customers away from OpenAI.
No horizon Evidence as of
Limitation: Menlo has an investment in Anthropic.
Assessment: UnresolvedSaid
Observation
“Over the last couple years, Altman’s public credibility has steadily waned (see e.g., Karen Hao’s bestseller, and my earlier essay on Altman in The Guardian).”
Our reading: Altman's public credibility has steadily declined over the last couple of years.
No horizon Evidence as of
Limitation: Historical values in an interactive tracker were not available in the page-reader output.
Assessment: UnresolvedSaid
Observation
“Those price wars did in fact come to pass; users costs per token are roughly a hundred times lower two year later.”
Our reading: LLM price wars occurred and user costs per token are roughly 100 times lower than two years earlier.
No horizon Evidence as of
Limitation: A supported component is not enough to support the full conjunction.
Assessment: UnresolvedSaid
Observation
“(Altman got famous hinting at the supposed miracles of GPT-5; by any reasonable measure it was both late and short of expectations.)”
Our reading: GPT-5 was both late and short of expectations.
No horizon Evidence as of
Limitation: The reported postponement concerns an approximate public timeline, not a precise missed deadline [e1].
Assessment: UnresolvedSaid
Causal claim
“DeepSeek launched a price war that forced Altman to cut prices dramatically.”
Our reading: DeepSeek's price war forced OpenAI to cut prices dramatically.
No horizon Evidence as of
Limitation: A company's public efficiency explanation may omit commercial considerations.
Assessment: UnresolvedSaid
Observation
“They still aren’t adding a lot of quantifiable value to the world:”
Our reading: LLMs still are not adding much quantifiable value to the world.
No horizon Evidence as of
Limitation: The claim lacks a threshold and an agreed measure of value.
Source: Let’s be honest, Generative AI isn’t going all that well
Assessment: UnresolvedSaid
Observation
“A large fraction of what LLMs do is mostly just memorization (and Hinton was on the wrong side of this argument):”
Our reading: A large fraction of what LLMs do is mostly memorization, and Hinton was wrong on this point.
No horizon Evidence as of
Limitation: Large fraction has no stated numerical threshold.
Source: Let’s be honest, Generative AI isn’t going all that well
Assessment: UnresolvedSaid
Conditional forecast
“If LeCun pulls the same stuff in his new company, morale will be deathly low.”
Our reading: If LeCun keeps failing to credit others' work at his new company, morale there will be very low.
No deadline stated Evidence as of
Only if: if LeCun fails to acknowledge others' work in his new company
Assessment: UnresolvedSaid
Causal claim
“My own view, which I stand by, is that we need “neurosymbolic” contributions from both traditions if we are to get to trustworthy AI.”
Our reading: In Marcus's stated view, which he stands by, getting to trustworthy AI requires neurosymbolic contributions from both the neural network and classical symbolic traditions.
No horizon Evidence as of
Limitation: The evidence provides no agreed application scope, failure tolerance, or boundary for what counts as a contribution from either tradition.
Assessment: UnresolvedSaid
Forecast
“Neurosymbolic AI will displace pure LLMs over time; here’s why.”
Our reading: Neurosymbolic AI will eventually displace pure LLMs.
No deadline stated Evidence as of
Limitation: Neither 'neurosymbolic' nor 'pure LLM' is defined. Whether LLMs that use tools or agent harnesses count as neurosymbolic is disputed, and the outcome may depend on that choice.
Source: AI Cartoon of The Year — and five (re)readings for 2026
Assessment: UnresolvedSaid
Forecast
“And LLMs will continue to exist.”
Our reading: LLMs will continue to exist even after the AI bubble falls apart.
No deadline stated Evidence as of
Limitation: The packet does not establish when or whether the anticipated broad collapse occurred.
Assessment: UnresolvedSaid
Causal claim
“And without reliability, profits are limited.”
Our reading: Without reliability, profits from AI are limited.
No horizon Evidence as of
Limitation: The usable evidence is a reputable news report because the located primary documents could not be read with the required tool.
Assessment: UnresolvedSaid
Forecast
“But the economics don’t make sense, and never will, in large part because of the core technical problems that I have stressed repeatedly here and elsewhere since 2019.”
Our reading: The economics of LLMs will never make sense.
No deadline stated Evidence as of
Limitation: The detailed financial evidence concerns one major developer, not every LLM business.
Assessment: UnresolvedSaid
Causal claim
“This cold reality in turns undermines a large fraction of the use cases that people initially fantasized about.”
Our reading: The inherent limitations of LLMs undermine a large fraction of the use cases people initially imagined.
No horizon Evidence as of
Limitation: The studies examine different models, periods, tasks, and forms of human oversight.
Assessment: UnresolvedSaid
Observation
“What is new that they have at last become widely recognized, not just as the transitory “bugs” the industry wanted you to think of, but as inherent limitations that flow from the very design of LLMs they really are.”
Our reading: LLMs' technical problems are now widely recognized as inherent limitations of their design, not transitory bugs.
No horizon Evidence as of
Limitation: A selection of technical papers is not a representative opinion survey.
Assessment: UnresolvedSaid
Forecast
“2025 will be known as the year of the peak bubble, and also the moment at which Wall Street began to lose confidence in generative AI.”
Our reading: 2025 will come to be seen as the peak of the generative AI bubble and when Wall Street began losing confidence in generative AI.
No deadline stated Evidence as of
Limitation: The cited commentary is a secondary summary; no primary record can by itself establish collective historical recognition.
Source: Six (or seven) predictions for AI 2026 from a Generative AI realist
Assessment: UnresolvedSaid
Observation
“Few AI companies aside from Nvidia are making a profit, and nobody has much of a technical moat.”
Our reading: Few AI companies other than Nvidia are profitable, and no AI company has much of a technical moat.
No horizon Evidence as of
Limitation: Company-level profits do not isolate profits from AI products.
Source: Six (or seven) predictions for AI 2026 from a Generative AI realist
Assessment: UnresolvedSaid
Forecast
“Right now, as it happens, China is at most a few months behind; I expect the lead to be slight and to flip back and forth, with nobody retaining a sizeable a lead for long.”
Our reading: The US-China lead in generative AI will be slight and flip back and forth, with neither retaining a sizeable lead for long.
No deadline stated Evidence as of
Limitation: The evidence comes from one capability index, the Epoch Capabilities Index.
Source: The core misconception that is driving American AI policy
Assessment: UnresolvedSaid
Forecast
“Conversely, nothing the United States can realistically do (short of full out nuclear war) is going to stop Chinese companies from serving generative AI on China-based cloud infrastructure.”
Our reading: Nothing the United States can realistically do, short of full out nuclear war, is going to stop Chinese companies from serving generative AI on China-based cloud infrastructure.
No deadline stated Evidence as of
Limitation: Restrictions on access to advanced compute must not be equated with cessation of existing inference services.
Source: The core misconception that is driving American AI policy
Assessment: UnresolvedSaid
Forecast
“Nothing China can realistically do (short of full out nuclear war) is going to stop companies like Google, Microsoft, and Amazon from serving generative AI on the cloud.”
Our reading: Nothing China can realistically do, short of full out nuclear war, is going to stop companies like Google, Microsoft, and Amazon from serving generative AI on the cloud.
No deadline stated Evidence as of
Limitation: The operational examples do not provide an exhaustive history of every provider.
Source: The core misconception that is driving American AI policy
Assessment: UnresolvedSaid
Forecast
“I literally don’t see any plausible scenario in which either nation outright “wins” the generative AI race to the exclusion of the other.”
Our reading: Marcus does not see any plausible scenario in which either the US or China outright wins the generative AI race to the exclusion of the other.
No deadline stated Evidence as of
Limitation: Service announcements do not constitute a comprehensive global market census.
Source: The core misconception that is driving American AI policy
Assessment: UnresolvedSaid
Observation
“For all intents and purposes, the race is basically a tie – with both countries serving many of their own customers, using largely similar products.”
Our reading: For all intents and purposes, the US-China generative AI race is basically a tie, with both countries serving many of their own customers using largely similar products.
No horizon Evidence as of
Limitation: US survey evidence covers teenagers, not the entire domestic market.
Source: The core misconception that is driving American AI policy
Assessment: UnresolvedSaid
Causal claim
“Importantly, since everybody is following the same playbook—ever more massive data, ever more massive servers, fed into ever-larger large language models—nobody has a real technical advantage here.”
Our reading: Because everybody is following the same playbook of ever more massive data and servers fed into ever-larger large language models, nobody has a real technical advantage in the generative AI race.
No horizon Evidence as of
Limitation: DeepSeek’s findings are a developer self-assessment, without comparable measurements establishing the practical magnitude of the disclosed deficits [e1].
Source: The core misconception that is driving American AI policy
Assessment: UnresolvedSaid
Observation
“As noted yesterday, the H200 move is hardly popular with either party.”
Our reading: The decision to allow H200 sales to China is unpopular with both US political parties.
No horizon Evidence as of
Limitation: Party membership and the required breadth of opposition are unspecified.
Source: Has the Chinese government figured out the fact that GPUs ≠ AGI?
Assessment: UnresolvedSaid
Conditional forecast
“If we are to build AGI, we are going to need to learn something from humans, how they reason and understand the physical world, and how they represent and acquire language and complex concepts.”
Our reading: If we are to build AGI, we are going to need to learn something from humans: how they reason and understand the physical world, and how they represent and acquire language and complex concepts.
No deadline stated Evidence as of
Only if: if we are to build AGI
Source: “Scale Is All You Need” is dead
Assessment: UnresolvedSaid
Observation
“Worse, they are burning billions of dollars of month.”
Our reading: OpenAI is burning billions of dollars per month.
No horizon Evidence as of
Limitation: The first-half and full-year reports do not establish a common accounting basis or isolate July–September cash burn; subtracting their figures cannot settle the claim [e1, e2].
Source: OpenAI’s “Code Red”
Assessment: UnresolvedSaid
Forecast
“In the end LLMs will continue to exist, no matter what; they will get cheaper. And they will find some utility (indeed they are already have).”
Our reading: LLMs will continue to exist, get cheaper, and have some utility.
No deadline stated Evidence as of
Limitation: The deployment and efficiency evidence is vendor-reported.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Conditional forecast
“And if Sustekver and I (and at this point many others) are right that scaling is largely played out, a decline in demand is sure to follow.”
Our reading: If scaling is largely played out, a decline in demand for AI compute is sure to follow.
No deadline stated Evidence as of
Only if: if scaling is largely played out
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Observation
“More than that, any normal seven-year old develops a rich model of the world, including the objects they see, the people they interact with and so on, and even how their bodies work. GPT is still just faking it.”
Our reading: Unlike a seven-year-old, GPT lacks a rich model of the world and is just faking it.
No horizon Evidence as of
Limitation: The behavioral reading of 'faking it' is an evaluator interpretation.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Forecast
“But they will never be AGI, and they never be much more than commodity.”
Our reading: LLMs will never be AGI and will never be much more than a commodity.
No deadline stated Evidence as of
Limitation: One benchmark cannot settle AGI.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Observation
“In some ways, GPT-5 is more capable than most 7 or 8 year olds.”
Our reading: In some ways, such as trivia and writing python code, GPT-5 is more capable than most 7- or 8-year-olds.
No horizon Evidence as of
Limitation: The available model evidence is company-reported and predates the target period.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Observation
“Ultimately though, what LLMs are great at seeming is plausible – while being much less good at getting their facts straight.”
Our reading: LLMs are good at seeming plausible but much less good at getting facts right.
No horizon Evidence as of
Limitation: The located plausibility experiment concerns prompted rationales rather than ordinary factual answers.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Observation
“The reality is OpenAI has ridden to a $500 billion valuation on hopes, not profits. And those hopes are slipping away, as usage declines and others catch up.”
Our reading: OpenAI's $500 billion valuation rests on hopes rather than profits, and those hopes are slipping as usage declines and competitors catch up.
No horizon Evidence as of
Limitation: October 2025 is the contract's selected reporting period; the claim itself specifies no usage window.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Observation
“And I certainly don’t think that ChatGPT has lived up to expectations.”
Our reading: ChatGPT has not lived up to expectations.
No horizon Evidence as of
Limitation: The capability comparison is company-reported and limited to its internal benchmark.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Causal claim
“Too much industry hype is repeated with too little skepticism, driving up market valuations on analyses that often feel to me superficial.”
Our reading: Too much industry hype is repeated with too little skepticism, driving up market valuations on analyses that often feel to Marcus superficial.
No horizon Evidence as of
Limitation: Correlation between optimistic coverage and rising prices would not establish the direction of causation.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Observation
“Three years and nearly a trillion dollars later almost of all it remains true. And it’s not just that GPT-4 was pretty much as I anticipated but that the same problems have continued to plague every single model since”
Our reading: Almost all of his December 2022 predictions about GPT-4 remain true, and the same problems plague every model since, including GPT-5, Claude, Gemini, Grok, Llama and DeepSeek.
No horizon Evidence as of
Limitation: Representative failures cannot establish a universal claim about all model versions.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Observation
“Worse, it doesn’t prove that its premise—that exponentially increasing compute—will actually bring us to artificial general intelligence. He’s conflating costs going up exponentially with benefits going up exponentially.”
Our reading: Jensen Huang's claim of exponential compute demand does not show that exponentially increasing compute will bring AGI; he conflates exponential costs with exponential benefits.
No horizon Evidence as of
Limitation: This assesses the referenced argument, not the eventual feasibility of AGI.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Conditional forecast
“If the economy goes down, ChatGPT will be at the center of the mess.”
Our reading: If the economy goes down, ChatGPT will be at the center of the mess.
No deadline stated Evidence as of
Only if: if the economy goes down
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Forecast
“I think that the recurring core technical problems that we have seen (as discussed below) with LLMs aren’t going way; instead they inherent to the technology.”
Our reading: The recurring core technical problems of LLMs are inherent to the technology and will not go away.
No deadline stated Evidence as of
Limitation: The formal and practical meanings of hallucination differ.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Observation
“But time has shown that its results have held strong.”
Our reading: The MIT finding that only 5% of companies get a return on generative AI investment has held up.
No horizon Evidence as of
Limitation: Similar difficulties scaling AI do not independently corroborate a 5% return prevalence.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Forecast
“I just don’t happen to think large language models like ChatGPT will get us there.”
Our reading: Large language models like ChatGPT will not get us to AGI.
No deadline stated Evidence as of
Limitation: AGI and the architectural boundary are not precisely defined.
Source: Three years on, ChatGPT still isn't what it was cracked up to be – and it probably never will be
Assessment: UnresolvedSaid
Observation
“The first and most obvious answer is money, which I estimate, back of the envelope as (roughly) a trillion dollars, much of it on Nvidia chips and massive salaries.”
Our reading: Supposing for the sake of argument that LLMs have run their course and new ideas are needed, Marcus estimates, back of the envelope, the money cost of the field taking so long to recognize this at roughly a trillion dollars, much of it on Nvidia chips and massive salaries.
No horizon Evidence as of
Limitation: The spending boundary and starting date remain ambiguous.
Assessment: UnresolvedSaid
Observation
“Suffice for now to say that we have built (and continue to build) our entire national policy (such as it is) around an idea that was never grounded in a sound analysis of AI.”
Our reading: The US has built, and continues to build, its entire national policy (such as it is) around an idea, in context the AI 2027 picture of imminent AGI, that was never grounded in a sound analysis of AI.
No horizon Evidence as of
Limitation: The packet lacks policy-development records and the technical analyses actually relied upon during January 20–November 21, 2025.
Source: BREAKING: The AI 2027 doomsday scenario has officially been postponed
Assessment: UnresolvedSaid
Observation
“In short, Altman was—likely in conjunction with Nvidia, which also just seemed to be laying groundwork for a bailout—launching a full court press for loan guarantees when he got caught with hands in the cookie jar.”
Our reading: Altman was launching a full court press for federal loan guarantees, likely in conjunction with Nvidia, which also seemed to be laying groundwork for a bailout.
No horizon Evidence as of
Limitation: The metaphor leaves the required intensity imprecise.
Assessment: UnresolvedSaid
Observation
“But it is no longer about lying to employees. It is about directly lying to the American public.”
Our reading: Sam Altman is now directly lying to the American public, not just to employees.
No horizon Evidence as of
Limitation: The submission does not expressly request guarantees for OpenAI's own data-center borrowing [e2].
Assessment: UnresolvedSaid
Conditional forecast
“Which means you, the taxpayer, will be footing the bill.”
Our reading: If the government goes along, taxpayers will end up paying for AI companies' borrowing.
No deadline stated Evidence as of
Only if: if the government goes along with the backstop
Source: OpenAI probably can’t make ends meet. That’s where you come in.
Assessment: UnresolvedSaid
Observation
“Nonetheless, a very large fraction of our economy is going into the world of price wars and little moat, massive, massive investments into companies that are all basically following the same strategy of investing more and more money into one single idea, viz. scaling ever larger language models, in hopes that something magical will emerge.”
Our reading: A very large fraction of the US economy is going into massive investments in companies that are all basically following the same strategy of scaling ever larger language models, in hopes that something magical will emerge.
No horizon Evidence as of
Limitation: The broad equipment, software, R&D and data-center categories do not isolate investment in larger-language-model development.
Assessment: UnresolvedSaid
Observation
“Yet investments in the same single approach grow every day.”
Our reading: Investments in the single LLM/transformer approach continue to grow.
No horizon Evidence as of
Limitation: The evidence lacks a comparable aggregate series isolating LLM/transformer investment in Q3 2025 and earlier periods.
Assessment: UnresolvedSaid
Observation
“Modest profits was maybe a bit optimistic, with most LLM developers losing money.”
Our reading: Most LLM developers are losing money.
No horizon Evidence as of
Limitation: The selected financial interval is an evaluator interpretation.
Assessment: UnresolvedSaid
Conditional forecast
“If and when the whole generative AI edifice comes crashing down, it will be in no small part because too many otherwise smart investors read too many graphs—from “LLM scaling” to usage statistics—too naively, assuming that things had been going up for a while would continue to go up at the same pace, indefinitely.”
Our reading: If generative AI collapses, a large part of the cause will be investors naively extrapolating scaling and usage trends.
No deadline stated Evidence as of
Only if: if and when the generative AI edifice comes crashing down
Assessment: UnresolvedSaid
Causal claim
“The problem, as always, lies in generalizing outside the training distribution.”
Our reading: The problem with vibe coding lies, as always, in generalizing outside the training distribution.
No horizon Evidence as of
Limitation: Qualitative reports do not measure causal effects.
Source: Is vibe coding dying?
Assessment: UnresolvedSaid
Forecast
“Remember how in October and in March I told you that vibe coding — in the sense of amateurs using large language models to write code to “build products that would have previously required teams of engineers” — would never be remotely reliable?”
Our reading: Vibe coding by amateurs using LLMs to build products that previously required engineering teams will never be remotely reliable.
No deadline stated Evidence as of
Limitation: Most of the evidence is anecdotal or comes from a vendor's CEO.
Source: Is vibe coding dying?
Assessment: UnresolvedSaid
Observation
“I found that the claim of “solution” was pretty misleading, as I summed up in a tweet, and they refused to correct their misleading presentation:”
Our reading: In 2019 OpenAI's claim that its robot 'solved' the Rubik's cube was misleading, and OpenAI refused to correct it.
No horizon Evidence as of
Limitation: Disagreement over wording does not by itself prove a factual misrepresentation.
Source: Erdosgate
Assessment: UnresolvedSaid
Observation
“June, 2025: the Apple reasoning paper confirmed that even with “reasoning”, LLMs still can’t solve distribution shift, the core Achille’s heel in neural networks that I have been writing about for nearly 30 years.”
Our reading: Even with reasoning, LLMs still cannot handle distribution shift, as the June 2025 Apple paper confirmed.
No horizon Evidence as of
Limitation: The competing papers are evidence of a scientific dispute, not equally decisive demonstrations.
Source: Game over. AGI is not imminent, and LLMs are not the royal road to getting there.
Assessment: UnresolvedSaid
Observation
“We aren’t close to AGI, but we are reshaping our world on the premise that we are.”
Our reading: We are not close to AGI.
No horizon Evidence as of
Limitation: Benchmark failures do not measure time remaining to AGI.
Source: The Grand AGI Delusion
Assessment: UnresolvedSaid
Observation
“And schoolchildren using ChatGPT to do their homework aren’t enough to cover that.”
Our reading: Schoolchildren using ChatGPT to do their homework are not enough to cover OpenAI's immense costs and cash burn.
No horizon Evidence as of
Limitation: The reporting window and meaning of 'cover that' are not explicit.
Source: OpenAI’s future, foretold?
Assessment: UnresolvedSaid
Forecast
“that LLM scaling would not bring us to AGI”
Our reading: Scaling LLMs will not produce AGI.
No deadline stated Evidence as of
Limitation: There is no universally accepted AGI test.
Assessment: UnresolvedSaid
Forecast
“Perhaps I also no longer need to warn people that the idea that coding would disappear soon is bullshit.”
Our reading: Human coding will not disappear soon due to AI.
No deadline stated Evidence as of
Limitation: This leaves the forecast open because of its timing, not because the evidence shows human coding disappeared.
Assessment: UnresolvedSaid
Observation
“Watch the tuners come and go! So much for object permanence.”
Our reading: Grok's generated video failed to keep objects consistent, with the bass tuners appearing and disappearing.
No horizon Evidence as of
Limitation: No evidence items show what the video contains.
Source: Spinal Tap meets John Malkovich
Assessment: UnresolvedSaid
Causal claim
“Agency plus LLMs have already led multiple “vibe coders” to lose databases, with new reports coming in every day or two, stemming simply from the unreliability inherent in LLMs (that Gary has so often harped on).”
Our reading: Agency combined with LLMs has already led multiple vibe coders to lose databases, with new reports every day or two, and these losses stem simply from the unreliability built into LLMs.
No horizon Evidence as of
Limitation: The Cursor incident rests on a user allegation without execution logs or an independent postmortem [e2].
Assessment: UnresolvedSaid
Forecast
“The bad news is that although this one was stopped, many others won’t be. No one patch would be enough, or even a thousand; there are just too many variations on the overall theme”
Our reading: Many attacks on AI coding tools won't be stopped; not even a thousand patches would suffice given the number of variations.
No deadline stated Evidence as of
Limitation: The evidence concerns researcher demonstrations rather than a census of malicious attacks.
Assessment: UnresolvedSaid
Forecast
“But between the disappointments of GPT-5 and a new study from METR that shows that LLMs do markedly better on coding benchmarks than in real-word practice, I think it is safe to say that LLMs won’t lead the way.”
Our reading: LLMs will not be the approach that leads the way to AGI.
No deadline stated Evidence as of
Limitation: The first accepted AGI is an interpretation of 'lead the way', not a criterion Marcus explicitly supplied.
Assessment: UnresolvedSaid
Causal claim
“Critically, as I argued at the end of June (and going back to 2019) LLMs never induce proper world models, which is why, for example, they still can’t even play chess reliably,1 and continue to make stupid, head-scratching errors with startling regularity.”
Our reading: LLMs never induce proper world models, which causes them to be unable to play chess reliably and to make frequent stupid errors.
No horizon Evidence as of
Limitation: The strongest intervention evidence concerns a specialist chess model.
Assessment: UnresolvedSaid
Causal claim
“ChatGPT gets them wrong because it is munging words together, not genuinely processing an (elementary) model of British PM history.”
Our reading: ChatGPT gets the British prime minister tasks wrong because it is munging words together rather than genuinely processing an elementary model of British PM history.
No horizon Evidence as of
Limitation: Evidence from Llama-2 cannot directly support or contradict a claim about GPT-5's internal processing.
Assessment: UnresolvedSaid
Observation
“They don’t induce abstract models of the world that they can reliably engage, even when those models are given to them on a silver platter (as with the rules of chess).”
Our reading: LLMs do not induce abstract world models they can reliably use, even when given the rules explicitly.
No horizon Evidence as of
Limitation: RuleArena tests practical regulations rather than chess.
Assessment: UnresolvedSaid
Observation
“Even with thinking mode activated, the output was filled with errors that could easily have been avoided, with a 5-second Wikipedia search that any sensible human could have performed.”
Our reading: GPT-5 in thinking mode produced a list of Canadian Prime Ministers full of easily avoidable errors.
No horizon Evidence as of
Limitation: The retrieved plain-text version of the post does not supply independently verifiable image provenance.
Assessment: UnresolvedSaid
Observation
“The real news is a breaking study from Arizona State University that fully vindicates what I have told you for nearly 30 years—and more recently what Apple told you—about the core weakness of LLMs: their inability to generalize broadly.”
Our reading: LLMs' core weakness is their inability to generalize broadly, as confirmed by an ASU study.
No horizon Evidence as of
Limitation: This assesses the August 5 version available when Marcus wrote.
Source: GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
Assessment: UnresolvedSaid
Observation
“Driverless cars that still are only available in couple percent of the world’s cities.”
Our reading: Driverless cars are available in only a couple percent of the world's cities.
No horizon Evidence as of
Limitation: This does not establish that worldwide availability exceeded his estimate.
Source: GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
Assessment: UnresolvedSaid
Observation
“What the mainstream media mostly hasn’t told you yet is that a few days later, hardly anybody is buying Altman’s story.”
Our reading: A few days after launch, hardly anybody believes Altman's claims that GPT-5 is like a PhD-level expert.
No horizon Evidence as of
Limitation: The evidence is news reports of individual reactions, not representative data.
Source: GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
Assessment: UnresolvedSaid
Observation
“Even some of the tech bros are waking up to the reality that “AGI in 2027” was marketing, not reality.”
Our reading: Even some tech bros are waking up to the reality that 'AGI in 2027' was marketing, not reality.
No horizon Evidence as of
Limitation: The observation concerns public attitudes by August 2025, not whether AGI ultimately arrives in 2027.
Source: GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
Assessment: UnresolvedSaid
Observation
“The challenge of parts and wholes in generative images that Ernest Davis and I discussed here in December fared no better.”
Our reading: GPT-5 shows no improvement on the parts-and-wholes problem in generated images.
No horizon Evidence as of
Limitation: The only systematic test predates GPT-5 and used ChatGPT-4o.
Source: GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
Assessment: UnresolvedSaid
Observation
“Elon is moving faster. Anthropic and Google and many others are nipping at their heels. Their relationship with Microsoft has frayed.”
Our reading: Elon Musk is moving faster than OpenAI, Anthropic and Google and many others are nipping at OpenAI's heels, and OpenAI's relationship with Microsoft has frayed.
No horizon Evidence as of
Limitation: Release cadence, benchmark rank and rate of capability improvement are different measures.
Source: GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
Assessment: UnresolvedSaid
Observation
“It’s not like other systems are faring much better.”
Our reading: Other generative AI systems such as Grok are not faring much better than GPT-5.
No horizon Evidence as of
Limitation: The packet contains no verified primary comparison from the August 7–9 launch window.
Source: GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
Assessment: UnresolvedSaid
Causal claim
“In practice, those mistakes and errors have greatly limited the utility agents like ChatGPT agent.”
Our reading: Mistakes and errors have greatly limited the utility of agents like ChatGPT agent.
No horizon Evidence as of
Limitation: The causal evidence consists of small, selected task demonstrations.