Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Pop Culture

We recorded 27 claims from this post. 15 were checked against evidence. 12 can’t be checked. 21 more are held. Read the post at its source.

Claims from this post (27)

In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.

  1. Assessment: ContradictedSaid

    “And yes, that sound you hear is the slow deflation of the bubble I've been warning you about since March.”

    What we tested: The generative AI bubble is slowly deflating as of July 2024.

    What happened: Their account of PitchBook data reports record generative-AI investment in Q2. The same article describes weaker US seed activity and cooler enthusiasm, so the contradiction concerns broad financial contraction. (Aspiring for Intelligence — Sabrina Albert and Vivek Ramaswami, )

  2. Assessment: SupportedSaid

    “For Goldman to suddenly turn on the AI movement suggests that it’s extremely anxious about the future of generative AI, with almost everybody agreeing on one core point: that the longer this tech takes to make people money, the more money it's going to need to make.”

    What we tested: The longer generative AI takes to make money, the more money it will need to make.

    What happened: The investor's model illustrates the recurring recovery burden from continued AI infrastructure spending. Its numerical estimate is not treated as audited industry profit or as a figure claimed by Zitron. (Sequoia Capital — David Cahn, )

  3. Assessment: Can’t be checkedSaid

  4. Assessment: Can’t be checkedSaid

  5. Assessment: UnresolvedSaid

    “Or, put another way, each additional step becomes increasingly (and exponentially) more expensive to take.”

    What we tested: Each additional step of AI model improvement becomes exponentially more expensive.

  6. Assessment: UnresolvedSaid

  7. Assessment: Can’t be checkedSaid

    “In essence, replacing humans with AI might break everything if you're one of those bosses that doesn't actually know what the fuck it is they're talking about.”

    What we tested: Replacing human workers with AI may break operations when the managers doing it do not understand the work.

  8. Assessment: UnresolvedSaid

  9. Assessment: Can’t be checkedSaid

    “These are not things that you can train in a dataset, because they're derived from experiences inside and outside of the creative process.”

    What we tested: The adaptability, judgment and responsibility of human creative workers cannot be trained into AI via datasets.

  10. Assessment: Can’t be checkedSaid

    “And fully replacing any creative is so very unlikely if you're doing so based on copying a million pieces of someone else's homework.”

    What we tested: Fully replacing any creative worker is very unlikely if it is done by copying a million pieces of someone else's work.

  11. Assessment: UnresolvedSaid

  12. Assessment: Can’t be checkedSaid

  13. Assessment: UnresolvedSaid

    “Yet, I have a counterpoint: no it doesn't.”

    What we tested: OpenAI does not have a secret, unreleased breakthrough technology.

  14. Assessment: UnresolvedSaid

    “Generative AI, as I said back in March, is peaking, if it hasn't already peaked.”

    What we tested: Generative AI is peaking or has already peaked.

  15. Assessment: ContradictedSaid

    “It cannot do much more than it is currently doing, other than doing more of it faster with some new inputs.”

    What we tested: Generative AI cannot do much more than it currently does, beyond doing it faster with new inputs.

    What happened: The public evaluation reported 97.8% success on basic Blocksworld and 52.8% on its obfuscated version, where earlier tested LLMs remained below 5%. These are substantive planning gains; the event date denotes publication of the demonstration, since exact test-run dates are not supplied. (Valmeekam, Stechly, Gundawar and Kambhampati / arXiv, )

  16. Assessment: ContradictedSaid

    “It isn’t getting much more efficient.”

    What we tested: Generative AI is not getting much more efficient.

    What happened: The paper reports stronger model performance with 93.3% less attention-cache memory than DeepSeek 67B. Its deployment tests report 5.76 times the generation throughput on an eight-H800 node using the earlier service's workload distribution, demonstrating substantial resource-efficiency gains. (DeepSeek-AI / arXiv, )

  17. Assessment: Can’t be checkedSaid

  18. Assessment: Can’t be checkedSaid

  19. Assessment: UnresolvedSaid

    “The jobs market isn't going to change because of generative AI, because generative AI can't actually do many jobs, and it's mediocre at the few things that it's capable of doing.”

    What we tested: Generative AI will not change the jobs market because it can't do many jobs and is mediocre at what it can do.

  20. Assessment: UnresolvedSaid

  21. Assessment: Can’t be checkedSaid

    “Generative AI is not the future, but a regurgitation of the past, a useful-yet-not-groundbreaking way to quickly generate "new" data from old that costs far too much to make the compute and energy demands worth it.”

    What we tested: Generative AI is not the future but a regurgitation of the past: a useful but not groundbreaking way to quickly generate 'new' data from old, which costs far too much to make its compute and energy demands worth it.

  22. Assessment: UnresolvedSaid

    “Basically, there's going to be a moment that spooks a venture capital firm into pushing one of its startups to sell, or the sudden, unexpected yet very obvious collapse of a major player.”

    What we tested: There will be a moment that spooks a venture capital firm into pushing one of its startups to sell, or a sudden, unexpected yet very obvious collapse of a major player.

  23. Assessment: UnresolvedSaid

    “I see no situation where OpenAI and Anthropic continue to iterate on Large Language Models in perpetuity, as at some point Microsoft, Amazon and Google decide (or are forced to decide) that cloud compute welfare isn't a business model.”

    What we tested: OpenAI and Anthropic will not be able to keep iterating on LLMs indefinitely because Microsoft, Amazon and Google will at some point stop subsidizing their compute.

  24. Assessment: Can’t be checkedSaid

    “Without a real, tangible breakthrough — one that would require them to leave the world of LLMs entirely, in my opinion — it's unclear how generative AI companies can survive.”

    What we tested: Without a real, tangible breakthrough, which in the author's opinion would require leaving LLMs entirely, it is unclear how generative AI companies can survive.

  25. Assessment: UnresolvedSaid

  26. Assessment: Can’t be checkedSaid

  27. Assessment: Can’t be checkedSaid

    “It's all a disgraceful waste.”

    What we tested: The generative AI boom is a disgraceful waste.

Held from this post (21)

These records did not pass every check, so nothing about them is published. Held is not a finding.