Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Subprime Intelligence

We recorded 26 claims from this post. 16 were checked against evidence. 10 can’t be checked. 20 more are held. Read the post at its source.

Claims from this post (26)

In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.

  1. Assessment: Can’t be checkedSaid

  2. Assessment: Can’t be checkedSaid

    “These things are not "learning," or "understanding," or even "intelligent" — they're giant math machines that, while impressive at first, can never assail the limits of a technology that doesn't actually know anything.”

    What we tested: Generative AI models are not learning, understanding or intelligent and can never overcome the limits of a technology without knowledge.

  3. Assessment: UnresolvedSaid

    “The assumption is that audiences are stupid, and ignorant, and "just won't care," and I firmly disagree — I think regular people will find this stuff deeply offensive.”

    What we tested: Regular audiences will find AI-generated video with visual hallucinations deeply offensive rather than ignore it.

  4. Assessment: Can’t be checkedSaid

    “I believe artificial intelligence companies deeply underestimate how perfect the things around us are, and how deeply we base our understanding and acceptance of the world on knowledge and context.”

    What we tested: Zitron believes AI companies deeply underestimate how perfect the things around us are and how deeply we base our understanding and acceptance of the world on knowledge and context.

  5. Assessment: UnresolvedSaid

  6. Assessment: UnresolvedSaid

  7. Assessment: Can’t be checkedSaid

  8. Assessment: ContradictedSaid

    “ChatGPT can spin up piles of anodyne business copy, yet its outputs always require enough editing that it's questionable how much time you've actually saved.”

    What we tested: ChatGPT can spin up piles of anodyne business copy, but those outputs always require enough editing that it is questionable how much time is actually saved.

    What happened: The randomized experiment involved 453 professionals completing occupation-specific writing assignments. Substantial savings on completed work, accompanied by higher assessed quality, contradict the blanket claim under the stated reading of business copy. (Science; abstract reproduced by Stanford SCALE, )

  9. Assessment: UnresolvedSaid

    “Despite the frothy tales and visions of how generative artificial intelligence will automate our entire existence, there's a distinct lack of practical outputs that suggest that it is even capable of doing so.”

    What we tested: Despite frothy visions of generative AI automating our entire existence, there is a distinct lack of practical outputs suggesting it is even capable of doing so.

  10. Assessment: Can’t be checkedSaid

    “I don't argue it will, at least not in such a way that anybody's lives will be improved.”

    What we tested: Zitron doubts that generative AI, a product that can only sort-of-kind-of do something, will create trillions of dollars of economic value, at least not in a way that improves anybody's lives.

  11. Assessment: UnresolvedSaid

    “I believe that once reality catches up with artificial intelligence's marketing, there will be a dramatic knock-on effect that savages the entire tech industry.”

    What we tested: Zitron believes that once reality catches up with AI's marketing, there will be a dramatic knock-on effect that savages the entire tech industry.

  12. Assessment: Can’t be checkedSaid

    “I'd argue that a generative AI's inability to reliably generate stuff is an existential threat that should have smothered these companies early in their lives.”

    What we tested: Zitron argues that generative AI's inability to reliably generate output is an existential threat that should have smothered AI companies like OpenAI and Anthropic early in their lives.

  13. Assessment: SupportedSaid

    “And there are so many stories about how unreliable this technology is.”

    What we tested: Generative AI is unreliable, as shown by many stories.

    What happened: The court found that ChatGPT fabricated cases used in the March 1 filing. This is a primary judicial finding of incorrect generated material, rather than an allegation repeated by the speaker. (U.S. District Court for the Southern District of New York, reproduced by FindLaw, )

  14. Assessment: UnresolvedSaid

  15. Assessment: UnresolvedSaid

  16. Assessment: UnresolvedSaid

  17. Assessment: UnresolvedSaid

    “As a result, every interaction with ChatGPT or Claude is, on some level, guaranteed revenue for one of the big tech firms.”

    What we tested: Every interaction with ChatGPT or Claude is, on some level, guaranteed revenue for one of the big tech firms.

  18. Assessment: UnresolvedSaid

    “Moreover, the scale is different, and serving a webpage will always cost less than processing a request sent to a generative AI model.”

    What we tested: Processing a generative AI request will always cost more than serving a webpage.

  19. Assessment: Can’t be checkedSaid

    “Google's investment in Anthropic was made in the hopes that it’d see a similar revenue multiplier, and I'd argue Amazon's was made in the same vein — though it was too late to force Anthropic to use AWS as their preferred vendor.”

    What we tested: Google's investment in Anthropic was made hoping for a revenue multiplier like Microsoft's, and Zitron argues Amazon's was made in the same vein, though too late to force Anthropic to use AWS as its preferred vendor.

  20. Assessment: UnresolvedSaid

  21. Assessment: Can’t be checkedSaid

    “I consider myself relatively tuned into the tech ecosystem, and I read every single tech publication regularly, yet I'm struggling to point to anything that generative AI has done other than reignite the flames of venture capital.”

    What we tested: Zitron, who says he reads every tech publication regularly, is struggling to point to anything generative AI has done other than reignite venture capital.

  22. Assessment: SupportedSaid

    “There are cool little app integrations, interesting things like live translation in Samsung devices, but these are features, not applications.”

    What we tested: Generative AI integrations like live translation are features, not applications.

    What happened: Samsung's launch documentation places Live Translate inside its existing Phone app. That supports the feature-versus-standalone-product distinction for the named example. (Samsung Electronics, )

  23. Assessment: Can’t be checkedSaid

  24. Assessment: UnresolvedSaid

  25. Assessment: Can’t be checkedSaid

    “This industry is money-hungry, energy-hungry, and compute-hungry, yet it doesn't seem to be doing anything to sustain these otherworldly financial and infrastructural demands, other than the fact that people keep saying that "artificial intelligence is the future."”

    What we tested: The AI industry is money-, energy- and compute-hungry, yet it does not seem to be doing anything to sustain those demands other than people repeating that AI is the future.

  26. Assessment: UnresolvedSaid

Held from this post (20)

These records did not pass every check, so nothing about them is published. Held is not a finding.