Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

“Generative AI is imperfect and costly to run, yet is held up as a solution to many problems that it can't even begin to fix.”

Software Has Eaten The Media, paragraph 41. The full statement is at the source.

Our reading, the sentence that was checked:

Generative AI is imperfect and costly to run, yet is held up as a solution to many problems that it can't even begin to fix.

Assessment: Can’t be checked Evidence as of

Where and when Ed Zitron wrote it

Where's Your Ed At, Software Has Eaten The Media, paragraph 41.

Said
Source observed
live page, full text, public
Evidence as of
the cutoff for this assessment
Assessment recorded
assessment wyea-the-anti-economy-6cfef8-a2

We recorded 8 claims from this post. See every claim from this post.

The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-02-27. This page does not claim the wording was captured then.

What the claim commits to

Kind
Observation
Deadline, as the speaker wrote it
None stated. This site does not add one.
Deadline state when assessed
No horizon
Deadline state on 2026-10-29
No horizon (the release’s reference date)

Conditions

  • many problems (scope, stated by the speaker)

From the speaker

  • Generative AI
  • imperfect
  • costly to run
  • held up as a solution
  • many problems
  • can't even begin to fix

Our interpretation

  • Errors and inference resource costs are independently measurable factual components.
  • The complete assertion does not identify the set of promoted problems, the promoters, or what counts as beginning to fix a problem.
  • The surrounding examples suggest concerns about coding, image generation and assistants, but do not define the broader set denoted by many problems.
  • Choosing a task basket and a minimum useful contribution would determine the verdict. There is no sufficiently stable plain reading for grading the complete assertion.
  • Many problems is a scope qualifier, not a conditional forecast antecedent. The sentence does not assert that generative AI is useless for every task.

This claim is not graded on evidence. The record checks that the words are quoted correctly and attributed to the right person, and that the claim is classified correctly.

Current assessment

Not graded on evidence

Outcome: Can’t be checked

The statement is a recommendation, a value judgment, or too open to test. It is recorded, not scored.

Evidence as of
Deadline state when assessed
No horizon
Assessment recorded
Policy version
2026-10-28.7

Rationale

The statement leaves “many problems” unspecified and gives no standard for “beginning to fix” them, so the whole claim cannot be scored reliably [wyea-the-anti-economy-6cfef8-o1]. OpenAI’s March 2023 GPT-4 report acknowledged factual and reasoning errors [e1]. A study published November 28, 2023 found that content-generating tasks were the most energy-intensive tasks in its tested sample [e2]. In a coding experiment completed June 20, 2022, participants with Copilot completed a JavaScript HTTP-server task 55.8% faster than controls [e3]. These findings address particular models and tasks, without settling the claim about unspecified promoted problems [e1, e2, e3].

Limitations

  • The energy comparison establishes relative energy use in the tested sample, not monetary operating costs or company losses [e2].
  • The coding result does not establish benefits on other tasks or rule out failure on other problems [e3].
  • The evidence does not pair a defined set of promotional promises with evaluations using a stated standard for useful progress [e1, e2, e3].

Evidence (3 items)

No outcome evidence: a claim of this kind is recorded and attributed, not scored.

Where it was said (1)

Said once in the sources this register covers.

  • : Where's Your Ed At, Software Has Eaten The Media

    Generative AI is imperfect and costly to run, yet is held up as a solution to many problems that it can't even begin to fix.

    Published
    2024-02-27
    Source observed
    , live page
    Access
    full text, public

History

Assessment versions

Recorded events

  1. Assessment publishedBy this site

    First assessment published after both reviews and the final-text check passed.

    About assessment wyea-the-anti-economy-6cfef8-a2.

  2. HeldBy this site

    The final-text check failed: rationale_supported_by_evidence; overclaims: the records document model errors and substantial inference resource demands, alongside useful assistance on a coding task..

    About assessment wyea-the-anti-economy-6cfef8-a1, which was not published.