Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

“To Summarize: Coding LLMs Don’t Actually Replace Software Engineers, and Never Will, Due To The Inherent Unreliability Of Large Language Models”

The Case Against Generative AI, paragraph 247. The full statement is at the source.

Our reading, the sentence that was checked:

Coding LLMs do not and never will replace software engineers because LLMs are inherently unreliable.

Assessment: Unresolved No deadline stated on 2026-10-29 Evidence as of

Where and when Ed Zitron wrote it

Where's Your Ed At, The Case Against Generative AI, paragraph 247.

Said
Source observed
live page, full text, public
Evidence as of
the cutoff for this assessment
Assessment recorded
assessment wyea-the-case-against-generative-ai-773a61-a1

We recorded 39 claims from this post. See every claim from this post.

The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2025-09-29. This page does not claim the wording was captured then.

What the claim commits to

Kind
Forecast
Deadline, as the speaker wrote it
None stated. This site does not add one.
Deadline state when assessed
No deadline stated
Deadline state on 2026-10-29
No deadline stated (the release’s reference date)

Conditions

  • due to inherent unreliability (qualifier, stated by the speaker)

From the speaker

  • Coding LLMs Don’t Actually Replace Software Engineers
  • Never Will
  • Due To The Inherent Unreliability Of Large Language Models

Our interpretation

  • Never supplies no finite deadline.
  • Replacement means sustained substitution for substantive software-engineering jobs, including demonstrably avoided hiring, rather than just generating code or saving some worker time.
  • Ordinary human management and review do not automatically disqualify replacement. Evidence must show that humans are not still doing the substantive work attributed to the replacement.
  • Inherent unreliability is the proposed explanation, not a conditional antecedent that must occur before the forecast can be assessed.

Counts as supported if: No finite period without replacement can establish the unlimited never prediction.

Counts as contradicted if: A documented deployment demonstrates reliable, sustained substitution for substantive software-engineering jobs and verifies the resulting labor substitution.

Retrospective: these criteria were written after the outcome was public.

Current assessment

Did the forecast come true?

Outcome: Unresolved

The record was checked, and the evidence available by the cutoff does not settle it.

Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.

Evidence as of
Deadline state when assessed
No deadline stated
Assessment recorded
Policy version
2026-10-28.7

Rationale

The prediction has no deadline. Anthropic reports reduced engineering hiring attributed to AI and increasingly autonomous work, which are meaningful counterevidence to a broad denial of substitution. The records examined do not establish a decisive, corroborated replacement deployment under the stated rule. The forecast therefore remains open; this is not evidence that never is correct.

Limitations

  • A broader reading that includes any avoided hiring would make the company survey more directly contradictory.
  • The strongest staffing evidence is company-reported.
  • The assessment does not require the disappearance of the profession or the absence of all human supervision.

Evidence (2 items)

  • Context only: Anthropic,

    hiring less due to AI

    Why it matters here: Reported reductions in hiring are material evidence against assuming that AI only adds output. However, managers' attribution does not independently verify the staffing counterfactual or sustained replacement of substantive jobs under the stated rule.

    Publisher
    Anthropic
    Kind of source
    Company disclosure: the company describing itself, not an independent finding
    Describes events of
    Public from
  • Context only: Anthropic, filed with the U.S. Securities and Exchange Commission,

    autonomous work alongside employees

    Why it matters here: The filing reports autonomous work but does not identify engineering positions replaced or measure the remaining human workload. It therefore does not satisfy the early-resolution rule.

    Publisher
    Anthropic, filed with the U.S. Securities and Exchange Commission
    Kind of source
    Regulatory filing
    Describes events of
    Public from

What would settle it

A dated deployment record tying reliable performance of substantive engineering work to verified eliminated or avoided engineering positions, with remaining human work disclosed.

Where it was said (1)

Said once in the sources this register covers.

  • : Where's Your Ed At, The Case Against Generative AI

    To Summarize: Coding LLMs Don’t Actually Replace Software Engineers, and Never Will, Due To The Inherent Unreliability Of Large Language Models

    Published
    2025-09-29
    Source observed
    , live page
    Access
    full text, public

History

Assessment versions

Recorded events

  1. Assessment publishedBy this site

    First assessment published after both reviews and the final-text check passed.

    About assessment wyea-the-case-against-generative-ai-773a61-a1.