Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

“The problem is that these pieces aren’t about breakthroughs — they’re marketing collateral dressed up as technological progress, superficially-exciting yet hollow on the inside, which almost feels a little too on the nose.”

Put Up Or Shut Up, paragraph 25. The full statement is at the source.

Our reading, the sentence that was checked:

The stories about OpenAI's Strawberry and AGI levels are marketing collateral, not reports of breakthroughs.

Assessment: Unresolved Evidence as of

Where and when Ed Zitron wrote it

Where's Your Ed At, Put Up Or Shut Up, paragraph 25.

Said
Source observed
live page, full text, public
Evidence as of
the cutoff for this assessment
Assessment recorded
assessment wyea-put-up-or-shut-up-e2499b-a2

We recorded 19 claims from this post. See every claim from this post.

The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2024-07-16. This page does not claim the wording was captured then.

What the claim commits to

Kind
Observation
Deadline, as the speaker wrote it
None stated. This site does not add one.
Deadline state when assessed
No horizon
Deadline state on 2026-10-29
No horizon (the release’s reference date)

From the speaker

  • these pieces aren’t about breakthroughs
  • marketing collateral dressed up as technological progress
  • hollow on the inside

Our interpretation

  • These pieces means the July 2024 Bloomberg levels report and Reuters Strawberry report discussed in the post.
  • The ordinary factual reading is that the stories promote unverified development claims rather than establish a substantial demonstrated technical advance.
  • Marketing collateral is treated as an assertion about promotional substance, not automatically as an allegation of payment or company authorship.
  • The target period covers the articles and their pre-post updates. Later releases cannot establish what the articles demonstrated at publication.

Counts as supported if: The articles and underlying records establish that their apparent progress claims consisted of promotional plans without a substantiated material capability advance.

Counts as contradicted if: The reporting and its underlying records substantiate a material demonstrated advance, or establish a factual basis inconsistent with the characterization that the stories were substantively hollow promotion.

Retrospective: these criteria were written after the outcome was public.

Current assessment

Was it true for the period described?

Outcome: Unresolved

The record was checked, and the evidence available by the cutoff does not settle it.

Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.

Evidence as of
Deadline state when assessed
No horizon
Assessment recorded
Policy version
2026-10-28.7

Rationale

Bloomberg's July 11, 2024 report describes a provisional levels framework and an internal demonstration that OpenAI believed showed new reasoning skills [e1]. Reuters's July 15, 2024 version reports sources' accounts of Q* demonstrations and an internal MATH score above 90%, while saying it could not link that score to Strawberry [e2]. These reports contain attributed capability claims, but do not independently establish a material breakthrough [e1] [e2]. They also do not establish that the underlying work lacked technical substance, so the characterization as hollow promotion remains unresolved [e1] [e2].

Limitations

  • The supplied articles do not provide technical records that independently validate the reported demonstrations or benchmark result [e1] [e2].
  • The articles do not establish promotional intent or the absence of underlying technical progress [e1] [e2].
  • The claim specifies no technical threshold for a breakthrough.

Evidence (2 items)

  • Supports the claim: Bloomberg, syndicated by Yahoo Finance,

    a work in progress.

    Why it matters here: The article describes a provisional classification and company expectations, supporting the narrower criticism that it does not establish a completed breakthrough. It also reports an internal demonstration, so provisional status does not establish that the underlying work was hollow.

    Publisher
    Bloomberg, syndicated by Yahoo Finance
    Kind of source
    News report
    Describes events of
    Public from
  • Context only: Reuters, syndicated by Yahoo Finance,

    could not determine

    Why it matters here: Reuters reports claimed internal demonstrations and a benchmark result, while expressly limiting its attribution to Strawberry. This complicates the description of the story as merely empty plans, but the report does not independently validate a Strawberry breakthrough.

    Publisher
    Reuters, syndicated by Yahoo Finance
    Kind of source
    News report
    Describes events of
    Public from

What would settle it

Contemporaneous technical and sourcing records establishing whether the July 11–15, 2024 reports reflected a demonstrated material advance or only promotional plans, assessed against an explicit breakthrough threshold.

Where it was said (1)

Said once in the sources this register covers.

  • : Where's Your Ed At, Put Up Or Shut Up

    The problem is that these pieces aren’t about breakthroughs — they’re marketing collateral dressed up as technological progress, superficially-exciting yet hollow on the inside, which almost feels a little too on the nose.

    Published
    2024-07-16
    Source observed
    , live page
    Access
    full text, public

History

Assessment versions

Recorded events

  1. Assessment publishedBy this site

    First assessment published after both reviews and the final-text check passed.

    About assessment wyea-put-up-or-shut-up-e2499b-a2.

  2. HeldBy this site

    The final-text check failed: citations_correct.

    About assessment wyea-put-up-or-shut-up-e2499b-a1, which was not published.