“Promises for world-changing science that rarely materialize.”
Our reading, the sentence that was checked:
Promises that AI will produce world-changing science rarely materialize.
Assessment: Unresolved Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it., paragraph 73.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-gpt-5-overdue-overhyped-and-underwhelming-589ed9-a1
We recorded 30 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2025-08-09. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
From the speaker
- Promises for world-changing science
- rarely materialize
- the last several years
Our interpretation
- The ordinary reading is that only a small proportion of promises of transformative AI-assisted scientific advances had delivered the promised results by the post date.
- The surrounding text describes several preceding years without specifying their beginning. The target period therefore has an unspecified start and ends on the post date.
- Individual successes or failures cannot establish how frequently promises materialized. Promises whose stated deadlines had not arrived must not be counted as failures.
Counts as supported if: A reasonably representative inventory of scientific promises and independently validated outcomes shows that fulfillment was infrequent by the post date, accounting for the promises' deadlines.
Counts as contradicted if: A reasonably representative inventory shows that fulfillment was common by the post date.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
AlphaFold supplies a substantial scientific success that must be included. It does not refute a claim that successes are rare. Conversely, examples of unmet promises would not establish rarity without a representative denominator. The searched evidence does not settle the frequency claim.
Limitations
- The searches were not an exhaustive census of AI science promises.
- Any numerical verdict would depend on definitions Marcus did not provide.
Evidence (1 item)
Context only: Royal Swedish Academy of Sciences / NobelPrize.org,
more than two million people from 190 countries.
Why it matters here: The Academy recognized AI-enabled protein structure prediction and documented extensive use. This is a material success that an assessment must include, but one success does not establish the proportion of promises fulfilled.
- Publisher
- Royal Swedish Academy of Sciences / NobelPrize.org
- Kind of source
- Secondary summary
- Describes events of
- Public from
What would settle it
A representative, dated inventory pairing scientific promises with independently validated outcomes and accounting for deadlines, with results robust to reasonable definitions of rarely and world-changing.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, GPT-5: Overdue, overhyped and underwhelming. And that’s not the worst of it.
Promises for world-changing science that rarely materialize.
- Where
- paragraph 73
- Published
- 2025-08-09
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-gpt-5-overdue-overhyped-and-underwhelming-589ed9-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-gpt-5-overdue-overhyped-and-underwhelming-589ed9-a1.