“Because Deep Research lowers the effort, making it trivial to write legit-sounding articles, paper mill factories (there is already such a thing, designed to game citation counts, “an illegitimate, yet lucrative business“ that is growing) will massively ramp up production, choking the peer review process and saturating the market with hard-to-find, hard-to-rectify errors.”
Our reading, the sentence that was checked:
Because Deep Research lowers the effort and makes it trivial to write legit-sounding articles, paper mills will massively ramp up production, choking the peer review process and saturating the market with hard-to-find, hard-to-rectify errors.
Assessment: Unresolved No deadline stated on 2026-10-29 Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Deep Research, Deep Bullshit, and the potential (model) collapse of science, paragraph 34.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-deep-research-deep-bullshit-and-the-996dc7-a1
We recorded 13 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2025-02-03. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Forecast
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No deadline stated
- Deadline state on 2026-10-29
- No deadline stated (the release’s reference date)
Conditions
- because Deep Research lowers the effort, making it trivial to write legit-sounding articles (qualifier, stated by the speaker)
From the speaker
- Because Deep Research lowers the effort
- making it trivial to write legit-sounding articles
- paper mill factories
- will massively ramp up production
- choking the peer review process
- saturating the market with hard-to-find, hard-to-rectify errors
Our interpretation
- Deep Research means OpenAI's named product, rather than all generative AI or other companies' similarly named tools.
- The ordinary reading is a large increase in paper-mill production attributable to easier article generation with Deep Research, producing both serious peer-review overload and widespread errors that are difficult to detect and correct.
- Because states an asserted cause, not an if-then contingency. The causal connection is part of the forecast that must be established.
- Massively and choking require evidence of a substantial change and material disruption. Isolated fraudulent papers or ordinary reviewer workload are insufficient.
- No numerical threshold or deadline is supplied. I do not add one.
Counts as supported if: Credible investigations or publishing records document a large increase in paper-mill output attributable to OpenAI Deep Research, together with material peer-review overload and widespread errors that persist because detection and correction are difficult.
Counts as contradicted if: Decisive evidence establishes that the predicted causal sequence cannot occur. Nonoccurrence over a finite interval, successful screening at one venue, or evidence about other AI tools does not refute this undated forecast.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Did the forecast come true?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No deadline stated
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The evidence establishes a plausible mechanism and relevant surrounding problems. OpenAI advertised major time savings, NeurIPS organizers documented concerns about AI-written submissions, and a cancer-literature study found substantial suspected paper-mill contamination. But the latter predates Deep Research, and the NeurIPS report does not identify either this product or paper mills. None establishes the forecast's complete causal sequence. Marcus gave no deadline, so the absence of decisive evidence by 2026-10-28 is not a failed prediction.
Limitations
- The search cannot establish that no undisclosed paper-mill use exists.
- AI-text detection does not reliably establish which product generated a manuscript.
- The claim's scale and disruption thresholds are qualitative.
- The evidence items are context, not decisive outcome evidence.
Evidence (3 items)
Context only: OpenAI,
in tens of minutes
Why it matters here: OpenAI described substantial time savings when launching the product. This makes the proposed mechanism plausible but does not independently establish trivial article fabrication, paper-mill adoption, or publishing harm.
- Publisher
- OpenAI
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
Context only: NeurIPS Position Paper Track chairs,
acute risk to the peer review system
Why it matters here: Organizers reported extensive suspected AI writing and announced rejection or further scrutiny of submissions. This is relevant evidence of publishing strain, but their report does not establish paper-mill provenance, use of Deep Research, or the full predicted consequences.
- Publisher
- NeurIPS Position Paper Track chairs
- Kind of source
- Independent measurement
- Describes events of
- Public from
Context only: BMJ; abstract hosted by PubMed,
substantial numbers of flagged papers
Why it matters here: The study screened cancer papers published from 1999 through 2024 for similarity to paper-mill publications; the event date marks the corpus endpoint. It establishes a substantial pre-existing problem, not an increase caused by a product launched in 2025, and flagged papers are not individually confirmed fraud.
- Where
- Abstract, Results
- Publisher
- BMJ; abstract hosted by PubMed
- Kind of source
- Peer-reviewed paper
- Describes events of
- Public from
What would settle it
A dated, independently checked investigation linking substantial growth in paper-mill output to Deep Research, with publisher records showing resulting peer-review disruption and audits showing widespread errors that remain difficult to detect and correct.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Deep Research, Deep Bullshit, and the potential (model) collapse of science
Because Deep Research lowers the effort, making it trivial to write legit-sounding articles, paper mill factories (there is already such a thing, designed to game citation counts, “an illegitimate, yet lucrative business“ that is growing) will massively ramp up production, choking the peer review process and saturating the market with hard-to-find, hard-to-rectify errors.
- Where
- paragraph 34
- Published
- 2025-02-03
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-deep-research-deep-bullshit-and-the-996dc7-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-deep-research-deep-bullshit-and-the-996dc7-a1.