“Few people will fact-check its output carefully, since it will all superficially look ok.”
Our reading, the sentence that was checked:
Few people will carefully fact-check Deep Research's output, since it will all superficially look ok.
Assessment: Unresolved No deadline stated on 2026-10-29 Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Deep Research, Deep Bullshit, and the potential (model) collapse of science, paragraph 27.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-deep-research-deep-bullshit-and-the-5f6b63-a1
We recorded 13 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2025-02-03. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Forecast
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No deadline stated
- Deadline state on 2026-10-29
- No deadline stated (the release’s reference date)
Conditions
- since it will all superficially look ok (qualifier, stated by the speaker)
From the speaker
- Few people will fact-check its output carefully
- since it will all superficially look ok
Our interpretation
- “Its output” means OpenAI Deep Research reports.
- “Few” means a small minority of typical users, not simply anything below a majority.
- Careful fact-checking means substantively checking important claims and whether cited sources support them, beyond reading or checking formatting.
- “Since” supplies a causal explanation for the predicted behavior, not an if-then antecedent. The claim therefore does not require a separate condition event before assessment.
Counts as supported if: Representative behavioral evidence shows that only a small minority carefully check reports, and credible appearance demonstrably contributes to that behavior.
Counts as contradicted if: Representative evidence shows widespread careful checking, or credible causal evidence refutes the claimed role of superficial plausibility. If the frequency and causal components differ, assess them separately.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Did the forecast come true?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No deadline stated
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The searches did not find evidence establishing either how few Deep Research users carefully check reports or whether credible appearance causes low checking. General AI surveys and instructed expert audits do not answer those questions. “Since” is a proposed explanation, not an unmet condition that makes the forecast unscorable. With no deadline or conclusive event, it remains unresolved.
Limitations
- Checking behavior may vary substantially with expertise and task stakes.
- Self-reported confidence or checking would not by itself establish actual behavior or causation.
Evidence (0 items)
No evidence item settled this claim by the cutoff.
What would settle it
Representative observation of users' substantive verification behavior, combined with a controlled or otherwise credible causal study of how report presentation affects checking.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Deep Research, Deep Bullshit, and the potential (model) collapse of science
Few people will fact-check its output carefully, since it will all superficially look ok.
- Where
- paragraph 27
- Published
- 2025-02-03
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-deep-research-deep-bullshit-and-the-5f6b63-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-deep-research-deep-bullshit-and-the-5f6b63-a1.