“Opensource models (though perhaps not Meta’s) are only a few months behind.”
Our reading, the sentence that was checked:
Open-source models, perhaps excluding Meta's, are only a few months behind frontier models.
Assessment: Supported Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Breaking news, and how the end might begin, paragraph 62.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-breaking-news-and-how-the-end-might-722136-a1
We recorded 22 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-28. The source may have been edited after 2026-06-10. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- perhaps not Meta's (qualifier, stated by the speaker)
From the speaker
- Opensource models
- (though perhaps not Meta's)
- only a few months behind
Our interpretation
- Read as: the best open-weight models trail the best closed frontier models by a few months of capability, as of the post.
- 'A few months' read plainly as roughly 2 to 6 months.
- Period: the most recent window public measurement covered before the post, January 2026 to June 10, 2026.
- The Meta caveat excludes Meta's models from the claim. The best open model in that window need not be Meta's.
Counts as supported if: A credible measurement around the post date showing the leading open-weight models lag the closed frontier by about 2 to 6 months.
Counts as contradicted if: A credible measurement showing the lag is a year or more, or that open models lead.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Supported
The dated evidence matches what the claim committed to, under the criteria frozen before grading.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Epoch AI measured the gap between the best open-weight and closed models from January 1 to May 28, 2026. It found an average lag of four months on its aggregate capability index, or six months under a stricter test. Both fit Marcus's 'only a few months behind'. Epoch cautions that the true gap may be somewhat larger, because open models can do worse on private benchmarks and labs may hold back their best closed models.
Limitations
- One measurement organization and one index.
- Epoch flags possible understatement of the gap.
Evidence (2 items)
Supports the claim: Epoch AI,
Since January 2026, the most capable open-weight models have lagged frontier closed models by an average of four months in the Epoch Capabilities Index (ECI), our aggregate measure of model capability.
Why it matters here: An average four-month lag over Jan to May 2026 fits 'only a few months behind'.
- Where
- paragraph 1
- Publisher
- Epoch AI
- Kind of source
- Independent measurement
- Describes events of
- Public from
Supports the claim: Epoch AI,
We find an average time gap of four months. This estimate would grow to six months if we required that the open-weight model’s point estimate for ECI be strictly higher
Why it matters here: Even under the stricter test the lag is six months, still within a plain reading of 'a few months'.
- Where
- section Analysis
- Publisher
- Epoch AI
- Kind of source
- Independent measurement
- Describes events of
- Public from
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Breaking news, and how the end might begin
Opensource models (though perhaps not Meta’s) are only a few months behind.
- Where
- paragraph 62
- Published
- 2026-06-10
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-breaking-news-and-how-the-end-might-722136-a1: Current. Outcome: Supported. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-breaking-news-and-how-the-end-might-722136-a1.