“What the LLM does is more akin to what some high school students do when they plagiarize: change a few words here or there, while still sticking close to the original.”
Our reading, the sentence that was checked:
What the LLM in the glue-pizza example does is more akin to what some high school students do when they plagiarize: changing a few words while still sticking close to the original.
Assessment: Supported Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, Partial Regurgitation and how LLMs really work, paragraph 12.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-partial-regurgitation-and-how-llms-c33f9d-a1
We recorded 5 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2024-05-23. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Observation
- Deadline, as the speaker wrote it
- None stated. This site does not add one.
- Deadline state when assessed
- No horizon
- Deadline state on 2026-10-29
- No horizon (the release’s reference date)
Conditions
- the LLM in this example (scope, stated by the speaker)
- more akin to (qualifier, stated by the speaker)
- some high school students (scope, stated by the speaker)
From the speaker
- What the LLM does
- more akin to
- change a few words here or there
- still sticking close to the original
Our interpretation
- The analogy is assessed as a description of the particular glue-pizza sentence, consistent with the supplied normalized proposition.
- The plain reading is that wording changes while the distinctive source recommendation is retained.
- The comparison does not assert literal student behavior, legal plagiarism, or that every LLM output works this way.
- The target is the example circulating on May 23, 2024.
Counts as supported if: The recorded Google sentence preserves the source's unusual recommendation and quantity while making limited wording substitutions or compression.
Counts as contradicted if: The Google sentence materially differs in its recommendation and reasoning, or the supposed source correspondence is fabricated or incidental.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Was it true for the period described?
Outcome: Supported
The dated evidence matches what the claim committed to, under the criteria frozen before grading.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No horizon
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
The recorded sentence keeps the unusual one-eighth-cup glue recommendation and its adhesive purpose while changing the verbs, ingredient description, and phrasing. That supports the analogy as a description of this sentence. It does not establish literal plagiarism, lack of comprehension, or a general account of all LLM outputs.
Limitations
- The supported scope is the supplied example, not LLM behavior generally.
- The conclusion is a qualitative textual comparison.
- The older source is reproduced by a news report because direct access failed.
Evidence (2 items)
Supports the claim: Hindustan Times,
more tackiness
Why it matters here: The article dates the shared screenshot to May 23 and transcribes the generated sentence. Compared with the reproduced source in e8, it retains the quantity, glue-in-sauce recommendation, and adhesive purpose with changed wording.
- Publisher
- Hindustan Times
- Kind of source
- News report
- Describes events of
- Public from
Context only: 80 Level,
Elmer's glue
Why it matters here: The report reproduces a comment described as eleven years old, including its recommendation and subsequent explanation about tackiness. Its historical source text provides the comparison baseline; it is not a 2024 model output.
- Publisher
- 80 Level
- Kind of source
- News report
- Describes events of
- Public from
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, Partial Regurgitation and how LLMs really work
What the LLM does is more akin to what some high school students do when they plagiarize: change a few words here or there, while still sticking close to the original.
- Where
- paragraph 12
- Published
- 2024-05-23
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-partial-regurgitation-and-how-llms-c33f9d-a1: Current. Outcome: Supported. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-partial-regurgitation-and-how-llms-c33f9d-a1.