Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

“(In reality, Imagen has no idea what weight, mass, or density are.)”

Horse rides astronaut, paragraph 63. The full statement is at the source.

Our reading, the sentence that was checked:

Imagen has no understanding of weight, mass or density.

Assessment: Unresolved Evidence as of

Where and when Gary Marcus wrote it

Marcus on AI, Horse rides astronaut, paragraph 63.

Said
Source observed
live page, full text, public
Evidence as of
the cutoff for this assessment
Assessment recorded
assessment marcus-horse-rides-astronaut-a6cd19-a1

We recorded 10 claims from this post. See every claim from this post.

The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2022-05-28. This page does not claim the wording was captured then.

What the claim commits to

Kind
Observation
Deadline, as the speaker wrote it
None stated. This site does not add one.
Deadline state when assessed
No horizon
Deadline state on 2026-10-29
No horizon (the release’s reference date)

From the speaker

  • Imagen has no idea
  • weight, mass, or density

Our interpretation

  • The target is the original Imagen system discussed in May 2022, not later Imagen versions.
  • For this ongoing state, the target period is May 2022 through publication, the period of the model’s initial public report.
  • The ordinary behavioral reading is that Imagen lacks systematic usable competence with these physical concepts.
  • This does not require deciding whether a machine has subjective understanding. Neither a single implausible image nor the architecture alone establishes absence of competence.

Counts as supported if: Controlled evaluations of the original model consistently fail to demonstrate usable knowledge of weight, mass and density across varied prompts, after accounting for general image-generation and language-following errors.

Counts as contradicted if: Controlled evaluations demonstrate systematic, transferable competence with one or more of these concepts, contradicting the blanket assertion of no understanding.

Retrospective: these criteria were written after the outcome was public.

Current assessment

Was it true for the period described?

Outcome: Unresolved

The record was checked, and the evidence available by the cutoff does not settle it.

Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.

Evidence as of
Deadline state when assessed
No horizon
Assessment recorded
Policy version
2026-10-28.7

Rationale

The searched records do not settle whether original Imagen had usable competence with weight, mass or density. General image benchmarks and failures on a horse–astronaut prompt do not establish the claimed absence of all such competence. No controlled evaluation of these concepts in the original model was located.

Limitations

  • The behavioral interpretation makes the claim testable but does not settle philosophical questions about understanding.
  • Missing evaluations are not evidence that the model lacked the concepts.

Evidence (1 item)

  • Context only: Google Research authors, published through arXiv,

    a comprehensive and challenging benchmark

    Why it matters here: The original report describes a text-to-image evaluation framework. The inspected evaluation does not establish either systematic competence or its absence for weight, mass and density.

    Publisher
    Google Research authors, published through arXiv
    Kind of source
    Preprint, not peer reviewed
    Describes events of
    Public from

What would settle it

Controlled tests of the preserved original model across weight, mass and density relationships, with matched language and rendering controls and independently scored outputs.

Where it was said (1)

Said once in the sources this register covers.

  • : Marcus on AI, Horse rides astronaut

    (In reality, Imagen has no idea what weight, mass, or density are.)

    Published
    2022-05-28
    Source observed
    , live page
    Access
    full text, public

History

Assessment versions

Recorded events

  1. Assessment publishedBy this site

    First assessment published after both reviews and the final-text check passed.

    About assessment marcus-horse-rides-astronaut-a6cd19-a1.