Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Gary Marcus Marcus on AI Published

Further Trouble in Hinton City

We recorded 4 claims from this post. 4 were checked against evidence. 6 more are held. Read the post at its source.

Claims from this post (4)

In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.

  1. Assessment: SupportedSaid

    “More evidence against his claims just keeps piling up.”

    What we tested: Evidence against Hinton's claims that GenAI understands and doesn't store things keeps accumulating.

    What happened: The public study documents sensitivity to meaning-preserving formatting changes. This supplies evidence of fragile generalization, although it does not establish an absence of understanding. (arXiv; Sclar and colleagues, )

  2. Assessment: UnresolvedSaid

    “GenAI systems do effectively store things. (In this case, canonical video game controller images.)”

    What we tested: GenAI systems effectively store things such as canonical video game controller images.

  3. Assessment: UnresolvedSaid

    “They (often) don’t come up with a novel independent design that would meet the requirements.”

    What we tested: GenAI systems often don't come up with a novel independent design that would meet the requirements.

  4. Assessment: UnresolvedSaid

    “Noncanonical situations continue to remain difficult for generative AI systems, precisely because frequent statistics are a mediocre substitute for deep understanding.”

    What we tested: Generative AI systems still struggle with noncanonical situations because frequency statistics are a poor substitute for deep understanding.

Held from this post (6)

These records did not pass every check, so nothing about them is published. Held is not a finding.