Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

The Second Worst $100B Investment in The History of AI?

We recorded 13 claims from this post. 2 were checked against evidence. 11 can’t be checked. 1 more is held. Read the post at its source.

Claims from this post (13)

In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.

  1. Assessment: UnresolvedSaid

    “Most of those who invested in driverless cars lost money, unless they invested early and cashed out, before patience began to run out.”

    What we tested: Most of those who invested in driverless cars lost money, unless they invested early and cashed out before patience began to run out.

  2. Assessment: Can’t be checkedSaid

    “By any reasonable account the worst investment in the history of AI has to be the over $100 billion that have been invested in “driverless” cars.”

    What we tested: By any reasonable account, the over $100 billion invested in driverless cars has to be the worst investment in the history of AI.

  3. Assessment: UnresolvedSaid

    “There may be a payoff someday, but thus far there has not been a lot.”

    What we tested: As of March 2024, investment in driverless cars has not produced much payoff.

  4. Assessment: Can’t be checkedSaid

    “The generality of Waymo’s approach is very much still in question, and I am not sure anyone else is still seriously in the full autonomy game.”

    What we tested: The generality of Waymo's approach (to conditions such as bad weather, poorly mapped roads and different driving patterns) is very much still in question, and Marcus is not sure anyone else is still seriously in the full autonomy game.

  5. Assessment: Can’t be checkedSaid

    “But misery loves company, and the forlorn $100B may see company before the end of the decade.”

    What we tested: Before the end of the decade, another $100B AI investment (Microsoft/OpenAI's Stargate) may join driverless cars as a poor investment.

  6. Assessment: Can’t be checkedSaid

    “A $100B LLM is still an LLM.”

    What we tested: A $100B LLM is still an LLM.

  7. Assessment: Can’t be checkedSaid

    “Driverless cars were crippled by the endless long tail of outliers; LLMs may well pattern similarly, working in many cases but often troubled by the unexpected, even when scaled.”

    What we tested: LLMs, even when scaled, may well remain often troubled by unexpected cases, as driverless cars were by the long tail of outliers.

  8. Assessment: Can’t be checkedSaid

    “Reasoning and planning in unexpected scenarios are still likely to be flawed.”

    What we tested: Even a $100B LLM will likely still have flawed reasoning and planning in unexpected scenarios.

  9. Assessment: Can’t be checkedSaid

    “On many tasks, the results might be only slightly better than a $10B model or a $1B model, but the operating costs presumably would be much larger.”

    What we tested: On many tasks, a $100B LLM's results might be only slightly better than those of a $10B or $1B model, while its operating costs would presumably be much larger.

  10. Assessment: Can’t be checkedSaid

    “On most problems, customers probably would not be willing to pay the required premium.”

    What we tested: On most problems, customers probably would not pay the premium required by a $100B LLM.

  11. Assessment: Can’t be checkedSaid

  12. Assessment: Can’t be checkedSaid

  13. Assessment: Can’t be checkedSaid

    “If they are wrong, the net effect will be to delay AGI, because their project will siphon away talent from other approaches – just as it already has, but more so.”

    What we tested: If the Stargate premises are wrong, the project will delay AGI by siphoning talent away from other approaches.

Held from this post (1)

These records did not pass every check, so nothing about them is published. Held is not a finding.