Pundit ClaimsAI claims by Gary Marcus and Ed Zitron, with the evidence

Changes, page 36 of 52

Every substantive change to the register, newest first. Speaker events record what the people covered said or changed. Site events record what this site published, corrected, flagged, or withdrew. The two never share a label.

Substantive changes (10273)

Page 36 of 52: changes 7001 to 7200 of 10273, newest first. Dates are when the change was recorded.

  1. HeldBy this siteGary Marcus

    Held record marcus-oops-how-google-bombed-while-doing-bb9161

    e1 is decisive for a financial claim but states no metric scope

  2. Assessment publishedBy this siteGary Marcus

    Hallucinating web search could be dangerous if left to run amok in domains like medicine, and promises to fix it are scientifically problematic.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-oops-how-google-bombed-while-doing-772c19-a1.

  3. HeldBy this siteGary Marcus

    Held record marcus-oops-how-google-bombed-while-doing-6726ff

    The anthropic review does not accept e4 as contradicts.

  4. Assessment publishedBy this siteGary Marcus

    If hallucinations are not fixed soon, which they may not be, people may quickly tire of chat-based search and return to traditional search.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-oops-how-google-bombed-while-doing-35c27e-a1.

  6. Assessment publishedBy this siteGary Marcus

    Most likely neither Google's nor Microsoft's chatbot search product is particularly reliable.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-oops-how-google-bombed-while-doing-0dfcae-a1.

  8. HeldBy this siteGary Marcus

    Held record marcus-one-genai-image-ten-errors-c5349e

    The anthropic review reads the claim differently.

  10. Assessment publishedBy this siteGary Marcus

    The physical errors (and one conceptual error) in the Midjourney image discussed in the post are of a piece with hallucinations and near-plagiarism.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-one-genai-image-ten-errors-37e75c-a1.

  12. Assessment publishedBy this siteGary Marcus

    Readers should never trust AI hype, such as claims that ChatGPT writes poetry indistinguishable from Shakespeare.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-on-hype-and-the-unbearable-banality-3ae6b2-a1.

  14. Assessment publishedBy this siteGary Marcus

    Employees should not panic yet about AI replacing their jobs.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-on-employment-dont-panic-yet-2603c4-a1.

  15. Assessment publishedBy this siteGary Marcus

    For now, employers should not focus on replacing humans with AI and should instead use AI to help their existing workers.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-on-employment-dont-panic-yet-219c0b-a1.

  17. HeldBy this siteGary Marcus

    Held record marcus-o3-agi-the-art-of-the-demo-and-what-cdebf1

    The anthropic review does not accept e9 as contradicts.

  18. Assessment publishedBy this siteGary Marcus

    The o3 demo does not change the view that AGI requires true logical reasoning rather than statistical tricks.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-b9eae1-a1.

  20. Assessment publishedBy this siteGary Marcus

    No one outside OpenAI has evaluated o3's robustness across different problem types.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-a8b6ba-a1.

  21. Assessment publishedBy this siteGary Marcus

    o3 may work on problems allowing massive data augmentation but not on problems that do not.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-a36471-a1.

  22. Assessment publishedBy this siteGary Marcus

    During 2025, many AI influencers and possibly some companies will claim AGI has been reached.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-9f5bee-a1.

  23. Assessment publishedBy this siteGary Marcus

    OpenAI's o3 is not the long-awaited GPT-5.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-9b659d-a1.

  24. Assessment publishedBy this siteGary Marcus

    o3's best demo results showed truly impressive major advances on ARC and FrontierMath.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-9a94fb-a2.

  25. Assessment publishedBy this siteGary Marcus

    As of the demo, o3 had not been released to the public nor vetted by the scientific community.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-8bf959-a1.

  26. HeldBy this siteGary Marcus

    Held record marcus-o3-agi-the-art-of-the-demo-and-what-6ddd11

    e2 is dated 2024-12, which is not inside the period described (… to 2024-12-20); it can only be context

  27. HeldBy this siteGary Marcus

    Held record marcus-o3-agi-the-art-of-the-demo-and-what-612921

    "likely" is hedged or probabilistic; one outcome does not score it; hedged language is not scored, even on a plain reading

  28. Assessment publishedBy this siteGary Marcus

    The environmental impact of such high-compute AI systems could be immense.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-55f5eb-a1.

  29. Assessment publishedBy this siteGary Marcus

    AI demos should not be taken seriously until the products are released and subjected to outside scrutiny.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-4ff1bc-a1.

  30. Assessment publishedBy this siteGary Marcus

    Those claiming AGI are likely to craft definitions post hoc or give none at all.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-4abc95-a1.

  31. Assessment publishedBy this siteGary Marcus

    Many basic problems on the path to AGI remain unsolved.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-256352-a1.

  32. Assessment publishedBy this siteGary Marcus

    People should not assume o3 is reliable until many people have tested it on many kinds of tasks.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-21773e-a1.

  33. Assessment publishedBy this siteGary Marcus

    Spending a quarter trillion dollars to get systems 1000x more expensive than humans is maybe not the right approach.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-o3-agi-the-art-of-the-demo-and-what-17e769-a1.

  34. HeldBy this siteGary Marcus

    Held record marcus-o3-agi-the-art-of-the-demo-and-what-11221b

    The anthropic screen reads the claim differently.

  35. Assessment publishedBy this siteGary Marcus

    The economics of generative AI could get wild.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nvidia-could-soon-take-a-serious-fec58e-a1.

  36. HeldBy this siteGary Marcus

    Held record marcus-nvidia-could-soon-take-a-serious-90b3b7

    The openai screen reads the claim differently.

  39. Assessment publishedBy this siteGary Marcus

    Marcus doubts that Altman would have given up his OpenAI board seat if there had really been nothing against him that even looked like a legitimate grievance.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-not-consistently-candid-821d92-a1.

  40. Assessment publishedBy this siteGary Marcus

    Altman's indirect stake in OpenAI through Y Combinator may be worth tens of millions of dollars.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-not-consistently-candid-6f602e-a1.

  42. Assessment publishedBy this siteGary Marcus

    If Altman was already working on the Rain chip deal when he testified to the Senate in May 2023, he should have disclosed it.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-not-consistently-candid-53ab62-a1.

  43. Assessment publishedBy this siteGary Marcus

    If the OpenAI board was trying to return OpenAI to its original mission of AI for human interest rather than profit, it should be praised, not condemned.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-not-consistently-candid-17f348-a1.

  44. Assessment publishedBy this siteGary Marcus

    LaMDA is not sentient.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nonsense-on-stilts-d6fb09-a1.

  45. HeldBy this siteGary Marcus

    Held record marcus-nonsense-on-stilts-d3b80d

    The anthropic screen reads the claim differently.

  46. Assessment publishedBy this siteGary Marcus

    Language models like LaMDA string words together without any coherent understanding of the world.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nonsense-on-stilts-cd38ec-a1.

  47. Assessment publishedBy this siteGary Marcus

    Marcus doubts that LaMDA and similar language models will play any important role in the future of AI.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nonsense-on-stilts-a29178-a1.

  48. Assessment publishedBy this siteGary Marcus

    No AI system that anyone knew how to build in 2022 is sentient.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nonsense-on-stilts-9d49da-a1.

  49. Assessment publishedBy this siteGary Marcus

    LaMDA-style language models only match statistical patterns of human language, and their output has no real meaning.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nonsense-on-stilts-96e570-a1.

  50. Assessment publishedBy this siteGary Marcus

    Neither LaMDA nor similar large language models such as GPT-3 are remotely intelligent.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nonsense-on-stilts-75d580-a1.

  51. Assessment publishedBy this siteGary Marcus

    Fooling people into thinking a program is intelligent is not the same as building an intelligent program.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nonsense-on-stilts-48f130-a1.

  52. Assessment publishedBy this siteGary Marcus

    Everything LaMDA says is bullshit with no real meaning behind it.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nonsense-on-stilts-28eaa9-a1.

  53. Assessment publishedBy this siteGary Marcus

    Current AI does not firmly have the sound logic, reliable causal reasoning, and originality that Nobel-calibre science requires.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nobel-prizes-and-the-ai-hype-hall-cd169c-a1.

  54. HeldBy this siteGary Marcus

    Held record marcus-nobel-prizes-and-the-ai-hype-hall-c80802

    the horizon on 2026-10-28 is not_due, not open_horizon

  55. HeldBy this siteGary Marcus

    Held record marcus-nobel-prizes-and-the-ai-hype-hall-c3ca51

    hedged language is not scored, even on a plain reading

  56. Assessment publishedBy this siteGary Marcus

    Even in the best AI-for-science work, such as Google's AI co-scientist, human scientists still choose the research goals.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nobel-prizes-and-the-ai-hype-hall-bfc85e-a1.

  57. Assessment publishedBy this siteGary Marcus

    In AI it is easy to build demos covering 80% of a task such as driving or a scientific problem, but getting the last 20% is often very hard.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nobel-prizes-and-the-ai-hype-hall-b2dc5a-a1.

  58. HeldBy this siteGary Marcus

    Held record marcus-nobel-prizes-and-the-ai-hype-hall-9dfc90

    The anthropic screen reads the claim differently.

  59. HeldBy this siteGary Marcus

    Held record marcus-nobel-prizes-and-the-ai-hype-hall-8558de

    The anthropic screen reads the claim differently.

  60. Assessment publishedBy this siteGary Marcus

    Nobel-calibre science is much harder than driving, and AI still has not reliably solved driving.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nobel-prizes-and-the-ai-hype-hall-81f40e-a1.

  61. Assessment publishedBy this siteGary Marcus

    Current AI cannot reliably solve river-crossing puzzles.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nobel-prizes-and-the-ai-hype-hall-612ee6-2-a1.

  62. Assessment publishedBy this siteGary Marcus

    Elon Musk's 2019 promise of over a million Tesla robotaxis has largely failed to come true.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-nobel-prizes-and-the-ai-hype-hall-33890b-a1.

  63. HeldBy this siteGary Marcus

    Held record marcus-nobel-prizes-and-the-ai-hype-hall-137618

    hedged language is not scored, even on a plain reading

  64. HeldBy this siteGary Marcus

    Held record marcus-nobel-prizes-and-the-ai-hype-hall-0ac7a1

    the conclusive event's date differs from its evidence

  65. HeldBy this siteGary Marcus

    Held record marcus-nobel-prizes-and-the-ai-hype-hall-08b51c

    The openai review found the criteria unfair to the speaker's words.

  66. HeldBy this siteGary Marcus

    Held record marcus-noam-chomsky-and-gpt-3-faccda

    The openai review found the criteria unfair to the speaker's words.

  67. Assessment publishedBy this siteGary Marcus

    GPT-3 cannot avoid producing misinformation because it models how words relate to each other, not how language relates to the world.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-noam-chomsky-and-gpt-3-f648bc-a1.

  68. Assessment publishedBy this siteGary Marcus

    LLMs' failures argue strongly for exploring Kantian AI systems that start with built-in representations of space, time, causality and some universal grammar.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-noam-chomsky-and-gpt-3-d8d192-a1.

  69. Assessment publishedBy this siteGary Marcus

    For AI to understand language, it should process language through built-in commonsense understanding instead of starting as a blank slate and learning statistics.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-noam-chomsky-and-gpt-3-c49391-a1.

  70. Assessment publishedBy this siteGary Marcus

    Because systems like GPT-3 don't tell us why human languages have the special character that they do, they have little explanatory value.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-noam-chomsky-and-gpt-3-c476d0-a1.

  72. HeldBy this siteGary Marcus

    Held record marcus-noam-chomsky-and-gpt-3-75df3d

    The final-text check failed: rationale_supported_by_evidence; overclaims: e2 studies GPT-2 and smaller models, not GPT-3..

  73. Assessment publishedBy this siteGary Marcus

    Systems like GPT-3 do not gravitate towards human language, and they never develop a cohesive understanding of the world, no matter how much experience they have.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-noam-chomsky-and-gpt-3-61b596-a1.

  75. Assessment publishedBy this siteGary Marcus

    New AI systems with a firmer innate, Kantian basis might eventually tell us more about the human mind.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-noam-chomsky-and-gpt-3-5ad6a3-a1.

  76. Assessment publishedBy this siteGary Marcus

    Doing well on a benchmark does not amount to being intelligent.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-e8ff52-a1.

  77. Assessment publishedBy this siteGary Marcus

    The AI field should not lower its AGI goal from Star Trek computer-level to merely beating an average person.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-d9df8f-a1.

  79. Assessment publishedBy this siteGary Marcus

    A genuine AGI must reliably do multidigit arithmetic.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-cda2a4-a1.

  80. Assessment publishedBy this siteGary Marcus

    Around early 2022, before LLM euphoria, the field assumed AGI meant more than beating ordinary humans.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-cc7110-a2.

  81. Assessment publishedBy this siteGary Marcus

    AI still has a long way to go on reasoning, compositionality, planning, and factuality.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-c974be-a1.

  82. Assessment publishedBy this siteGary Marcus

    An AGI should do what it is asked, decline what it cannot do, and know the difference.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-c8e452-a1.

  83. Assessment publishedBy this siteGary Marcus

    LLMs cannot reliably write summaries without hallucinating.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-b7e604-a1.

  84. HeldBy this siteGary Marcus

    Held record marcus-no-virginia-agi-is-not-imminent-aa764b

    The final-text check failed: citations_correct.

  85. HeldBy this siteGary Marcus

    Held record marcus-no-virginia-agi-is-not-imminent-6f7105

    The anthropic review reads the claim differently.

  87. Assessment publishedBy this siteGary Marcus

    Marcus doubts LLMs or any extant AI can summarize and reliably answer questions about original films and TV programs.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-544b2c-a1.

  88. Assessment publishedBy this siteGary Marcus

    Beating AI benchmarks is often a statistical artifact and says less than people assume.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-5387d8-a1.

  89. Assessment publishedBy this siteGary Marcus

    Without knowing the training corpus, one can hardly conclude what a machine understands or how general it is.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-447af8-a1.

  90. Assessment publishedBy this siteGary Marcus

    AI benchmarks are often quite gameable.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-39aa05-a2.

  91. Assessment publishedBy this siteGary Marcus

    Because current systems ingest massive data possibly including sample exams, benchmark success is even less indicative of intelligence than in 2019.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-27976b-a1.

  92. Assessment publishedBy this siteGary Marcus

    Marcus seriously doubts that AI is close to beating typical human performance on virtually all cognitive tasks.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-26c457-a1.

  93. Assessment publishedBy this siteGary Marcus

    Generality, the ability to cope with new things, is what would make AGI general, and that is precisely where current AI is still lacking.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-15eaa7-a1.

  94. HeldBy this siteGary Marcus

    Held record marcus-no-virginia-agi-is-not-imminent-09b64e

    The openai screen doubts the attribution.

  95. Assessment publishedBy this siteGary Marcus

    AGI standards should not be lowered so big tech can prematurely declare victory, since much work remains.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-virginia-agi-is-not-imminent-04db25-a1.

  96. HeldBy this siteGary Marcus

    Held record marcus-no-sora-has-not-learned-physics-404d76

    The anthropic screen reads the claim differently.

  98. HeldBy this siteGary Marcus

    Held record marcus-no-rag-is-probably-not-going-to-rescue-f16f8e

    The anthropic screen reads the claim differently.

  99. Assessment publishedBy this siteGary Marcus

    RAG is immature, not guaranteed correct, and there is no evidence it is a cure-all for LLM problems.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-rag-is-probably-not-going-to-rescue-ee4809-a2.

  100. Assessment publishedBy this siteGary Marcus

    Getting RAG from a research idea to reliable production remains difficult.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-rag-is-probably-not-going-to-rescue-e0f14c-a1.

  102. Assessment publishedBy this siteGary Marcus

    RAG may somewhat reduce hallucinations but will not come close to eliminating them.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-rag-is-probably-not-going-to-rescue-afdf2d-a2.

  103. Assessment publishedBy this siteGary Marcus

    Every LLM, with or without RAG, should probably carry a disclaimer after each response.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-rag-is-probably-not-going-to-rescue-a483c2-a1.

  105. Assessment publishedBy this siteGary Marcus

    So far retrieval-augmented generation has produced inconsistent results.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-rag-is-probably-not-going-to-rescue-38ee57-a1.

  106. Assessment publishedBy this siteGary Marcus

    Investors have put over $100 billion into driverless cars and so far have little to show for it.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-rag-is-probably-not-going-to-rescue-28a2dc-a1.

  107. Assessment publishedBy this siteGary Marcus

    Expecting RAG to fix LLMs' problems is like waiting for a miracle.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-rag-is-probably-not-going-to-rescue-282d32-a1.

  111. Assessment publishedBy this siteGary Marcus

    It seems likely that Sam Altman will return to OpenAI and the board will resign.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-one-person-should-be-trusted-here-895f9e-a1.

  113. Assessment publishedBy this siteGary Marcus

    OpenAI's original structure was meant to make the for-profit serve the non-profit, with a financially disinterested board looking out for humanity.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-one-person-should-be-trusted-here-5d3e24-a1.

  114. HeldBy this siteGary Marcus

    Held record marcus-no-one-person-should-be-trusted-here-49c08d

    The openai screen reads the claim differently.

  115. Assessment publishedBy this siteGary Marcus

    Reaching AGI will require new ideas, not merely new code optimizations.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-need-to-panic-about-anthropics-fd88df-a1.

  116. HeldBy this siteGary Marcus

    Held record marcus-no-need-to-panic-about-anthropics-d9b71e

    The final-text check failed: rationale_supported_by_evidence, citations_correct; overclaims: The report retains human responsibility for choosing research goals..

  117. HeldBy this siteGary Marcus

    Held record marcus-no-need-to-panic-about-anthropics-cece9a

    The final-text check failed: citations_correct.

  118. Assessment publishedBy this siteGary Marcus

    Pure deep learning has largely hit a wall, and neurosymbolic AI is rescuing it.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-need-to-panic-about-anthropics-beac4c-a1.

  119. Assessment publishedBy this siteGary Marcus

    AGI, a machine that can autonomously do anything a human can do, has not been achieved.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-need-to-panic-about-anthropics-bcf02b-a1.

  120. Assessment publishedBy this siteGary Marcus

    Achieving AGI is harder than achieving recursive self-improvement.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-need-to-panic-about-anthropics-8e85fb-a1.

  121. Assessment publishedBy this siteGary Marcus

    Anthropic's blog shows considerable coding advances, and its argument for slowing down AI research should be considered.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-need-to-panic-about-anthropics-89bf48-a1.

  122. Assessment publishedBy this siteGary Marcus

    There is no need to panic yet about Anthropic's results.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-need-to-panic-about-anthropics-3672ac-a1.

  123. Assessment publishedBy this siteGary Marcus

    A faster AI coding tool will probably not end the world.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-need-to-panic-about-anthropics-353225-a1.

  124. Assessment publishedBy this siteGary Marcus

    Users of popular GenAI systems might accidentally get into legal trouble because the systems do not list sources or warn about possible infringement.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-multimodal-chatgpt-is-not-going-e402ee-a1.

  125. HeldBy this siteGary Marcus

    Held record marcus-no-multimodal-chatgpt-is-not-going-e04f38

    The openai review found the criteria unfair to the speaker's words.

  126. HeldBy this siteGary Marcus

    Held record marcus-no-multimodal-chatgpt-is-not-going-c7862e

    "likely" is hedged or probabilistic; one outcome does not score it; hedged language is not scored, even on a plain reading

  128. Assessment publishedBy this siteGary Marcus

    GenAI developers will not easily escape copyright problems, and copyright infringement lawyers will have plenty of work.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-multimodal-chatgpt-is-not-going-bc5816-a1.

  129. Assessment publishedBy this siteGary Marcus

    Almost nothing in AI is truly trivial.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-multimodal-chatgpt-is-not-going-b5a5d4-a1.

  131. HeldBy this siteGary Marcus

    Held record marcus-no-multimodal-chatgpt-is-not-going-8bc786

    The openai review abstained.

  132. Assessment publishedBy this siteGary Marcus

    Gary Marcus still thinks that licensing is the best and only way to go in dealing with generative AI's copyright problems.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-multimodal-chatgpt-is-not-going-79fee3-a1.

  133. HeldBy this siteGary Marcus

    Held record marcus-no-multimodal-chatgpt-is-not-going-63ace3

    The anthropic review found the criteria unfair to the speaker's words.

  134. Assessment publishedBy this siteGary Marcus

    In a 45-minute test, multimodal ChatGPT was unreliable at identifying the copyrighted sources of Midjourney-generated images.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-multimodal-chatgpt-is-not-going-5a9763-a2.

  135. Assessment publishedBy this siteGary Marcus

    Output similarity may be central in many upcoming lawsuits, and their outcome could greatly affect the economics of generative AI.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-multimodal-chatgpt-is-not-going-13aa21-a1.

  137. HeldBy this siteGary Marcus

    Held record marcus-no-dario-amodei-we-will-not-be-curing-ebd3ce

    The anthropic screen doubts the attribution.

  138. Assessment publishedBy this siteGary Marcus

    AI will not make the disease-curing contributions Hassabis described within the next decade, though it might someday.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-dario-amodei-we-will-not-be-curing-d2d3a2-a1.

  139. HeldBy this siteGary Marcus

    Held record marcus-no-dario-amodei-we-will-not-be-curing-aacab9

    The anthropic screen reads the claim differently.

  140. HeldBy this siteGary Marcus

    Held record marcus-no-dario-amodei-we-will-not-be-curing-9c5a21

    The anthropic screen reads the claim differently.

  143. Assessment publishedBy this siteGary Marcus

    If Amodei believes his claims, he should do a medical internship to better understand the challenges in medicine.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-dario-amodei-we-will-not-be-curing-3451f4-a1.

  144. HeldBy this siteGary Marcus

    Held record marcus-no-dario-amodei-we-will-not-be-curing-3015c8

    The openai review found the criteria unfair to the speaker's words.

  145. Assessment publishedBy this siteGary Marcus

    Amodei has a habit of giving people unrealistic hope, and Marcus does not respect this about him.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-dario-amodei-we-will-not-be-curing-15a49f-a1.

  146. Assessment publishedBy this siteGary Marcus

    Anthropic does not actually want a pause on AI development, at least for now.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-anthropic-did-not-call-for-a-pause-f99681-a1.

  147. HeldBy this siteGary Marcus

    Held record marcus-no-anthropic-did-not-call-for-a-pause-8b926e

    The openai screen reads the claim differently.

  148. Assessment publishedBy this siteGary Marcus

    Anthropic will likely point to China, as it always does, and keep rushing ahead with AI development.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-anthropic-did-not-call-for-a-pause-80d1e4-a1.

  149. Assessment publishedBy this siteGary Marcus

    Anthropic does not plan to pause AI development and is unlikely ever to do so.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-no-anthropic-did-not-call-for-a-pause-583910-a1.

  150. Assessment publishedBy this siteGary Marcus

    Large language models associate patterns without really understanding them; they are statistics without comprehension.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-new-ways-to-corrupt-llms-e91556-a1.

  151. Assessment publishedBy this siteGary Marcus

    Bad actors could easily use subliminal learning techniques to corrupt LLMs for harmful purposes.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-new-ways-to-corrupt-llms-dc937b-a1.

  152. Assessment publishedBy this siteGary Marcus

    Weird generalization in LLMs is an avenue that bad actors could easily exploit.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-new-ways-to-corrupt-llms-262499-a1.

  153. Assessment publishedBy this siteGary Marcus

    If society is put in the hands of giant, superficial correlation machines such as LLMs, it is not going to end well.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-new-ways-to-corrupt-llms-251370-a1.

  154. HeldBy this siteGary Marcus

    Held record marcus-new-ways-to-corrupt-llms-026817

    The anthropic screen finds the claim checkable, so it must be graded.

  155. Assessment publishedBy this siteGary Marcus

    LLMs only string together sequences of words and have no coherent understanding of the world behind them.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-new-adventures-in-ai-hype-our-language-cd38ec-a1.

  157. Assessment publishedBy this siteGary Marcus

    LaMDA and similar language models may not play any important role in the future of AI.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-new-adventures-in-ai-hype-our-language-a29178-a1.

  158. Assessment publishedBy this siteGary Marcus

    Anthropic fails to respect the rights of the artists and writers whose work it takes.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-new-adventures-in-ai-hype-our-language-67d7b9-a1.

  160. HeldBy this siteGary Marcus

    Held record marcus-new-adventures-in-ai-hype-our-language-52d256

    The anthropic review found the criteria unfair to the speaker's words.

  161. Assessment publishedBy this siteGary Marcus

    Marcus's 2022 argument that LaMDA was not sentient and lacked understanding applies equally to Anthropic's Claude.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-new-adventures-in-ai-hype-our-language-216d91-a1.

  163. Assessment publishedBy this siteGary Marcus

    Anthropic CEO Dario Amodei is rattled by DeepSeek, and his essay is defensive.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-my-conversation-with-chinas-victor-fd8547-a1.

  164. Assessment publishedBy this siteGary Marcus

    The LLM race is enormously expensive and can no longer be won by any country.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-my-conversation-with-chinas-victor-f6c434-a1.

  165. HeldBy this siteGary Marcus

    Held record marcus-my-conversation-with-chinas-victor-de2c29

    a observation claim cannot be assessed on the causal_assessment axis

  166. HeldBy this siteGary Marcus

    Held record marcus-my-conversation-with-chinas-victor-dba2bb

    The two reviews differ: anthropic historical_observation/not_applicable/supported, openai historical_observation/not_applicable/unresolved.

  167. Assessment publishedBy this siteGary Marcus

    Anthropic's main advantage is having more chips, but AI progress really needs better ideas and room for innovative startups.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-my-conversation-with-chinas-victor-bceef0-a1.

  168. HeldBy this siteGary Marcus

    Held record marcus-my-conversation-with-chinas-victor-a475df

    hedged language is not scored, even on a plain reading

  169. HeldBy this siteGary Marcus

    Held record marcus-my-conversation-with-chinas-victor-87e7c5

    The openai screen reads the claim differently.

  170. HeldBy this siteGary Marcus

    Held record marcus-my-conversation-with-chinas-victor-74dccc

    The final-text check failed: citations_correct.

  171. HeldBy this siteGary Marcus

    Held record marcus-my-conversation-with-chinas-victor-652d2e

    The anthropic screen reads the claim differently.

  172. Assessment publishedBy this siteGary Marcus

    It is still embarrassing to the US AI giants that a leaner, hungrier startup abroad (DeepSeek) got there first on cost reductions.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-my-conversation-with-chinas-victor-595867-a1.

  173. Assessment publishedBy this siteGary Marcus

    The country that does its best to develop new AI technology that is more reliable and harder to replicate than LLMs will win the race.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-my-conversation-with-chinas-victor-4dc095-a1.

  175. Assessment publishedBy this siteGary Marcus

    DeepSeek's cost reductions were ones US labs would have achieved before long anyway.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-my-conversation-with-chinas-victor-25bf78-a1.

  176. HeldBy this siteGary Marcus

    Held record marcus-musk-grok-and-rigorous-adherence-1d47c3

    The anthropic screen doubts the attribution.

  177. HeldBy this siteGary Marcus

    Held record marcus-muddles-about-models-e9c668

    The anthropic screen reads the claim differently.

  178. Assessment publishedBy this siteGary Marcus

    AI is unlikely ever to be trustworthy if its makers keep skipping explicit cognitive models of the world.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-muddles-about-models-e3fd2f-a1.

  179. Assessment publishedBy this siteGary Marcus

    Marcus conjectures that ChatGPT cannot reliably say how many white bishops remain, or what happened to a captured pawn, partway through a chess game.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-muddles-about-models-ddc350-a1.

  180. Assessment publishedBy this siteGary Marcus

    AI safety will not emerge anytime soon, and probably never, from correlation-based systems that lack structured, interrogable representations of the world.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-muddles-about-models-a120e9-a1.

  181. Assessment publishedBy this siteGary Marcus

    Correlations found inside LLMs are not causal, semantic world models.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-muddles-about-models-906956-a1.

  182. Assessment publishedBy this siteGary Marcus

    The correlations with space and time in Gurnee and Tegmark's findings do not show that LLMs genuinely represent space or time.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-muddles-about-models-6d610a-a1.

  183. Assessment publishedBy this siteGary Marcus

    GPT's failure to stick to the rules of chess, even when it plays a decent game, reflects the same problem: correlations are fragile and cannot be counted on.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-muddles-about-models-566f8e-a1.

  184. HeldBy this siteGary Marcus

    Held record marcus-muddles-about-models-45a553

    a causal claim cannot be assessed on the forecast_outcome axis

  185. HeldBy this siteGary Marcus

    Held record marcus-muddles-about-models-44de94

    The anthropic screen reads the claim differently.

  186. Assessment publishedBy this siteGary Marcus

    Without flexible underlying models, AI systems will keep producing hallucinations and hit-or-miss reasoning, and will lack the needed stability.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-muddles-about-models-390731-a2.

  188. HeldBy this siteGary Marcus

    Held record marcus-muddles-about-models-1d532e

    The anthropic screen doubts the attribution.

  189. HeldBy this siteGary Marcus

    Held record marcus-muddles-about-models-0d2dd7

    The anthropic screen reads the claim differently.

  190. Assessment publishedBy this siteGary Marcus

    The new Upwork Research Institute study on generative AI is incredibly damning.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-most-people-dont-think-genai-has-e5545e-a1.

  191. HeldBy this siteGary Marcus

    Held record marcus-most-people-dont-think-genai-has-ab0049

    The openai review does not accept e2 as supports.

  192. Assessment publishedBy this siteGary Marcus

    Microsoft Bing completely flubbed the prompt "people going yuck towards Generative AI", 4 out of 4 results.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-most-people-dont-think-genai-has-32cdc1-a2.

  194. Assessment publishedBy this siteGary Marcus

    Claude Code is a real advance, and Mythos probably builds on some of what was learned from it.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-misplaced-panic-over-ai-progress-f51636-a1.

  195. Assessment publishedBy this siteGary Marcus

    Wildeford's concern that Mythos has 'broken' the METR time-horizon graph is a red herring, because the graph only measures 50% success.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-misplaced-panic-over-ai-progress-eaaaf2-a1.

  196. Assessment publishedBy this siteGary Marcus

    Reliability has been the key problem with GenAI, and the METR graph at 50% success does not address reliable performance at all.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-misplaced-panic-over-ai-progress-ac6eb9-a1.

  197. HeldBy this siteGary Marcus

    Held record marcus-misplaced-panic-over-ai-progress-aadf56-2

    The anthropic screen reads the claim differently.

  199. Assessment publishedBy this siteGary Marcus

    Anticipating that Anthropic will have $2T revenue in 2030 is a perfect example of the trillion pound baby fallacy.

    First assessment published after both reviews and the final-text check passed.

    Assessment marcus-misplaced-panic-over-ai-progress-9138d0-a1.