A Few Words About Bullshit
We recorded 3 claims from this post. 3 were checked against evidence. 3 more are held. Read the post at its source.
Claims from this post (3)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: UnresolvedSaid
“Just like every other large language model I have seen.”
What we tested: Like Galactica, every other large language model the author has seen prevaricates (fabricates content) a lot.
Assessment: UnresolvedSaid
“High school students will love it, and use it to fool and intimidate (some of) their teachers.”
What we tested: High school students will love Galactica and will use it to fool and intimidate some of their teachers.
Assessment: SupportedSaid
“Pitch perfect and utterly bogus imitations of science and math, presented as the real thing.”
What we tested: The Galactica examples Andrew Sundstrom shared are pitch-perfect but utterly bogus imitations of science and math, presented as the real thing.
What happened: The preserved response presents a purported paradox with formal sections and a solution, treating the sum of two 0.5 terms as 0.4 to reach this conclusion. Direct arithmetic gives 1, so the mathematical exposition is invalid despite its factual presentation. (Ernest Davis and Andrew Sundstrom, NYU-hosted experiment record, )
Held from this post (3)
These records did not pass every check, so nothing about them is published. Held is not a finding.