Bad Actors are Grooming LLMs to Produce Falsehoods
We recorded 4 claims from this post. 4 can’t be checked. 4 more are held. Read the post at its source.
Claims from this post (4)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: Can’t be checkedSaid
“GenAI powered chatbots’ lack of reasoning can directly contribute to the nefarious effects of LLM grooming: the mass-production and duplication of false narratives online with the intent of manipulating LLM outputs.”
What we tested: Generative AI chatbots' lack of reasoning can directly contribute to the harmful effects of LLM grooming by disinformation actors.
Assessment: Can’t be checkedSaid
“If the data that a model has been trained on or can access via real-time search has been tainted, then the model may well just regurgitate that tainted information.”
What we tested: If an LLM's training data or search-accessible data is tainted, the model may well regurgitate the tainted information.
Assessment: Can’t be checkedSaid
“To the extent that such systems are now supplying news to a large number of people, this is a serious failure, with potentially serious consequences.”
What we tested: To the extent that such systems now supply news to a large number of people, o3's failure to note that the Pravda network is a known disinformation network is a serious failure with potentially serious consequences.
Assessment: Can’t be checkedSaid
“In the meantime, systems of naive mimicry and regurgitation, such as the AIs we have now, are soiling their own futures (and training databases) every time they unthinkingly repeat propaganda.”
What we tested: Current AIs, being naive mimicry systems, degrade their own futures and training data whenever they repeat propaganda.
Held from this post (4)
These records did not pass every check, so nothing about them is published. Held is not a finding.