What scaling does and doesn’t buy you: peeling back the hype surrounding Google‘s trendy Nano Banana
We recorded 8 claims from this post. 5 were checked against evidence. 3 can’t be checked. 5 more are held. Read the post at its source.
Claims from this post (8)
In the order they appear in the post. Each quotation is the speaker’s words in this post. A label such as “Supported” or “Can’t be checked” is the claim’s current assessment; its page has the evidence and the reasons.
Assessment: Can’t be checkedSaid
“Thanks to scaling (and some other tricks), the graphics are terrific, and the ability to have it edit photos that you upload is genuinely cool.”
What we tested: Thanks to scaling (and some other tricks), Google's Nano Banana has terrific graphics, and its ability to edit uploaded photos is genuinely cool.
Assessment: UnresolvedSaid
“And guess what, surprise, surprise, even the latest models still struggle with compositionality”
What we tested: Even the latest image generation models, Nano Banana among them, still struggle with compositionality.
Assessment: UnresolvedSaid
“Over the last few years, graphics have gotten better and better. World models and comprehension less so.”
What we tested: Over the last few years, graphics in image generation systems have gotten better and better, while world models and comprehension have improved less.
Assessment: UnresolvedSaid
“Suffice to say that I was able to break nano banana literally on my first try:”
What we tested: Marcus got Nano Banana to fail on his very first attempt.
Assessment: UnresolvedSaid
“For all the hype, Nano Banana is not all that much better at this sort of thing than ChatGPT-5:”
What we tested: Despite the hype, Nano Banana is not much better than ChatGPT-5 at drawing part-whole structures such as bicycles.
Assessment: UnresolvedSaid
“ChatGPT, by the way, also continues to struggle with the basic facts of life:”
What we tested: ChatGPT still struggles with basic facts of life in image generation.
Assessment: Can’t be checkedSaid
“But it’s all still just an extended form of mimicry, not something deeper, as the persistent failures with parts and wholes keep showing us.”
What we tested: Image and video generation systems like these are still just an extended form of mimicry, not something deeper, as their persistent failures with parts and wholes keep showing.
Assessment: Can’t be checkedSaid
“Beauty is only skin deep.”
What we tested: The visual polish of generative image systems is superficial and hides a lack of understanding.
Held from this post (5)
These records did not pass every check, so nothing about them is published. Held is not a finding.