“Turning LLMs into a product that controls your home and talks to you in a way that would be reliable enough to use at scale in millions of homes is still a long, long way away.”
Our reading, the sentence that was checked:
A reliable LLM-based conversational home-control product usable at scale in millions of homes is still a long, long way away.
Assessment: Unresolved No deadline stated on 2026-10-29 Evidence as of
Where and when Gary Marcus wrote it
Marcus on AI, How come smart assistants have virtually no ability to converse, despite all the spectacular progress with large language models?, paragraph 24.
- Said
- Source observed
- live page, full text, public
- Evidence as of
- the cutoff for this assessment
- Assessment recorded
- assessment marcus-how-come-smart-assistants-have-virtually-d5df75-a1
We recorded 10 claims from this post. See every claim from this post.
The wording above is the version this site observed on 2026-10-29. The source may have been edited after 2022-11-22. This page does not claim the wording was captured then.
What the claim commits to
- Kind
- Forecast
- Deadline, as the speaker wrote it
- “still a long, long way away”
- Deadline state when assessed
- No deadline stated
- Deadline state on 2026-10-29
- No deadline stated (the release’s reference date)
From the speaker
- Turning LLMs into a product
- controls your home and talks to you
- reliable enough to use at scale
- millions of homes
- still a long, long way away
Our interpretation
- The milestone requires an operational LLM-based conversational assistant with home-control capability and evidence of practical reliability at household scale.
- Millions means at least two million homes. Customer accounts, supported devices, and availability are not automatically counts of homes using the product.
- Reliable enough means dependable ordinary home-control use, not perfection.
- Long, long way away supplies no defensible calendar deadline. I do not substitute a fixed number of years.
Counts as supported if: A sufficiently distant arrival date for a product meeting all stated requirements could support the forecast, but the speaker supplies no duration that can be scored mechanically.
Counts as contradicted if: A documented arrival shortly after the post, meeting conversation, home control, household scale, and practical reliability requirements, would contradict an unambiguously distant-arrival reading.
Retrospective: these criteria were written after the outcome was public.
Current assessment
Did the forecast come true?
Outcome: Unresolved
The record was checked, and the evidence available by the cutoff does not settle it.
Scored on a plain reading. The speaker named no measure for this claim, so it was judged on the reading an informed reader would take, stated below under our interpretation. Both reviews had to find that reading fair.
- Evidence as of
- Deadline state when assessed
- No deadline stated
- Assessment recorded
- Policy version
- 2026-10-28.7
Rationale
Alexa+ is substantial evidence against treating the capability as indefinitely remote: Amazon reports tens of millions of participants, and independent testing demonstrates conversation and useful home control. But the records do not establish reliability across millions of homes. More fundamentally, Marcus supplied no deadline, so assigning a failure after an evaluator-chosen number of years would add a commitment he did not make. No conclusive event satisfies the stated rule.
Limitations
- Large-scale participation is company-reported.
- One household’s successes and defects cannot establish population-wide reliability.
- Even a verified milestone date would leave the meaning of long, long way away disputed.
Evidence (2 items)
Context only: Amazon,
millions
Why it matters here: Amazon reports substantial Alexa+ participation, and the same article describes its LLM architecture, conversation, and home automation. Customer participation does not establish the number of homes using those capabilities dependably.
- Publisher
- Amazon
- Kind of source
- Company disclosure: the company describing itself, not an independent finding
- Describes events of
- Public from
Context only: Consumer Reports,
some bugs
Why it matters here: The reviewer successfully used natural-language home control and routine creation but also encountered device-control failures. This demonstrates practical capability without measuring reliability across millions of homes.
- Publisher
- Consumer Reports
- Kind of source
- Independent measurement
- Describes events of
- Public from
What would settle it
Dated evidence of a conversational LLM home-control product operating dependably at the stated household scale would establish the milestone. A firm timing verdict would additionally require a defensible interpretation of the unspecified delay.
Where it was said (1)
Said once in the sources this register covers.
: Marcus on AI, How come smart assistants have virtually no ability to converse, despite all the spectacular progress with large language models?
Turning LLMs into a product that controls your home and talks to you in a way that would be reliable enough to use at scale in millions of homes is still a long, long way away.
- Where
- paragraph 24
- Published
- 2022-11-22
- Source observed
- , live page
- Access
- full text, public
History
Assessment versions
- Assessment marcus-how-come-smart-assistants-have-virtually-d5df75-a1: Current. Outcome: Unresolved. Evidence as of 2026-10-28. Public date not recorded.
Recorded events
Assessment publishedBy this site
First assessment published after both reviews and the final-text check passed.
About assessment marcus-how-come-smart-assistants-have-virtually-d5df75-a1.