
0:00
14:10
Four AI Models Steered a Real Corolla, and Only One Finished
Source: https://arxiv.org/abs/2609.38948
Paper was published on September 30, 2026
This episode was AI-generated on October 1, 2026. The script was written by an AI language model and the host voices were synthesized by Eleven Labs. The producer is not affiliated with Anthropic or Eleven Labs.
Researchers handed four unmodified general-purpose AI models the steering and speed controls of an actual Toyota Corolla on a cone course — and the car kept moving while the models thought. Eight of eleven attempts died at the first turn, and the median gap between the last image a model saw and its next command was about four meters of travel. This episode is about what breaks when an agent has to act on a world that won't wait for it.
Key Takeaways:
- Why the researchers threw out their first interface after the car moved 2.4 meters while a model was still planning a path
- The latency number that frames everything: a median of about four meters traveled between the last image a model saw and its next accepted command — and one 17-second, 7.4-meter gap
- Why the obvious cautious strategy of stopping to think backfires: steering only becomes active once the car rolls, so a turn takes four seconds to build from rest versus about two while moving
- How 'percent of course completed' swings from 49 percent to 17 percent just by tightening the allowed distance from four meters to three
- The difference between a model that writes a good post-mortem and one that changes its actions — Grok promised 'short overlapping moves' and never issued one; Astra went from 13 observations to 33 and finished
- Why one conversation per system and three shared-history attempts makes this a strong study of failure modes and a weak basis for ranking models
00:00 - Four models, one Corolla, one finish: The setup: unmodified vision-language models driving a 2022 Corolla through modified openpilot on a 127-meter cone course, with a safety driver who ended all ten failures.
00:57 - Who is actually driving here?: Why this tests model-plus-application systems — GPT-6 Astra and GPT-5.6 Sol in Codex, Claude Fable 5.1 in Claude Code, Grok 4.6 in Cursor — with one conversation and up to three shared-history attempts each.
03:04 - Why the first interface was thrown out: Path-planning interfaces failed because images went stale mid-plan, pushing the team toward three simple tools that always report the image's age.
04:40 - Only one system crossed the line: Astra finished on its second attempt in five minutes twenty-two seconds, Fable reached 45 percent, Grok and Sol never cleared the first corner — and the scoring rule itself turns out to be fragile.
06:03 - Controlling a car that already moved: The latency problem measured in meters, and why stopping to think makes the steering problem harder rather than easier.
07:55 - Seeing the cones, misreading the lane: The recurring spatial failure: models detected the cones but assigned the lane to the wrong side of a diagonal boundary, with Sol wrongly inferring boundary side from cone color.
08:49 - Does reflection change the driving?: Grok's correct diagnosis never became a control procedure, while Astra and Fable actually changed behavior between attempts — evidence for in-conversation learning, but not for its reliability.
10:12 - Bad accelerators and polite refusals: Two confounds the authors disclose: a low-level controller that accumulated while stopped and overshot a 1 m/s request to 2.8, and development-stage refusals that disappeared once tool reports and naming changed.
12:21 - What belongs inside the task spec: Closing arguments: report an image's age because the environment moves during deliberation, and judge agents by changed actions rather than better explanations.
Recommended Reading:
- Reflexion: Language Agents with Verbal Reinforcement Learning: The canonical treatment of in-context self-correction, which is exactly the mechanism the episode scrutinizes when Astra improves after its reflection prompt but Grok's correct post-mortem never becomes a change in its commands. (https://arxiv.org/abs/2303.11366)
- Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting: Backs up the hosts' insistence that a model's written justification for a steering command is not evidence of its actual decision process — look at the actions, not the narration. (https://arxiv.org/abs/2305.04388)
- Do As I Can, Not As I Say: Grounding Language in Robotic Affordances: The classic argument that language models need to be bound to what is physically executable right now, which is the same gap DrivingBench exposes when a plausible plan arrives four meters too late. (https://arxiv.org/abs/2204.01691)
- DriveLM: Driving with Graph Visual Question Answering: A leading example of the open-loop, describe-the-road-photograph driving benchmarks that this episode explicitly positions DrivingBench against, useful for seeing what closed-loop control adds. (https://arxiv.org/abs/2312.14150)
More episodes from "AI Papers: A Deep Dive"



Don't miss an episode of “AI Papers: A Deep Dive” and subscribe to it in the GetPodcast app.








