
0:00
12:48
How can a legged robot use a vision-language model to navigate trails without asking it to place every foot? This episode explains how ROAM connects semantic scene interpretation to reinforcement-learned navigation and locomotion through spatial maps. We examine the system's real alpine deployments and controlled experiments involving terrain preferences, warning signs, and foot placement. ([roam-hiking.github.io](https://roam-hiking.github.io/)) Three questions organize the discussion: why distinguish risk from preference and steppability; what does simulation teach the controllers; and which experiments demonstrate that semantic information actually changes behavior? We also place the architecture alongside BehAV's behavioral cost maps and NaVILA's intermediate movement commands, showing how different interfaces divide responsibility between reasoning and execution. The practical focus is the perception-to-control boundary: what information crosses it, how a controller uses it, and what a roboticist can build from the released front end. The central limitation is grounding: correct hazard labels can be lost during segmentation. ([arxiv.org](https://arxiv.org/html/2611.25215v1)) Listen for a technical assessment of what the mountain footage demonstrates—and why choosing the right interface may matter as much as choosing a more capable model.
Weitere Episoden von „Embodied AI 101“



Verpasse keine Episode von “Embodied AI 101” und abonniere ihn in der kostenlosen GetPodcast App.








