PEAOM: Better Sim-to-Real Table Tennis by Modeling Camera Errors

Can a realistic generated robot video still be bad training data? This episode explains how RoboCurate turns predicted robot actions back into visible motion, then uses that comparison to curate synthetic demonstrations. We follow the path from video generation and inverse dynamics to a learned consistency judge, focusing on downstream policy performance as the meaningful test of a data curator. Three findings anchor the discussion: the gain from adding action verification after video screening; transfer across simulation benchmarks; and synthetic-only novel-task examples in physical-robot training. The experiments span GR-1 Tabletop and DexMimicGen in simulation, plus dexterous manipulation with ALLEX and OpenArm. The central limitation is that replay excludes manipulated objects: motion agreement does not itself validate contact or grasp stability. For practitioners building synthetic-data pipelines, the takeaway is to evaluate the pairing of video and action, not visual plausibility alone. Where should your next compute budget go — another generated dataset, or a better test of its labels?

This episode of Embodied AI 101 examines NTT's physics-aware world model for manipulation, separating the shelf-loading result from the proposed airport baggage application and explaining how an existing robot controller could use predicted outcomes to choose between actions without replacing its entire planning stack or treating generated video as ground truth. We unpack what the reported success rates and OBJ3D comparison actually establish, why image similarity is not a calibrated measure of collapse risk, how hidden mass distribution and friction complicate generalization, and which details about code, evaluation protocols, inference time, and production throughput practitioners still need before attempting integration. With context from Mujin's baggage automation, NTT's own engineering commentary, and contemporary world-model research, we frame a practical test for physical AI in logistics: can physics-grounded prediction prevent costly manipulation failures reliably enough, and quickly enough, to justify adding another model to a working robotic system rather than simply producing a more convincing preview of what might happen?

Why does a table-tennis robot that succeeds in simulation miss the ball on hardware? This episode explains how PEAOM models the measurement process that turns a physical trajectory into a controller's estimated state. We cover three questions: how calibration-derived distortions enter before trajectory fitting, why systematic camera bias differs from independent Gaussian jitter, and what the reported improvement in physical return success actually measures. The authors report an increase from 56.4% to 86.0% without real-world policy fine-tuning. ([link.springer.com](https://link.springer.com/article/10.1007/s12555-026-00269-2)) The method combines simulated robot-arm striking with a calibrated observation model and a shared state-estimation pipeline. We connect its design to earlier table-tennis noise experiments and structured perception-error modeling in drone racing. ([roboticsproceedings.org](https://roboticsproceedings.org/rss19/p006.pdf)) The central unresolved comparison is whether training with the error model beats correcting measurements with the same calibration before using an ideal-trained policy. This analysis draws on the public abstract and released implementation; the subscription-only article body was unavailable. Where should a robot handle camera error—in its learned policy, or before the policy ever sees the ball?

Should a vision-language-action robot receive tactile measurements as continuous features or as discrete labels? This episode explains the architectural choices behind that question and the evidence needed to interpret an avocado-sorting comparison. The discussion covers three approaches: semantic directives that guide a manipulation policy, tactile representations integrated into action generation, and numerical physical-property estimates used for interpretation. Verified examples include Octopi's real-robot avocado reasoning and TAP-VLA's tactile annotations for contact-rich manipulation, with Franka Panda robots and GelSight sensing providing concrete experimental context. The central methodological question is whether a comparison isolates representation format or also changes how much information reaches the controller. This is a source-limited contextual episode: the full text of Ran Yang and colleagues' paper could not be retrieved, so its architecture, dataset, ablations, and experimental results are not presented as verified. For roboticists working on tactile sensing, VLA adaptation, and food manipulation, the discussion offers a framework for evaluating the eventual evidence. Is the important advantage continuity itself—or preserving the evidence needed for the robot's next decision?

Can an encoder-free vision-language-action model make robot foundation models more accessible? This episode explains NEO-VLA's architecture, its strongest experimental findings, and what its public release enables other laboratories to reproduce. We cover three findings: why early backbone layers matter for action prediction, how multimodal co-training supports robustness, and what the released implementation offers practitioners. NEO-VLA combines native vision-language processing with a continuous flow-matching action expert, drawing on a training mixture that includes real robot demonstrations and simulation. Its evaluations span LIBERO, distribution-shift benchmarks, and physical manipulation on the Pika robot. ([arxiv.org](https://arxiv.org/pdf/2611.06918)) The episode follows the path from convolutional image patches to action chunks, then examines how researchers can use the released pretrained and benchmark-specific policies. We also investigate the main limitation: the release is not a self-contained reproduction of training. Camera observations must be reconstructed from upstream sources, and the original starting backbone is not released as the documented initial checkpoint. ([huggingface.co](https://huggingface.co/weepiess2383/NEO-VLA)) For roboticists studying imitation learning, visual representations, and accessible robot foundation models, the central question is concrete: which stage of visual computation should your controller actually read?

Can a robot policy learn better three-dimensional control without running a geometric model every time it acts? This episode of *Embodied AI 101* examines how SLA uses spatial supervision during continual pretraining and downstream adaptation. We cover three questions: how OmniVGGT features become training targets for a VLA; why the alignment-on versus alignment-off scaling experiment matters; and what the RoboDojo-Real leaderboard establishes about the resulting system. The discussion spans simulated bimanual manipulation in RoboTwin, perturbation testing in LIBERO-Plus, and physical evaluation across ARX X5, Piper, and Piper X robots. ([arxiv.org](https://arxiv.org/abs/2511.10560)) We connect SLA to its predecessor, Spatial Forcing, explain adaptive layer aggregation and state dropout, and identify the practical entry point through the released training workflow. The central limitation is causal attribution: the real-world leaderboard configuration adds visual history without a memory-matched baseline that isolates spatial alignment. ([arxiv.org](https://arxiv.org/html/2611.08373v1)) For researchers scaling robot foundation models and practitioners adapting pretrained policies, this is a discussion about what supervision buys—not just how much data gets collected. When the target moves, what has your policy learned that lets it move with it?

Can a robot learn better 3D manipulation without running an additional perception model at deployment? This episode examines how SLA extends π0.5 through spatially supervised continual pretraining and downstream adaptation. We cover three questions: how a frozen OmniVGGT teacher shapes intermediate visual features; why adaptive layer selection and state dropout belong in the training recipe; and what the moving-target experiment measures. The headline result is a rise from 42% to 76% success on a real-world bimanual Piper fruit-manipulation condition requiring grasping, handover, and placement. We connect that experiment to simulation-based robustness evaluation in RoboTwin and explain why applying alignment at both training stages matters. We also place SLA in the lineage of Spatial Forcing, distinguishing feature-alignment machinery from the expanded pretraining strategy. The central limitation is causal attribution on hardware: the reported comparison evaluates the combined recipe rather than a matched control isolating geometric alignment. For roboticists building vision-language-action policies, the episode offers a concrete research question: how much useful physical understanding can training leave inside the policy you already deploy?

Can a robot world model use imagined collisions to choose safer actions? This episode examines Noetic's reported safety-aware rollout loop and explains how it relates to latent planning, safe reinforcement learning, and learned safety filters. We cover three questions: what the reported three-or-more-step imagination horizon describes; how an explicit safety program can influence candidate actions; and what experiment would establish a benefit in executed behavior. Technical context comes from PlaNet, Dreamer, SafeDreamer, and Latent Safety Filters, spanning simulated navigation and physical Franka manipulation. The latter provides a measured example of using latent safety reasoning to improve safe task completion and safeguard manipulation against spilling. Noetic's reported domain is obstacle avoidance around walls and hazards during model rollouts; the available brief does not establish its simulator or robot platform. The central limitation is the unverified bridge between safe imagined outcomes and safer environment execution. Research located relevant published methods, but the original X post could not be retrieved and no matching Noetic technical paper was located, so Noetic-specific claims remain attributed to the supplied summary. When does imagining a collision actually help prevent one?

Can a vision-language-action model make clothing cleanup a useful autonomous household chore? This episode explains how Pi0.5 fits into a wheeled robot system combining SLAM, visual checking, collision detection, and motion replay. The builder reports 97% success on unfamiliar garments and an average end-to-end time of two minutes per item. We follow three threads: the division of labor inside the demonstration; the heterogeneous co-training behind Physical Intelligence's π0.5; and the evaluation needed to distinguish new garments from genuinely new environments. The underlying paper contributes real-robot household evaluations and controlled comparisons, while related work such as OK-Robot supplies context for modular mobile manipulation. The central limitation is the demonstration's unspecified generalization protocol: the accessible thread does not establish the trial denominator or held-out-home conditions. For roboticists building household systems, the practical question is where to place the boundary between learned contact behavior and engineered task execution. Could the most useful role for a generalist VLA be as one well-integrated component of a robot that finishes the chore?

What makes a humanoid foundation model useful when its first attempt goes wrong? This episode examines how Delta-0 connects whole-body control, human-motion pretraining, and corrective learning—and what its experiments establish. We cover three questions: how its latent world-action model connects observations with motion commands; why relative end-effector corrections make human intervention easier; and what to make of the reported dishwasher success increase from 20% to 65% after targeted post-training. ([deltai.com](https://deltai.com/en/blog/delta-0)) The system runs on a Unitree G1 with WUJI hands, combining simulation-trained control with real-world household manipulation. ([robopapers.substack.com](https://robopapers.substack.com/p/ep115-delta-0-a-new-chapter-in-humanoid)) We place the approach alongside SONIC's shared whole-body control interface, HIL-SERL's intervention-driven reinforcement learning, and Zero-HLM's simulation-generated humanoid experience. ([nvlabs.github.io](https://nvlabs.github.io/GEAR-SONIC/)) The central limitation is generalization evidence: improvement after collecting corrections in a rearranged kitchen does not establish broad transfer across unfamiliar tasks and environments. ([deltai.com](https://deltai.com/en/blog/delta-0)) For roboticists building loco-manipulation policies, the practical question is whether the controller makes useful corrections easy to express and learn from. Could that interface matter as much as the policy architecture?