DEEP DIVE: INTERIOR SENSING SOLUTIONS FOR VEHICLES

Prompt battle! We've all tried giving generative AI chatbots instructions that yield useful results. Recently, GenAI has rapidly expanded across various industries. But can it help drive a car? Dr. Liu Ren, Vice President and Chief Scientist for scalable and assistive AI at Bosch Research, is confident it can. He and his team are at the forefront of integrating foundation models such as large language models or vision-language models with advanced driver assistance systems (ADAS). In this episode, Liu explains to our hosts, Shuko and Geoff, how the extensive knowledge contained in foundation models can enhance the perception, prediction, and planning capabilities of ADAS. What's even more impressive is that Bosch Research’s approach works despite the constrained resources typical in vehicle environments. As Liu shares his cutting-edge research, Shuko and Geoff go head-to-head in a challenge: Who can craft the cleverest prompts for GenAI? Credits: 1. Chenbin Pan, Burhan Yaman, Tommaso Nesti, Abhirup Mallik, Alessandro G Allievi, Senem Velipasalar, Liu Ren. “VLP: Vision Language Planning for Autonomous Driving”, The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 (CVPR 2024). 2. Xiaoqi Wang, Wenbin He, Xiwei Xuan, Clint Sebastian, Jorge Henrique Piazentin Ono, Xin Li, Sima Behpour, Thang Doan, Liang Gou, Han Wei Shen, Liu Ren. “USE: Universal Segment Embeddings for Open-Vocabulary Image Segmentation” , The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 (CVPR 2024). 3.Chenbin Pan, Burhan Yaman, Senem Velipasalar, Liu Ren. “CLIP-BEVFormer: Enhancing Multi-View Image-Based BEV Detector with Ground Truth Flow”, The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 (CVPR 2024). More Bosch podcasts: From Know-how to Wow with Liu Ren, all about “Visual Analytics”: https://www.youtube.com/watch?v=CmR97fW_B3I Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/

The OGS, the Optical Gas Spectrometer, is a feat of engineering. In the previous episode, we discussed what it can do and how it works. Today, Bosch associate and OGS inventor Alex Stratmann talks more about turning Raman spectrometers into an industrial product. Many considerations had to be made, from the custom laser source to the material used for the seals, and we also learn that OGS development hasn't stopped: The team is working on a high-pressure version and on efforts to measure almost any gas in the world. More Bosch podcasts: Previous episode: https://fromknowhowtowow.podigee.io/65-optical-gas-spectrometer Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/

Take a deep breath. What you just breathed in was probably about 78% nitrogen and 21% oxygen and some minor other components. But how do you measure that? Measuring gases and their concentrations has been pretty difficult, says Bosch physicist Alex Stratmann. His team’s invention, the optical gas spectrometer, OGS, is set to change that. It packs what used to be a complex lab setup into a tabletop device. OGS leverages Raman spectroscopy, a method that exists for about a 100 years and has been used e.g. in the art world to analyze pigments. Our hosts Melena and Shuko learn from Cristina Aibéo, a chemist at Berlin’s National Museums, how Raman spectroscopy can help solve crimes and also save energy. At Bosch, on the other hand, the OGS helps with measuring hydrogen - and thus with the transition to a green hydrogen economy. Breathe in, breathe out, hit play! From Know-how to Wow”: How to produce green hydrogen? https://www.youtube.com/watch?v=fvbHOY7GAig

Bosch’s interior sensing solutions for vehicles can include a driver and/or occupant-monitoring camera, along with an interior radar. All three have distinct capabilities but together they enable not only reliable safety features, but also new comfort features. Bosch product manager Tyler Warga shares details about how the system works and how it handles difficult situations like changing light conditions or obstructions, e.g. sunglasses. Per usual, your host is Geoff’s voice avatar. More Bosch podcasts: Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/

You’re driving in your car, you notice a new restaurant as you drive past and you wonder: What was that? A car of the not-so-distant future may be able to answer that question. Because it knows what a driver (or passenger) is looking at - be it a landmark on the side of the road, the dashboard, or the road ahead. In the first place, monitoring the driver's gaze and head position enables important safety features, says Bosch product manager Tyler Warga. Geoff and Shuko learn how cameras and radar sensors can pick up signals that people are subconsciously sending. This can help prevent drunk driving, reduce distractions, and save children's lives. Future autonomous cars could even benefit from a sense of the driver's emotional state: they could pick up on Duchenne smiles. As University of Missouri professor Kennon Sheldon explains, this type of smile signals honest amusement. So be amused and wowed when you join us for a sensor-packed ride! More Bosch podcasts: Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/

Today, artificial intelligence is often synonymous with neural networks. But they're not always the smartest choice. Daniel Jung of Bosch Sensortec in Sweden explains why the Smart Connected Sensors technology platform uses a different kind of AI. He also reveals some other tricks that make the Smart Connected Sensors efficient and reliable. Your host, as usual for our deep dive episodes, is Geoff's voice avatar. More Bosch podcasts: Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/

Move it — and do it with precision! Join our host Geoff at CES in Las Vegas, where he tests the brand new Smart Connected Sensors from Bosch Sensortec. This technology platform, comprising up to eight connected sensor nodes with various sensors, not only tracks movements but also benchmarks them against a reference. How well does Geoff mimic the motions of a virtual robot? Sure, that’s fun to find out, but product manager Abhinav Kunchamwar delves into diverse applications where precise motion tracking is transformative. He shares insights with this month’s hosts Shuko and Melena. They also learn more about the hardware than expected, as Geoff accidentally breaks open one of the sensor casings. Whoops! More Bosch podcasts: Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/

Self-charging cars! They’re a thing, as we know since our CES live show. Join Geoff’s voice avatar and our in-house expert Andrew Krier for an exclusive closer look at automated valet charging, or AVC. Imagine electric vehicles autonomously navigating to chargers, guided by advanced camera systems: convenience meets technology - a glimpse into how we'll soon be rolling! Show notes: More Bosch podcasts: Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/

Let's spin the reels of innovation! Our hosts Melena and Geoff are at CES, the Consumer Electronics Show in Las Vegas, exploring Bosch's latest innovations in the areas of mobility and living. However, it wouldn’t be a trip to Las Vegas without a few surprises. Melena and Geoff are challenging each other in a competition: They’re testing their knowledge about Automated Valet Charging and the IDS Ultra heat pump for cold climates. With support from Bosch experts Andrew Krier and Goncalo Costa, they'll answer questions selected by a virtual slot machine –Vegas-style! And who knows, maybe our #LikeABosch hero Shawn will also make a special appearance?!

A year ago, From Know-how to Wow introduced AI-hosted Deep Dive episodes. We've compiled the nerdiest bits from 12 months of Deep Dives - and added a little holiday cheer at the end. Join Geoff's voice avatar for a look back at our episodes on spatial audio, quantum sensors, and more! More Bosch podcasts: Beyond Bosch: https://podtail.com/de/podcast/beyond-bosch/