Apple Vision Pro Just Took a Massive Leap (NVIDIA Interview)

Apple Immersive Video is one of the most impressive experiences on Apple Vision Pro, but few people know what it takes to make it possible. I met with the founders of SpatialGen to get a behind-the-scenes look at the technology they've built to stream immersive video today and bring live immersive video to life.As part of the interview, I joined the team at the Tennessee Aquarium to experience an immersive video production firsthand, including time behind the camera with the same Blackmagic URSA Cine Immersive system used to create Apple Immersive Video.In this episode, Zach and Michael share the story behind SpatialGen, the technology powering much of the immersive video ecosystem, and their new Zeus live encoding platform designed for live Apple Immersive Video.We discuss:• How SpatialGen got started from a simple Vision Pro project• Why Apple Immersive Video files can be several terabytes in size• The infrastructure required to stream immersive video to Apple Vision Pro• Live Apple Immersive Video at full resolution and 90 FPS• What live immersive video could mean for sports, concerts, entertainment, and more• Where SpatialGen and the Apple Vision Pro ecosystem are headed nextSpecial thanks to the SpatialGen team for the invitation, the behind-the-scenes access, and the opportunity to experience their technology firsthand.Links:SpatialGen: https://spatialgen.comTheater for Apple Vision Pro: https://apps.apple.com/us/app/theater-cinema-events/id6502666560Tennessee Aquarium: https://tnaqua.orgFollow Spatial Insider: YouTube: https://www.youtube.com/@spatialinsider X: https://x.com/spatialinsider Threads: https://www.threads.com/@spatialinsider Instagram: https://www.instagram.com/spatialinsider/ TikTok: https://www.tiktok.com/@spatialinsiderFollow Justin Ryan: X: https://x.com/justinryanio Threads: https://www.threads.com/@justinryan.io LinkedIn: https://www.linkedin.com/in/justinryanio/Make sure to like and subscribe for more videos like this.Until then, stay spatial.#applevisionpro #augmentedreality #appleimmersivevideo

Elite freediver Ant Williams, featured in Apple’s Ice Dive, shares what it was like being part of an official Apple Immersive production as he chased a world record beneath the frozen ice of Iceland on a single breath.We talk about working with Apple, the production setup behind the film, filming with some of the only Apple Immersive cameras in the world at the time, and what it was like seeing Apple Vision Pro used throughout the production and editing process.Ant also takes us inside the mental and physical challenge of swimming under pitch black ice, what it felt like experiencing Apple Immersive Video for the first time, and how emotional it was for his family to finally step into the world he’s spent years trying to describe to them.We also dive into the sports psychology techniques that helped him perform under extreme pressure and become one of the world’s top freedivers.Ice Dive is available in the Apple TV app on Apple Vision Pro as part of the Adventure series. Watch it here: https://tv.apple.com/us/episode/ice-dive/umc.cmc.1lxb2q6h7pj1b6k1q2hgq25xt?showId=umc.cmc.5al10vz5fkqzxonreq110ony0Purchase Ant’s book, Let It Be Tough, here: https://www.simonandschuster.com/books/Let-it-be-Tough/Ant-Williams/9781761638565Follow Ant Williams on Instagram: https://www.instagram.com/freediveguy/?hl=enFollow Spatial Insider: YouTube: https://www.youtube.com/@spatialinsider X: https://x.com/spatialinsider Threads: https://www.threads.com/@spatialinsider Instagram: https://www.instagram.com/spatialinsider/ TikTok: https://www.tiktok.com/@spatialinsiderFollow Justin Ryan: X: https://x.com/justinryanio Threads: https://www.threads.com/@justinryan.io LinkedIn: https://www.linkedin.com/in/justinryanio/Make sure to like and subscribe for more videos like this.Until then, stay spatial.

In this episode of Spatial Insider, I sit down with Ben Allan and Clara Chong, award winning filmmakers and two of the world’s leading experts in Apple Immersive Video.We cover what Apple Immersive Video actually is, why it feels fundamentally different from both traditional film and VR, and what makes the experience so unforgettable. We also explore how the grammar of this new medium is still being written, the technical workflow from the Blackmagic URSA Cine Immersive camera through DaVinci Resolve and Fairlight audio, and how lighting, sound, and storytelling all work differently in 180 degree immersive space.Ben and Clara also share where they see this medium going next.They also share details about their book, Cinematic Immersive for Professionals, available now on Apple Books, the first guide of its kind for filmmakers entering this space.This is one of the most insightful conversations I’ve had about where visual storytelling is headed. Watch to hear their full perspective.Cinematic Immersive for Professionals on Apple Books: https://books.apple.com/us/book/cinematic-immersive-for-professionals/id6754396227Main Course Films: https://www.maincoursefilms.com/production/Clara: https://www.linkedin.com/in/clara-chong-384835b/Ben: https://www.linkedin.com/in/ben-allan-acs-csi-0b219528/Download Theater: https://apps.apple.com/us/app/theater-cinema-events/id6502666560Blackmagic Design: https://www.blackmagicdesign.com/products/blackmagicursacineimmersiveSpatialGen: https://spatialgen.com/liveDownload Amplium: https://apps.apple.com/us/app/amplium/id6612011166Follow Spatial Insider: YouTube: https://www.youtube.com/@spatialinsider X: https://x.com/spatialinsider Threads: https://www.threads.com/@spatialinsider Instagram: https://www.instagram.com/spatialinsider/ TikTok: https://www.tiktok.com/@spatialinsiderFollow Justin Ryan: X: https://x.com/justinryanio Threads: https://www.threads.com/@justinryan.io LinkedIn: https://www.linkedin.com/in/justinryanio/Make sure to like and subscribe for more videos like this.

You’ve probably seen the viral headlines. We’re talking real surgeries on real patients happening right now with Apple Vision Pro, not a demo or a concept.In this episode of Spatial Insider, I sit down with the team behind ScopeXR, the app making this possible: Dr. Eric Rosenberg, Chief Medical Officer and corneal cataract surgeon; Michael Simmons, ScopeXR CEO, veteran developer, and creator of Fantastical and Cardhop; and Justin Kent, Founding Engineer at ScopeXR, a veteran iOS developer who’s been building apps since before it was even called iOS and has shipped more than 40 apps to the App Store.We cover the full story. How they met and started ScopeXR. What ScopeXR actually does inside the Operating Room and why it matters. How the Apple Vision Pro's gesture based interface keeps the surgical field sterile. Why surgeons can now bring in mentors, residents, and consultants from anywhere in the world in real time. How the wired and wireless feed works and why patient safety drove every technical decision. And why this is a use case for Apple Vision Pro that simply cannot be replicated on any other device.Eric also walks us through the full OR experience from scrubbing in to operating, and explains why having all patient data, surgical feeds, and consultation tools in one headset changes everything about how eye surgery is performed.This is just the beginning of spatial computing in healthcare. More to come.Learn more about ScopeXR: https://scopexr.comGet in touch with the ScopeXR team: [email protected] with Justin Kent: https://www.linkedin.com/in/justinkent1/Connect with Michael Simmons: https://www.linkedin.com/in/misimmons/Connect with Eric Rosenberg: https://www.linkedin.com/in/student4life/ Follow Spatial Insider:YouTube: https://www.youtube.com/@spatialinsiderX: https://x.com/spatialinsiderThreads: https://www.threads.com/@spatialinsiderInstagram: https://www.instagram.com/spatialinsider/TikTok: https://www.tiktok.com/@spatialinsiderFollow Justin Ryan:X: https://x.com/justinryanioThreads: https://www.threads.com/@justinryan.ioLinkedIn: https://www.linkedin.com/in/justinryanio/Make sure to like and follow for more content like this.

NVIDIA and Apple have been quietly collaborating on something truly massive for spatial computing. It has the potential to completely change how people see the Apple Vision Pro and what it can do.In this interview, I sit down with Max Bickley, Product Manager on NVIDIA’s Omniverse team, to break down what NVIDIA CloudXR 6.0 unlocks for Vision Pro and where this is all headed.We cover a lot of ground. Max breaks down how foveated streaming works and how NVIDIA and Apple solved the gaze privacy challenge together. We talk about what it means to stream high fidelity experiences from a remote GPU directly to your headset, and why two of the best simulators in the world, X-Plane 12 and iRacing, are coming to Vision Pro.We also get into what the Apple and NVIDIA collaboration signals about the future of spatial computing and how agentic workflows could reshape spatial app development entirely.Learn more about NVIDIA Cloud XR: https://developer.nvidia.com/blog/build-and-stream-browser-based-xr-experiences-with-nvidia-cloudxr-js/Follow Justin Ryan:X: https://x.com/justinryanioThreads: https://www.threads.com/@justinryan.ioLinkedIn: https://www.linkedin.com/in/justinryanio/Follow Spatial Insider:YouTube: https://www.youtube.com/@spatialinsiderX: https://x.com/spatialinsiderThreads: https://www.threads.com/@spatialinsiderInstagram: https://www.instagram.com/spatialinsider/TikTok: https://www.tiktok.com/@spatialinsiderLearn more about X-Plane: https://www.x-plane.comLearn more about iRacing: https://www.iracing.comMake sure to like and subscribe for more videos like this.