One of the most significant VoiceOver improvements in iOS 27 is the arrival of much richer, AI-powered image descriptions. In this podcast, David Nason takes the feature for a hands-on test drive, showing how VoiceOver can provide far more detailed information about images than the simpler descriptions users may be familiar with. Rather than having to share an image with another app, these descriptions are integrated directly into VoiceOver and can be accessed using the rotor or a gesture of your choice.
David demonstrates the different ways you can interact with visual content. Image Description provides a detailed account of an image, while Ask About Image lets you pose a specific question about what is shown. Explore Image combines the two approaches, first providing a description and then letting you type or dictate follow-up questions. These capabilities aren't limited to individual pictures: VoiceOver can describe an entire screen, answer questions about it, and even describe an individual item under VoiceOver focus. That last option could prove especially useful when encountering an unlabeled button or another inaccessible interface element.
The episode then turns to customization. David walks through adding Image Recognition to the VoiceOver rotor, choosing which recognition options appear there, and rearranging them to suit your preferences. He also demonstrates assigning Intelligent Image Description directly to a VoiceOver gesture for almost instant access. Alternatively, you can assign a gesture to Show Recognition Options, which presents a menu and lets you choose the type of description or exploration you want each time.
There's also a particularly useful option in Photos. David demonstrates generating an intelligent description of a photograph and saving it as that photo's VoiceOver label, meaning the description will subsequently be announced while browsing your photo library. He also discusses some areas where he would like to see the feature improve, including the ability to edit saved descriptions and receive more complete information about people and certain types of images. Despite these limitations, he comes away impressed by how quickly and conveniently the feature makes visual information accessible from within VoiceOver itself.
If you're a blind, DeafBlind, or low-vision iPhone user who regularly encounters photographs, app artwork, unlabeled controls, or other visual information, this episode offers a practical look at what these new VoiceOver capabilities can do. It's also worth a listen if you already use third-party AI image-description tools, as David demonstrates why having this functionality integrated directly into VoiceOver could make exploring visual content considerably quicker and easier.
Transcript
Disclaimer: This transcript was generated by AI Note Taker – VoicePen, an AI-powered transcription app. It is not edited or formatted, and it may not accurately capture the speakers’ names, voices, or content.
David: Hallo there and welcome to the AppleVis Podcast. My name is David Nason. This podcast is to demo one of the new and I think most important features, certainly for those of us using voiceover, in iOS 27. That feature is the new AI-powered image descriptions. Now you may be thinking we already had image descriptions in voiceover, but this…
Altri episodi di "AppleVis Podcast"
Non perdere nemmeno un episodio di “AppleVis Podcast”. Iscriviti all'app gratuita GetPodcast.
