Apple Intelligence is heading to the Vision Pro, as part of an upcoming operating system update. Apple confirmed on Friday that its generative AI platform will arrive on the extended reality headset as part of VisionOS 2.4. A beta version of the software is currently available for developers. The public version is set for an April release
Like the iPhone and Mac before it, the Vision Pro will receive Apple Intelligence updates in waves. The first set includes several familiar offerings, focused primarily on generating text and images. The company sees the addition of features like Rewrite, Proofread, and Summarize as key components for on-device workflow.
It’s worth keeping in mind that Apple has framed Vision Pro as a “spatial computing” device since the outset. For all the video, gaming, and other entertainment features, the company has sought to set the system apart from its extended reality predecessors by positioning it as an extension of desktop computing – or, as TechCrunch framed it in our review, “The Infinite Desktop.”
As it stands, composing text is a mixed bag on the headset. The default typing method requires the wearer to look at a letter, before pinching two fingers together to select. While well implemented, it’s cumbersome when faced with writing more than a word or two at a time. Voice addresses this bottleneck to a degree, and Apple’s recent AI-powered Siri supercharge bodes well for the smart assistant’s Vision Pro future.
Apple is banking on the combination of voice dictation and generative AI writing tools to deliver a smoother experience to convince more Vision Pro users to incorporate the headset into more of their existing workflows. At the very least, features like Message Summaries and email Smart Reply streamline interaction with different apps, without taking the user away from a given task.
Image Playground is the other big piece of the puzzle, bringing image generation to the wearable display as part of the Vision OS 2.4 update. The feature is integrated directly into the VisionOS Photos app, allowing users to create images through verbal prompts.
All of the above features have previously been rolled out on iOS, macOS, and iPadOS. There are no new Apple Intelligence features specific to Vision Pro arriving in this update.
Along with VisionOS 2.4, Apple has also launched a Vision Pro iPhone app arriving with iOS 18.4, which is also now in beta. The app serves a few different purposes. Foremost is the ability to browse VisionOS content like TV shows and movies, which can then be transferred onto the headset. This feature appears to be, in part, a response to the limitations of wearing the headset, both in terms of personal comfort and battery life. If you’re going to be scrolling through content, you might as well do it from the comfort of your iPhone.
When an iPhone is unlocked and within proximity of the headset, the new app can also be used to manage guest accounts. The Vision Pro will prompt its owner when someone is attempting to sign in as a guest. A streaming image of the guest’s in-headset view is accessible through the new app, as well.
Add comment