What is the EyeSight feature of Apple Vision Pro and how does it work?

The Apple Vision Pro headset, which is scheduled to be released to global markets in early 2024 at a price of $3,499, is equipped with the EyeSight feature, which can change the scope of your vision according to the environment and eliminate the feeling of limitation and isolation while using the headset. .

Apple Vision Pro makes the people close to you a part of the augmented reality experience through the EyeSight feature. Additionally, EyeSight will display visual cues of people around you or placed in augmented reality.

In the rest of this article, we are going to learn about the use of EyeSight and its different modes.

What is the EyeSight function of Apple Vision Pro?

EyeSight is one of the best features of the Apple Vision Pro headset, which is the result of the interaction of hardware and software. One of the goals of this feature is to display a digital version of the user’s eyes.

According to Apple’s statements at the WWDC 2023 event, the user’s eyes are considered as an indicator of communication and emotion, and Apple Vision Pro shows your eyes when the audience is around you; By switching to this mode, the headset panel will become transparent.

In addition, EyeSight can provide several behind-the-scenes gestures to let your audience know what activity you’re focusing on. In a new post published by Apple, EyeSight was mentioned as a unique feature that allows the user to stay in touch with the contacts around them, and this feature is not available in any of the headsets on the market.

How does EyeSight work?

The Apple Vision Pro’s external OLED panel is made of a lenticular lens that, according to Apple, shows the correct view of your eyes to the audience. When Apple Vision Pro detects that you are using media content or apps, it provides the appropriate graphic view on the EyeSight screen.

However, when the subject is in your line of sight, Apple Vision Pro will display your eyes. To make your eyes look natural, EyeSight uses data from built-in infrared cameras (two infrared cameras for each eye) to record your eye movements and facial expressions.

This data is fed to the machine learning algorithm and then combined with your digital persona, and then through the TrueDepth camera, your eyes are designed while the device is running.

\nNote: The view that people around you see is the natural view of the eyes, not your real eyes.

EyeSight modes in Apple Vision Pro

EyeSight supports different modes to let others know what you are doing in augmented reality. EyeSight automatically switches between modes based on your activity in different situations, making it one of the most innovative VR headset features we’ve seen yet.

Transparent mode

This mode allows you to see other people and a view of your eyes will be visible to them. When the headset’s sensors detect people near you, EyeSight allows them to see inside the panel, so you’ll know that the contacts around you are present.

At the same time, the EyeSight feature shows your eyes to the person in front of you, which means they are aware that your attention is drawn to the audience. Also, when the room is empty, EyeSight will turn off and not show your eyes in the background.

Full immersion mode

If you’re fully immersed in augmented reality and virtual reality or watching a movie, EyeSight will display an animated and colorful pattern on the outer panel of the headset. This effect is similar to Siri animation and people around you will notice that you are busy with your work.

Additionally, EyeSight displays your eye in semi-transparent form while using the app, depending on the level of animation.

Capture Mode

EyeSight enters this mode when you are recording Spatial images and videos. The visual indicator for Capture Mode is white and misty, which animates during video recording and turns on the flash when the image is captured.

This indicator, like the security badge, is mandatory and informs people around you that you are recording video or taking pictures of them.

EyeSight improves the way you interact

Before the introduction of Apple Vision Pro, EyeSight was only a hypothetical feature, but now this feature is one of the best points of differentiation of the Apple headset compared to other products on the market. EyeSight enables users to use the device in a more natural and dynamic way and interact with their surroundings.