A new method for modeling based on eye reflection + video

Neural Radiation Field (NeRF) technology has incredible capabilities in converting 2D images and videos to 3D models and now the researchers of the “University of Maryland” have developed a new method to produce a three-dimensional model based on eye reflection Humans have provided.

In this new study, researchers have shown a stunning development in the way of creating three-dimensional images of the reflection of the cornea of ​​human eyes, which can have many applications in the field of modeling. In this research, the researchers explain that with the help of this method, it is possible to produce high-resolution photos of the people’s environment through the reflection of the cornea of ​​each person’s eye in an image, and by adjusting their color and details, a three-dimensional model can be created. To understand more about this technology, you can watch the short video below.

Making a three-dimensional model based on the cornea of ​​the eye

Of course, it should be noted that the current models produced by this method are not very clear and cannot be understood in full detail, and researchers have used special lighting methods to show the effects of modeling.

To test this tool in a real-life scenario, the researchers examined the eye reflections of Miley Cyrus and Lady Gaga, two famous American singers, to recreate what they see while filming their videos.

However, the resolution of the rendered image wasn’t high enough, and the most accurate they could determine by testing their method was that Cyrus might have been looking at a lighting grid, and Gaga might have been looking at something a bit like a person’s torso. It is similar.

The researchers have published the results of their research along with several videos on GitHub. Although the currently presented results are flawed due to the difficulty of accurately estimating the eye position as well as the intertwining texture of the iris and scene reflections, they continue to work on the technology and also promise to release the code for the technology soon via this page. will be made available.