NVIDIA is collaborating with Stanford University's Computational Imaging Group to develop smaller, lighter extended reality (XR) glasses using artificial intelligence (AI). According to an NVIDIA technical blog, this innovative research aims to address the bulk and social barriers of current XR devices that rely on heavy optics and head straps.
XR Optical Design Challenges
Current XR devices require displays to be placed close to the user's eyes, which shifts the center of gravity and necessitates the use of a head strap. This setup is necessary to balance the device, but it is quite bulky. Additionally, the human eye struggles to perceive displays that are too close, so an optical system is needed to relay the image to a comfortable viewing distance. Traditional solutions such as pancake lenses and optical waveguides have their own limitations, including increased weight, aberrations, and limited viewing angles.
Holographic Near-Eye Display
Holographic near-eye displays have emerged as a promising technology to overcome these challenges. Using spatial light modulators (SLMs) that manipulate the phase of light, these displays can reconstruct 3D holograms close to the focal length of the lens, even when the display is very close. NVIDIA researchers have presented holographic glasses for virtual reality (VR) that are just 2.5 mm thick, significantly reducing their volume and enabling a more comfortable user experience.
Revolutionary AI-driven holography
The study was published in the journal Naturewill demonstrate a full-color 3D holographic augmented reality (AR) display with metasurface waveguides. These holographic AR glasses use AI-driven algorithms to manage the complex wavefront propagation in a waveguide system, eliminating lenses from the optical path. This approach not only minimizes the form factor, but also improves image quality by leveraging AI for precise calibration.
Future impacts
The integration of AI into the development of XR glasses represents a major advancement in display technology. By enabling the creation of lightweight, compact devices, AI-driven holography opens up new possibilities for XR applications and has the potential to transform the way we experience virtual and augmented reality content. This breakthrough also paves the way for new display form factors beyond the traditional 2D rectangular screens prevalent in the display industry.
For more information, see the NVIDIA technical blog.
Image credit: Shutterstock
