Speaker
Description
The emergence of image sensors has revolutionized the world of technology. Over the past few decades, significant advancements in image sensor technology have brought about state-of-the-art imagers that have reached the theoretical limits of classical photography. Furthermore, with the evolution of information processing and hardware development, the usage of image sensors has expanded to include visible, near-infrared (NIR), and short-wave infrared (SWIR) information gathering in addition to traditional color imaging. As a result, the extended capabilities of image sensors have enabled a variety of applications such as autonomous driving, robot vision, and AR/VR.
In contrast to traditional camera applications, AR/VR requires unique modalities to enable users to interact with the surrounding environment properly. To achieve this, various image sensing technologies such as global shutter operation, 3D sensing, and efficient infrared sensing are used to track the environment concerning the location of the user, gaze detection (eye tracking), and hand tracking [1].
This presentation focuses on introducing the different image sensing technologies that enable AR/VR applications. The talk will begin by discussing the requirements of AR/VR applications, followed by an explanation of the basic operation principles of image sensing technologies. Furthermore, emerging novel image sensing technologies will be presented, which would enable further efficient information sensing.
One of the critical components of AR/VR is the ability to track the user's location in real-time accurately. As a result, image sensors need to incorporate global shutter operation, which enables the image sensors to capture images simultaneously, eliminating distortion caused by motion. Additionally, 3D sensing is required to map the user's environment accurately. The technology allows the sensors to perceive depth in the user's environment, which is necessary for proper object recognition. Another critical aspect of AR/VR is gaze detection (eye tracking). Eye tracking allows the image sensor to determine where the user is looking, which is crucial for creating an immersive experience. Infrared sensing technology is used to detect the user's eyes accurately, even in low-light conditions, and provide the necessary information for gaze detection. Finally, hand tracking is essential in AR/VR applications as it allows users to interact with the virtual environment naturally. The image sensors need to incorporate efficient infrared sensing technology to accurately detect and track the user's hands.
In conclusion, the evolution of image sensor technology has enabled the development of AR/VR applications that are immersive, interactive, and efficient. The introduction of global shutter operation, 3D sensing, and efficient infrared sensing technology has expanded the capabilities of image sensors and allowed for the creation of novel image sensing technologies that will enable even further efficient information gathering.
References
[1] Liu, Chiao, et al., 2019 IEEE International Electron Devices Meeting (IEDM). IEEE, 2019. Devices Meeting, 19-3, (2022)
| Keywords | Image sensor, AR/VR |
|---|
