RUDN University improves eye tracking technology in VR systems
Foveated rendering is a basic technology of VR systems. When a person looks at something, their gaze is focused on the so-called foveated region, and everything else is covered by peripheral vision. Therefore, a computer has to render the images in the foveated region with the highest degree of detail, while other parts require less computational powers. This approach helps improve computational performance and eliminates issues caused by the gap between the limited capabilities of graphic processors and increasing display resolution. However, foveated rendering technology is limited in speed and accuracy of the next gaze fixation point prediction because the movement of a human eye is a complex and largely random process. To solve this issue, a team of researchers from MSU together with a professor from RUDN University developed a mathematical modeling method that helps calculate next gaze fixation points in advance.
"One of the issues with foveated rendering is timely prediction of the next gaze fixation point because vision is a complex stochastic process. We suggested a mathematical model that predicts gaze fixation point changes," said Prof. Viktor Belyaev, a Ph.D. in Technical Sciences from the Department of Mechanics and Mechatronics of RUDN University.
The predictions of the model are based on the study of the so-called saccadic movements, fast and rhythmic movements of the eye. They accompany the shifts of our gaze from one object to another and can suggest the next fixation point. The ratio between the length, range, and maximum speed of saccadic eye movements is determined by certain empirical regularities. However, these models cannot be used by eye trackers to predict eye movements because they are not accurate enough. Therefore, the researchers focused on a mathematical model that helped them obtain saccadic movement parameters. After that, this data was used to calculate the foveated region of an image.
The method was tested experimentally using a VR helmet and AR glasses. The eye tracker based on the mathematical model was able to detect minor eye movements (3.4 minutes, which is equal to 0.05 degrees), and the inaccuracy amounted to 6.7 minutes (0.11 degrees). Moreover, the team managed to eliminate the calculation error caused by blinking: a filter included in the model reduced the inaccuracy 10 times. The results of the work could be used in VR modeling, video games, and in medicine for surgeries and vision disorders diagnostics.
"We have effectively solved the issue with the foveated rendering technology that existed in the mass production of VR systems. In the future, we plan to calibrate our eye tracker to reduce the impact of display or helmet movements against a user's head," added Prof. Viktor Belyaev from RUDN University.
The results of the study were published in the SID Symposium Digest of Technical Papers.
Imagine a world where everyone has enough food, clean water, access to education, and decent work. A world where nature is protected and the future of our planet is cared for. These are the Sustainable Development Goals—to achieve a sustainable future for all! To this end, in 2015, the United Nations (UN) defined 17 Sustainable Development Goals (SDGs). The SDGs are a global plan that helps countries and people work together towards a better future. All 193 UN member states have joined the plan.
Researchers from the Faculty of Artificial Intelligence at RUDN University conducted a large-scale study that revealed systemic errors in large language models (LLMs) when diagnosing depression based on text. This work, carried out in collaboration with colleagues from AIRI, Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences, Ivannikov Institute for System Programming of the Russian Academy of Sciences, Moscow Institute of Physics and Technology, and MBZUAI, not only identifies the problem but also lays the foundation for the creation of more reliable and secure tools for detecting depression and anxiety.
Alexandra Sentyabreva, a junior researcher at the Laboratory of Cell Technologies and Tissue Engineering at RUDN Research Institute of Molecular and Cellular Medicine at the Russian University of People's Friendship, won the competition for young scientists at the All-Russian Scientific Conference “Topical Issues of Morphogenesis in Norm and Pathology.” She was awarded the Academician A.P. Avtsyn Prize.
Imagine a world where everyone has enough food, clean water, access to education, and decent work. A world where nature is protected and the future of our planet is cared for. These are the Sustainable Development Goals—to achieve a sustainable future for all! To this end, in 2015, the United Nations (UN) defined 17 Sustainable Development Goals (SDGs). The SDGs are a global plan that helps countries and people work together towards a better future. All 193 UN member states have joined the plan.
Researchers from the Faculty of Artificial Intelligence at RUDN University conducted a large-scale study that revealed systemic errors in large language models (LLMs) when diagnosing depression based on text. This work, carried out in collaboration with colleagues from AIRI, Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences, Ivannikov Institute for System Programming of the Russian Academy of Sciences, Moscow Institute of Physics and Technology, and MBZUAI, not only identifies the problem but also lays the foundation for the creation of more reliable and secure tools for detecting depression and anxiety.
Alexandra Sentyabreva, a junior researcher at the Laboratory of Cell Technologies and Tissue Engineering at RUDN Research Institute of Molecular and Cellular Medicine at the Russian University of People's Friendship, won the competition for young scientists at the All-Russian Scientific Conference “Topical Issues of Morphogenesis in Norm and Pathology.” She was awarded the Academician A.P. Avtsyn Prize.