2
RUDN University improves eye tracking technology in VR systems

RUDN University improves eye tracking technology in VR systems

The tracking of eye movement is one of the key elements of virtual and amplified reality technologies (VR/AR). Professor from RUDN University developed a mathematical model that helps accurately predict the next gaze fixation point and reduces the inaccuracy caused by blinking. At the same time, the observational error that occurs due to blinking was reduced by 10 times. The model would make VR/AR systems more realistic and sensitive to user actions.

Foveated rendering is a basic technology of VR systems. When a person looks at something, their gaze is focused on the so-called foveated region, and everything else is covered by peripheral vision. Therefore, a computer has to render the images in the foveated region with the highest degree of detail, while other parts require less computational powers. This approach helps improve computational performance and eliminates issues caused by the gap between the limited capabilities of graphic processors and increasing display resolution. However, foveated rendering technology is limited in speed and accuracy of the next gaze fixation point prediction because the movement of a human eye is a complex and largely random process. To solve this issue, a team of researchers from MSU together with a professor from RUDN University developed a mathematical modeling method that helps calculate next gaze fixation points in advance.

"One of the issues with foveated rendering is timely prediction of the next gaze fixation point because vision is a complex stochastic process. We suggested a mathematical model that predicts gaze fixation point changes," said Prof. Viktor Belyaev, a Ph.D. in Technical Sciences from the Department of Mechanics and Mechatronics of RUDN University.

The predictions of the model are based on the study of the so-called saccadic movements, fast and rhythmic movements of the eye. They accompany the shifts of our gaze from one object to another and can suggest the next fixation point. The ratio between the length, range, and maximum speed of saccadic eye movements is determined by certain empirical regularities. However, these models cannot be used by eye trackers to predict eye movements because they are not accurate enough. Therefore, the researchers focused on a mathematical model that helped them obtain saccadic movement parameters. After that, this data was used to calculate the foveated region of an image.

The method was tested experimentally using a VR helmet and AR glasses. The eye tracker based on the mathematical model was able to detect minor eye movements (3.4 minutes, which is equal to 0.05 degrees), and the inaccuracy amounted to 6.7 minutes (0.11 degrees). Moreover, the team managed to eliminate the calculation error caused by blinking: a filter included in the model reduced the inaccuracy 10 times. The results of the work could be used in VR modeling, video games, and in medicine for surgeries and vision disorders diagnostics.

"We have effectively solved the issue with the foveated rendering technology that existed in the mass production of VR systems. In the future, we plan to calibrate our eye tracker to reduce the impact of display or helmet movements against a user's head," added Prof. Viktor Belyaev from RUDN University.

The results of the study were published in the SID Symposium Digest of Technical Papers.

International scientific cooperation View all
16 Oct
530 applications, 90 young scientists from 30 countries. Darya Nazarova, a postgraduate student of RUDN Faculty of Economics, traveled 11,276 km from Moscow to Sao Paulo for the International Scientific School on Technological and Innovation Strategies and Economic Development Policy at the University of Campinas (UNICAMP). Darya Nazarova, a young RUDN scientist, writes about scientific research, rafting and the country of eternal carnival.
78
Scientific Conferences View all
16 Oct
The collection consists of two volumes and includes biographical information about Russian demographers and their scientific research. The first volume is devoted to the research of the Pre-Revolutionary period, the second to the works of the Soviet era and the present.
113
Similar newsletter View all
16 Oct
Green Diplomacy Center opened in RUDN

A Center for Green Diplomacy was created based on the RUDN Institute of Environmental Engineering. Among the goals is the integration of the results of scientific and practical activities into the development of international relations in the environmental sphere. The center's specialists will also accompany the corporate sector in solving various environmental problems.

118
19 Apr
A huge pizza and a jug of water, why should 5G networks be sliced? The winners of RUDN science competition explain

RUDN summarized the results of the scientific competition "Project Start: work of the science club ". Students of the Faculty of Physics, Mathematics and Natural Sciences have created a project for a managed queuing system using a neural network to redistribute resources between 5G segments. How to increase flexibility, make the network fast and inexpensive and reach more users — tell Gebrial Ibram Esam Zekri ("Fundamental Computer Science and Information Technology", Master's degree, II course) and Ksenia Leontieva ("Applied Mathematics and Computer Science", Master's degree, I course).

179
19 Apr
Lyricists and physicists are now on equal terms: the first humanitarian laboratory opened in RUDN

What is your first association with the word “laboratory”? Flasks and beakers? Microscopes and centrifuges? Yes, many of us would answer the same way.

226
Similar newsletter View all