Mathematicians from RUDN University and the Free University of Berlin proposed a new way of using neural networks for working with noisy high-dimensional data
The restoration of the probability distribution of observed data by artificial neural networks is the most important part of machine learning. The probability distribution not only allows us to predict the behaviour of the system under study, but also to quantify the uncertainty with which forecasts are made. The main difficulty is that, as a rule, only the data are observed, but their exact probability distributions are not available. To solve this problem, Bayesian and other similar approximate methods are used. But their use increases the complexity of a neural network and therefore makes its training more complicated.
RUDN University and the Free University of Berlin mathematicians used deterministic weights in neural networks, which would help overcome the limitations of Bayesian methods. They developed a formula that allows one to correctly estimate the variance of the distribution of observed data. The proposed model was tested on different data: synthetic and real; on data containing outliers and on data from which the outliers were removed. The new method allows restoration of probability distributions with accuracy previously unachievable.
The mathematicians of RUDN University and the Free University of Berlin used deterministic weights for neural networks and used the networks outputs to encode the distribution of latent variables for the desired marginal distribution. An analysis of the training dynamics of such networks allowed them to obtain a formula that correctly estimates the variance of observed data, despite the presence of outliers in the data. The proposed model was tested on different data: synthetic and real. The new method allows restoring probability distributions with higher accuracy compared with other modern methods. Accuracy was assessed using the AUC method (area under the curve is the area under the graph that allows making assessment of the mean square error of the predictions depending on the sample size estimated by the network as “reliable”; the higher the AUC score, the better the predictions).
The article was published in the journal Artificial Intelligence.
RUDN summarized the results of the scientific competition "Project Start: work of the science club ". Students of the Faculty of Physics, Mathematics and Natural Sciences have created a project for a managed queuing system using a neural network to redistribute resources between 5G segments. How to increase flexibility, make the network fast and inexpensive and reach more users — tell Gebrial Ibram Esam Zekri ("Fundamental Computer Science and Information Technology", Master's degree, II course) and Ksenia Leontieva ("Applied Mathematics and Computer Science", Master's degree, I course).
The National Demographic Report, 2023 Demographic Well-Being of Russian Regions (hereinafter - the National Demographic Report) was prepared by the scientific team of the Institute of Demographic Studies of the Federal Research Center of the Russian Academy of Sciences, the Vologda Scientific Center of the Russian Academy of Sciences, Peoples' Friendship University of Russia, the Center for Family and Demography of the Academy of Sciences of the Republic of Tatarstan, as well as with the participation of leading scientists from the Republic of Bashkortostan, Stavropol Krai, Volgograd, Ivanovo, Kaliningrad, Nizhny Novgorod, Sverdlovsk Oblasts and Khanty-Mansi Autonomous Okrug–Yugra.
RUDN summarized the results of the scientific competition "Project Start: work of the science club ". Students of the Faculty of Physics, Mathematics and Natural Sciences have created a project for a managed queuing system using a neural network to redistribute resources between 5G segments. How to increase flexibility, make the network fast and inexpensive and reach more users — tell Gebrial Ibram Esam Zekri ("Fundamental Computer Science and Information Technology", Master's degree, II course) and Ksenia Leontieva ("Applied Mathematics and Computer Science", Master's degree, I course).
What is your first association with the word “laboratory”? Flasks and beakers? Microscopes and centrifuges? Yes, many of us would answer the same way.
The National Demographic Report, 2023 Demographic Well-Being of Russian Regions (hereinafter - the National Demographic Report) was prepared by the scientific team of the Institute of Demographic Studies of the Federal Research Center of the Russian Academy of Sciences, the Vologda Scientific Center of the Russian Academy of Sciences, Peoples' Friendship University of Russia, the Center for Family and Demography of the Academy of Sciences of the Republic of Tatarstan, as well as with the participation of leading scientists from the Republic of Bashkortostan, Stavropol Krai, Volgograd, Ivanovo, Kaliningrad, Nizhny Novgorod, Sverdlovsk Oblasts and Khanty-Mansi Autonomous Okrug–Yugra.