2
RUDN scientist built a neural network to estimate the optimal threshold policy for heterogeneous devices in queueing theory

RUDN scientist built a neural network to estimate the optimal threshold policy for heterogeneous devices in queueing theory

RUDN University mathematician proposed an artificial neural network for solving the queuing theory problems that arise, for example, in computing systems or business processes. Together with classical methods, it will help calculate the optimal queue length, at which it is necessary to use a slower device to minimize the functions of average losses even with a large system load. The results are published in Mathematics.

Queuing theory mathematically describes systems with the need for optimization of the flow of customers, or requests. For example, it is used to calculate the load on servers in computer systems or optimize customer queues in a supermarket (in this case, the “server” is a cashier). The approach by which the requests are distributed depends on each specific task. One of the popular approaches is based on the threshold values with the maximum allowed number of clients in the queue to the server. To find the optimal threshold value, the policy iteration method is used, but it cannot be applied, for example, if there are too many clients. RUDN University mathematicians have shown that in such cases, the classical method can be improved by artificial neural networks.

“Policy-iteration algorithm is a fairly versatile tool for solving various optimization problems. Unfortunately, as is usually the case in practice, this algorithm is not without some limitations, such as the difficulties associated with convergence when the traffic is close to loaded, limitation on the process dimension, and, consequently, on the number of states. Thus, we would like to compensate for some of the weaknesses of this algorithm with other methods for calculating the optimal control policy”, said Dmitry Efrosinin, Ph.D., associate professor of the Department of Probability Theory and Mathematical Statistics at RUDN University.

Mathematicians studied a model of several servers with different operating speeds. The flow of incoming client requests is a Poisson process—the number of requests in any time interval does not depend on how many requests were in another interval. The time it takes to close on each request is distributed exponentially. First, RUDN University mathematicians performed calculations using a classical algorithm and then used the obtained data to teach artificial neural networks. They were then used to calculate the efficiency of the neural network (or the accuracy of the solution).

As a result, it turned out that the neural network gives a fairly accurate result. The value completely coinciding with the theoretical value was obtained with a probability of 80-97%. An almost correct solution, that is, differing by ±1 compared to the theory, was obtained with a probability of 99%. Hence, the mathematicians concluded that, if necessary, the neural network can complement the classical algorithm.

“We strongly believe that the trained neural network can be successfully used to calculate the optimal thresholds for those system parameters for which alternative numerical methods are difficult or impossible to use, for example, in a heavy traffic case. With this study, we confirm that the analysis of controlled queueing systems and the solution of optimization problems using classical Markov decision theory can be successfully combined with machine learning techniques. These approaches do not contradict each other; on the contrary, combining them provides new results”, said Dmitry Efrosinin, Ph.D., associate professor of the Department of Probability Theory and Mathematical Statistics at RUDN University. 

The results are published in the journal Mathematics.

International Projects View all
Visiting Professors View all
12 Dec 2024
In 2024, RUDN started accepting applications for the new annual Prize for Scientific Achievement in Chemistry. The award was established to honour contributions to fundamental and applied research, as well as merit in achieving the UN Sustainable Development Goals.
1212
Similar newsletter View all
21 Apr
Building a sustainable future: what are SDGs and how RUDN helps achieve them

Imagine a world where everyone has enough food, clean water, access to education, and decent work. A world where nature is protected and the future of our planet is cared for. These are the Sustainable Development Goals—to achieve a sustainable future for all! To this end, in 2015, the United Nations (UN) defined 17 Sustainable Development Goals (SDGs). The SDGs are a global plan that helps countries and people work together towards a better future. All 193 UN member states have joined the plan.

58
21 Apr
Unfounded generalizations and false conclusions: RUDN scientists have identified AI “hallucinations” in the diagnosis of mental disorders

Researchers from the Faculty of Artificial Intelligence at RUDN University conducted a large-scale study that revealed systemic errors in large language models (LLMs) when diagnosing depression based on text. This work, carried out in collaboration with colleagues from AIRI, Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences, Ivannikov Institute for System Programming of the Russian Academy of Sciences, Moscow Institute of Physics and Technology, and MBZUAI, not only identifies the problem but also lays the foundation for the creation of more reliable and secure tools for detecting depression and anxiety.

50
21 Apr
Rats and neurodegenerative processes: a junior researcher at RUDN University wins Academician A. P. Avtsyn Award

Alexandra Sentyabreva, a junior researcher at the Laboratory of Cell Technologies and Tissue Engineering at RUDN Research Institute of Molecular and Cellular Medicine at the Russian University of People's Friendship, won the competition for young scientists at the All-Russian Scientific Conference “Topical Issues of Morphogenesis in Norm and Pathology.” She was awarded the Academician A.P. Avtsyn Prize.

44
Similar newsletter View all