AI to Enable Accurate Modelling of Data Storage System Performance
Researchers at the HSE Faculty of Computer Science have developed a new approach to modelling data storage systems based on generative machine learning models. This approach makes it possible to accurately predict the key performance characteristics of such systems under various conditions. Results have been published in the IEEE Access journal.
Data storage systems play an important role in today’s digital world, as they are responsible for the safety and prompt availability of vast amounts of information. These systems consist of many components, including controllers, HDD and SSD disks, as well as cache memory, which work together to ensure fast and efficient operation. To achieve optimal performance, it is essential to accurately predict how these systems will function in different scenarios, such as when the load on the system changes.
Researchers at the HSE Faculty of Computer Science developed a new approach to modelling data storage system performance, which relies on generative machine learning models. The authors proposed a method that provides high-precision predictions of the key performance characteristics of the systems: the number of input/output operations per second (IOPS) and latency.
The modelling includes two stages. First, the scientists collect data by measuring the system’s performance under various loads and configurations. This data is then fed to two special generative models: the CatBoost regression model and the normalizing flow model. CatBoost works well with tabular data and can accurately predict average values and performance deviations. The normalizing flow model produces a complete distribution of possible outcomes, taking into account data uncertainties and variability.
Mikhail Hushchyn
‘One of the main advantages of our method is that it does not require detailed knowledge of the internal structure of the system components. This is often impossible due to the manufacturers’ trade secrets. Instead, our generative models are trained directly on real-world data. For instance, in our study, we trained a model using 300,000 measurements. This makes our approach versatile and applicable to any type of data storage system,’ says study author Mikhail Hushchyn, a senior research fellow at the HSE Faculty of Computer Science.
The researchers tested the accuracy of the proposed approach using Little's law, a fundamental principle of queuing theory. According to test results, these predictions are highly consistent with real observations: prediction errors range from just 4–10% for IOPS and 3–16% for latency, while the correlation with the observed values reaches 0.99.
Aziz Temirkhanov
‘Our proposed approach opens up broad prospects for optimising and planning the operation of data centres. It makes it possible to predict the behaviour of the system amid load changes, identify potential performance issues, and optimise power consumption. Furthermore, expensive physical experiments are no longer required for accurate modelling,’ stated Aziz Temirkhanov, a junior research fellow at the Laboratory of Methods for Big Data Analysis.
The experimental code and measurements of the storage system performance are publicly available.
The research was carried out within the Mirror Laboratories project of HSE University on improving the efficiency of data centres and data storage systems using artificial intelligence methods.
See also:
Similar Comprehension, Different Reading: How Native Language Affects Reading in English as a Second Language
Researchers from the MECO international project, including experts from the HSE Centre for Language and Brain, have developed a tool for analysing data on English text reading by native speakers of more than 19 languages. In a large-scale experiment involving over 1,200 people, researchers recorded participants’ eye movements as they silently read the same English texts and then assessed their level of comprehension. The results showed that even when comprehension levels were the same, the reading process—such as gaze fixations, rereading, and word skipping—varied depending on the reader's native language and their English proficiency. The study has been published in Studies in Second Language Acquisition.
Registration for Russian Olympiad in Artificial Intelligence 2025 Now Open
Registration for the fifth season of the Russian Olympiad in Artificial Intelligence has opened. This year, the competition has gained international status. The event is open to students in the 8–11 grades both in Russia and abroad. The winners will receive benefits when applying to Russian universities.
Mortgage and Demography: HSE Scientists Reveal How Mortgage Debt Shapes Family Priorities
Having a mortgage increases the likelihood that a Russian family will plan to have a child within the next three years by 39 percentage points. This is the conclusion of a study by Prof. Elena Vakulenko and doctoral student Rufina Evgrafova from the HSE Faculty of Economic Sciences. The authors emphasise that this effect is most pronounced among women, people under 36, and those without children. The study findings have been published in Voprosy Ekonomiki.
Scientists Discover How Correlated Disorder Boosts Superconductivity
Superconductivity is a unique state of matter in which electric current flows without any energy loss. In materials with defects, it typically emerges at very low temperatures and develops in several stages. An international team of scientists, including physicists from HSE MIEM, has demonstrated that when defects within a material are arranged in a specific pattern rather than randomly, superconductivity can occur at a higher temperature and extend throughout the entire material. This discovery could help develop superconductors that operate without the need for extreme cooling. The study has been published in Physical Review B.
Scientists Develop New Method to Detect Motor Disorders Using 3D Objects
Researchers at HSE University have developed a new methodological approach to studying motor planning and execution. By using 3D-printed objects and an infrared tracking system, they demonstrated that the brain initiates the planning process even before movement begins. This approach may eventually aid in the assessment and treatment of patients with neurodegenerative diseases such as Parkinson’s. The paper has been published in Frontiers in Human Neuroscience.
Global AI Trends Discussed at International Foresight Workshop at HSE University
At an international foresight workshop on artificial intelligence held at HSE University, Russian and foreign scholars discussed the trends and challenges arising from the rapid development of AI.
'Biotech Is Booming Worldwide'
For more than five years, the International Laboratory of Bioinformatics at the HSE Faculty of Computer Science has been advancing cutting-edge research. During this time, its scientists have achieved major breakthroughs, including the development of CARDIOLIFE—a unique genetic test unmatched worldwide that predicts the likelihood of cardiovascular disease. With the active participation of HSE students, including doctoral students, the team is also working on a new generation of medicines. In this interview with the HSE News Service, Laboratory Head Maria Poptsova shares insights into their work.
Civic Identity Helps Russians Maintain Mental Health During Sanctions
Researchers at HSE University have found that identifying with one’s country can support psychological coping during difficult times, particularly when individuals reframe the situation or draw on spiritual and cultural values. Reframing in particular can help alleviate symptoms of depression. The study has been published in Journal of Community Psychology.
HSE Students Win International Olympiad in Artificial Intelligence
In the finals of the olympiad, the Russian team competed with 300 talented schoolchildren from 61 countries, including Australia, Brazil, Hungary, China, Mexico, the United Arab Emirates, Poland, Serbia, Singapore, the USA, Sweden, and Japan. The finals included team and individual rounds. In the team round, the Russian team made it into the top 10, winning a silver medal. In the individual competition, Russian schoolchildren won six gold medals, one silver, and one bronze.
‘Neural Networks Can Provide Assessments As Accurate As Humans’
Voice assistants have become part of everyday life. They can plan routes, play music and films, and answer questions. But the quality of their speech requires assessment. To address this, students of the Applied Artificial Intelligence Workshop at the HSE University and VK Engineering and Mathematics Schoolhave developed neural networks capable of evaluating speech synthesis.