'We Are Creating the Medicine of the Future'
Dr Gerwin Schalk is a professor at Fudan University in Shanghai and a partner of the HSE Centre for Language and Brain within the framework of the strategic project 'Human Brain Resilience.' Dr Schalk is known as the creator of BCI2000, a non-commercial general-purpose brain-computer interface system. In this interview, he discusses modern neural interfaces, methods for post-stroke rehabilitation, a novel approach to neurosurgery, and shares his vision for the future of neurotechnology.
Brain-Computer Interfaces
Neural interfaces are technologies that establish a direct connection between the brain and a computer. Special devices, such as electrodes placed on the scalp, on the brain's surface, or within the brain, are used to detect brain signals. These signals are then processed and converted into meaningful information, which can be transmitted to electronic devices such as computers, prosthetics, or speech synthesisers.
Just as smartwatches or other wearable devices give us useful information about our body, such as heart rate or the number of our steps, neurotechnology can provide important information about the health of our brain or can even help to improve it. In contrast to wearable devices, neurotechnologies are currently still used almost exclusively in laboratory settings and in limited testing in the clinic. For example, clinicians use them for rehabilitating patients after strokes or brain injuries, restoring speech functions, and performing neurosurgical procedures.
I have spent my career understanding the neural basis of neurotechnologies and on facilitating their transition into wider areas of research and the clinic. Indeed, my BCI2000 software is now the most widely used software for studying neurotechnologies. My team and I have been developing this software for nearly 25 years, and there is still quite some room for further improvements. Essentially, BCI2000 is similar to Linux or Android systems since it can be used across various applications.
A New Approach to Rehabilitation
Many post-stroke patients experience a loss of motor or speech functions. Conventional rehabilitation methods involve regular therapy sessions at specialised clinics. Patients are asked to repeat specific words or phrases multiple times and perform various exercises.
However, this approach has several limitations: therapy sessions can only take place at a facility under professional supervision. It can be inconvenient for patients, complicated, and expensive. Additionally, once patients return home, they often discontinue therapy sessions and miss the opportunity for a full recovery.
Together with HSE, we have been developing a new rehabilitation system that uses neurotechnologies. It is designed to aid language recovery in patients with aphasia who have lost the ability to speak coherently and express their thoughts following illness or injury. Instead of repeating phrases, patients are invited to play a game. Special sensors are attached to the head to monitor brain signals. The person sees a picture on the screen and hears several words, one of which corresponds to the image. The brain must identify the correct word. If the system can detect from the brain signal that the person identified the correct word, the person receives a reward such as a smiley face. In this way, even individuals who have lost the physical ability to speak can engage in this exercise.
We now have a prototype of this system. Our next goal is to make it accessible and understandable to people without specialised knowledge. The system should be extremely simple, allowing anyone to use it, including junior medical staff at any hospital. Patients only need to place a special device on their head and begin playing.
Today, neurotechnology for rehabilitation is like a delicate young sprout. To allow it to grow stronger and flourish, we cannot immediately place it in the heart of a dense forest. We must cultivate it separately and only then integrate it into the broader environment. In our case, that means the healthcare system. This is a crucial and challenging task that requires time, expertise, effort, and patience. We are gradually creating a new model of medicine that will not replace but complement the existing one, which is primarily based on pharmacological solutions.
Invasive Neurotechnologies: A Revolution in Neurosurgery
Another important application of neurotechnologies is functional brain mapping. In brain surgery, eg when removing tumours, it is critically important to identify areas of the brain that control movement, language, and other functions. The surgeon does not always see the tumour’s boundaries, as it may not visually differ from the surrounding tissue. Meanwhile, the cost of an error in neurosurgery is extremely high: if too much tissue is removed, the patient could lose the ability to walk or speak.
Conventional brain mapping methods involve electrical stimulation of the brain. A clinician applies an electrical current to a specific area of the patient's brain, and if the patient's arm twitches or they stop speaking, it indicates that the area is responsible for motor or language functions, respectively. This process requires significant patient involvement directly on the operating table. Additionally, electrical stimulation can sometimes trigger seizures.
We have developed a simpler and safer method that analyses brain signals while the patient performs simple tasks. We use electrocorticography, which involves placing electrodes directly on the surface of the brain. The patient performs several tasks simultaneously, such as speaking, sticking out their tongue, and moving their hand. We monitor brain signals, and if we detect an increase in activity in a specific area, we can infer that this region is involved in the corresponding function. Brain mapping requires a personalised approach. While everyone's brain is generally structured similarly, functions are located in slightly different areas in different people, and tumours can further distort these areas. Therefore, for the surgeon to operate with precision, it is essential to map each individual functional area of the brain.
Neurotechnologies of the Future
There is extensive media coverage of neuroprostheses—electronic implants that help people regain the ability to walk, see, or hear. Last year, my colleagues and I demonstrated that we could read brain signals and convert them into natural-sounding speech. We were able to recreate a Pink Floyd song by analysing neuronal activity. This work contributes to neuroprostheses that can restore speech function. While all of this may seem ambitious, futuristic, and reminiscent of science fiction novels, we will initially only be able to help some people.
In the case of neuroprostheses, we restore a lost ability in a patient—whether it's the ability to walk, see, hear, or speak—without altering anything in the brain itself. In the case of rehabilitation using neurotechnologies, we aim to reorient the functioning preserved part of the brain to take over functions that were previously controlled by other areas. These changes may be less spectacular, but they are much deeper and more complex, with potential and benefits that are far greater.
To pursue these exciting goals, we don't necessarily need to invent completely new technologies, but we certainly need to continue to learn how to configure the existing ones correctly and effectively. It is important to integrate these technologies into clinical practice, train clinicians, and earn the trust of patients. It's a long journey ahead, but we are already at the start of a new revolution in medicine.
Translating neurotechnologies into practical devices for monitoring health in everyday life is one of our primary goals. They should become a valuable tool for monitoring personal health, and should be accessible to everyone, not just to clinicians and researchers. For example, a person may wear a headband while sleeping and receive a report in the morning about the quality of their sleep, the state of their nervous system, and stress levels, along with recommendations on how to improve their lifestyle—such as reducing alcohol consumption, going to bed earlier, or exercising more. If we can 'translate' brain signals into meaningful information, it will mark a significant step forward in preventive medicine.
See also:
HSE Researchers Teach Neural Network to Distinguish Origins from Genetically Similar Populations
Researchers from the AI and Digital Science Institute, HSE Faculty of Computer Science, have proposed a new approach based on advanced machine learning techniques to determine a person’s genetic origin with high accuracy. This method uses graph neural networks, which make it possible to distinguish even very closely related populations.
HSE Economists Reveal the Secret to Strong Families
Researchers from the HSE Faculty of Economic Sciences have examined the key factors behind lasting marriages. The findings show that having children is the primary factor contributing to marital stability, while for couples without children, a greater income gap between spouses is associated with a stronger union. This is the conclusion reported in Applied Econometrics.
Fifteen Minutes on Foot: How Post-Soviet Cities Manage Access to Essential Services
Researchers from HSE University and the Institute of Geography of the Russian Academy of Sciences analysed three major Russian cities to assess their alignment with the '15-minute city' concept—an urban design that ensures residents can easily access essential services and facilities within walking distance. Naberezhnye Chelny, where most residents live in Soviet-era microdistricts, demonstrated the highest levels of accessibility. In Krasnodar, fewer than half of residents can easily reach essential facilities on foot, and in Saratov, just over a third can. The article has been published in Regional Research of Russia.
HSE Researchers Find Counter-Strike Skins Outperform Bitcoin and Gold as Alternative Investments
Virtual knives, custom-painted machine guns, and gloves are common collectible items in videogames. A new study by scientists from HSE University suggests that digital skins from the popular video game Counter-Strike: Global Offensive (CS:GO) rank among the most profitable types of alternative investments, with average annual returns exceeding 40%. The study has been published in the Social Science Research Network (SSRN), a free-access online repository.
HSE Neurolinguists Reveal What Makes Apps Effective for Aphasia Rehabilitation
Scientists at the HSE Centre for Language and Brain have identified key factors that increase the effectiveness of mobile and computer-based applications for aphasia rehabilitation. These key factors include automated feedback, a variety of tasks within the application, extended treatment duration, and ongoing interaction between the user and the clinician. The article has been published in NeuroRehabilitation.
'Our Goal Is Not to Determine Which Version Is Correct but to Explore the Variability'
The International Linguistic Convergence Laboratory at the HSE Faculty of Humanities studies the processes of convergence among languages spoken in regions with mixed, multiethnic populations. Research conducted by linguists at HSE University contributes to understanding the history of language development and explores how languages are perceived and used in multilingual environments. George Moroz, head of the laboratory, shares more details in an interview with the HSE News Service.
Slim vs Fat: Overweight Russians Earn Less
Overweight Russians tend to earn significantly less than their slimmer counterparts, with a 10% increase in body mass index (BMI) associated with a 9% decrease in wages. These are the findings made by Anastasiia Deeva, lecturer at the HSE Faculty of Economic Sciences and intern researcher in Laboratory of Economic Research in Public Sector. The article has been published in Voprosy Statistiki.
Scientists Reveal Cognitive Mechanisms Involved in Bipolar Disorder
An international team of researchers including scientists from HSE University has experimentally demonstrated that individuals with bipolar disorder tend to perceive the world as more volatile than it actually is, which often leads them to make irrational decisions. The scientists suggest that their findings could lead to the development of more accurate methods for diagnosing and treating bipolar disorder in the future. The article has been published in Translational Psychiatry.
Scientists Develop AI Tool for Designing Novel Materials
An international team of scientists, including researchers from HSE University, has developed a new generative model called the Wyckoff Transformer (WyFormer) for creating symmetrical crystal structures. The neural network will make it possible to design materials with specified properties for use in semiconductors, solar panels, medical devices, and other high-tech applications. The scientists will present their work at ICML, a leading international conference on machine learning, on July 15 in Vancouver. A preprint of the paper is available on arxiv.org, with the code and data released under an open-source license.
HSE Linguists Study How Bilinguals Use Phrases with Numerals in Russian
Researchers at HSE University analysed over 4,000 examples of Russian spoken by bilinguals for whom Russian is a second language, collected from seven regions of Russia. They found that most non-standard numeral constructions are influenced not only by the speakers’ native languages but also by how frequently these expressions occur in everyday speech. For example, common phrases like 'two hours' or 'five kilometres’ almost always match the standard literary form, while less familiar expressions—especially those involving the numerals two to four or collective forms like dvoe and troe (used for referring to people)—often differ from the norm. The study has been published in Journal of Bilingualism.