Brain–Computer Interface Using Functional Near-Infrared Spectroscopy for Post-Stroke Motor Rehabilitation: Case Series

Cover Page


Cite item

Abstract

Introduction. Non-invasive brain–computer interfaces (BCIs) enable feedback motor imagery [MI] training in neurological patients to support their motor rehabilitation. Nowadays, the use of BCIs based on functional near-infrared spectroscopy (fNIRS) for motor rehabilitation is yet to be investigated.

Objective: To evaluate the potential fNIRS BCI use in hand MI training for comprehensive post-stroke rehabilitation.

Materials and methods. This pilot study included clinically stable patients with mild-to-moderate post-stroke hand paresis. In addition to the standard rehabilitation, the patients underwent 10 nine-minute MI fNIRS BCI training sessions. To evaluate the quality of fNIRS BCI control, we assessed the percentage of time during which the classifier accurately detected patient's mental state. We scored the hand function using the Action Research Arm Test (ARAT) and the Fugl-Meyer Assessment (FMA).

Results. The study included 5 patients at 1 day to 12 months of stroke. All the participants completed the study. All study participants achieved BCI control rates higher than random (41–68%). While three patients demonstrated the clinically significant improvements in their ARAT scores, one of them also showed an improvement in the FMA score. All the participants reported experiencing drowsiness during training.

Conclusions. Post-stroke patients can operate the fNIRS BCI system under investigation. We suggest adjusting the feedback system, extending the duration of training, and incorporating functional electromyostimulation to enhance training effectiveness.

Full Text

Introduction

Brain–computer interfaces (BCIs) are systems that translate brain activity signals into commands for the output devices. Non-invasive BCIs enable feedback motor imagery (MI) training in neurological patients to support their motor rehabilitation. At present, several systematic reviews comprise the evidence base for employing BCIs, which utilize sensory and motor EEG rhythms (EEG BCIs), in post-stroke rehabilitation [1–4]. We also conducted a randomized controlled trial (RCT) to evaluate effectiveness of using EEG BCI with visual and exoskeleton-mediated kynesthetic feedback in the post-stroke population [5, 6]. A series of training sessions for MI, controlled with this technology, resulted in improved grasping and pinching. However, the EEG-BCI use is complicated due to the necessity of applying EEG gel onto the scalp, signal artifacts in patient motion and muscle contraction during training, and the low spatial resolution of signal source detection.

Functional near-infrared spectroscopy BCIs (fNIRS-BCIs) is a non-invasive BCI to conduct feedback MI training. The sources of brain activity may involve alterations in concentrations of oxy-, deoxy-, and total hemoglobin up to 4 cm below the head surface. This technology does not require the use of any electrode gel, and patient movements during training do not result in significant signal distortion. At present, fNIRS-BCI remains largely unexplored approach to post-stroke rehabilitation. The latest review [7] of biofeedback methods mentions only one fNIRS-BCI study in post-stroke rehabilitation [8]. The study protocol implied the presentation of the signal amplitude as the color and the height of the bars on the monitor rather than signal classification.

The exploratory study of this technology with assessment of the attained level of online signal detection was necessary as an initial test prior to the development of the fNIRS BCI effectiveness RCT protocol.

The study objective is to evaluate the potential fNIRS BCI use for customized hand MI training in comprehensive post-stroke rehabilitation.

Materials and methods

Study design

This pilot study is a case series of post-stroke rehabilitation integrating standard management with additional fNIRS BCI mental training.

The study was conducted at the Institute of Neuro-Rehabilitation and Recovery Technologies of the Research Center of Neurology from June to October 2022. The study included inpatients receiving scheduled rehabilitation. Each patient participated for a total of 12 days including five training days followed by two days off, and then five more training days. fNIRS BCI training supplemented the standard clinical rehabilitation program. Prior to the first fNIRS BCI training session and post the last one, hand motion was assessed and scored using international validated scales.

The study protocol was approved by the Local Ethics Committee of the Research Center of Neurology (Protocol No. 5-4/22, 1 June 2022). Patient participation in this study was entirely voluntary, and all participants provided informed consent. The study protocol was pre-registered in the local research project protocol database of the Institute of Neuro-Rehabilitation and Recovery Technologies (ID 210).

Inclusion criteria

Inclusion criteria: primary or recurrent stroke with a supratentorial CT or MRI-confirmed focus, mildto-moderate clinical paresis of the distal upper limb, the stroke time of one day to 12 months, clinically stable state without any life-threatening conditions, and informed consent to participate in the study.

Exclusion criteria: severe speech, vision, and/or cognitive function impairment and/or hand tissue contractures.

Standard rehabilitation course

All patients underwent a two-week rehabilitation course that included personal instructor-led exercise therapy, neuro-muscular electric stimulation of lower limb muscles, therapeutic massage, robotic biofeedback mechanotherapy to recover hand fine movements, and stationary cycling exercises. The above activities were performed on daily basis, except for the days-off (10 sessions each).

fNIRS BCI training

MI fNIRS BCI training was performed on a daily basis except for the days-off in addition to the standard rehabilitation course. Each patient underwent 10 training sessions.

The study used a non-invasive BCI based on the recognition of a BOLD cortical signal in the hand MI expressed as changes in the relative concentrations of oxy- and deoxyhemoglobin assessed by near-infrared spectroscopy. The NIRScout system (NIRxMe- dicalTechnologies), with 8 detectors and 16 sources, was used for fNIRS. The study protocol, the filtration method, and the classification of brain activity signals and the software used were described previously [9]. The patient received visual feedback on the 22'' computer monitor. The flow chart is presented in Fig. 1.

 

Fig. 1. The fNIRS BCI and post-priming training flow chart

Hb, deoxyhemoglobin; HbO, oxyhemoglobin.

 

The investigator customized movement types for MI during BCI training and selected the most difficult (for which, accordingly, the lowest score on this test was assigned) movement based on the patient's ARAT results. Before each training session, the investigator asked the patient to repeat the target movement several times until they confirmed their readiness to perform it mentally (priming). If the movement implied manipulating an item (ARAT), the item was provided to the patient during priming.

During the procedure, a BCI cap equipped with sources and detectors was put on the patient's head. During the session, the patients sat by the computer monitor at the desk with their hands comfortably positioned on either the armrests or the desk. There was a fixation point consisting of a circular shape in the center of the dark screen to stabilize the patient's gaze. Additionally, three arrows surrounded the fixation point, which provided commands with colors that changed dynamically. Following one of three commands, the patient either kynesthetically imagined slow motion of their left or right hand (with the corresponding arrow changing color) or relaxed and directed their gaze towards the center of the screen (with the upper arrow changing color). When MI task was successfully detected by the classifier, a gaze fixation point in the center of the screen was gradiently coloring green. Following the command to relax, the point color did not change in any classifier response.

Each nine-minute training session consisted of four units, with two commands randomly given to the left and right hand for 15 seconds, interspersed with rest intervals. Two-second preparatory instruction preceded the main commands.

Signal acquisition and processing

Sources and detectors were nested on the EEG cap. Signal recording frequency was 15.625 Hz. Recorded radiation intensities were calculated as oxyhemoglobin (HbO) and deoxyhemoglobin (Hb) using the modified Beer–Lambert law. To classify active states, the signal was filtered with a first order Chebyshev type I filter with 1 dB passband ripple and 0.005 Hz cutoff frequency. To classify rest vs active state, the signal was filtered with a second order Chebyshev type I filter with 1 dB passband ripple. The cutoff frequencies were selected for zero drift at the command frequency. For classification, we used linear discriminant analysis with additional learning based on the previous units of the current session and the participant's previous test sessions. In gradual classification, we first classified resting vs. active state and left hand vs. right hand in the following classification of active states. Per-second record intervals were classified.

Endpoints

First of all, this pilot study evaluated the quality of the detection of patient's mental states during training by the classifier. This indicator is measured as the percentage of correctly detected intervals. Over 33% of the total amount of the classified intervals is considered to be higher than random because the patients performed three mental tasks (100% / 3 ≈ 33%).

For the pre- and post-rehabilitation assessment of the hand function, we used the ARAT scale (with a maximum possible score of 57 points and a clinically significant increase in 6 points in the chronic stroke period and 12–17 points in the acute stroke period) [10, 11] and the Fugl-Meyer Assessment of the Upper Extre- mity (with a maximum possible score of 126 points and a clinically significant increase in 5 points) [10, 12]. The trained physician performed the blinded movement assessment.

Statistical data processing

The resulting percentage of the detection of brain signal activity is presented as the median and the 25th and 75th quartiles. The MatLab R2019b package (MathWorks, Natick, MA, USA) was used for analysis.

Because the study was a non-comparative exploratory case series, we did not use other statistical methods.

Results

Population

While eight patients were successfully screened, five were included in the study and three were not included. Table 1 shows the profiles of the participants. All five participants completed the study with no withdrawals.

 

Table 1. Patient demographics and baseline characteristics

Patient

Sex

Age, years

Stroke type

Stroke lesion side

Stroke time, months ago

APAT score

FMA score (upper extremity)

P1

Male

71

Primary

Left

12

44

107

P2

Male

58

Primary

Left

12

39

104

P3

Male

58

Secondary

Right

8 and 2

35

114

P4

Male

49

Primary

Right

< 1

35

116

P5

Female

43

Primary

Left

1

52

122

 

In order to train MI, we selected the following movements: 'to pinch and hold a 6-mm ball with their digit 1 and digit 4 for P1, P3, and P4; 'to pinch and hold a 6-mm ball with their digit 1 and digit 2 for P2; 'to pinch and hold a 1.5-mm ball with their digit 1 and 4 for P5.

Motor control and improvement

All patients were able to control MI fNIRS-BCI with better than random classification accuracy rate (>33%; Table 2).

 

Table 2. Resulting BCI control and motor score improvement

Patient

Classifier accuracy, %

ARAT score improvement

FMA score improvement

P1

68 [57; 73]

6*

1

P2

41 [37; 47]

4

3

P3

45 [41; 47]

6*

0

P4

45 [34; 50]

20*

9*

P5

49 [46; 59]

5

3

Note. *Clinically significant improvement as adjusted by the stroke time [10].

 

Following comprehensive inpatient rehabilitation and additional MI fNIRS-BCI training, all patients showed improved motor scores (Fig. 2). While three patients demonstrated the clinically significant improvement in ARAT score, one of them also achieved significant improvement in FMA score (Fig. 2).

 

Fig. 2. Changes in motor scores during rehabilitation and additional fNIRS BCI training.

 

The MI fNIRS BCI training was not associated with any adverse events. However, all participants reported experiencing drowsiness during training, which impaired concentration and task performance by the end of the session.

Discussion

In this study, we demonstrated the potential fNIRS BCI use for customized hand MI training in comprehensive post-stroke rehabilitation. All study participants achieved BCI control rates higher than random.

In the study, the total MI training exposure was 1.5 h (10 nine-minute sessions), which is significantly lower than the total training exposure of 5–27 h, with the session duration of 0.5–1.5 h, in other non-invasive BCI studies [13]. Nevertheless, patients developed drowsiness even during the shorter sessions. Thus, we find it reasonable to change the feedback scenario for play or various visualizations and to break the session units with pauses. Notably, MI drowsiness was mentioned in other studies [13].

Following the fNIRS BCI, all study participants showed improvement in motor function on at least one scale, including clinically significant improvement in three patients. However, the study design did not include a control group and the range of inclusion criteria was quite broad, which limits this exploratory study. Therefore, it is impossible to prove that the resulting improvement was caused by fNIRS BCI training. Nevertheless, the effectiveness of MI fNIRS BCI training has been demonstrated in a number of meta-analyses and systematic reviews based on multiple RCTs [1–4, 13]. Nowadays, professionals are searching for the most convenient and practical BCI systems and feedback scenarios [14].

Although the fNIRS BCI is a more convenient method than EEG BCI, it is the EEG BCI that has been evaluated in the vast majority of studies the present systematic reviews are based on. М. Mihara et al. showed fNIRS BCI effectiveness for rehabilitation of patients with subcortical stroke in the only randomized trial involving 20 patients: six 20-minute training sessions contributed to a better improvement of motor function measured as FMA score in the active group than in the sham fNIRS BCI group [8]. Interestingly, unlike the system we used in our study, the fNIRS BCI technology used by M. Mihara et al. did not involve any online signal classification. Therefore, additional, unobvious actions are needed to translate the recorded signals into commands to start exoskeleton operation or electrostimulation, if these methods are used for additional sensorimotor feedback.

The hallmark of our study is customisation of the movement type for further in-training MI based on the ARAT. This approach corresponds to the modern concept of customized rehabilitation and allows the use of goal attainment scaling [10].

A recent meta-analysis showed a better effect of BCI systems with functional electrostimulation in rehabilitation setting, as compared to those with the exoskeleton for kinesthetic feedback or with visual feedback only [13]. Therefore, we recommend to supplement the fNIRS BCI hardware with functional electromyosti- mulation controlled by brain activity signals in the MI during further rework.

Conclusion

In this pilot study, we demonstrated the potential fNIRS BCI use for customized hand MI training in comprehensive post-stroke rehabilitation and identified the ways to improve this technology and the training protocol.

Ethics approval. The study was conducted non-invasively in accordance with the ethics of the Declaration of Helsinki. The study protocol was approved by the Local Ethics Committee of the Research Center of Neurology (Protocol No. 5-4/22, 1 June 2022). All the participants signed informed consent.

Source of funding. The study was conducted by R.Kh. Lyukmanov, E.S. Ikonnikova, A.N. Cherkasova, and N.A. Suponeva on state assignment by the Ministry of Science and Higher Education of the Russian Federation for the Research Center of Neurology for 2021–2023 (research project No. 210). The study was conducted by P.D. Bobrov, M.R. Isaev, and O.A. Mokienko on state assignment by the Ministry of Science and Higher Education of the Russian Federation for the Institute of Higher Nervous Activity and Neurophysiology of RAS for 2021–2023.

Conflict of interest. The authors declare no apparent or potential conflicts of interest related to the publication of this article.

×

About the authors

Roman Kh. Lyukmanov

Research Center of Neurology

Email: xarisovich@gmail.com
ORCID iD: 0000-0002-8671-5861

Cand. Sci. (Med.), Researcher, Head, Brain–Computer Interface Group, Institute of Neurorehabilitation

Russian Federation, Moscow

Mikhail R. Isaev

Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences

Email: shycmympuk@yandex.ru
ORCID iD: 0000-0002-3907-5056

Junior Researcher, Laboratory of Mathematical Neurobiology of Learning Department

Russian Federation, Moscow

Olesya A. Mokienko

Research Center of Neurology; Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences

Email: lesya.md@yandex.ru
ORCID iD: 0000-0002-7826-5135

Cand. Sci. (Med.), Researcher, Brain–Computer Interface Group, Institute of Neurorehabilitation, Research Center of Neurology; Senior Researcher, Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences

Russian Federation, Moscow; Moscow

Pavel D. Bobrov

Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences

Author for correspondence.
Email: bobrov_pd@mail.ru
ORCID iD: 0000-0003-2566-1043

Cand. Sci. (Biol.), Head, Laboratory of Mathematical Neurobiology of Learning Department

Russian Federation, Moscow

Ekaterina S. Ikonnikova

Research Center of Neurology

Email: xarisovich@gmail.com
ORCID iD: 0000-0001-6836-4386

Junior Researcher, Brain–Computer Interface Group, Institute of Neurorehabilitation

Russian Federation, Moscow

Anastasiia N. Cherkasova

Research Center of Neurology

Email: lesya.md@yandex.ru
ORCID iD: 0000-0002-7019-474X

Junior Researcher, Brain–Computer Interface Group, Institute of Neurorehabilitation

Russian Federation, Moscow

Natalia A. Suponeva

Research Center of Neurology

Email: xarisovich@gmail.com
ORCID iD: 0000-0003-3956-6362

D. Sci. (Med.), Corresponding Member of the Russian Academy of Sciences, Director, Institute of Neurorehabilitation

Russian Federation, Moscow

References

  1. Monge-Pereira E., Ibañez-Pereda J., Alguacil-Diego I.M. et al. Use of electroencephalography brain-computer interface systems as a rehabilitative approach for upper limb function after a stroke: a systematic review. PM. R. 2017;9(9):918–932. doi: 10.1016/j.pmrj.2017.04.016
  2. Baniqued P.D.E., Stanyer E.C., Awais M. et al. Brain-computer interface robotics for hand rehabilitation after stroke: a systematic review. J. Neuroeng Rehabil. 2021;18 (1):15. doi: 10.1186/s12984-021-00820-8
  3. Fu J., Chen S., Jia J. Sensorimotor rhythm-based brain-computer interfaces for motor tasks used in hand upper extremity rehabilitation after stroke: a systematic review. Brain Sci. 2022;13(1):56. doi: 10.3390/brainsci13010056
  4. Carvalho R., Dias N., Cerqueira J.J. Brain-machine interface of upper limb recovery in stroke patients rehabilitation: a systematic review. Physiother. Res. Int. 2019;24(2):e1764. doi: 10.1002/pri.1764
  5. Frolov A.A., Mokienko O., Lyukmanov R. et al. Post-stroke rehabilitation training with a motor-imagery-based Brain-Computer Interface (BCI)-controlled hand exoskeleton: a randomized controlled multicenter trial. Front. Neurosci. 2017;11:400. doi: 10.3389/fnins.2017.00400
  6. Люкманов Р.Х., Азиатская Г.А., Мокиенко О.А. и др. Интерфейс мозг–компьютер в постинсультной реабилитации: клинико-нейропсихологическое исследование. Журнал неврологии и психиатрии им. С.С. Корсакова. 2018;118(8):43–51. Lyukmanov R.Kh., Aziatskaya GA, Mokienko O.A. et al. Post-stroke rehabilitation training with a brain-computer interface: a clinical and neuropsychological study. Zhurnal Nevrologii i Psikhiatrii imeni S.S. Korsakova. 2018;118(8):43–51. (In Russ.). doi: 10.17116/jnevro201811808143
  7. Soekadar S.R., Kohl S.H., Mihara M., von Lühmann A. Optical brain imaging and its application to neurofeedback. Neuroimage Clin. 2021;30:102577. doi: 10.1016/j.nicl.2021.102577
  8. Mihara M., Hattori N., Hatakenaka M. et al. Near-infrared spectroscopy-mediated neurofeedback enhances efficacy of motor imagery-based training in poststroke victims: a pilot study. Stroke. 2013;44(4):1091–1098. doi: 10.1161/STROKEAHA.111.674507
  9. Исаев М.Р., Бобров П.Д. Влияние выбора стратегии формирования обучающего множества и способа фильтрации на эффективность ИМК, основанного на спектрометрии в ближнем инфракрасном диапазоне. Журнал высшей нервной деятельности им. И.П. Павлова. 2022;72(5):728–738. Isaev M.R., Bob-rov P.D. Effect of session to session learning and filtration method on the performance of BCI based on near infrared spectroscopy. Žurnal vysšej nervnoj deâtelʹnosti im. I.P. Pavlova. 2022;72(5):728–738. (In Russ.) doi: 10.31857/S0044467722050070
  10. Мокиенко О.А., Супонева Н.А. (ред.) Инсульт у взрослых: центральный парез верхней конечности. Клинические рекомендации. М.;2018:64. Mokienko O.A., Suponeva N.A. (eds.) Stroke in adults: central paresis of the upper limb. Clinical guidelines. Moscow; 2018:64. (In Russ.)
  11. Carroll D. A quantitative test of upper extremity function. J. Chronic Dis. 1965;18: 479–491. doi: 10.1016/0021-9681(65)90030-5
  12. Fugl-Meyer A.R., Jääskö L., Leyman I. et al. The post-stroke hemiplegic patient. 1. A method for evaluation of physical performance. Scand. J. Rehabil. Med. 1975;7(1):13–31.
  13. Xie Y.L., Yang Y.X., Jiang H. et al. Brain-machine interface-based training for improving upper extremity function after stroke: а meta-analysis of randomized controlled trials. Front. Neurosci. 2022;16:949575. doi: 10.3389/fnins.2022.949575
  14. Simon C., Bolton D.A.E., Kennedy N.C. et al. Challenges and opportunities for the future of brain–computer interface in neurorehabilitation. Front. Neurosci. 2021;15:699428. doi: 10.3389/fnins.2021.699428

Supplementary files

Supplementary Files
Action
1. JATS XML
2. Fig. 1. The fNIRS BCI and post-priming training flow chart

Download (136KB)
3. Fig. 2. Changes in motor scores during rehabilitation and additional fNIRS BCI training.

Download (117KB)

Copyright (c) 2023 Lyukmanov R.K., Isaev M.R., Mokienko O.A., Bobrov P.D., Ikonnikova E.S., Cherkasova A.N., Suponeva N.A.

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

СМИ зарегистрировано Федеральной службой по надзору в сфере связи, информационных технологий и массовых коммуникаций (Роскомнадзор).
Регистрационный номер и дата принятия решения о регистрации СМИ: серия ПИ № ФС 77-83204 от 12.05.2022.


This website uses cookies

You consent to our cookies if you continue to use our website.

About Cookies