This paper is in the following e-collection/theme issue:

Games for Rehabilitation (94) Games and Gamification for Health (650) Extended Reality, Virtual Reality and Virtual Worlds (560) Innovations in Exercise Rehabilitation (213)

Published on in Vol 10, No 3 (2022): Jul-Sep

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/36288, first published .
The Design, Development, and Testing of a Virtual Reality Device for Upper Limb Training in People With Multiple Sclerosis: Single-Center Feasibility Study

The Design, Development, and Testing of a Virtual Reality Device for Upper Limb Training in People With Multiple Sclerosis: Single-Center Feasibility Study

The Design, Development, and Testing of a Virtual Reality Device for Upper Limb Training in People With Multiple Sclerosis: Single-Center Feasibility Study

Authors of this article:

Alon Kalron1, 2 Author Orcid Image ;   Lior Frid2 Author Orcid Image ;   Iliya Fonkatz2 Author Orcid Image ;   Shay Menascu2, 3 Author Orcid Image ;   Mark Dolev2 Author Orcid Image ;   David Magalashvili2 Author Orcid Image ;   Anat Achiron2, 3 Author Orcid Image
Article Authors Cited by (8) Tweetations (6) Metrics

    Original Paper

    1Department of Physical Therapy, School of Health Professions, Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv, Israel

    2Multiple Sclerosis Center, Sheba Medical Center, Tel Hashomer, Israel

    3Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv, Israel

    Corresponding Author:

    Alon Kalron, PT, PhD

    Department of Physical Therapy

    School of Health Professions, Sackler Faculty of Medicine

    Tel-Aviv University

    Ramat-Aviv

    Tel-Aviv, 39040

    Israel

    Phone: 972 036405430

    Email: alonkalr@post.tau.ac.il


    Background: Multiple sclerosis (MS) is a common nontraumatic, neurological, disabling disease that often presents with upper limb dysfunction. Exercise training has resulted in improvement for patients; however, there can be a lack of compliance due to access because of location and lack of MS experts. Virtual reality (VR) is a promising technology that can offer exercise therapy/rehabilitation at a distance. This type of remote training can be motivational and effective for patients with MS and can improve range of motion and muscle strength for those with upper limb dysfunction.

    Objective: The aim of this study is to evaluate the safety and feasibility of the XRHealth software and the Oculus Rift Station for patients with MS with upper limb motor dysfunction.

    Methods: A single-center, prospective, feasibility study was conducted with patients with MS who had upper limb motor dysfunction. Patients participated in a single 45-minute digital environment session with VR and completed a questionnaire about the quality of the training and fatigability. The clinician also completed a questionnaire to evaluate the suitability and safety of the training.

    Results: Overall, 30 patients were enrolled between the ages of 20 and 81 years. Patients reported that the training sessions within the digital environment were helpful, challenging, fun, and simple to understand, and that they would be willing to repeat the sessions again. The physical therapist that oversaw the patients reported that the training was suitable for 87% (n=26) of the patients. Anticipated adverse events were fatigue, temporary dizziness, and temporary nausea. The operator complications included that the cable of the head-mounted display interrupted the training (n=2, 7%) and fatigue that caused cessation of the VR training session (n=2, 7%). No serious adverse events were reported.

    Conclusions: These preliminary results demonstrated that the use of the XRHealth software and Oculus Rift Station platform is feasible, safe, and engaging for patients, and has the potential to improve the functionality of the upper limbs in patients with MS. This study provides support for future studies of implementing a series of training sessions with virtual reality in a home-based environment.

    JMIR Serious Games 2022;10(3):e36288

    doi:10.2196/36288

    Keywords

    virtual reality; rehabilitation; feasibility; upper limb; multiple sclerosis 


    Background

    Multiple sclerosis (MS) is a chronic progressing demyelinating disease of the central nervous system [1]. The age at which MS is generally diagnosed is between the ages of 20-40 years, with a higher prevalence in female patients than male patients [2]. MS is the most common nontraumatic neurological disabling disease affecting young adults with an incidence of approximately 1 in 1000 [2], which affects approximately 2.8 million people worldwide (35.9 per 100,000 population) [3].

    In patients with MS, upper limb dysfunction is common and occurs in approximately 50% to 76% of patients [4,5]. The presentation of upper limb dysfunction can be variable in patients with a range of physical symptoms presenting as tremor, lack of movement coordination, or muscle weakness [1,6,7]. These symptoms can lead to a decreased quality of life (QoL) due to poor health status, psychological difficulties, depressed mood and cognitive difficulties [8], increased mortality, restriction of activities [9,10], and dependency on others [11]. Some of the most frequent challenges that patients with MS face is dexterity, activities of daily living, and limitations in the upper limbs [12]. Treatment approaches for MS typically involve pharmacological intervention and rehabilitation treatments [13-15].

    Symptoms of MS can range from visual impairment; dysarthria and dysphagia; impairment of coordination and balance; ataxia; sensory impairment; and bladder, bowel and sexual dysfunction [1,16-19]. Exercise training for MS and those with upper limb dysfunction has demonstrated significant benefit [20-24] and has been able to mitigate symptoms and decrease dependency on others [15,22,23].

    The major reasons for lack of compliance in patients with MS are the inability to access exercise programs because patients live in a rural area or location that lack MS experts that support traditional upper limb exercise programs. Patient transportation and access can be limited due to time commitments, vehicle access, and simply not having the health and physical ability to travel to a hospital for physical rehabilitation. Another major obstacle is the cost of care that is prohibitive for patients. The COVID-19 pandemic has highlighted the need to provide therapy/rehabilitation from a distance, mainly due to travel restrictions, access, and risk of infection [25]. Since rehabilitation can be especially difficult for the patient due to time and physical demands, loss of motivation and compliance often occur; therefore, it is critical to develop innovative new methods to keep patients motivated and improve QoL.

    A method to circumvent these challenges and support exercise training in the home of patients and increase physical activity and functionality, thereby improving QoL, is telerehabilitation [26]. Therapy is delivered remotely with telerehabilitation outside traditional hospital settings, providing access to patients who have problems with mobility and travel restrictions. A promising new component is virtual reality (VR) for patients. VR provides a 3D-simulated environment with a computer interacting with a number of electronic accessories that can motivate patients to do repetitive tasks with sensory and visual feedback [27]. The level of immersion with VR may vary, ranging from nonimmersive (eg, video games) to fully immersive, where the user must have proper VR glasses or a head-mounted display such as the HTC Vive or Oculus Rift. There are different ideas on the classification of VR to date, and a classification remains to be standardized between studies [28]. Immersive VR has been applied to psychological therapy for many disorders including posttraumatic stress disorder, borderline personality disorder, schizophrenia, and other psychological disorders [29]. Patients can practice functional tasks such as shopping or crossing the street in a virtual environment [27]. The benefits of VR have been established in multiple applications including pain management and reduction [30-34], mental health support [33-36], and rehabilitation [32]. In MS, the application of VR has improved balance, posture, motor control, coordination, and gait [37-40] as well as improved motor function in the upper limbs [41]. A recent study demonstrated an improvement in manual dexterity for patients with MS using game-based VR video capture training [42]. The controlled environment of immersive VR can lead to improved patient outcomes compared with conventional therapy in different types of motor impairments including hemiparesis caused by Parkinson disease, MS, cerebral palsy, and stroke [28,29,41,43]. Despite the promising results, VR is not widely implemented, resulting in an unmet medical need for a growing patient population.

    Currently, XRHealth software is cleared for marketing in the United States by the Food and Drug Administration, Europe (EC certification), and Israel (AMAR). The software along with the Oculus Rift Station guides patients through exercises according to an individualized treatment plan from their medical practitioner. The Oculus Rift station has touch controllers and provides df for the movement inside a virtual environment, which includes high-end tracking of both the head and arm movements with 0.01 degrees in 90 Hz accuracy. Through the combination of the XRHealth software, the Oculus Rift Station, and a clinical therapist, the motion and movement kinetics of a patient can be tracked and provided to a clinician.

    Objectives

    The objective of this pilot study is to evaluate the combination of the XRHealth software with the Oculus Rift Station for safety and feasibility in patients with MS with upper limb motor dysfunction. The quality of the resulting data from this platform was assessed for optimization and serves as preliminary data for the development and design of future studies for VR training in people with MS.


    Ethics Approval

    This is a single-center safety and feasibility study based on a single 45-minute training session. All patients provided informed consent, and institutional review board approval was obtained at the Sheba Medical Center (SMC-5207-18). This study was conducted in the Sheba Multiple Sclerosis Center, Tel-Hashomer, Israel, between 2019 and 2020.

    Patients

    Patients were enrolled if they were 18 years or older, had moderate weakness in upper extremity muscles as defined by the British Medical Research Council including those with grade 4 in 2 muscle groups, or British Medical Research Council grade 3 in 1 muscle group. Patients were excluded if they had a hearing impairment, any orthopedic impairment restricting upper limb movements, or any cardiovascular disease preventing aerobic exercise.

    VR Training Platform and Device

    The intervention involved 2 activities performed once within the VR environment that would require both arm and shoulder movements either while seated (Figure S1A in Multimedia Appendix 1) or standing (Figure S1B in Multimedia Appendix 1) on the setup shown in Figure S1C in Multimedia Appendix 1. This was performed with the Oculus Rift and XRHealth software. The Oculus Rift headset is similar to goggles and, when worn, allows the patient to look in any direction naturally as if in the real world. In the Oculus Rift headset, there is a tracker that constantly analyzes head movement, allowing a clinician to make adjustments for the patient in real time [44]. The XRHealth software platform has three main components: a central console, a data portal, and a control panel. In the central console, a range of different motor, cognitive, and mental experiences in the form of games and exercises can be selected and serves as a “home environment” for all XRHealth applications. The data portal is a Health Insurance Portability and Accountability Act–compliant web-based platform that clinicians can use to track and analyze data from patients, and offers longitudinal data about patient performance and progress. The VR experience can be viewed and adjusted remotely and in real time by the clinician, and is supported by the control panel.

    All assessments were overseen by a physical therapist with 2 years of experience in neurohabilitation. The first activity was an active shoulder range of motion (ROM) application called “Balloon Blast.” In this VR environment, the patient uses both hands and is prompted to pop balloons with a swipe of a sword (Figure S2A in Multimedia Appendix 1). The area of shoulder activity is determined with an active ROM measurement (Figure S2B and C in Multimedia Appendix 1). After a 5-minute rest period, the patient performed the second activity, which is a motor cognitive training environment called “Color Match.” Patients wear different colored virtual gloves on both hands and are then prompted to hit light bulbs with the hand that matches the bulb color (Figure S2D in Multimedia Appendix 1). The initial settings of the “Color Match” VR environment were set to a medium level for all patients and adjusted according to the patient’s capabilities. Medium level was defined as 3.6 seconds between the moment the light turns on and then turns off for the patient to act.

    Outcome Measures for Safety and Feasibility

    Each patient answered 4 questionnaires for the assessment (Supplemental 1 in Multimedia Appendix 1), and the physical therapist who oversaw the session also completed a questionnaire (Supplemental 2 in Multimedia Appendix 1). The lowest score was 1 and the highest was 4. Patient answers were averaged together for a final result. Patient questionnaires aimed to evaluate patient experience in relation to the VR platform for optimization and to inform the design of future studies. Questions included patient assessment on the level of difficulty, physical effects such as fatigue, engagement, and suitability of the VR training session.


    Patient Characteristics

    A total of 30 patients with MS with upper limb motor dysfunction were enrolled and completed the training. Of those, 50% (n=15) were female patients, the mean age was 50.8 (range 20.3-81.2) years, and the mean Expanded Disability Status Scale score was 5.4 (Table 1).

    Table 1. Patient demographic and clinical characteristics.
    CharacteristicPatients (N=30), n (%)Value


    		Mean (SD)Range
    Age (years)N/Aa50.74 (13.6)20.3-81.2
    Female, n (%)15 (50)N/AN/A
    Multiple sclerosis type, n (%)N/AN/A

    		Primary progressive multiple sclerosis3 (10)


    		Clinically isolated syndrome3 (10)


    		Relapsing and remitting multiple sclerosis14 (47)


    		Secondary progressive multiple sclerosis10 (33)

    Disease duration (years)N/A18.6 (12.8)0.6-58
    Expanded Disability Status ScaleN/A5.4 (1.7)1.5-8.0

    aN/A: not applicable.

    Patient Satisfaction

    Patients reported in the questionnaires that the “Balloon Blast” activity was fun (mean 3.73, SD 0.52), simple to understand (mean 3.67, SD 0.71), simple to perform (mean 3.43, SD 0.86), challenging (mean 3.10, SD 1.03), and a task that they would repeat (mean 3.63, SD 0.72; Figure 1A). In the “Color Match” activity, patients reported that the activity was fun (mean 3.47, SD 0.78), simple to understand (mean 3.60, SD 0.72), simple to perform (mean 3.53, SD 0.73), challenging (mean 3.17, SD 1.02), and a task that they would repeat (mean 3.40, SD 0.97; Figure 1A).

    ‎
    Figure 1. Questionnaire results: (A) self-reported satisfaction questionnaire average, (B) the overall VR experience reported by patients, and (C) statements about the session and levels of patient agreeance. VR: virtual reality.
    View this figure

    For overall VR experience satisfaction, patients reported that during the VR training session they felt physical exertion (mean 2.3, SD 1.09) and cognitive exertion (mean 2.5, SD 1.04), and that the training was focused (mean 3.2, SD 0.89; Figure 1B). Using the same scoring system, patients reported high levels of agreement with the following statements: practicing in a form of a digital environment activity is appropriate for me (mean 3.63, SD 0.61); practicing in VR allowed me to focus on the training without distractions (mean 3.70, SD 0.53); I was interested in the information that was presented to me after the VR training session (mean 2.8, SD 1.06); the information that was presented to me after the VR training session gave me added value on my condition (mean 2.6, SD 1.07); using this tool at home will help me adhere to practicing over time (mean 3.33, SD 0.88); and if I had a tracking tool on my cognitive condition based on VR, I would like to use it at home (mean 3.57, SD 0.68; Figure 1C). After completing the VR training sessions with the patients, the physical therapist reported that this was a suitable solution for people with MS (n=26, 87%).

    Safety

    Reported intraoperative complications included that the cable of the head-mounted display interrupted the training (n=2, 7%) and fatigue that caused cessation of the VR training session (n=2, 7%). There were no other intraoperative complications reported. Anticipated adverse events (AEs) according to a 4-point Likert scale were fatigue (mean 1.9, SD 0.96), temporary dizziness (mean 1.57, SD 0.77), and temporary nausea (mean 1.17, SD 0.46). Of the patients that reported fatigue, 6 patients experienced light fatigue, 9 patients reported moderate fatigue, and 1 patient reported severe fatigue resulting in a score of 1. Of those that reported dizziness, 7 patients reported light dizziness and 4 patients reported moderate dizziness. In patients that reported nausea, 3 reported light nausea and 1 reported moderate nausea. No other unanticipated AEs were reported. There were no serious AEs. All the AEs reported were resolved within a short period of time.


    Principal Results

    Overall, patients found the VR environment training session helpful and would be willing to do more. The physical therapist determined that the session was suitable for people with MS. Physical exercise therapy for patients with MS is critical in maintaining movement, mental health, and the ability to be self-sufficient [21]. This study supports moving the platform into a home-based environment, which reduces the financial and travel burden on patients while also improving health and QoL [45-48]. Furthermore, the VR digital environment is a simple patient interface in which patients reported the programs to be engaging, challenging, simple, and fun. Patients had minimal risk, and the activities were safe and tolerable. There were no serious AEs, and those that were reported were temporary.

    The XRHealth platform is performed under medical supervision during training and allows the physical therapist to modify several parameters during a session that meets the specific needs of the patient. The types of assessments that can be performed include ROM, action time, response time, and omission and commission mistakes collected during a single 45-minute training session, which is then output as a graph by the XR software (Figure S2E in Multimedia Appendix 1). The ability to involve a clinician and obtain a number of data points to determine outcomes while patients are receiving care in a digital environment are substantial benefits.

    Limitations

    This study is not without limitations. First, the study did not include standard measures of upper limb function or manual dexterity. In addition, future adaptations could use the standardized System Usability Scale rather than the customized questionnaire used in this study based on similar publications in the field. Furthermore, this was a small study with a single VR training session. Future larger studies are needed to investigate whether scores derived from the VR system correlate with clinical upper limb measures in people with MS and other populations with central neurological damage such as stroke or Parkinson disease. A larger and longer study with more sessions would provide the efficacy data needed to support the use of a VR environment for physical therapy in people with MS.

    Comparison With Prior Work

    The use of VR technology has revealed improvements in the clinic for patients with upper limb dysfunction and stroke [49,50], and has also demonstrated benefit and favorable results in improving gait impairments and balance in people with MS [51]. Early research in 2006 examining the efficacy of VR showed improvements in gait control for patients with MS [52]. A small study of 5 patients with MS showed that VR plus passive robotic support yielded improved upper limb function and was well tolerated [53]. In 2015, another study of 30 people with MS demonstrated that VR had significant improvement in overall stability after 24 sessions [38]. There are few prior studies, and it is unclear if the use of VR training in people with MS can improve the QoL status, although these studies show a positive trend in assisting people with MS. Currently, the use of VR is limited in the clinic for patients with MS despite preliminary successes. The XRHealth platform therefore has the ability to bring this technology to a broader patient population.

    At this time, there are small ongoing randomized controlled trials (RCTs) integrating VR into MS therapy for upper limb dysfunction. These include the Telerehabilitation and Multiple Sclerosis (TEAMS) pilot RCT (ClinicalTrials.gov NCT04032431) comparing conventional therapy to a home-based telerehabilitation VR program [54], a single-blinded RCT using serious games for upper limb rehabilitation (ClinicalTrials.gov NCT04171908) [42], and a randomized interventional study adding game-based VR exercises to conventional physiotherapy (ClinicalTrials.gov NCT04212689) [55]. This pilot study contributes to these studies in support of integrating VR for rehabilitation of people with MS with upper limb dysfunction.

    Conclusions

    In conclusion, the XRHealth medical solution of a VR digital environment and Oculus Rift platform is a feasible and safe training system for upper limb training in people with MS. These findings pave the way for future RCTs to examine the benefits of the XRHealth VR training compared with standard care to improve functionality of the upper limbs in people with MS. Additionally, it would be noteworthy to compare VR training at a clinical facility compared to VR training telehealth, both monitored by a physical therapist. Finally, future research should examine the psychometric values of the outcome measures produced by the XRHealth platform in patients with upper limb dysfunctions.

    Acknowledgments

    JetPub Scientific Communications, LLC was supported by funding from XRHealth, and provided drafts and editorial assistance to the authors during preparation of this manuscript.

    Authors' Contributions

    AK and AA conceptualized the study. AK validated the study. AK and AA created the visualizations for the study. AK reviewed and edited the manuscript. LF was the project administrator. LF and IF preformed the investigation. SM, MD, and DM provided the resources for the study. AA supervised the study.

    Conflicts of Interest

    AA is a clinical advisor for XRHealth. All other authors have nothing to declare.

    ‎
    Multimedia Appendix 1

    Supplementary material.

    DOCX File , 2491 KB
    1. Compston A, Coles A. Multiple sclerosis. Lancet 2008 Oct 25;372(9648):1502-1517. [CrossRef] [Medline]
    2. Koch-Henriksen N, Sørensen PS. The changing demographic pattern of multiple sclerosis epidemiology. Lancet Neurol 2010 May;9(5):520-532. [CrossRef] [Medline]
    3. Walton C, King R, Rechtman L, Kaye W, Leray E, Marrie RA, et al. Rising prevalence of multiple sclerosis worldwide: insights from the Atlas of MS, third edition. Mult Scler 2020 Dec;26(14):1816-1821 [FREE Full text] [CrossRef] [Medline]
    4. Holper L, Coenen M, Weise A, Stucki G, Cieza A, Kesselring J. Characterization of functioning in multiple sclerosis using the ICF. J Neurol 2010 Jan;257(1):103-113. [CrossRef] [Medline]
    5. Lamers I, Maris A, Severijns D, Dielkens W, Geurts S, Van Wijmeersch B, et al. Upper limb rehabilitation in people with multiple sclerosis: a systematic review. Neurorehabil Neural Repair 2016 Sep;30(8):773-793. [CrossRef] [Medline]
    6. Kister I, Bacon TE, Chamot E, Salter AR, Cutter GR, Kalina JT, et al. Natural history of multiple sclerosis symptoms. Int J MS Care 2013;15(3):146-158 [FREE Full text] [CrossRef] [Medline]
    7. Lublin FD, Reingold SC, Cohen JA, Cutter GR, Sørensen PS, Thompson AJ, et al. Defining the clinical course of multiple sclerosis: the 2013 revisions. Neurology 2014 Jul 15;83(3):278-286 [FREE Full text] [CrossRef] [Medline]
    8. Johansson S, Ytterberg C, Claesson I, Lindberg J, Hillert J, Andersson M, et al. High concurrent presence of disability in multiple sclerosis. Associations with perceived health. J Neurol 2007 Jun;254(6):767-773. [CrossRef] [Medline]
    9. Bertoni R, Lamers I, Chen C, Feys P, Cattaneo D. Unilateral and bilateral upper limb dysfunction at body functions, activity and participation levels in people with multiple sclerosis. Mult Scler 2015 Oct;21(12):1566-1574. [CrossRef] [Medline]
    10. Kierkegaard M, Einarsson U, Gottberg K, von Koch L, Holmqvist L. The relationship between walking, manual dexterity, cognition and activity/participation in persons with multiple sclerosis. Mult Scler 2012 May;18(5):639-646. [CrossRef] [Medline]
    11. Yozbatiran N, Baskurt F, Baskurt Z, Ozakbas S, Idiman E. Motor assessment of upper extremity function and its relation with fatigue, cognitive function and quality of life in multiple sclerosis patients. J Neurol Sci 2006 Jul 15;246(1-2):117-122. [CrossRef] [Medline]
    12. Kamm C, Heldner M, Vanbellingen T, Mattle H, Müri R, Bohlhalter S. Limb apraxia in multiple sclerosis: prevalence and impact on manual dexterity and activities of daily living. Arch Phys Med Rehabil 2012 Jun;93(6):1081-1085. [CrossRef] [Medline]
    13. Goldschmidt C, McGinley MP. Advances in the treatment of multiple sclerosis. Neurol Clin 2021 Feb;39(1):21-33 [FREE Full text] [CrossRef] [Medline]
    14. Sutliff MH, Bennett SE, Bobryk P, Halper J, Saslow LA, Skutnik LT, et al. Rehabilitation in multiple sclerosis: commentary on the recent AAN systematic review. Neurol Clin Pract 2016 Dec;6(6):475-479 [FREE Full text] [CrossRef] [Medline]
    15. Döring A, Pfueller CF, Paul F, Dörr J. Exercise in multiple sclerosis -- an integral component of disease management. EPMA J 2011 Dec 24;3(1):2 [FREE Full text] [CrossRef] [Medline]
    16. DasGupta R, Fowler C. Bladder, bowel and sexual dysfunction in multiple sclerosis: management strategies. Drugs 2003;63(2):153-166. [CrossRef] [Medline]
    17. Henze T, Rieckmann P, Toyka KV, Multiple Sclerosis Therapy Consensus Group of the German Multiple Sclerosis Society. Symptomatic treatment of multiple sclerosis. Multiple Sclerosis Therapy Consensus Group (MSTCG) of the German Multiple Sclerosis Society. Eur Neurol 2006;56(2):78-105 [FREE Full text] [CrossRef] [Medline]
    18. Cattaneo D, Jonsdottir J, Zocchi M, Regola A. Effects of balance exercises on people with multiple sclerosis: a pilot study. Clin Rehabil 2007 Sep;21(9):771-781. [CrossRef] [Medline]
    19. Darley F, Brown J, Goldstein N. Dysarthria in multiple sclerosis. J Speech Hear Res 1972 Jun;15(2):229-245. [CrossRef] [Medline]
    20. Pellegrino L, Coscia M, Muller M, Solaro C, Casadio M. Evaluating upper limb impairments in multiple sclerosis by exposure to different mechanical environments. Sci Rep 2018 Feb 01;8(1):2110. [CrossRef] [Medline]
    21. Halabchi F, Alizadeh Z, Sahraian MA, Abolhasani M. Exercise prescription for patients with multiple sclerosis; potential benefits and practical recommendations. BMC Neurol 2017 Sep 16;17(1):185 [FREE Full text] [CrossRef] [Medline]
    22. Motl R, Sandroff B. Benefits of exercise training in multiple sclerosis. Curr Neurol Neurosci Rep 2015 Sep;15(9):62. [CrossRef] [Medline]
    23. Swank C, Thompson M, Medley A. Aerobic exercise in people with multiple sclerosis: its feasibility and secondary benefits. Int J MS Care 2013;15(3):138-145 [FREE Full text] [CrossRef] [Medline]
    24. Pilutti LA, Platta ME, Motl RW, Latimer-Cheung AE. The safety of exercise training in multiple sclerosis: a systematic review. J Neurol Sci 2014 Aug 15;343(1-2):3-7. [CrossRef] [Medline]
    25. Zasadzka E, Trzmiel T, Pieczyńska A, Hojan K. Modern technologies in the rehabilitation of patients with multiple sclerosis and their potential application in times of COVID-19. Medicina (Kaunas) 2021 May 30;57(6):549 [FREE Full text] [CrossRef] [Medline]
    26. Amatya B, Galea M, Kesselring J, Khan F. Effectiveness of telerehabilitation interventions in persons with multiple sclerosis: a systematic review. Mult Scler Relat Disord 2015 Jul;4(4):358-369. [CrossRef] [Medline]
    27. Perez-Marcos D, Solazzi M, Steptoe W, Oyekoya O, Frisoli A, Weyrich T, et al. A fully immersive set-up for remote interaction and neurorehabilitation based on virtual body ownership. Front Neurol 2012;3:110. [CrossRef] [Medline]
    28. Huygelier H, Mattheus E, Abeele VV, van Ee R, Gillebert C. The use of the term virtual reality in post-stroke rehabilitation: a scoping review and commentary. Psychol Belg 2021 Jun 03;61(1):145-162 [FREE Full text] [CrossRef] [Medline]
    29. Elor A, Kurniawan S. The ultimate display for physical rehabilitation: a bridging review on immersive virtual reality. Frontiers Virtual Reality 2020 Nov 12;1:A. [CrossRef]
    30. Keefe FJ, Huling DA, Coggins MJ, Keefe DF, Rosenthal ZM, Herr NR, et al. Virtual reality for persistent pain: a new direction for behavioral pain management. Pain 2012 Nov;153(11):2163-2166 [FREE Full text] [CrossRef] [Medline]
    31. Hua Y, Qiu R, Yao W, Zhang Q, Chen X. The effect of virtual reality distraction on pain relief during dressing changes in children with chronic wounds on lower limbs. Pain Manag Nurs 2015 Oct;16(5):685-691. [CrossRef] [Medline]
    32. Reid D. Virtual reality and the person-environment experience. Cyberpsychol Behav 2002 Dec;5(6):559-564. [CrossRef] [Medline]
    33. Park M, Kim D, Lee U, Na E, Jeon H. A literature overview of virtual reality (VR) in treatment of psychiatric disorders: recent advances and limitations. Front Psychiatry 2019;10:505. [CrossRef] [Medline]
    34. Diemer J, Alpers G, Peperkorn H, Shiban Y, Mühlberger A. The impact of perception and presence on emotional reactions: a review of research in virtual reality. Front Psychol 2015;6:26. [CrossRef] [Medline]
    35. Srivastava K, Das RC, Chaudhury S. Virtual reality applications in mental health: challenges and perspectives. Ind Psychiatry J 2014;23(2):83-85 [FREE Full text] [CrossRef] [Medline]
    36. Rothbaum BO, Hodges L, Alarcon R, Ready D, Shahar F, Graap K, et al. Virtual reality exposure therapy for PTSD Vietnam Veterans: a case study. J Trauma Stress 1999 Apr;12(2):263-271. [CrossRef] [Medline]
    37. Gutiérrez RO, Galán Del Río F, Cano de la Cuerda R, Alguacil Diego IM, González RA, Page JCM. A telerehabilitation program by virtual reality-video games improves balance and postural control in multiple sclerosis patients. NeuroRehabilitation 2013;33(4):545-554. [CrossRef] [Medline]
    38. Eftekharsadat B, Babaei-Ghazani A, Mohammadzadeh M, Talebi M, Eslamian F, Azari E. Effect of virtual reality-based balance training in multiple sclerosis. Neurol Res 2015 Jun;37(6):539-544. [CrossRef] [Medline]
    39. Calabrò RS, Russo M, Naro A, De Luca R, Leo A, Tomasello P, et al. Robotic gait training in multiple sclerosis rehabilitation: can virtual reality make the difference? Findings from a randomized controlled trial. J Neurol Sci 2017 Jun 15;377:25-30. [CrossRef] [Medline]
    40. Kalron A, Fonkatz I, Frid L, Baransi H, Achiron A. The effect of balance training on postural control in people with multiple sclerosis using the CAREN virtual reality system: a pilot randomized controlled trial. J Neuroeng Rehabil 2016 Mar 01;13:13. [CrossRef] [Medline]
    41. Webster A, Poyade M, Rooney S, Paul L. Upper limb rehabilitation interventions using virtual reality for people with multiple sclerosis: a systematic review. Mult Scler Relat Disord 2021 Jan;47:102610. [CrossRef] [Medline]
    42. Waliño-Paniagua CN, Gómez-Calero C, Jiménez-Trujillo MI, Aguirre-Tejedor L, Bermejo-Franco A, Ortiz-Gutiérrez RM, et al. Effects of a game-based virtual reality video capture training program plus occupational therapy on manual dexterity in patients with multiple sclerosis: a randomized controlled trial. J Healthc Eng 2019;2019:9780587. [CrossRef] [Medline]
    43. Iruthayarajah J, McIntyre A, Cotoi A, Macaluso S, Teasell R. The use of virtual reality for balance among individuals with chronic stroke: a systematic review and meta-analysis. Top Stroke Rehabil 2017 Jan;24(1):68-79. [CrossRef] [Medline]
    44. Rajesh Desai P, Nikhil Desai P, Deepak Ajmera K, Mehta K. A review paper on Oculus Rift-a virtual reality headset. Int J Eng Trends Technol 2014 Jul 25;13(4):175-179. [CrossRef]
    45. McCue M, Fairman A, Pramuka M. Enhancing quality of life through telerehabilitation. Phys Med Rehabil Clin N Am 2010 Feb;21(1):195-205. [CrossRef] [Medline]
    46. Agostini M, Moja L, Banzi R, Pistotti V, Tonin P, Venneri A, et al. Telerehabilitation and recovery of motor function: a systematic review and meta-analysis. J Telemed Telecare 2015 Jun;21(4):202-213. [CrossRef] [Medline]
    47. Gregory P, Alexander J, Satinsky J. Clinical telerehabilitation: applications for physiatrists. PM R 2011 Jul;3(7):647-56; quiz 656. [CrossRef] [Medline]
    48. Hailey D, Roine R, Ohinmaa A, Dennett L. Evidence of benefit from telerehabilitation in routine care: a systematic review. J Telemed Telecare 2011;17(6):281-287. [CrossRef] [Medline]
    49. Feys P, Coninx K, Kerkhofs L, De Weyer T, Truyens V, Maris A, et al. Robot-supported upper limb training in a virtual learning environment : a pilot randomized controlled trial in persons with MS. J Neuroeng Rehabil 2015 Jul 23;12:60 [FREE Full text] [CrossRef] [Medline]
    50. Maris A, Coninx K, Seelen H, Truyens V, De Weyer T, Geers R, et al. The impact of robot-mediated adaptive I-TRAVLE training on impaired upper limb function in chronic stroke and multiple sclerosis. Disabil Rehabil Assist Technol 2018 Jan;13(1):1-9. [CrossRef] [Medline]
    51. Casuso-Holgado M, Martín-Valero R, Carazo A, Medrano-Sánchez EM, Cortés-Vega MD, Montero-Bancalero F. Effectiveness of virtual reality training for balance and gait rehabilitation in people with multiple sclerosis: a systematic review and meta-analysis. Clin Rehabil 2018 Sep;32(9):1220-1234. [CrossRef] [Medline]
    52. Baram Y, Miller A. Virtual reality cues for improvement of gait in patients with multiple sclerosis. Neurology 2006 Jan 24;66(2):178-181. [CrossRef] [Medline]
    53. Sampson P, Freeman C, Coote S, Demain S, Feys P, Meadmore K, et al. Using functional electrical stimulation mediated by iterative learning control and robotics to improve arm movement for people with multiple sclerosis. IEEE Trans Neural Syst Rehabil Eng 2016 Feb;24(2):235-248. [CrossRef] [Medline]
    54. Kalron A, Achiron A, Pau M, Cocco E. The effect of a telerehabilitation virtual reality intervention on functional upper limb activities in people with multiple sclerosis: a study protocol for the TEAMS pilot randomized controlled trial. Trials 2020 Aug 12;21(1):713 [FREE Full text] [CrossRef] [Medline]
    55. Virtual reality approach in multiple sclerosis. ClinicalTrials.gov.   URL: https://www.clinicaltrials.gov/ct2/show/NCT04212689 [accessed 2019-12-27]

    ‎
    AE: adverse event
    MS: multiple sclerosis
    QoL: quality of life
    RCT: randomized controlled trial
    ROM: range of motion
    TEAMS: Telerehabilitation and Multiple Sclerosis
    VR: virtual reality

    Edited by N Zary; submitted 15.01.22; peer-reviewed by M Pau, C Li; comments to author 27.05.22; revised version received 21.06.22; accepted 11.08.22; published 12.09.22

    Copyright

    ©Alon Kalron, Lior Frid, Iliya Fonkatz, Shay Menascu, Mark Dolev, David Magalashvili, Anat Achiron. Originally published in JMIR Serious Games (https://games.jmir.org), 12.09.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.