This paper is in the following e-collection/theme issue:

Games for Rehabilitation (87) Viewpoints and Personal Experiences on Gaming and Games (11) Serious Games for Health and Medicine (641) Games and Gamification for Health (604) Game Design and Efficacy of Game Elements (81) mHealth for Rehabilitation (233)

Published on in Vol 9, No 4 (2021): Oct-Dec

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/28079, first published .
Serious Games Are Not Serious Enough for Myoelectric Prosthetics

Serious Games Are Not Serious Enough for Myoelectric Prosthetics

Serious Games Are Not Serious Enough for Myoelectric Prosthetics

Authors of this article:

Christian Alexander Garske1 Author Orcid Image ;   Matthew Dyson1 Author Orcid Image ;   Sigrid Dupan2 Author Orcid Image ;   Graham Morgan3 Author Orcid Image ;   Kianoush Nazarpour2 Author Orcid Image
Article Authors Cited by (12) Tweetations (7) Metrics

    Viewpoint

    1Intelligent Sensing Laboratory, School of Engineering, Newcastle University, Newcastle upon Tyne, United Kingdom

    2Edinburgh Neuroprosthetics Laboratory, School of Informatics, University of Edinburgh, Edinburgh, United Kingdom

    3Networked and Ubiquitous Systems Engineering Group, School of Computing, Newcastle University, Newcastle upon Tyne, United Kingdom

    Corresponding Author:

    Christian Alexander Garske, MSc

    Intelligent Sensing Laboratory

    School of Engineering

    Newcastle University

    Merz Court

    Newcastle upon Tyne, NE1 7RU

    United Kingdom

    Phone: 44 191 20 86682

    Email: c.a.garske2@ncl.ac.uk


    Serious games show a lot of potential for use in movement rehabilitation (eg, after a stroke, injury to the spinal cord, or limb loss). However, the nature of this research leads to diversity both in the background of the researchers and in the approaches of their investigation. Our close examination and categorization of virtual training software for upper limb prosthetic rehabilitation found that researchers typically followed one of two broad approaches: (1) focusing on the game design aspects to increase engagement and muscle training and (2) concentrating on an accurate representation of prosthetic training tasks, to induce task-specific skill transfer. Previous studies indicate muscle training alone does not lead to improved prosthetic control without a transfer-enabling task structure. However, the literature shows a recent surge in the number of game-based prosthetic training tools, which focus on engagement without heeding the importance of skill transfer. This influx appears to have been strongly influenced by the availability of both software and hardware, specifically the launch of a commercially available acquisition device and freely available high-profile game development engines. In this Viewpoint, we share our perspective on the current trends and progress of serious games for prosthetic training.

    JMIR Serious Games 2021;9(4):e28079

    doi:10.2196/28079

    Keywords

    rehabilitation; serious games; engagement; transfer; upper limb; arm prosthesis; virtual training; virtual games 


    Adherence of patients to interventions (eg, home exercises) remains a key challenge in rehabilitation medicine [1]. Patients complain that exercises often feel tedious and tiring and that progress, if any, is slow and incremental [1]. Delivering virtual training in the form of games can help overcome issues related to nonadherence (or noncompliance) of patients to their exercise regimen [1]. The use of serious games has been recommended to motivate patients in performing their prescribed exercises consistently and completely [2-4].

    The stroke rehabilitation literature includes a large number of publications that use serious games. Koutisiana et al [5] identified 96 publications between the years 1999 and 2019. The serious games used in stroke rehabilitation are showing significant benefits for the users, most notably an increased number of repetitions performed, which is a prime goal for this kind of rehabilitation [6]. Supported by this academic evidence, rehabilitation programs like Rehability (Imaginary srl), which has grown out of the Rehab@Home project [7], are being incorporated in clinical practice.

    Although serious games have found their way into a multitude of areas of everyday life, industry, and research, including prosthetic training [8], academic results supporting the efficacy of serious games in myoelectric prosthetic training are scarce, if not nonexistent. Using games in virtual rehabilitation has been a part of research for 30 years [9], but they have only gained proper traction in the field in the last decade. This rise coincided with the commercialization of a range of game-related technologies (eg, motion tracking cameras and game controllers with inertial measurement sensors [6]). In this paper, we will offer our perspective on the efficacy of virtual training in general and serious games specifically for myoelectric prosthetics training.

    Current research claims that the use of serious games in myoelectric prosthetics training has promise to improve training. Examples include faster learning [10], reduction of fatigue and irritation while training [11], and increased muscle control [12]. In addition, serious games can offer a faster route to myoelectric training after limb loss [11], as a game would likely not rely on socket fitting or full wound closure. Furthermore, it can make the training more enjoyable and engaging [11], as well as affordable and accessible for the home environment [10]. It also has the potential to assist the user with their body image [11], decrease phantom limb pain [11], and let the user feel more in charge of their own rehabilitation [8,10], while at the same time make it feel less like rehabilitation [8].

    The prevailing view is that this combination of positive effects has the potential to significantly add to the existing prosthetic training and lead to a reduction in prosthesis abandonment, which has been linked to a lack of motivation and engagement [13] and poor training [10]. The performance of virtual prosthetic training at home can also offer benefits to the therapists. As a supplement to existing training regimes, it can offer an objective measure of how diligently the patient is doing their exercises at home and of their improvements [10]. It also has the potential to decrease rehabilitation times and the time necessary for each patient, thereby reducing the workload for therapists [8].

    We investigated papers that included any virtual training or assessment for upper limb prosthesis control using myoelectric signals as input. The included papers were identified during investigation of the literature and has been augmented with systematic searches in multiple databases, including PubMed, Web of Science, and Google Scholar. This led to the inclusion of 55 journal articles and conference papers, with a total of 59 different virtual training programs. CAG classified these programs into two categories, namely serious games and simulators (Table 1), according to Narayanasamy et al [14]. Both training simulators and serious games are interactive simulations in a virtual environment with the purpose of skill development. Simulators often duplicate real-world scenarios, require standard operational procedures, are not designed for entertainment, have no secondary purpose, and usually do not have an obvious final state. Conversely, a serious game is set in a fictitious scenario, provides various challenges, allows for entertainment, and allows the user to develop gameplay patterns while trying to achieve game-specific goals. This can include an end state. Therefore, some of the programs are classified as “simulators,” even when the authors identified them as “games.” The programs were further classified by the type of task the user was given, the type of control scheme the program used, and the input and output devices that were used. This more detailed table can be found in Multimedia Appendix 1.

    Table 1. Categorization of the virtual training programs.
    NamesPublications
    Serious games

    		Air-Guitar Hero (rhythm game)[15]

    		WiiEMG (sports game)[16]

    		Sonic Racing (racing game)[17]

    		MyoBox (dexterity game)[18,19]

    		Flappy Bird (sidescroller)a[20]

    		Space Invaders (fixed shooter)a[20]

    		MyoBeatz (rhythm game)b[21]

    		Falling of Momo (vertical scroller)b[22-25]

    		Volcanic Crush (reaction game)a,b[10]

    		Dino Sprint (endless runner)a,b[10]

    		Dino Feast (dexterity game)a,b[10]

    		Space ARMada (fixed shooter)[11]

    		SuperTuxKart (racing game)[2,12,26,27]

    		Step Mania 5 (rhythm game)[2,12,26,27]

    		Pospos (dexterity game)[2,12,26,27]

    		Who nose?/Nose Picker (simple game)a[28,29]

    		Smash Bro/Bash and Debris (sidescroller)a[28,29]

    		Sushi Slap (action game)a[28,29]

    		Crazy Meteor (multidirectional shooter)a[28,29]

    		Dog Jump/Beeline Border Collie (sidescroller)[28,29]

    		Breakout-EMG (arcade game)[30]

    		Training Game Prototypea[31]

    		Dino Claw (dexterity game)a,b[10]

    		Training, TACc test, and Crossbow Gamea[32]

    		UpBeat (rhythm game)a,b[4]

    		Rhythm Gamea,b[13]

    		Crate Whacker (tech demo)b[33]

    		Race the Sun (endless runner)b[33]

    		Fruit Ninja (dexterity game)b[33]

    		Kaiju Carnage (action game)b[33]
    Simulators

    		UVa Neuromuscular Training System[34,35]

    		Commercial software PAULA[36]

    		Virtual training[36]

    		Virtual training environment[37]

    		Mixed reality trainingb[38]

    		Virtual box and beans testb[39]

    		Virtual box and blocks testa,b[40]

    		Virtual rehabilitation training toola,b[41]

    		VITA: Virtual Therapy Arma,b[42]

    		Explorationa,b[43]

    		AR prosthesis simulator[44]

    		Virtual training system[45-47]

    		Training system[48]

    		Catching simulator[49]

    		Performance assessment[50]

    		Catching simulator Prosthesis Gripper[19]

    		MSMS (Musculoskeletal Modelling Software)[51,52]

    		Prosthesis simulator[53]

    		VRd testing environment[54]

    		Virtual simulation[55]

    		VR evaluation environment[56]

    		Virtual reality environment System[57]

    		ARe training systema[58,59]

    		Myoelectric training tool[60]

    		Training environment[61]

    		Virtual prosthesis[62]

    		Virtual model[63]

    		Training platform[64]

    		Manus VR Training Platform[65]

    		Dual-arm EMGf signal control training system[66]

    		Myoelectric Control Evaluation and Trainer System[67]

    aDeveloped using the Unity engine.

    bUses the Myo Gesture Control Armband.

    cTAC: Target Achievement Control.

    dVR: Virtual Reality.

    eAR: Augmented Reality.

    fEMG: electromyography.


    The categorization of the publications in this field and the software presented therein has shown a significant split of the approaches of researchers into roughly two groups, as can be seen in Figure 1. This divide is most noticeable with regard to whether the software is classified as a game or a simulator and which type of tasks are implemented. The first approach focuses on the engagement and motivation of the user and seems to have grown in popularity in recent years. Researchers develop serious games that often have an explicit or implicit focus on game design elements to keep the user engaged in the game and therefore in the rehabilitation or training. The majority of these myogames (21/30) incorporate abstract tasks not resembling a real-life scenario. These games attempt to train the user in the use of a myoelectric prosthesis by focusing on different aspects of muscle control, including proportional control, independent control, and others. Only two games feature a task that is somewhat activities of daily living–related, both consisting of variants of a pick-and-place task, one stationary [10] and one moving in a 3D environment [31]. In a further seven games, the user is tasked with reproducing specific postures in two rhythm games [4,13], a virtual reality crossbow game [32], and four open-source games [33].

    ‎
    Figure 1. Heatmap of the authors’ software classification against the performed tasks: serious games using abstract tasks [2,10-12,15-30], tasks related to ADL [10,31], and posture reproduction tasks [4,13,32,33]; as well as simulators using abstract tasks [34-36], ADL-related tasks [19,37-54], and posture reproduction tasks [56-67]. ADL: activities of daily living.
    View this figure

    Publications introducing and assessing these games show that they are engaging and enjoyable to the participants. Some studies involving people with limb difference showed their willingness to use them in a home environment [8,21,27]. With regard to skill acquisition, a general increase in in-game performance is shown for a number of these games [12,25,26]. However, it was rarely tested whether these myogames increase prosthetic ability or speed up the learning process of acquiring that skill. The one research group that tested for an increase in prosthetic ability did not find evidence of a significant increase following the playing of a myogame for different control schemes [19,30].

    The second approach focuses on skill transfer and therefore involves the development and investigation of simulators that mostly show the user a representation of the real world and require the performance of activities of daily living–related or posture reproduction tasks. Only two training programs that were classified as simulators used abstract tasks; these tasks were embedded in a sterile software environment and lacked distinctive game traits. In this type of research, the focus is on the effectiveness of the skill transfer from the virtual training to actual prosthetic ability. The prescribed tasks can involve recreations or tasks inspired by tests used in the assessment of prosthetic ability, like the Southampton Hand Assessment Procedure (SHAP) test [68], the Target Achievement Control (TAC) test [69], and others. The focus on task specificity for learning prosthetic skills seems like a promising approach as the results of one study indicated that skill transfer occurred. Performing a virtual task resembling the control of a prosthetic hand led to an increase in prosthetic ability [49] as opposed to when the task was to play a classic arcade game [30]. The task specificity therefore seems to have an influence on the effectiveness of virtual training; however, further research must be done to substantiate this.

    The effectiveness of virtual training in increasing prosthetic ability is without doubt one of the necessary requirements for any adoption into clinical rehabilitation; however, consensus on a universal measure of effectiveness is not available. A criticism of the myogames in the game-focused group is that they work on the implied assumption that an improvement in skill performing any myoelectric task will lead to an improvement in prosthetic skill [49]. Although it has been shown that the user increases their skill in different aspects on the muscular level [10,25], it is not clear whether that influences the way or speed at which a person might acquire prosthetic skill.


    Figure 2 shows another interesting development regarding the first research approach. It clearly features a joint spike in more recent years in the development of serious games incorporating an abstract task and presented in a nonimmersive environment using traditional media. The development of simulators and software using other task types and environment experiences has remained comparatively steady over the same time frame. The start of this spike in publications coincides with the release of the Myo Gesture Control Armband (Thalmic Labs), a dry surface electrode armband, on the commercial market in the year 2015 [70]. The spike in publications started to decrease when the company stopped selling this product in 2018. However, even though it is no longer sold, the Myo armband is still in widespread use in research as there is currently no commercial alternative available. In total, 30% of the programs analyzed use the Myo armband and the most recent work using it was published in 2021 [61]. The uptake in development has likely been further boosted due to a few professional commercial game development engines being free for personal and low-profit use alongside the provision of an application programming interface (API) for the Myo Armband; there are numerous open-source examples of the use of this API in these engines. The main example of one of these engines is the Unity game engine (Unity Technologies) made freely available in the year 2009 [71]; this game engine has been used in at least one-third of the published programs.

    ‎
    Figure 2. Number of training software introduced by task, software, and environment type. ADL: activities of daily living; AR: augmented reality; VR: virtual reality.
    View this figure

    These two factors indicate that the development of serious games intended for prosthetic training was strongly influenced by the emergence of readily available software and hardware technology. However, the enthusiastic embrace of the newly available technology tended toward research exploring the engagement aspects of game design. This is likely due to the low barrier to entry of this approach as there are a multitude of resources for game development available and the study of engagement does not require the involvement of people with limb difference. Investigation of these serious games confirmed that people are more willing to engage in learning a task if it is an intrinsically enjoyable and motivating experience [2]. Such research has also shown that with these games, participants are able to quickly master fine control of their muscles [10,25]. However, this research often tacitly assumed an efficacy in skill transfer by this virtual muscle training, which has yet to be substantiated. As such, it is not clear whether this increase in motor control would lead to enhanced prosthesis control and which types of games might be more conducive to learning how to use a prosthetic device. Therefore, at this point in time, serious games are not serious enough to train upper limb prosthesis use effectively.


    In the research targeting other conditions, such as stroke rehabilitation, the main target is to get the user to move their respective body part more to regain a substantial degree of control over it. The reason for the strong focus on the engagement and motivation of users to increase repetitions of a movement is therefore clear. However, using a myoelectric upper limb prosthesis requires the user to acquire a completely new set of skills. This can mean to either retrain or newly train muscles and their associated uses, depending on whether the limb difference is acquired or congenital. Therefore, a necessary requirement for a serious game in this field to be considered for clinical adoption would be evidence of a benefit to prosthetic ability (ie, evidence that the skill learned in the game transfers to the use of an actual myoelectric prosthesis). So far this kind of skill transfer has only been shown for software that we classified as simulators. It is hypothesized that the task specificity of the actions performed virtually allows the transfer to the real world to occur [49].

    Research in this field needs to establish viable paths for transfer to occur before focusing on the topic of engaging and motivating the target user group. Serious games intended for prosthetic training need to show their benefit for prosthetic ability, be it direct or indirect. Hence, a sensible approach for the development of such a serious game could be to first demonstrate which types of tasks allow transfer at all and then to develop the engaging and motivating game structure around it. As with other conditions, researchers employ the attractiveness of games to actively engage users; however, the clinical benefit cannot be neglected or compromised. The two different approaches in this field encourage separate habit loops when they should merge and form a single loop more beneficial for the user, as shown in Figure 3. Engagement should not be viewed separately but in conjunction with transfer-enabling training to enhance the habit formation of the user to adhere to the training.

    Therefore, the research should establish one or multiple tasks that either directly enable skill transfer to prosthetic use or show evidence of supporting the acquisition of prosthetic skill. Built on these tasks, an engaging and motivating platform should be implemented, which should enable users to increase their prosthetic skill while having fun. The positive reinforcement of the skill increase combined with the fun experienced while training should have a positive effect on adherence to the training and therefore on the long-term success of the intervention.

    ‎
    Figure 3. Diagram of the existent and recommended habit loops.
    View this figure

    Furthermore, the effect of the introduction of myogames on therapists’ workloads should be determined; this is highly dependent on the nature of the training and whether there is a need for the direct involvement of the therapist, which could potentially result in a similar or even larger workload [72]. As this factor depends strongly on the design of the program, it emphasizes the importance of smart development including the input and feedback of all parties involved, including clinicians and therapists, to lead to a product that benefits everyone.

    In conclusion, research on prosthetic training has confirmed that myoelectric skills can be acquired with serious games. However, for the development of a viable serious game intended for prosthetic training, it is necessary to validate the “serious” part of the game, namely the tasks that would allow for skill transfer. Serious games for prosthetic training can only be expected to yield fruitful results beyond engagement when they incorporate tasks that are found to facilitate prosthetic skill. We recommend that the research community investigates which types of myogame tasks might facilitate transfer, as the only existing results at the time of writing this paper indicate a lack of effectiveness [19,30,73]. This lack does not necessarily hold true for all tasks that are not related to activities of daily living, however, and ignoring abstract tasks entirely would exclude a wide range of possible avenues for prosthetic game development.

    It would be beneficial to be more accurate regarding the terminology used in the field and, if the term “game” is used, to specify the incorporated game design elements explicitly. More long-term and ideally home-based experiments are needed to conclusively test for any prosthetic skill transfer that might occur with the consistent use of prosthetic gaming devices. Even though previous studies indicate that no change in prosthetic ability occurs after training with a myogame [19,30,73], these only tested the effect of comparatively short training sessions with able-bodied people or very small groups of prosthesis users. It should also be tested whether prosthetic gaming has the potential to support traditional prosthetic training by allowing for supplementary practice sessions between visits to the prosthetist.

    Acknowledgments

    This work was supported by the Leverhulme Doctoral Scholarship Programme in Behaviour Informatics (DS-2017-015), the National Institute of Health Research (NIHR) via Devices 4 Dignity Starworks STWK-006, and the Engineering and Physical Sciences Research Council (EPSRC) via grant EP/R004242/1.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Detailed categorization of the virtual training programs.

    PDF File (Adobe PDF File), 39 KB
    1. Lohse K, Shirzad N, Verster A, Hodges N, Van der Loos HFM. Video games and rehabilitation: using design principles to enhance engagement in physical therapy. J Neurol Phys Ther 2013 Dec;37(4):166-175. [CrossRef] [Medline]
    2. Prahm C, Kayali F, Vujaklija I, Sturma A, Aszmann O. Increasing motivation, effort and performance through game-based rehabilitation for upper limb myoelectric prosthesis control. In: 2017 International Conference on Virtual Rehabilitation (ICVR). 2017 Presented at: International Conference on Virtual Rehabilitation (ICVR); June 19-22, 2017; Montreal, QC, Canada. [CrossRef]
    3. Tatla SK, Shirzad N, Lohse KR, Virji-Babul N, Hoens AM, Holsti L, et al. Therapists' perceptions of social media and video game technologies in upper limb rehabilitation. JMIR Serious Games 2015;3(1):e2 [FREE Full text] [CrossRef] [Medline]
    4. Melero M, Hou A, Cheng E, Tayade A, Lee SC, Unberath M, et al. Upbeat: Augmented Reality-Guided Dancing for Prosthetic Rehabilitation of Upper Limb Amputees. J Healthc Eng 2019;2019:2163705. [CrossRef] [Medline]
    5. Koutsiana E, Ladakis I, Fotopoulos D, Chytas A, Kilintzis V, Chouvarda I. Serious Gaming Technology in Upper Extremity Rehabilitation: Scoping Review. JMIR Serious Games 2020 Dec 11;8(4):e19071. [CrossRef] [Medline]
    6. Bonnechère B. Serious games in physical rehabilitation: from theory to practice. Heidelberg, Germany: Springer International Publishing; 2018.
    7. Pannese L, Bo G, Lawo M, Gabrielli S. The Rehab@Home project: Engaging game-based home rehabilitation for improved quality of life. In: Proceedings of the SEGAMED Conference. 2013 Presented at: SEGAMED Conference; 2013; Nice, France.
    8. Garske CA, Dyson M, Dupan S, Nazarpour K. Perception of Game-Based Rehabilitation in Upper Limb Prosthetic Training: Survey of Users and Researchers. JMIR Serious Games 2021 Feb 01;9(1):e23710. [CrossRef] [Medline]
    9. Lovely DF, Stocker D, Scott RN. A computer-aided myoelectric training system for young upper limb amputees. Journal of Microcomputer Applications 1990 Jul;13(3):245-259. [CrossRef]
    10. Winslow BD, Ruble M, Huber Z. Mobile, Game-Based Training for Myoelectric Prosthesis Control. Front Bioeng Biotechnol 2018;6:94. [CrossRef] [Medline]
    11. Anderson F, Bischof WF. Augmented reality improves myoelectric prosthesis training. International Journal on Disability and Human Development 2014;13(3):349-354. [CrossRef]
    12. Prahm C, Kayali F, Sturma A, Aszmann O. PlayBionic: Game-Based Interventions to Encourage Patient Engagement and Performance in Prosthetic Motor Rehabilitation. PM R 2018 Nov;10(11):1252-1260. [CrossRef] [Medline]
    13. Bessa D, Rodrigues NF, Oliveira E, Kolbenschag J, Prahm C. Designing a serious game for myoelectric prosthesis control. In: 2020 IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH). 2020 Presented at: 2020 IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH); August 12-14, 2020; Vancouver, BC, Canada. [CrossRef]
    14. Narayanasamy V, Wong K, Fung C, Rai S. Distinguishing games and simulation games from simulators. Comput Entertain 2006;4(2):9. [CrossRef]
    15. Armiger RS, Vogelstein RJ. Air-Guitar Hero: A real-time video game interface for training and evaluation of dexterous upper-extremity neuroprosthetic control algorithms. In: 2008 IEEE Biomedical Circuits and Systems Conference. 2008 Presented at: 2008 IEEE Biomedical Circuits and Systems Conference; November 20-22, 2008; Baltimore, MD, USA p. 121-124. [CrossRef]
    16. Oppenheim H, Armiger RS, Vogelstein RJ. WiiEMG: A real-time environment for control of the Wii with surface electromyography. In: Proceedings of 2010 IEEE International Symposium on Circuits and Systems. 2010 Presented at: 2010 IEEE International Symposium on Circuits and Systems; May 30-June 2, 2010; Paris, France p. 957-960. [CrossRef]
    17. Martinez-Luna C, Kelly C, Rozell B, Lambrecht S, Horowitz A, Farrell T. A myoelectric video game training pilot study: changes in control signal properties. In: MEC20 Symposium Proceedings. 2020 Presented at: Myoelectric Controls and Upper Limb Prosthetics Symposium; July 2020; Fredericton, NB, Canada.
    18. Kristoffersen MB, Franzke AW, van der Sluis CK, Murgia A, Bongers RM. Serious gaming to generate separated and consistent EMG patterns in pattern-recognition prosthesis control. Biomedical Signal Processing and Control 2020 Sep;62:102140. [CrossRef]
    19. Kristoffersen MB, Franzke AW, Bongers RM, Wand M, Murgia A, van der Sluis CK. User training for machine learning controlled upper limb prostheses: a serious game approach. J Neuroeng Rehabil 2021 Feb 12;18(1):32. [CrossRef] [Medline]
    20. Radhakrishnan M, Smailagic A, French B, Siewiorek D, Balan R. Design and assessment of myoelectric games for prosthesis training of upper limb amputees. In: 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). 2019 Presented at: 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops); March 11-15, 2019; Kyoto, Japan p. 151-157. [CrossRef]
    21. Prahm C, Kayali F, Aszmann O. MyoBeatz: using music and rhythm to improve prosthetic control in a mobile game for health. In: 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH). 2019 Presented at: 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH); August 5-7, 2019; Kyoto, Japan   URL: https://doi.org/10.1109/SeGAH.2019.8882432 [CrossRef]
    22. Tabor A, Kienzle A, Smith C, Watson A, Wuertz J, Hanna D. The Falling of Momo: a myoelectric controlled game to support research in prosthesis training. In: CHI PLAY Companion '16: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. 2016 Presented at: CHI PLAY '16: The annual symposium on Computer-Human Interaction in Play; October 2016; Austin, TX, USA p. 71-77. [CrossRef]
    23. Tabor A, Bateman S, Scheme E. Game-based myoelectric training. In: CHI PLAY Companion '16: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. 2016 Presented at: CHI PLAY '16: The annual symposium on Computer-Human Interaction in Play; October 2016; Austin, TX, USA p. 299-306. [CrossRef]
    24. Tabor A, Bateman S, Scheme E, Flatla D, Gerling K. Designing game-based myoelectric prosthesis training. In: CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2017 Presented at: CHI '17: CHI Conference on Human Factors in Computing Systems; May 2017; Denver, CO, USA p. 1352-1363. [CrossRef]
    25. Tabor A, Bateman S, Scheme E. Evaluation of Myoelectric Control Learning Using Multi-Session Game-Based Training. IEEE Trans Neural Syst Rehabil Eng 2018 Sep;26(9):1680-1689. [CrossRef] [Medline]
    26. Prahm C, Vujaklija I, Kayali F, Purgathofer P, Aszmann OC. Game-Based Rehabilitation for Myoelectric Prosthesis Control. JMIR Serious Games 2017 Feb 09;5(1):e3 [FREE Full text] [CrossRef] [Medline]
    27. Prahm C, Kayali F, Sturma A, Aszmann O. Recommendations for games to increase patient motivation during upper limb amputee rehabilitation. In: Converging Clinical and Engineering Research on Neurorehabilitation II. 2017 Presented at: 3rd International Conference on NeuroRehabilitation (ICNR2016); October 18-21, 2016; Segovia, Spain p. 1161. [CrossRef]
    28. Smith P, Dombrowski M, Buyssens R, Barclay P. Usability testing games for prosthetic training. In: 2018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH). 2018 Presented at: 2018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH); May 16-18, 2018; Vienna, Austria. [CrossRef]
    29. Smith PA, Dombrowski M, Buyssens R, Barclay P. The Impact of a Custom Electromyograph (EMG) Controller on Player Enjoyment of Games Designed to Teach the Use of Prosthetic Arms. Comput Game J 2018 May 2;7(2):131-147. [CrossRef]
    30. van Dijk L, van der Sluis CK, van Dijk HW, Bongers RM. Learning an EMG Controlled Game: Task-Specific Adaptations and Transfer. PLoS One 2016;11(8):e0160817. [CrossRef] [Medline]
    31. Dyson M, Olsen J, Nazarpour K. A home-based myoelectric training system for children. In: MEC20 Symposium Proceedings. 2020 Presented at: Myoelectric Controls and Upper Limb Prosthetics Symposium; July 2020; Fredericton, NB, Canada.
    32. Woodward RB, Hargrove LJ. Adapting myoelectric control in real-time using a virtual environment. J Neuroeng Rehabil 2019 Jan 16;16(1):11. [CrossRef] [Medline]
    33. Hashim N, Abd Razak NA, Gholizadeh H, Abu Osman NA. Video Game-Based Rehabilitation Approach for Individuals Who Have Undergone Upper Limb Amputation: Case-Control Study. JMIR Serious Games 2021 Feb 04;9(1):e17017 [FREE Full text] [CrossRef] [Medline]
    34. De La Rosa R, Alonso A, De La Rosa S, Abásolo D. Myo-Pong: A neuromuscular game for the UVa-neuromuscular training system platform. In: 2008 Virtual Rehabilitation. 2008 Presented at: International Workshop on Virtual Rehabilitation; August 25-27, 2008; Vancouver, BC, Canada. [CrossRef]
    35. De La Rosa R, De La Rosa S, Alonso A, Val L. The UVa-neuromuscular training system platform. In: IWANN '09: Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part II: Distributed Computing, Artificial Intelligence, Bioinformatics, Soft Computing, and Ambient Assisted Living. 2009 Presented at: 10th International Work-Conference on Artificial Neural Networks: Part II: Distributed Computing, Artificial Intelligence, Bioinformatics, Soft Computing, and Ambient Assisted Living; June 10-12, 2009; Salamanca, Spain p. 863-869. [CrossRef]
    36. Terlaak B, Bouwsema H, Van Der Sluis CK, Bongers RM. Virtual Training of the Myosignal. PLoS One 2015 Sep;10(9):e0137161. [CrossRef] [Medline]
    37. Cavalcante R, Gaballa A, Cabibihan J, Soares A, Lamounier E. The importance of sensory feedback to enhance embodiment during virtual training of myoelectric prostheses users. In: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 2021 Presented at: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW); March 27-April 1, 2021; Lisbon, Portugal. [CrossRef]
    38. Sharma A, Hunt CL, Maheshwari A, Osborn L, Lévay G, Kaliki RR, et al. A mixed-reality training environment for upper limb prosthesis control. In: 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS). 2018 Presented at: 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS); October 17-19, 2018; Cleveland, OH, USA. [CrossRef]
    39. Prahm C, Schulz A, Paaben B, Schoisswohl J, Kaniusas E, Dorffner G, et al. Counteracting Electrode Shifts in Upper-Limb Prosthesis Control via Transfer Learning. IEEE Trans Neural Syst Rehabil Eng 2019 May;27(5):956-962. [CrossRef]
    40. Hashim NA, Razak NAA, Osman NAA. Comparison of Conventional and Virtual Reality Box and Blocks Tests in Upper Limb Amputees: A Case-Control Study. IEEE Access 2021;9:76983-76990. [CrossRef]
    41. Dhawan D, Barlow M, Lakshika E. Prosthetic rehabilitation training in Virtual Reality. In: 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH). 2019 Presented at: 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH); August 5-7, 2019; Kyoto, Japan. [CrossRef]
    42. Nissler C, Nowak M, Connan M, Büttner S, Vogel J, Kossyk I, et al. VITA - an everyday virtual reality setup for prosthetics and upper-limb rehabilitation. J Neural Eng 2019 Apr;16(2):026039. [CrossRef] [Medline]
    43. Phelan I, Arden M, Garcia C, Roast C. Exploring virtual reality and prosthetic training. In: 2015 IEEE Virtual Reality (VR). 2015 Presented at: IEEE Annual International Symposium Virtual Reality; March 23-27, 2015; Arles, France. [CrossRef]
    44. Lamounier EA, Lopes K, Cardoso A, Soares AB. Using Augmented Reality Techniques to Simulate Myoelectric Upper Limb Prostheses. J Bioengineer & Biomedical Sci 2013;S1:1-6. [CrossRef]
    45. Nakamura G, Shibanoki T, Shima K, Kurita Y, Hasegawa M, Otsuka A, et al. A training system for the MyoBock hand in a virtual reality environment. In: 2013 IEEE Biomedical Circuits and Systems Conference (BioCAS). 2013 Presented at: 2013 IEEE Biomedical Circuits and Systems Conference (BioCAS); October 31-November 2, 2013; Rotterdam, Netherlands p. 61-64. [CrossRef]
    46. Nakamura G, Shibanoki T, Mizobe F, Masuda A, Honda Y, Chin T, et al. A high-fidelity virtual training system for myoelectric prostheses using an immersive HMD. In: i-CREATe 2016: Proceedings of the international Convention on Rehabilitation Engineering & Assistive Technology. 2016 Presented at: i-CREATe 2016: international Convention on Rehabilitation Engineering & Assistive Technology; July 2016; Singapore p. 1-4.
    47. Nakamura G, Shibanoki T, Kurita Y, Honda Y, Masuda A, Mizobe F, et al. A virtual myoelectric prosthesis training system capable of providing instructions on hand operations. International Journal of Advanced Robotic Systems 2017 Sep 19;14(5):172988141772845. [CrossRef]
    48. Takeuchi T, Wada T, Mukobaru M, Doi S. A training system for myoelectric prosthetic hand in virtual environment. 2007 IEEE/ICME International Conference on Complex Medical Engineering 2007:1351-1356. [CrossRef] [Medline]
    49. van Dijk L, van der Sluis CK, van Dijk HW, Bongers RM. Task-Oriented Gaming for Transfer to Prosthesis Use. IEEE Trans Neural Syst Rehabil Eng 2016 Dec;24(12):1384-1394. [CrossRef] [Medline]
    50. Hargrove L, Losier Y, Lock B, Englehart K, Hudgins B. A real-time pattern recognition based myoelectric control usability study implemented in a virtual environment. In: 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 2007 Presented at: 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society; August 22-26, 2007; Lyon, France p. 4842-4845. [CrossRef]
    51. Davoodi R, Loeb GE. MSMS software for VR simulations of neural prostheses and patient training and rehabilitation. Stud Health Technol Inform 2011;163:156-162. [Medline]
    52. Davoodi R, Loeb GE. Development of a Physics-Based Target Shooting Game to Train Amputee Users of Multijoint Upper Limb Prostheses. Presence: Teleoperators and Virtual Environments 2012;21(1):85-95. [CrossRef]
    53. Lambrecht JM, Pulliam CL, Kirsch RF. Virtual reality environment for simulating tasks with a myoelectric prosthesis: an assessment and training tool. J Prosthet Orthot 2011 Apr;23(2):89-94. [CrossRef] [Medline]
    54. Blana D, Kyriacou T, Lambrecht JM, Chadwick EK. Feasibility of using combined EMG and kinematic signals for prosthesis control: A simulation study using a virtual reality environment. J Electromyogr Kinesiol 2016 Aug;29:21-27 [FREE Full text] [CrossRef] [Medline]
    55. Soares A, Andrade A, Lamounier E, Carrijo R. The development of a virtual myoelectric prosthesis controlled by an EMG pattern recognition system based on neural networks. Journal of Intelligent Information Systems 2003;21:127-141. [CrossRef]
    56. Côté-Allard U, Gagnon-Turcotte G, Phinyomark A, Glette K, Scheme E, Laviolette F, et al. A Transferable Adaptive Domain Adversarial Neural Network for Virtual Reality Augmented EMG-Based Gesture Recognition. IEEE Trans Neural Syst Rehabil Eng 2021;29:546-555. [CrossRef]
    57. Resnik L, Etter K, Klinger SL, Kambe C. Using virtual reality environment to facilitate training with advanced upper-limb prosthesis. J Rehabil Res Dev 2011;48(6):707-718. [CrossRef] [Medline]
    58. Boschmann A, Dosen S, Werner A, Raies A, Farina D. A novel immersive augmented reality system for prosthesis training and assessment. In: 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI). 2016 Presented at: 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI); February 24-27, 2016; Las Vegas, NV, USA. [CrossRef]
    59. Boschmann A, Neuhaus D, Vogt S, Kaltschmidt C, Platzner M, Dosen S. Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis. J Neuroeng Rehabil 2021 Feb 04;18(1):25 [FREE Full text] [CrossRef] [Medline]
    60. Dawson MR, Fahimi F, Carey JP. The development of a myoelectric training tool for above-elbow amputees. Open Biomed Eng J 2012;6:5-15 [FREE Full text] [CrossRef] [Medline]
    61. Al-Jumaily A, Olivares RA. Electromyogram (EMG) driven system based virtual reality for prosthetic and rehabilitation devices. In: iiWAS '09: Proceedings of the 11th International Conference on Information Integration and Web-based Applications & Services. 2009 Presented at: iiWAS '09: 11th International Conference on Information Integration and Web-based Applications & Services; December 2009; Kuala Lumpur, Malaysia p. 582-586. [CrossRef]
    62. Eriksson L, Sebelius F, Balkenius C. Neural control of a virtual prosthesis. In: ICANN 98: Proceedings of the 8th International Conference on Artificial Neural Networks. 1998 Presented at: International Conference on Artificial Neural Networks; September 2-4, 1998; Skövde, Sweden p. 905-910. [CrossRef]
    63. Muri F, Carbajal C, Echenique AM, Fernández H, López NM. Virtual reality upper limb model controlled by EMG signals. In: Journal of Physics: Conference Series 477. 2013 Presented at: 19th Argentinean Bioengineering Society Congress (SABI 2013); September 4-6, 2013; Tucumán, Argentina. [CrossRef]
    64. Perry BN, Armiger RS, Yu KE, Alattar AA, Moran CW, Wolde M, et al. Virtual Integration Environment as an Advanced Prosthetic Limb Training Platform. Front Neurol 2018;9:785. [CrossRef] [Medline]
    65. Pons J, Ceres R, Rocon E, Levin S, Markovitz I, Saro B, et al. Virtual reality training and EMG control of the MANUS hand prosthesis. Robotica 2005;23(3):311-317. [CrossRef]
    66. Shibanoki T, Nakamura G, Tsuji T, Hashimoto K, Chin T. A new approach for training on EMG-based prosthetic hand control. In: 2020 IEEE 2nd Global Conference on Life Sciences and Technologies (LifeTech). 2020 Presented at: 2020 IEEE 2nd Global Conference on Life Sciences and Technologies (LifeTech); March 10-12, 2020; Kyoto, Japan p. 307-308. [CrossRef]
    67. Dupont AC, Morin EL. A myoelectric control evaluation and trainer system. IEEE Trans Rehab Eng 1994;2(2):100-107. [CrossRef]
    68. Light CM, Chappell PH, Kyberd PJ. Establishing a standardized clinical assessment tool of pathologic and prosthetic hand function: normative data, reliability, and validity. Arch Phys Med Rehabil 2002 Jun;83(6):776-783. [CrossRef] [Medline]
    69. Simon AM, Hargrove LJ, Lock BA, Kuiken TA. Target Achievement Control Test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. J Rehabil Res Dev 2011;48(6):619-627. [CrossRef] [Medline]
    70. Thalmic Labs Myo armband hits consumer release, for sale on Amazon. IT Business Canada.   URL: https:/​/www.​itbusiness.ca/​news/​thalmic-labs-myo-armband-hits-consumer-release-for-sale-on-amazon/​54056 [accessed 2021-02-16]
    71. Unity 2.6 Released And Now Free!. Unity Technologies.   URL: https://unity.com/our-company/newsroom/unity-2-6-released-and-now-free [accessed 2021-02-16]
    72. Almeida J, Nunes F. The Practical Work of Ensuring Effective Use of Serious Games in a Rehabilitation Clinic: A Qualitative Study. JMIR Rehabil Assist Technol 2020 Feb 21;7(1):e15428. [CrossRef] [Medline]
    73. Heerschop A, van der Sluis CK, Otten E, Bongers RM. Performance among different types of myocontrolled tasks is not related. Hum Mov Sci 2020 Apr;70:102592 [FREE Full text] [CrossRef] [Medline]

    ‎
    EMG: electromyography
    SHAP: Southampton Hand Assessment Procedure
    TAC: Target Achievement Control

    Edited by N Zary; submitted 19.02.21; peer-reviewed by R Armiger, E Donoso Brown; comments to author 16.04.21; revised version received 09.06.21; accepted 25.08.21; published 08.11.21

    Copyright

    ©Christian Alexander Garske, Matthew Dyson, Sigrid Dupan, Graham Morgan, Kianoush Nazarpour. Originally published in JMIR Serious Games (https://games.jmir.org), 08.11.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.