Published on in Vol 10, No 1 (2022): Jan-Mar

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/28595, first published .
Viewpoint: Virtual and Augmented Reality in Basic and Advanced Life Support Training

Viewpoint: Virtual and Augmented Reality in Basic and Advanced Life Support Training

Viewpoint: Virtual and Augmented Reality in Basic and Advanced Life Support Training

Original Paper

1Department of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genova, Genova, Italy

2Simulation and Advanced Education Center, University of Genova, Genova, Italy

3Pediatric Emergency and Critical Care Department, Giannina Gaslini children’s Hospital, Genova, Italy

4Department of Surgical Sciences and Integrated Diagnostics, University of Genova, Genova, Italy

Corresponding Author:

Serena Ricci, PhD

Simulation and Advanced Education Center

University of Genova

Via Pastore 3

Genova, 16132

Italy

Phone: 39 01033550188

Email: serena.ricci@edu.unige.it


The use of augmented reality (AR) and virtual reality (VR) for life support training is increasing. These technologies provide an immersive experience that supports learning in a safe and controlled environment. This review focuses on the use of AR and VR for emergency care training for health care providers, medical students, and nonprofessionals. In particular, we analyzed (1) serious games, nonimmersive games, both single-player and multiplayer; (2) VR tools ranging from semi-immersive to immersive virtual and mixed reality; and (3) AR applications. All the toolkits have been investigated in terms of application goals (training, assessment, or both), simulated procedures, and skills. The main goal of this work is to summarize and organize the findings of studies coming from multiple research areas in order to make them accessible to all the professionals involved in medical simulation. The analysis of the state-of-the-art technologies reveals that tools and studies related to the multiplayer experience, haptic feedback, and evaluation of user’s manual skills in the foregoing health care-related environments are still limited and require further investigation. Also, there is an additional need to conduct studies aimed at assessing whether AR/VR-based systems are superior or, at the minimum, comparable to traditional training methods.

JMIR Serious Games 2022;10(1):e28595

doi:10.2196/28595

Keywords



Life support training has become more important in recent decades, creating mass training possibilities that have the potential to significantly reduce the number of deaths due to sudden cardiac arrest [1,2]. In emergency health care, it is crucial to know the differences between advanced training targeted at qualified professionals and training of the general population and paramedics [3]. Qualified professionals need to know how to use mechanical tools and drugs, in addition to performing lifesaving tasks, and general population cohorts need to know and understand how to perform basic manual skills (eg, maintaining an open airway and performing chest compressions) while waiting for professional help. It is important that both professionals and untrained rescuers are able to train with safe and realistic emergency medical scenarios. Training should provide opportunities for frequent rehearsal and assessment of a required core knowledge base in order to achieve optimal levels of practical expertise in stressful situations [4]. Life support training is typically accomplished via the use of manikins and simulated scenarios; moreover, the use of disruptive technologies like virtual reality (VR) and augmented reality (AR) have garnered more interest in training [5-7], beginning with nonimmersive serious games, up to immersive VR, AR, and mixed reality (MR) that provides haptic feedback and realistic interactions. This is probably due to the fact that these technologies can enhance immersivity, defined as the subjective impression to be part of a realistic experience [8], which further strengthens medical learning [9-11]. That said, efficacy studies on VR and AR simulations for emergency training have not been sufficiently performed, as the majority of the research studies in the area are proofs-of-concept. In fact, studies in the field have been presented in scientific journals and conferences that include many different research areas, such as computer science, engineering, medicine, and simulation. The resulting fragmentation and mix-and-match of studies in immersive medical emergency training have resulted in a jumble of different terminologies and aims, making it difficult to have a comprehensive overview of many existing immersive applications to date.

Our goal for this paper is to provide a comprehensive analysis and review of state-of-the-art of VR- and AR-based simulators for life support training. Our intention is to target professionals involved in medical simulation (ie, physicians, medical instructors, simulation specialists, engineers, technicians, computer scientists, and VR and AR developers).

We include, in our review, studies from multiple research areas, such as medicine, engineering, and computer science (Multimedia Appendix 1). First, we provide a description of VR- and AR-based tools used for first aid training, classifying them according to their technology, main features, and appropriate end-users; we also emphasize the advantages and limitations of the foregoing technologies. Following this, we pursue a discussion of the primary properties a simulator should have for optimizing trainee and instructor educational needs.

As the different studies cited are not of the same quality—some of them are well-designed randomized controlled trials, whereas others are prepost studies with surrogate outcomes and few subjects—we classified the studies according to the model of Kirkpatrick for the evaluation of outcomes [12], as this model is commonly used in the field of medical education [13]. Briefly, education outcomes can be classified in different levels as follows:

  • Level 1: reaction to learning experience.
  • Level 2a: modification of attitudes and perceptions.
  • Level 2b: acquisition of knowledge and skills.
  • Level 2c: retention of knowledge and skills over a period of time.
  • Level 3: behavioral change.
  • Level 4a: change in organizational practice.
  • Level 4b: benefits to patients/clients, families, and communities.

The review is organized as shown in Figure 1. We provide an overview of VR, AR, and MR; then, the first part encompasses the primary research studies for VR for life support training. The second part of our review covers AR applications for emergency care training and assessment.

Figure 1. Organization of the review. AR: augmented reality; MR: mixed reality; VR: virtual reality.
View this figure

Overview of VR and AR Technology

VR can be divided into nonimmersive, semi-immersive, and immersive VR (Textbox 1) [14,15].

Definitions of virtual reality and augmented technology

Virtual reality: computer-generated simulation:

  • Nonimmersive: the virtual environment is accessed through a display, and interaction is limited to keyboard and mouse
  • Semi-immersive: the setup includes projections or multiple screens
  • Immersive: a head-mounted display isolates the user from the real world
    • Mixed reality: virtual and real worlds are overlapped such that the user sees the virtual world and interacts with the real one

Augmented reality: integration of 3D virtual objects into a real environment in real time:

  • Optical see through: semi-transparent glasses to combine the virtual content with the real view of the world
  • Video see-through: cameras to show the user the real world, augmented with virtual elements
  • Projection-based: the virtual elements are projected in the real world
Textbox 1. Definitions of virtual reality and augmented technology

Nonimmersive VR includes desktop applications, in which the virtual environment is accessed through a screen, and interaction is usually limited to the keyboard and mouse, but it can also involve other devices such as gaming controllers, joysticks, or graphic tablets. Semi-immersive VR allows the user to experience a 3D environment through projections or multiple screens, while immersive VR requires a wired or wireless head-mounted display (HMD) that can fully isolate the user from the real environment [16]. In VR, interactions can occur in multiple ways: by using controllers, motion tracking devices, or data gloves which also provide haptic feedback such as vibrations. In addition, supplementary devices such as Leap Motion (Ultraleap) or external cameras track the users’ movements, thus allowing them to naturally interact with the VR without wearing or holding external devices.

Recently, immersive VR has further evolved into mixed reality (MR), combining virtual and real information, such that the virtual and real worlds can interact [17]. In particular, MR allows the users to be immersed in a virtual world and to interact with the virtual objects as they would normally do in the real world (eg, by grasping or handling real objects) [18,19], given that the virtual and real worlds are overlapped.

Another approach to “augment” the environment information is by using AR. In particular, AR can be defined as the integration of 3D virtual objects into a real environment in real time [20-23]. AR can be divided into (1) optical see through using semi-transparent glasses to combine the virtual content with the real view of the world; (2) video seen through taking advantage of cameras to show the user the real world, augmented with virtual elements; (3) projection-based which does not need any wearable device, as the virtual elements are projected (Textbox 1).

The main difference between AR and MR is the visual feedback provided: the former combines real and virtual elements in the user’s field of view; the latter shows a completely virtual world. In addition, with AR, the interaction with virtual objects is limited to simple gestures; conversely, MR guarantees a realistic interaction with virtual objects as the virtual and real world are overlapped.

Virtual Reality

The studies are organized into nonimmersive, semi-immersive, and immersive VR categories (Figure 1). For the sake of clarity, nonimmersive systems are defined as serious games throughout the text, as this term is most commonly used in health care simulation for the applications under study. Further, the immersive VR section contains a part about MR systems with haptic feedback, commonly referred to as hybrid tools.

Nonimmersive Systems or Serious Games

The early definitions of serious games described them as games with an educational purpose not primarily intended for entertainment [24]. Conversely, [25] suggests that the educational purpose of these games was most commonly deployed in a way that made them entertaining. More recently, the term serious game has been associated with videogames that include scoring systems that challenge users [26]. In particular, serious games are educational computer applications that teach a specific skill that can be transferred into real life [26,27]. With serious games, students can deal with a challenging situation by learning from mistakes [28,29]. They also find different strategies and can be rewarded by a score and through the possibility of exploring levels having increasing difficulty [27]. In 2021, Bedwell et al [30] defined the characteristics a serious game should have that can be summarized as such: rules and a specific challenging goal, a story told during the game, actions that the user can control, communication between the player and the game characters, and a scoring system.

Within the foregoing context, medical education is particularly suited for the development of serious games ranging from 2D applications to teach anatomy to 3D applications that train triage or surgery [31]. For the purpose of this review, we will discuss only VR-based serious games, specifically designed for life support training, with a specific focus on the difference between single-player and multiplayer tools (Table 1).

Table 1. Serious games specifically designed for emergency training.
StudyTopicTargetPlayersFeaturesStudy design (N)Kirkpatrick\'s level
Youngblood et al [32], 2008CRMaHCPb4Users can communicate vocally in real time and can perform clinical actions only if they are properly positioned with respect to the patient who responds to treatments and actionsPrepost (30)2b
Creutzfeldt et al [33], 2012 CPR-MVWCPRcHP, NCPd3Trainees are avatars in the virtual world who need to cooperate to perform BLSCase control (30)2b
Buttussi et al [34], 2013 EMSAVEALSeHCP1User plays the leader of an ALS team. When a correct task is selected, its execution and effects are shown. Otherwise, the game provides hints for self-correction. Debriefing at the end of the simulationPrepost (40)2c
Ribeiro et al [35], 2014 SeGTECPRNP1Training and evaluation modes; debriefingPrepost (31)2b
Vankipuram et al [36], 2014ALSHCP6Each role receives specific feedback and can perform certain actions. The player responsible for compression interacts with the system using a haptic joystick that mimics the patient’s chestUsability (96)2a
Boada et al [37], 2015 LISSACPRHCP, NP1The player has to save the victim applying CPR. Scoring system with penalties for wrong actions and delays. Two types of users: teacher and learnerRandomized trial (109)2b
Drummond et al [38], 2017 Staying AliveCPRHCP, NP1The player learns the appropriate tasks to manage SCA. Actions are guided throughout the gameRandomized trial (79)1
Latif et al [39], 2017 LA-VIECPRNP1Serious game usable to test the CPR knowledge of nonprofessional laypersons. The user is presented with different situations and needs to perform the correct action.Prepost (52)2b
Gerard et al [40], 2018 PediatricSimPALSfHCP1User plays the role of a code leader, selecting assessments and treatments performed by avatars. Two modes: tutorial, which provides real-time feedback; nontutorial with feedback at the end of the simulationPrepost (60)2a
Aksoy et al [41], 2019 3DMedSim tablet-based BLS CPRHCP1Usable with a tablet. Two modes: training which guides the trainees during the emergency and self-testRandomized trial (40)2b

aCRM: crisis resource management.

bHCP: health care providers.

cCPR: cardiopulmonary resuscitation.

dNP: nonprofessionals.

eALS: advanced life support.

fPALS: pediatric advanced life support.

Single Player

Single player is the most common type of serious games used for life support training. Typically, a trainer assesses a first aid scenario and decides which treatments the rescue team needs to perform. Serious games are mainly used by medical students, paramedics, and medical doctors to train and refresh decision-making and teamwork skills [40,41]. Nevertheless, some of these serious game applications have been designed for laypersons (Table 1) [35,39]. Several studies report these tools to be superior to traditional teaching methods. For instance, a study carried out on nursing students revealed that those who had access to a serious game after a theoretical presentation had better practical performance outcomes [37]. However, it was unclear whether performance improvements were due to exposure to serious games or simply a result of overall increased training time. Another study targeted at advanced life support (ALS) experts focused on the role of serious games as refresher tools (ie, courses were specifically designed for health care providers [HCP] familiar with a particular procedure, but required a review of basic conceptual and practical learning skills to maintain a high proficiency level on that skill) [34,42]. ALS performance was assessed before and 3 months after a serious game session. Results showed that performance at follow-up was significantly higher than performance outcomes at the beginning of the experiment [34]. Hence, serious games may be effective tools to enhance skill retention between practical courses. Another study compared a cardiopulmonary resuscitation (CPR) serious game with a traditional online course and found no difference between the two teaching modalities [38]. These results support the hypothesis that serious games can be valuable tools for first aid training, being at the minimum comparable to traditional methods in terms of outcomes. Furthermore, it is important that these applications are carefully designed in order to be engaging, motivating, and as realistic as possible. In fact, simulation games are preferable to passive instructions only if they provide active commands that motivate the learner’s immersion into content [38,43].

Multiplayers

Serious games involving multiple players are usually called collaborative virtual environments or multiplayer virtual worlds [44,45]. Typically, users are given specific roles within the game (eg, team leader, nurse, etc; Figure 2) with successful outcomes resulting from designed-in collaboration and communication goals.

As for single-player systems, analyses on multiplayer applications yielded results that are limited and difficult to compare. For example, two studies assessing self-efficacy of medical and high-school students using a commercial serious game detected an increase of confidence [46,47]. Unfortunately, the experimental design included both a lecture and serious game practice, thus making it impossible to discriminate whether the self-efficacy increase in procedure confidence was the result of a single training modality. The same research group also explored whether knowledge acquired through multiplayer games would be retained and transferred to manual practice [33]. Briefly, groups of medical students were trained using serious games 6 and 18 months prior to a high-fidelity simulation. Data from these participants were compared to a control group that had not practiced prior to the simulation [33]. Interestingly, all groups showed an improvement in theoretical knowledge. The effect of prior practice became a study factor when the authors took into consideration the number of violations to the CPR guidelines [33], further supporting the idea that serious games are helpful learning tools to learn and refresh CPR algorithm, but not for enhancing the theoretical and practical knowledge related to life-saving skills. Finally, comparing team-leadership skills following either virtual practice or high-fidelity simulation resulted in similar improvements [32,48].

One of the biggest limitations of serious games is the lack of physical practice, as the interaction is limited to keyboard and mouse clicks. To overcome this constraint, a research group added a haptic device (providing physical feedback) to simulate chest compression, thus allowing for a more realistic simulation and improved manual skills [36,45,49]. Yet, since multiple users are assigned different roles, some did not have access to haptic feedback; this resulted in different simulation experiences among trainees. In fact, multiplayer serious games raise an important question: how can students who are practicing different tasks retain the same skills? In other words, it is important to study whether skills acquisition is similar when learners are actively involved in the task, as well as during observational sessions of their practicing peers. On the one hand, team training may be beneficial, as it makes the learning experience more engaging and unpredictable. This is also supported by a qualitative study assessing medical students’ experiences during serious game practice where learners found team simulation challenging, competitive and rewarding, thus leading to better retention [44]. On the other hand, students might be easily distracted when not directly involved in the case presented in the simulation. A study comparing the outcome of students playing different roles during a high-fidelity simulation reported that operative roles enhanced problem-solving, support, and guided reflection abilities [50]. Also, the learning attitude seems related to the role played during the simulation [50]. Further, it is important that medical students learn how successfully be part of a team, as health care is currently provided by multidisciplinary teams who need to work together, and lack of communication and poor teamwork have been related to poor medical care [51]. Within this framework, simulation roles should be rotated, assigning students different roles, so that by the end of the practice session, all participants had experienced the same situations, learning either different skills or the same one from different perspectives. However, in order for the training to be effective, it should not be boring [9-11]. Indeed, one of the main advantages of serious games, and more generally of VR, is the unpredictability embedded within the simulation, thus compelling an increased level of focus and attention on the part of the learner, resulting in better outcomes. Given the foregoing, it appears to be a need for additional studies assessing whether serious games are superior to traditional teaching methods after the “wow” effect has subsided in order to accurately determine the real learning improvement potential of these tools.

Semi-Immersive Experiences

The first example of a semi-immersive VR tool was JUST VR, a semi-immersive tool used for the training of nonprofessionals [3]. In this simulation, users face a screen that presents an interactive medical emergency. During the simulation, trainees can move; this is enabled by a magnetic sensor placed on their head; also, they can vocally interact with a virtual assistant (controlled by a technician) who is giving commands on how to manage the emergency situation [3]. Even though this proof of concept might be helpful for learning within the CPR algorithm, it does not provide haptic feedback or effectively train for manual skills.

A recent study presented a CPR training simulation that occurred in the Octave VR facility at the University of Salford, Manchester, United Kingdom [52]. The Octave VR facility is an evolved version of a VR Cave, which is a room equipped with either projectors or screens covering three to six walls of a room. The Octave is defined by an octagonal space that displays an outdoor environment projected onto the walls and floor of the room; students can view a functional CPR manikin at the room’s center and, through shutter glasses, they experience 3D visual cues [52]. Confidence levels in performing lifesaving tasks and performance of second-year nursing students were compared in three environments: the Octave, a skill room (ie, a simulated hospital room), and a simulation room equipped with projectors displaying realistic images and audio of an outdoor urban environment [52]. Surprisingly, self-confidence was lower when students experienced the Octave with respect to the other environments, although students' performance outcomes improved. One possible explanation of these results is that students were unfamiliar with the Octave technology and thus felt less confident than they actually were due to the novelty of the simulation. Indeed, the Octave challenged the trainees more than other simulation technologies, proving to be an effective way to prepare learners for real-life scenarios [52]. However, the Octave technology is expensive and requires dedicated equipment, space, and trained technicians to operate, making it impractical for medical simulation centers to deploy for the immediate future.

A very different application of VR for CPR training is CPRBuddy proposed by [53]; it consists of a virtual avatar displayed on a screen. CPRBuddy follows the users’ performance on a manikin, providing real-time audio and gestural feedback. Interestingly, the avatar is able to illustrate an incorrect action committed by the student before showing him/her the correct procedure. CPRBuddy was tested on a sample of nine novice learners who were asked to perform chest compression before and after the training with the system, showing improved performance after the training. Similarly, Tian et al [54] presented a proof of concept of a CPR trainer which used a Microsoft Kinect and a haptic device. The Kinect captured the user’s movements while performing CPR with the haptic device, which provided the realistic physical feedback of a chest compression procedure. A virtual representation of the user reanimating a virtual patient was displayed on a screen; visual and audio cues were also provided [54]. Even if these are preliminary studies, they suggest that a virtual trainer can effectively support live tutors, reducing their effort during CPR courses and increasing learning outcomes.

Immersive Applications

The first example of an immersive VR application for first aid training was presented at the IEEE Virtual Reality Annual International Symposium of 1998 [55]. The first prototype called MediSim was developed to train front-line medical personnel in battlefield medicine. The prototype included a VR HMD, four trackers positioned on the user’s body, and a dynamic causality model that provided simulated changes in a patient’s condition according to the learner’s actions [55]. From the position of the trackers, MediSim reconstructed the trainee body configuration and position, creating a virtual avatar that could interact with a virtual patient and other objects (eg, surgical gloves). No tests studies were reported on the effectiveness of simulated patients or student learning performance, as the main goal of this study was to integrate the system into a battlefield simulator. MediSIM eventually evolved into BioSimMER [56], an application used to train medical first responders to an act of bioterrorism. With BioSimMER, trainees learned how to triage and treat different injuries related to a terroristic attack while at the same time protecting themselves from harm.

After these pioneer studies, research on semi-immersive and immersive VR/MR tools for life support training has been sparse, with only two main studies published between 2000 and 2014 [3,57].

VR applications lacking haptic feedback prove to be efficient learning tools for HCPs who need to refresh skills, be informed of new guidelines, and train for leadership or communicative skills. Moreover, VR applications are promising tools for teaching nonexperts, especially younger people, how to manage medical emergencies. In particular, young people are more prone to use mobile and gaming apps for learning new skills, thus making them a good way to reach them and raise awareness on the importance of first aid knowledge among the general population. In fact, as HMDs have become more common, game developers and designers have begun to create games that increase awareness of life-saving skills. Among these toolsets is Relieve (Studio Evil), a science fiction adventure game published by the company that developed VR CPR [58], and an MR application in collaboration with the Italian Resuscitation Council. Other examples include Accident: The Pilot (Duality SA), Ambulance Simulator (Image Power SA), Reanimation Inc. (Nuclear Games), and Lifesaver VR app endorsed by the UK Resuscitation Council [59].

Despite growing interest in immersive simulators for CPR training, few studies have assessed their potentialities. Table 2 summarizes the main immersive VR and MR tools for first aid training. A German group has recently implemented VReanimate II, an immersive tool for first aid and reanimation training [60,61]. This application provides different modalities, including a tutorial and two levels of exercises covering different scenarios. The application was tested on users who had limited first aid experience, resulting in a 20% increase in CPR knowledge after training; this suggests that VR has a strong potential to increase functional first aid knowledge. In addition, two studies from 2019 compared VR with a video-based and tablet-based serious game application in order to assess whether people retained more knowledge when trained using the VR system [41,62]. Results showed that the VR application led to increased knowledge of CPR steps [41,62] but a worsening outcome in chest compression technique after training [62]. Altogether, literature on VR for first aid training supports the claim that such technology can be a powerful tool that increases public awareness and learning of life-saving skills, primarily due to the high level of immersivity, perceptual access to real-time scenarios, and impersonation [63]. Further, VR appears to be highly valued by both untrained and expert users who can use it in different ways: the former can learn how to react to a medical emergency, memorizing the CPR algorithm and thus acquiring communicative skills; the latter can easily and rapidly refresh previously acquired knowledge [60,62,64].

Table 2. Virtual reality and mixed reality simulations.
StudyTargetTypeSetupSkillStatusDesign (# subjects)Kirkpatrick\'s level
Blome et al [61], 2017; Bucher et al [20], 2019 VReanimateNPaVRbHTC ViveChest compression (qualitative); defibrillationTutorial and exercises modes; simple instructions without complex text; qualitative evaluationUsability (8); prepost (22)1
Wong et al [64], 2018; CPR + AEDVRHCPcVRHTC ViveCPRd algorithmTutorial and simulation modes; training on AEDe; manual skills are performed by an avatar and not by the user; qualitative evaluationUsability (30)2b
Aksoy et al [41], 2019; 3DMedSim VR-based BLSHCPVRHMDfCPR algorithmTwo modes: training which guides the trainees during the emergency and self-test; quantitative EvaluationRandomized (40)2b
Leary et al [62], 2019 VR mAppNPVRSmartphone (VR), HMD and manikin (MR)CPR algorithm; defibrillationPortable and low-cost; quantitative evaluationRandomized (103)2a
Vaughan et al [65], 2019NPVR, MRgHMD and manikin (MR) or smartphone (VR)NonePortable; proof of conceptN/AhN/A
Buttussi et al [66], 2020NPVR, MRHTC Vive and manikin (for MR only)CPR algorithm; chest compressionTraining and evaluation modes; training mode provides progressively decreasing clues; quantitative evaluationPrepost (30)2b
Semeraro et al [57], 2009 VREMHCPMRPhysical manikin, data gloves and HMDNoneProof of conceptN/AN/A
Almousa et al [67], 2019HCP, NPMRHTC Vive and physical manikinChest compression; defibrillationMultiple scenarios and increasing difficulty levels; animations controlled by a technician; qualitative evaluationUsability (20)N/A
Bench et. al [68], 2019 Code BlueNPMRHTC Vive and physical manikinChest compressionQualitative evaluation;quantitative evaluationPrepost (23)2a
Girau et al [69], 2019HCPMRHTC Vive, Leap Motion, and physical manikinNoneInteractions between the virtual patient and the trainees; proof of conceptN/AN/A
Leary et al [70], 2019 VR SCANPMRHTC Vive and physical manikin (MR)CPR; algorithmManual and vocal interaction; quantitative evaluationPrepost (119)1
Liyanage et al [71], 2019HCPMRHTC Vive, Leap Motion, and physical manikinChest compressionProof of conceptN/AN/A
Semeraro et al [58], 2019HCP, NPMRHTC Vive and physical manikinChest compressionQuantitative evaluationN/AN/A

aNP: nonprofessionals.

bVR: virtual reality.

cHCP: health care providers.

dCPR: cardiopulmonary resuscitation.

eAED: automated external defibrillator.

fHMD: head-mounted display.

gMR: mixed reality.

hN/A: not applicable.

Mixed Reality Devices

Currently, literature on virtual reality for life support training is focused on MR systems for CPR training. In other words, many research groups have been trying to “enhance” VR by combining physical elements with a virtual environment. This way, the user interaction is more realistic than by using VR alone. On the one hand, MR tools may be more desirable for life support training, given their inherent advantage of haptic feedback combined with VR; on the other hand, a recent study comparing VR and MR CPR training reported no differences relative to procedural knowledge and self-efficacy [37].

In general, MR tools (Table 2) provide realistic feedback into an immersive environment (Figure 2), being more desirable than AR. By definition, AR integrates virtual and real elements in the learner’s field of view, presenting these elements as two separate layers [72]; However, in order for a technology to be truly immersive, the human brain should not be able to determine the difference between virtual and real elements [73,74]. In this context, MR seems more appropriate since the brain can perceive the environment as it would normally do in the real world, given that all the elements of the scene are virtual [73]; in addition, users perceive haptic feedback and perform actions in a realistic way.

Figure 2. Examples of immersive tools. Left: VR application without haptic feedback. Center: MR system which combines an HMD with a manikin for a more realistic simulation experience. Right: AR application (Holo BLSD) designed to augment a physical manikin with a virtual representation [75]. AR: augmented reality; HMD: head-mounted display; MR: mixed reality; VR: virtual reality.
View this figure

The first example of an MR tool for CPR training is the virtual reality enhanced mannequin (VREM), which combines a half-body manikin with HMD, data gloves, and tracking devices [57]. During the simulation, the user is immersed in a VR environment, but at the same time, they can physically interact with the manikin, as his/her hands’ movements are tracked in real time [57]. Despite having some limitations, such as the lack of performance evaluation, VREM was the first example of MR that combined immersive VR with manikins traditionally used to teach lifesaving skills. VREM was the sole example of an MR simulator until 2018 when new developments and tools appeared. In particular, several research groups implemented MR prototypes that share the same concept of augmenting a VR application with a manikin (Table 2). All these examples combine a manikin, either half-body or full-body, with an HMD device (typically HTC Vive) and a VR application developed in Unity game engine. Despite some differences among the projects, the main idea is to overlap a manikin with its virtual representation in ways that enable trainees to be immersed in a realistic virtual environment accompanied by realistic haptic feedback (Figure 2). The majority of these tools use trackers provided by the VR setup to monitor chest compressions by virtue of their direct placement into the physical hands and/or on the wrists of learners [58,66-68]. To prevent obstruction of the user’s hands, two setups include a Leap Motion device, specifically designed to track the hands in real time [69,71,76]. Leap Motion is attached to the HMD and combines infrared cameras with light-emitting diodes. A proprietary software analyzes the frames captured to extract hand-movement information [76]. These projects are proofs of concept which do not monitor CPR performance but address different challenges of MR, such as the interaction between the user and the manikin [69] and the monitoring of user’s performance via Leap Motion data [71]. Another project [65] attempted to import an MR application designed to be used with an HMD into a Google Cardboard VR platform in order to demonstrate that MR can be used with a smartphone, thus making it even more accessible.

MR solutions highlight an important point that there is a lack of integration between VR and CPR manikin equipped with sensors. In other words, the projects aim at combining VR with physical manikins into a single learning tool, but the two parts remain disconnected, with no data-sharing between them. To overcome this limitation, some research groups used trackers to monitor performance, while others added sensors into the manikin. CPR manikins are largely distributed by a few companies, and this may have caused a lack of communication between hardware and software, suggesting an investigation into how we might better integrate these learning toolsets is necessary. Data recorded by the manikins are protected; therefore, using manikins in combination with VR requires more successful collaborations between research groups and companies. It is unclear whether companies are not interested in providing secure access to their data or, instead, if universities are not willing to share their ideas with commercial, for-profit enterprises. In any case, university and for-profit enterprise collaborations are desirable for various reasons: first, the integration of performance data with VR leads to improved user experiences, as the learner would not be required to wear additional tracking devices; further, the virtual manikin can react more accurately to maneuvers performed by the learner during first aid training. Second, CPR manikins have been used for a long time, meaning that the hardware is stable with standardized performance indexes. The use of these devices would make comparisons with traditional methods more valuable than designing custom-made manikins that require validation prior to being integrated into the VR. Additionally, VR is becoming a common technology within medical simulation environments, as it provides riskless experiences that are controlled and scaled to the user’s ability. Hence, it is likely that companies need to look further into the integration of VR into first aid training scenarios in the near future. Initiating collaborations with universities would speed up this much-needed technological evolution; in particular, commercial and nonprofit collaborations can lead to now medical training opportunities and additional profit for commercial enterprise.

Augmented Reality

Projection-Based Systems

The use of AR within the context of first aid training is a recently recognized challenge. The first AR application to CPR training combined a physical manikin with AR interactive projections [77]. Briefly, sensors located on the manikin were used to monitor chest compression, head position, and airflow; an RGB-D (red, green, blue-depth) camera recorded the user’s position. Finally, a realistic scenario was projected in the simulation room to increase realism and immersivity. This system combined data from the camera and the manikin, giving real-time feedback about the trainee’s performance and position. Similarly, Kwon [78] implemented a portable version of the above prototype where projections are replaced by a mobile phone screen. However, the study did not include any demographic information for study participants; therefore, it is not known whether novice or expert learners can benefit from the AR projections in similar ways.

Low-Cost Prototypes

There is increasing awareness that first aid training should be affordable and easy to access, given that a medical emergency can occur anywhere, at any time. Also, CPR training should be tailored to the audience, with high-fidelity, highly functional simulations designed for HCPs in simulation centers and low-cost solutions devoted to the general population or to guarantee optimal training in low-income countries and rural areas. Within the foregoing contexts, some recent proofs of concept have appeared even though validation studies assessing the efficacy of such ideas are still missing. In 2016, Philips presented a low-cost project for automated external defibrillator placement training [79]. The system included a cloth sheet representation of a patient and a camera that monitored the correct positioning of the electrode pads. Feedback on the pads’ location and hand position were shown on a monitor. The rationale behind the project was that an effective CPR response in untrained personnel should be automatic and related to muscle memory rather than abstract cognitive learning. In this model, resistance that mimics chest stiffness should be included, in addition to hand and pad positioning. A more recent study presented the first prototype of an AR application usable with a smartphone [80]. The system combined two markers with a pillow mimicking the chest via a mobile application and a smartphone. The application computes chest compression depth and rate using markers and projects information via smartphone to a body over the pillow, blending the digital body into the real world. Altogether, studies showing the potentialities of low-cost AR applications suggest that further validation and efficacy studies are required prior to using these systems for CPR training. As an example, [80] have neither tested the system with experts nor compared their system with a traditional manikin. Hence, it is difficult to foresee the near-term role that these applications may play in increasing CPR knowledge among the general population.

Optical See-Through Applications

In recent years the majority of research studies have focused on AR in emergency training designed applications, taking advantage of optical see-through AR devices like the Microsoft HoloLens and Google Glass (Figure 2) [75,81-86]. AR-based tools can be divided into (1) applications that assist a user who needs to perform a life-saving task [81,85] and (2) applications that augment the simulation experience with virtual elements, giving real-time performance feedback during training [75,82,83]. The first group of tools aims at shortening the rescue time through cues appearing in an emergency setting. So far, in the latter context, experimental study results have been controversial. Siebert [81] compared the time required to provide defibrillation in two groups of pediatric residents. The first group could follow the pediatric advanced life support algorithm on a pocket reference card; the second group used Google Glasses to access the same information. Results show a similar shocking time in the two groups, but a better defibrillation dose delivered by residents using Google Glasses. Conversely, a study carried out on untrained subjects revealed that participants wearing HoloLens reacted faster and better than those having access to an instruction checklist on a tablet [85]. One possible explanation for these results is that AR may be beneficial for novice learners who do not have any previous experience with algorithms and instructions; however, HCPs may get distracted by information appearing in their field of view because they may look for confirmation of their prior knowledge [87]. Another variable may be that health professionals are familiar with the checklists. All of this suggests that AR could be a valuable tool for novice first aid rescuers and could be included in first aid kits. Indeed, further studies are required to (1) assess the acceptance rate of AR among the general population, (2) define its benefits and limitations, and (3) determine whether the efficient use of optical see-through systems to perform lifesaving tasks requires training.

Another class of AR-based applications includes CPR trainers that provide real-time feedback on users’ performance during simulations by combining a real manikin with AR optical see-through devices. Recently, two research groups have implemented similar tools: HoloBLSD [75,86] and CPReality [82,84]. HoloBLSD is a self-instruction basic life support defibrillation trainer having three modalities: learning, rehearsal, and evaluation, allowing the user to practice prior to evaluation [75,86]. CPReality is intended for hands-only CPR training; briefly, information on chest compression is measured by the manikin and integrated into the AR application, which displays, in real time, how the blood flows into the circulatory system as a result of the compression [82]. Both systems have been recently tested among HCPs, comparing the performance of participants who use AR with the performance of subjects undergoing traditional manikin-based training [70,86]. Results show that both HoloBSLD and CPReality lead to performance outcomes similar to those obtained with traditional training methods [84,86]. From a theoretical standpoint, self-learning AR tools can be at the minimum comparable to traditional training methods. However, one important factor should be taken into account: the biggest difference between instructor-guided courses and self-learning is the customization of the courses based on the learner's difficulties and abilities (ie, individualized learning). In particular, during a traditional course, an instructor can adjust the content of a simulation according to audience needs. This means tailoring courses to the audience’s skills, needs, and background. For this reason, it is important to further investigate the role of personalized training as to its impact on learning and retention outcomes. At this time, no current available AR or VR tools provide personalized and self-adjustable programs, as opposed to instructor-led training.


This review has summarized the main scientific studies related to first aid training using VR and AR. Some of the prototypes investigated have been designed by medical groups, others by technicians. Some of the prototypes focus on leadership and teamwork training, and others have been implemented to enhance the practice of manual skills.

The analysis of the existing AR- and VR-based systems has helped us to identify the primary features that a simulator should have in order to increase individualized outcomes. These studies highlight the importance of choosing the end user prior to defining the main features of a training toolset. In fact, nonprofessionals have little to no medical background, whereas medical students and HCPs require advanced training. Also, the general public is trained at far less frequent rates than medical caregivers. The general public needs more and better information—both theoretical and practical—in learning how to deal with stressful medical emergency situations without the immediate aid of a medical professional. Advanced life support instead requires coordination and cooperation, with everyone involved performing as optimally as possible (Textbox 2).

Main features an augmented reality or virtual reality-based simulator should have according to its users and purpose.

Nonprofessional:

  • Procedures:
    • Environmental safety
    • Chain of survival activation
    • Cardiopulmonary resuscitation performance
    • Automatic medical instrument management
  • Training:
    • Knowledge of procedures
    • Stress management
    • Manual skills
  • Assessment:
    • Guarantee safety
    • Procedure correct execution
    • Manual skills.

Health care providers:

  • Procedures
    • Environmental safety
    • Basic life support defibrillator
    • Advanced life support
    • Manual instrument management
    • Diagnostic skills in emergency
    • Invasive procedures performance
    • Drugs administration
  • Training:
    • Crisis resource management
    • Stress management
    • Familiarity with instruments
    • Procedure knowledge
    • Manual skills
    • Diagnostic skills
    • Drugs management
    • Teamwork
  • Assessment:
    • Guarantee safety
    • Procedure correct execution
    • Ability in performing invasive procedures
    • Diagnostic performance
    • Decision making
    • Drugs effects and indication knowledge
Textbox 2. Main features an augmented reality or virtual reality-based simulator should have according to its users and purpose.

Aside from defining the end user, it is important to establish whether the simulation tool is intended for training, assessment, or both, as training and evaluation tools should have different features. For instance, a training tool used by nonmedical learners should include information about how to communicate with paramedics or where to place one’s hands to optimally perform chest compression (Textbox 2). An evaluation instrument should simulate an emergency occurring in a nonhospital setting, also including distractors. In addition, chest compression should be assessed in a quantitative way, measuring compression rate, depth, and recoil. A simulator for HCPs should include pathology and pharmacology notions, as well as diagnostic skills used in emergency and invasive procedures performance (Textbox 2).

At the present time, we are unable to find a clear distinction between nonmedical and training and assessment tools. We believe this is a crucial point in order to effectively design AR/VR-based simulators for life support training. In fact, instructors should tailor the content they are delivering to their audience, in the same way first aid tools should be adapted to the end users, in order to guarantee engaging and challenging training.

A distinctive feature of simulation toolsets is the ability to train small groups of medical students, either in person or via distance learning; this is important for three reasons. First, every participant can take a specific, assigned role during the training. Presently, several multiplayer serious games have been implemented and introduced as medical training tools [32,44,45,48]; further, few multiplayer VR platforms with multiple cases designed for HCPs are available (eg, SimX, OMS Interprofessional, and ORama VR). Still, multiplayer AR and MR tools have not yet been designed. Second, the debriefing phase following the simulation training is more effective if the clinical case study is analyzed from multiple perspectives [88-92]. The majority of the studies we analyzed did not consider the possibility of providing the debriefing phase via the simulator itself, other than giving performance scores or video recordings of the simulation. We believe this would be a feature that would innovate medical simulation as an optimal training strongly affected by an organized debriefing phase that takes into consideration learner’s performance, errors, divergent behaviors, and user experience. Thirdly, at the time of writing, the way medical education is delivered has strongly changed due to the COVID-19 pandemic. Changes include the need to train smaller groups of students, thus replicating the same clinical case scenarios multiple times, and the need to deliver content online, taking advantage of distance learning but maintaining the same level of content quality and engagement. Another point to consider is the importance of designing AR- and VR-based simulators providing haptic feedback and monitoring the user’s manual skills. Among the basic tasks a user needs to perform during first aid, there is chest compression and bag-mask ventilation, in addition to more complex task knowledge required by HCPs (eg, invasive procedures, drugs administration, etc). At present, performance monitoring is sparse and typically limited to hands-only CPR [53,54,57,67,75]. Indeed, research studies in the field should focus more on realistic feedback and performance monitoring systems, considering all the maneuvers associated with optimal first aid.

Importantly, it is also necessary to carry out detailed learning outcome studies aimed at assessing whether AR- and VR-based systems are comparable to traditional training methods. In fact, if VR is equivalent to traditional methods, medical simulation can benefit from VR in terms of setting space, flexibility, and training time. This review indicates that many research studies report proof of concepts without comparing them to the most popular in-use manikin-based simulators [93,94]; specifically, very few studies compared VR/AR tools with traditional training methods, reporting controversial or inconsistent results.


Research on VR and AR for basic and advanced life support training is heterogeneous in terms of users, type of technology, experimental design, and metrics. Analysis of the existing studies revealed the importance of defining the end user and the purpose of the simulator during the design phase, as professionals and nonprofessionals need to learn different skills. Also, this review highlights a few limitations of the current devices that should be addressed to improve the learning outcome. These include the possibility to develop multiplayer tools, the inclusion of the debriefing phase within the simulation, the ability to monitor users’ performance, and the possibility to provide realistic haptic feedback. In this context, standardized tests are required to assess the benefits of new technologies in life support and, more generally, in medical training.

Acknowledgments

The authors thank Simone Marcutti for his help on the VR-AR terminology and Mr Sanford Forte for proofreading the manuscript. This work was partially supported by the operative program Por FSE Regione Liguria 2014-2020 RLOF18ASSRIC/17/1, by the Ministry of Science and Technology, Israel (Joint Israel-Italy Lab in Biorobotics Artificial Somatosensation for Humans and Humanoids) and by the program Erasmus+ KA201 Strategic Partnerships for School Education, First Aid Improve Survival.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Supplementary materials.

DOC File , 1950 KB

  1. Bagai A, McNally BF, Al-Khatib SM, Myers JB, Kim S, Karlsson L, et al. Temporal differences in out-of-hospital cardiac arrest incidence and survival. Circulation 2013 Dec 17;128(24):2595-2602. [CrossRef] [Medline]
  2. Rea TD, Helbock M, Perry S, Garcia M, Cloyd D, Becker L, et al. Increasing use of cardiopulmonary resuscitation during out-of-hospital ventricular fibrillation arrest: survival implications of guideline changes. Circulation 2006 Dec 19;114(25):2760-2765. [CrossRef] [Medline]
  3. Ponder M, Herbelin B, Molet T, Scherteneib S, Ulicny B, Papagiannakis G, et al. Interactive scenario immersion: Health emergency decision training in JUST project. 2002 Presented at: VRMHR Conf; 2002; Lausanne. [CrossRef]
  4. Gaba DM. The future vision of simulation in health care. Qual Saf Health Care 2004 Oct;13 Suppl 1:2-10 [FREE Full text] [CrossRef] [Medline]
  5. Jacobson M, Kozma R. Innovations in science and mathematics education: Advanced designs for technologies of learning. Mahwah: Advanced designs for technologies of learning. Routledge; 2012.
  6. Caro V, Carter B, Dagli S, Schissler M, Millunchick J. Can virtual reality enhance learning: A case study in materials science. Can virtual reality enhance learning: A case study in materials science. 2018 IEEE Front Educ Conf IEEE; 2018 Presented at: IEEE Front Educ Conf; 2018; San Jose, CA p. 1-4. [CrossRef]
  7. Gunn T, Jones L, Bridge P, Rowntree P, Nissen L. The use of virtual reality simulation to improve technical skill in the undergraduate medical imaging student. Interactive Learning Environments 2017 Sep 14;26(5):613-620. [CrossRef]
  8. Dede C. Immersive Interfaces for Engagement and Learning. American Association for the Advancement of Science 2009 Jan 02;323(5910):66-69. [CrossRef]
  9. Fernandez GL, Page DW, Coe NP, Lee PC, Patterson LA, Skylizard L, et al. Boot cAMP: educational outcomes after 4 successive years of preparatory simulation-based training at onset of internship. J Surg Educ 2012 Mar;69(2):242-248. [CrossRef] [Medline]
  10. Peyre SE, Peyre CG, Sullivan ME, Towfigh S. A surgical skills elective can improve student confidence prior to internship. J Surg Res 2006 Jun 01;133(1):11-15. [CrossRef] [Medline]
  11. Zeng W, Woodhouse J, Brunt LM. Do preclinical background and clerkship experiences impact skills performance in an accelerated internship preparation course for senior medical students? Surgery 2010 Oct;148(4):768-777. [CrossRef]
  12. Kirkpatrick D, Kirkpatrick J. Transferring Learning to Behavior: Using the Four Levels to Improve Performance. San Francisco: Berrett-Koehler Publishers; 2005.
  13. Mosley C, Dewhurst C, Molloy S, Shaw B. What is the impact of structured resuscitation training on healthcare practitioners, their clients and the wider service? A BEME systematic review. UK: Med Teach Taylor & Francis; 2012:349-385.
  14. Ma M, Zheng H. Virtual reality and serious games in healthcare. Adv Comput Intell Paradig Healthc 6 Virtual Real Psychother Rehabil Assess Springer.? 2011:169-192. [CrossRef]
  15. Sharples S, Cobb S, Moody A, Wilson J. Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems. Amsterdam: Elsevier; 2008:58-69.
  16. Anthes C, García-Hernández R, Wiedemann M, Kranzlmüller D. State of the art of virtual reality technology. 2016 Presented at: IEEE Aerosp Conf; 2016; Big Sky, Montana p. 1-19. [CrossRef]
  17. Billinghurst M, Kato H. Collaborative mixed reality. 1999 Presented at: First Int Symp Mix Real; 1999; Yokohama, Japan p. 261-284. [CrossRef]
  18. Hoenig W, Milanes C, Scaria L, Phan T, Bolas M, Ayanian N. Mixed reality for robotics. 2015 Presented at: IEEE/RSJ Int Conf Intell Robot Syst IEEE; 2015; Hamburg, Germany p. 5382-5387. [CrossRef]
  19. Couture N, Rivière G, Reuter P. Tangible interaction in mixed reality systems. Eng Mix Real Syst Springer 2010:101-120. [CrossRef]
  20. Azuma RT. A Survey of Augmented Reality. Presence: Teleoperators & Virtual Environments 1997 Aug;6(4):355-385. [CrossRef]
  21. Van Krevelen D, Poelman R. A Survey of Augmented Reality Technologies, Applications and Limitations. IJVR 2010 Jan 01;9(2):1-20. [CrossRef]
  22. Holliman N, Dodgson N, Favalora G, Pockett L. Three-dimensional displays: a review and applications analysis. IEEE Trans Broadcast 2011:362-371. [CrossRef]
  23. Cutolo F, Cattari N, Fontana U, Ferrari V. Optical See-Through Head-Mounted Displays With Short Focal Distance: Conditions for Mitigating Parallax-Related Registration Error. Front. Robot. AI 2020 Dec 4;7:196. [CrossRef]
  24. Abt C. Serious games. Lanham, Maryland: University press of America; 1987.
  25. Stokes B. Videogames have changed: time to considerserious games. Dev Educ J 2005;11(3):12.
  26. Bergeron B. Developing serious games (game development series). Newton Center: Charles River Media; 2005.
  27. Gorbanev I, Agudelo-Londoño S, González RA, Cortes A, Pomares A, Delgadillo V, et al. A systematic review of serious games in medical education: quality of evidence and pedagogical strategy. Med Educ Online 2018 Dec;23(1):1438718 [FREE Full text] [CrossRef] [Medline]
  28. Graafland M, Schraagen J, Schijven M. Systematic review of validity of serious games for medical education and surgical skills training. Br J Surg 2012;99:1322-1330. [CrossRef]
  29. Spellberg B, Harrington D, Black S, Sue D, Stringer W, Witt M. Capturing the diagnosis: an internal medicine education program to improve documentation. Am J Med Elsevier 2013;126(8):739-743. [CrossRef]
  30. Bedwell W, Pavlas D, Heyne K, Lazzara E, Salas E. Toward a Taxonomy Linking Game Attributes to Learning. Simulation and Gaming 2012 May 14;43(6):729-760. [CrossRef]
  31. Ricciardi F, De Paolis LT. A Comprehensive Review of Serious Games in Health Professions. International Journal of Computer Games Technology 2014;2014:1-11. [CrossRef]
  32. Youngblood P, Harter PM, Srivastava S, Moffett S, Heinrichs WL, Dev P. Design, development, and evaluation of an online virtual emergency department for training trauma teams. Simul Healthc 2008;3(3):146-153. [CrossRef] [Medline]
  33. Creutzfeldt J, Hedman L, Felländer-Tsai L. Effects of pre-training using serious game technology on CPR performance--an exploratory quasi-experimental transfer study. Scand J Trauma Resusc Emerg Med 2012 Dec 06;20:79 [FREE Full text] [CrossRef] [Medline]
  34. Buttussi F, Pellis T, Cabas Vidani A, Pausler D, Carchietti E, Chittaro L. Evaluation of a 3D serious game for advanced life support retraining. International Journal of Medical Informatics 2013 Sep;82(9):798-809. [CrossRef]
  35. Ribeiro C, Tiago J, Monteiro M, Pereira J. SeGTE: A serious game to train and evaluate basic life support. 2014 Presented at: Int Conf Comput Graph Theory Appl; 2014; Lisbon, Portugal p. 1-7. [CrossRef]
  36. Vankipuram A, Khanal P, Ashby A, Vankipuram M, Gupta A, DrummGurnee D, et al. Design and development of a virtual reality simulator for advanced cardiac life support training. IEEE J Biomed Health Inform 2014 Jul;18(4):1478-1484. [CrossRef] [Medline]
  37. Boada I, Rodriguez-Benitez A, Garcia-Gonzalez JM, Olivet J, Carreras V, Sbert M. Using a serious game to complement CPR instruction in a nurse faculty. Computer Methods and Programs in Biomedicine 2015 Nov;122(2):282-291. [CrossRef]
  38. Drummond D, Delval P, Abdenouri S, Truchot J, Ceccaldi P, Plaisance P, et al. Serious game versus online course for pretraining medical students before a simulation-based mastery learning course on cardiopulmonary resuscitation: A randomised controlled study. Eur J Anaesthesiol 2017 Dec;34(12):836-844. [CrossRef] [Medline]
  39. Latif M, Ajmal M, Ahmad F, Alam J, Saleem A. LA-VIE: A serious game for cardiopulmonary resuscitation. 2017 Presented at: IEEE 5th Int Conf Serious Games Appl Heal; 2017; USA p. 1-5. [CrossRef]
  40. Gerard JM, Scalzo AJ, Borgman MA, Watson CM, Byrnes CE, Chang TP, et al. Validity Evidence for a Serious Game to Assess Performance on Critical Pediatric Emergency Medicine Scenarios. Simul Healthc 2018 Jun;13(3):168-180. [CrossRef] [Medline]
  41. Aksoy E. Comparing the Effects on Learning Outcomes of Tablet-Based and Virtual Reality-Based Serious Gaming Modules for Basic Life Support Training: Randomized Trial. JMIR Serious Games 2019 May 01;7(2):13442 [FREE Full text] [CrossRef] [Medline]
  42. Vidani A, Chittaro L, Carchietti E. Assessing Nurses? Acceptance of a Serious Game for Emergency Medical Services. 2010 Presented at: Second Int Conf Games Virtual Worlds Serious Appl; 2010; Braga p. 101-108. [CrossRef]
  43. Sitzmann T. A meta-analytic examination of the instructional effectiveness of computer?based simulation games. Pers Psychol Wiley Online Library 2011;64(2):489-528. [CrossRef]
  44. Creutzfeldt J, Hedman L, Felländer-Tsai L. Cardiopulmonary Resuscitation Training by Avatars: A Qualitative Study of Medical Students' Experiences Using a Multiplayer Virtual World. JMIR Serious Games 2016 Dec 16;4(2):22 [FREE Full text] [CrossRef] [Medline]
  45. Khanal P, Vankipuram A, Ashby A, Vankipuram M, Gupta A, Drumm-Gurnee D, et al. Collaborative virtual reality based advanced cardiac life support training simulator using virtual reality principles. J Biomed Inform 2014 Oct;51:49-59 [FREE Full text] [CrossRef] [Medline]
  46. Creutzfeldt J, Hedman L, Medin C, Heinrichs WL, Felländer-Tsai L. Exploring virtual worlds for scenario-based repeated team training of cardiopulmonary resuscitation in medical students. J Med Internet Res 2010 Sep 03;12(3):38 [FREE Full text] [CrossRef] [Medline]
  47. Creutzfeldt J, Hedman L, Felländer-Tsai L. Using Virtual World Training to Increase Situation Awareness during Cardiopulmonary Resuscitation. Stud Health Technol Inform 2014;196:83-85. [Medline]
  48. LeRoy Heinrichs W, Youngblood P, Harter PM, Dev P. Simulation for team training and assessment: case studies of online training with virtual worlds. World J Surg 2008 Feb;32(2):161-170 [FREE Full text] [CrossRef] [Medline]
  49. Khanal P, Kahol K. Interactive haptic virtual collaborative training simulator to retain CPR skills. 2011 Presented at: Int Conf Ambient Media Syst Springer; 2011; Switzerland p. 70-77. [CrossRef]
  50. Thidemann I, Söderhamn O. High-fidelity simulation among bachelor students in simulation groups and use of different roles. Nurse Educ Today 2013 Dec;33(12):1599-1604. [CrossRef] [Medline]
  51. Banerjee A, Slagle JM, Mercaldo ND, Booker R, Miller A, France DJ, et al. A simulation-based curriculum to introduce key teamwork principles to entering medical students. BMC Med Educ 2016 Nov 16;16(1):295 [FREE Full text] [CrossRef] [Medline]
  52. Rushton MA, Drumm IA, Campion SP, O'Hare JJ. The Use of Immersive and Virtual Reality Technologies to Enable Nursing Students to Experience Scenario-Based, Basic Life Support Training-Exploring the Impact on Confidence and Skills. Comput Inform Nurs 2020 Jun;38(6):281-293. [CrossRef] [Medline]
  53. Morrison-Smith S, Yao H, Wang I, Lok B, Ruiz J. Staying Alive With Virtual Humans. 2018 Presented at: CHI Conf Hum Factors Comput Syst; 2018; Montreal, Canada p. 1-6. [CrossRef]
  54. Tian Y, Raghuraman S, Yang Y, Guo X, Prabhakaran B. 3d immersive cardiopulmonary resuscitation (cpr) trainer. 2014 Presented at: 22nd ACM Int Conf Multimed; 2014; Orlando, USA p. 749-750. [CrossRef]
  55. Stansfield S, Shawver D, Sobel A. A prototype VR system for training medical first responders. MediSim: A prototype VR system for training medical first responders. Proceedings IEEE 1998 Virtual Real Annu Int Symp (Cat No 98CB36180) IEEE; 1998 Presented at: IEEE Virtual Real Annu Int Symp; 1998; Atlanta, Georgia, USA p. 198-205. [CrossRef]
  56. Stansfield S, Shawver D, Sobel A, Prasad M, Tapia L. Design and Implementation of a Virtual Reality System and Its Application to Training Medical First Responders. Presence: Teleoperators & Virtual Environments 2000 Dec;9(6):524-556. [CrossRef]
  57. Semeraro F, Frisoli A, Bergamasco M, Cerchiari EL. Virtual reality enhanced mannequin (VREM) that is well received by resuscitation experts. Resuscitation 2009 Apr;80(4):489-492. [CrossRef] [Medline]
  58. Semeraro F, Ristagno G, Giulini G, Gnudi T, Kayal JS, Monesi A, et al. Virtual reality cardiopulmonary resuscitation (CPR): Comparison with a standard CPR training mannequin. Resuscitation 2019 Feb;135:234-235. [CrossRef] [Medline]
  59. Nas J, Thannhauser J, Vart P, van Geuns R, van Royen N, Bonnes JL, et al. Rationale and design of the Lowlands Saves Lives trial: a randomised trial to compare CPR quality and long-term attitude towards CPR performance between face-to-face and virtual reality training with the Lifesaver VR app. BMJ Open 2019 Nov 21;9(11):e033648 [FREE Full text] [CrossRef] [Medline]
  60. Bucher K, Blome T, Rudolph S, von MS. VReanimate II: training first aid and reanimation in virtual reality. J Comput Educ Springer 2019;6(1):53-78. [CrossRef]
  61. Blome T, Diefenbach A, Rudolph S, Bucher K, von MS. VReanimate Non-verbal guidance and learning in virtual reality. 2017 Presented at: 9th Int Conf Virtual Worlds Games Serious Appl IEEE; 2017; Athens, Greece p. 23-30. [CrossRef]
  62. Leary M, McGovern SK, Chaudhary Z, Patel J, Abella BS, Blewer AL. Comparing bystander response to a sudden cardiac arrest using a virtual reality CPR training mobile app versus a standard CPR training mobile app. Resuscitation 2019 Jun;139:167-173. [CrossRef] [Medline]
  63. Bandura A. Social foundations of thought and action. NJ: Englewood Cliffs; 1986:23-28.
  64. Wong M, Chue S, Jong M, Benny HWK, Zary N. Clinical instructors' perceptions of virtual reality in health professionals' cardiopulmonary resuscitation education. SAGE Open Med 2018;6 [FREE Full text] [CrossRef] [Medline]
  65. Vaughan N, John N, Rees N. CPR Virtual Reality Training Simulator for Schools. 2019 Presented at: Int Conf Cyberworlds IEEE; 2019; Kyoto, Japan p. 25-28. [CrossRef]
  66. Buttussi F, Chittaro L, Valent F. A virtual reality methodology for cardiopulmonary resuscitation training with and without a physical mannequin. J Biomed Inform 2020 Nov;111:103590. [CrossRef] [Medline]
  67. Almousa O, Prates J, Yeslam N, Mac Gregor D, Zhang J, Phan V, et al. Virtual Reality Simulation Technology for Cardiopulmonary Resuscitation Training: An Innovative Hybrid System With Haptic Feedback. Simulation and Gaming 2019 Jan 02;50(1):6-22. [CrossRef]
  68. Bench S, Winter C, Francis G. Use of a Virtual Reality Device for Basic Life Support Training: Prototype Testing and an Exploration of Users' Views and Experience. Simul Healthc 2019 Oct;14(5):287-292. [CrossRef] [Medline]
  69. Girau E, Mura F, Bazurro S, Casadio M, Chirico M, Solari F, et al. A Mixed Reality system for the simulation of emergency and first-aid scenarios. 2019 Jul Presented at: Annu Int Conf IEEE Eng Med Biol Soc; 2019; Berlin, Germany p. 5690-5695. [CrossRef]
  70. Leary M, Almodovar A, Buckler DG, Bhardwaj A, Blewer AL, Abella BS. Using an Immersive Virtual Reality System to Assess Lay Provider Response to an Unannounced Simulated Sudden Cardiac Arrest in the Out-of-Hospital Setting. Simul Healthc 2019 Apr;14(2):82-89. [CrossRef] [Medline]
  71. Liyanage S, Jayaratne L, Wickrarnasinghe M, Munasinghe A. Towards an Affordable Virtual Reality Solution for Cardiopulmonary Resuscitation Training. 2019 Presented at: IEEE Conf Virtual Real 3D User Interfaces IEEE; 2019; Osaka, Japan p. 1054-1055. [CrossRef]
  72. Azuma R. Tracking requirements for augmented reality. Commun ACM Association for Computing Machinery 1993 Jul;36(7):50-52. [CrossRef]
  73. Sherman WR, Craig AB. Understanding virtual reality. San Francisco: Morgan Kauffman Elsevier; 2003.
  74. Jennett C, Cox AL, Cairns P, Dhoparee S, Epps A, Tijs T, et al. Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies 2008 Sep;66(9):641-661. [CrossRef]
  75. Ingrassia PL, Mormando G, Giudici E, Strada F, Carfagna F, Lamberti F, et al. Augmented Reality Learning Environment for Basic Life Support and Defibrillation Training: Usability Study. J Med Internet Res 2020 May 12;22(5):e14910 [FREE Full text] [CrossRef] [Medline]
  76. Smeragliuolo AH, Hill NJ, Disla L, Putrino D. Validation of the Leap Motion Controller using markered motion capture technology. J Biomech 2016 Jun 14;49(9):1742-1750. [CrossRef] [Medline]
  77. Park N, Kwon Y, Lee S, Woo W, Jeong J. Projected AR-Based Interactive CPR Simulator. 2013 Presented at: Int Conf Virtual, Augment Mix Real Springer; 2013; Las Vegas, NV, ISA p. 83-89. [CrossRef]
  78. Kwon Y, Lee S, Jeong J, Kim W. HeartiSense: a novel approach to enable effective basic life support training without an instructor. 2014 Presented at: Hum Factors Comput Syst; 2014; Toronto, Ontario, Canada p. 1699-1704. [CrossRef]
  79. Djajadiningrat T, Lui P, Chao P, Richard C. Virtual Trainer: A Low Cost AR Simulation of a Sudden Cardiac Arrest Emergency. 2016 Presented at: ACM Conf Des Interact Syst; 2016; New York, USA p. 607-618. [CrossRef]
  80. boonbrahm P, Kaewrat C, Boonbrahm S. Interactive Marker-based Augmented Reality for CPR Training. IJTech 2019 Nov 27;10(7):1326-1334. [CrossRef]
  81. Siebert JN, Ehrler F, Gervaix A, Haddad K, Lacroix L, Schrurs P, et al. Adherence to AHA Guidelines When Adapted for Augmented Reality Glasses for Assisted Pediatric Cardiopulmonary Resuscitation: A Randomized Controlled Trial. J Med Internet Res 2017 May 29;19(5):e183 [FREE Full text] [CrossRef] [Medline]
  82. Balian S, McGovern SK, Abella BS, Blewer AL, Leary M. Feasibility of an augmented reality cardiopulmonary resuscitation training system for health care providers. Heliyon 2019 Aug;5(8):e02205 [FREE Full text] [CrossRef] [Medline]
  83. Kwon C, Kim D. A Comparative Study on the Effectiveness of the Training System of an Augmented Reality-based Automated External Defibrillator with an added Tactile Sense. Int J Innov Technol Explor Eng 2019;8(8):1091-1096.
  84. Leary M, McGovern SK, Balian S, Abella BS, Blewer AL. A Pilot Study of CPR Quality Comparing an Augmented Reality Application vs. a Standard Audio-Visual Feedback Manikin. Front. Digit. Health 2020 Feb 28;2:1. [CrossRef]
  85. Johnson J, Rodrigues D, Gubbala M, Weibel N. Holocpr: Designing and evaluating a mixed reality interface for time-critical emergencies. 2018 Presented at: 12th EAI Int Conf Pervasive Comput Technol Healthc; 2018; New York, USA p. 67-76. [CrossRef]
  86. Strada F, Bottino A, Lamberti F, Mormando G, Ingrassia PL. Holo-BLSD – A Holographic Tool for Self-training and Self-Evaluation of Emergency Response Skills. IEEE Trans. Emerg. Topics Comput 2021 Jul 1;9(3):1581-1595. [CrossRef]
  87. Drummond D, Arnaud C, Guedj R, Duguet A, de SN, Petit A. Google Glass for residents dealing with pediatric cardiopulmonary arrest: A randomized, controlled, simulation-based study. Pediatr Crit Care Med 2017:120-127. [CrossRef]
  88. Bajaj K, Meguerdichian M, Thoma B, Huang S, Eppich W, Cheng A. The PEARLS Healthcare Debriefing Tool. Academic Medicine 2018;93(2):336. [CrossRef]
  89. Dieckmann P, Molin Friis S, Lippert A, Ostergaard D. The art and science of debriefing in simulation: Ideal and practice. Med Teach 2009 Jul;31(7):287-294. [CrossRef] [Medline]
  90. Jaye P, Thomas L, Reedy G. The Diamons: a structure for simulation debrief. Clin Teach 2015 Jun;12(3):171-175 [FREE Full text] [CrossRef] [Medline]
  91. Nyström S, Dahlberg J, Edelbring S, Hult H, Dahlgren M. Debriefing practices in interprofessional simulation with students: a sociomaterial perspective. BMC Med Educ 2016;16:1-8 [FREE Full text] [CrossRef] [Medline]
  92. Shinnick M, Woo M, Horwich T, Steadman R. The most important component in simulation? Clin Simul Nurs 2011;7(3):105-111. [CrossRef]
  93. Sidi A, Gravenstein N, Lampotang S. Construct Validity and Generalizability of Simulation-Based Objective Structured Clinical Examination Scenarios. J Grad Med Educ 2014 Sep;6(3):489-494 [FREE Full text] [CrossRef] [Medline]
  94. Chiu M, Tarshis J, Antoniou A, Bosma TL, Burjorjee JE, Cowie N, et al. Simulation-based assessment of anesthesiology residents' competence: development and implementation of the Canadian National Anesthesiology Simulation Curriculum (CanNASC). Can J Anaesth 2016 Dec;63(12):1357-1363. [CrossRef] [Medline]


ALS: advanced life support
AR: augmented reality
CPR: cardiopulmonary resuscitation
HCP: health care provider
HMD: head-mounted display
MR: mixed reality
VR: virtual reality
VREM: virtual reality enhanced mannequin


Edited by N Zary; submitted 08.03.21; peer-reviewed by N Moore, D Drummond; comments to author 29.03.21; revised version received 15.06.21; accepted 03.12.21; published 23.03.22

Copyright

©Serena Ricci, Andrea Calandrino, Giacomo Borgonovo, Marco Chirico, Maura Casadio. Originally published in JMIR Serious Games (https://games.jmir.org), 23.03.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.