This paper is in the following e-collection/theme issue:

Games for Rehabilitation (87) Extended Reality, Virtual Reality and Virtual Worlds (509) Cognitive and Neurorehabilitation (236) Serious Games for Health and Medicine (641) Human Factors and Usability Case Studies (739) Emerging Technologies for Rehabilitation (241) Gamification (116) Virtual Reality Interventions in Mental Health (109)

Published on in Vol 10, No 2 (2022): Apr-Jun

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/34884, first published .
Effects of Virtual Reality–Based Multimodal Audio-Tactile Cueing in Patients With Spatial Attention Deficits: Pilot Usability Study

Effects of Virtual Reality–Based Multimodal Audio-Tactile Cueing in Patients With Spatial Attention Deficits: Pilot Usability Study

Effects of Virtual Reality–Based Multimodal Audio-Tactile Cueing in Patients With Spatial Attention Deficits: Pilot Usability Study

Authors of this article:

Samuel Elia Johannes Knobel1 Author Orcid Image ;   Brigitte Charlotte Kaufmann2 Author Orcid Image ;   Nora Geiser3 Author Orcid Image ;   Stephan Moreno Gerber1 Author Orcid Image ;   René M Müri1, 4, 5 Author Orcid Image ;   Tobias Nef1, 5, 6 Author Orcid Image ;   Thomas Nyffeler1, 3, 4, 5 Author Orcid Image ;   Dario Cazzoli1, 3, 7 Author Orcid Image
Article Authors Cited by (2) Tweetations (5) Metrics

    Original Paper

    1Gerontechnology & Rehabilitation Group, University of Bern, Bern, Switzerland

    2Sorbonne Université, Institut du Cerveau - Paris Brain Institute (ICM), Inserm, Centre national de la recherche scientifique, Hôpital de la Pitié-Salpêtrière, Paris, France

    3Neurocenter, Luzerner Kantonsspital, Luzern, Switzerland

    4Perception and Eye Movement Laboratory, Departments of Neurology and BioMedical Research, Inselspital, Bern University Hospital, Bern, Switzerland

    5Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland

    6ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland

    7Institute of Psychology, University of Bern, Bern, Switzerland

    Corresponding Author:

    Dario Cazzoli, PhD, PD

    Neurocenter

    Luzerner Kantonsspital

    Spitalstrasse

    Luzern, 6004

    Switzerland

    Phone: 41 205 56 86

    Email: dario.cazzoli@luks.ch


    Background: Virtual reality (VR) devices are increasingly being used in medicine and other areas for a broad spectrum of applications. One of the possible applications of VR involves the creation of an environment manipulated in a way that helps patients with disturbances in the spatial allocation of visual attention (so-called hemispatial neglect). One approach to ameliorate neglect is to apply cross-modal cues (ie, cues in sensory modalities other than the visual one, eg, auditory and tactile) to guide visual attention toward the neglected space. So far, no study has investigated the effects of audio-tactile cues in VR on the spatial deployment of visual attention in neglect patients.

    Objective: This pilot study aimed to investigate the feasibility and usability of multimodal (audio-tactile) cueing, as implemented in a 3D VR setting, in patients with neglect, and obtain preliminary results concerning the effects of different types of cues on visual attention allocation compared with noncued conditions.

    Methods: Patients were placed in a virtual environment using a head-mounted display (HMD). The inlay of the HMD was equipped to deliver tactile feedback to the forehead. The task was to find and flag appearing birds. The birds could appear at 4 different presentation angles (lateral and paracentral on the left and right sides), and with (auditory, tactile, or audio-tactile cue) or without (no cue) a spatially meaningful cue. The task usability and feasibility, and 2 simple in-task measures (performance and early orientation) were assessed in 12 right-hemispheric stroke patients with neglect (5 with and 7 without additional somatosensory impairment).

    Results: The new VR setup showed high usability (mean score 10.2, SD 1.85; maximum score 12) and no relevant side effects (mean score 0.833, SD 0.834; maximum score 21). A repeated measures ANOVA on task performance data, with presentation angle, cue type, and group as factors, revealed a significant main effect of cue type (F30,3=9.863; P<.001) and a significant 3-way interaction (F90,9=2.057; P=.04). Post-hoc analyses revealed that among patients without somatosensory impairment, any cue led to better performance compared with no cue, for targets on the left side, and audio-tactile cues did not seem to have additive effects. Among patients with somatosensory impairment, performance was better with both auditory and audio-tactile cueing than with no cue, at every presentation angle; conversely, tactile cueing alone had no significant effect at any presentation angle. Analysis of early orientation data showed that any type of cue triggered better orientation in both groups for lateral presentation angles, possibly reflecting an early alerting effect.

    Conclusions: Overall, audio-tactile cueing seems to be a promising method to guide patient attention. For instance, in the future, it could be used as an add-on method that supports attentional orientation during established therapeutic approaches.

    JMIR Serious Games 2022;10(2):e34884

    doi:10.2196/34884

    Keywords

    virtual reality; search task; stroke; neglect, multimodal cueing; bird search task 


    Virtual reality (VR) devices are being increasingly used, and can be found in industries [1,2] and areas of entertainment, military [3,4], and medicine [5-11]. Skills learned in VR have been shown to be transferable to the real world [7,12,13], leading to a broad spectrum of possibilities, from training to rehabilitation. Virtual environments have the advantage of being fully customizable, and therefore, they are potentially adaptable to different situations and even different user abilities [14,15]. Particularly in the field of rehabilitation of neurological disorders, VR has been shown to be a promising approach because of this adaptability and the inclusion of different sensory information [16]. This is believed to not only promote cortical reorganization but also facilitate the activation of neuronal plasticity [17]. One of the possible applications of VR in this area is the creation of an environment that can be manipulated in a way that would help patients with disturbances in the spatial allocation of visual attention. These disturbances are often subsumed under the label of visual neglect, a frequent condition occurring after right hemispheric stroke (up to 70%) [18,19]. Visual neglect is characterized by the inability to respond or react to targets coming from the contralesional side of space. It is a negative prognostic factor for the overall outcome after stroke and is difficult to treat [20].

    One approach to ameliorate visual neglect is to apply cross-modal cues (ie, cues in sensory modalities other than the visual one) in order to guide visual attention toward the neglected side. Most commonly, auditory cues have been successfully applied in neglect patients in order to guide visual attention toward the contralesional side [21-24]. Although less often investigated, tactile cues (alone or in combination with auditory cues) seem also to be able to ameliorate the contralesional allocation of visual attention in this patient population [21,25].

    Most setups of the above-mentioned studies were based on 2D screens, complex speaker arrays, or loudspeakers on moving robot arms. The use of a 3D VR environment can reduce the complexity of the system and increase its ecological validity, owing to the higher immersion, larger visual field, and possibility to freely move the head and body [26].

    Indeed, the effects of auditory cues, presented in a VR setting, on visuospatial attention deployment have been successfully explored in neglect patients and show promising results [27,28]. In contrast, to the best of our knowledge, no study has so far investigated the effects of tactile cues in VR on the spatial deployment of visual attention in neglect patients, although results obtained in healthy controls seem encouraging [29,30]. Finally, previous results in 2D settings suggest that multimodal cueing (ie, combining auditory and tactile cueing at the same time) may result in superior effects than single cueing [29,31]. However, the effects of this combination for patients with visual attention deficits in a 3D VR setting have not been studied.

    Thus, this pilot study aimed to investigate the feasibility and usability of multimodal (auditory and tactile) cueing, as implemented in a 3D VR setting (our bird search task), in patients with visual neglect, as well as obtain results concerning the effects of different types of cues on visual attention allocation compared with noncued conditions in these patients. We hypothesized that (1) the implementation of a new system, including tactile, auditory, and combined audio-tactile cueing, is feasible and usable for patients with impaired spatial attention; (2) the different cue types have a positive effect on the visuospatial attention allocation ability of patients; and (3) the use of multimodal cues (combined auditory and tactile) has larger effects than unimodal cues (auditory or tactile alone).


    Demographics

    Between June 2020 and November 2020, 12 patients with left-sided visual neglect after subacute right hemispheric stroke were recruited and included in the study.

    They were inpatients at the Neurorehabilitation Clinics of the Inselspital, Bern University Hospital, or the Kantonsspital Luzern, Switzerland. All patients had normal or corrected-to-normal vision. The mean age of the patients was 58.2 years (SD 9.70 years), and 4 were female. See Table 1 for detailed information and Figure 1 for the recruitment flowchart.

    Table 1. Detailed demographics and results of the neuropsychological tests of the participants.
    Patient IDGenderAge (years)CBSa scoreCoCbLBTcSomatosensory impairment
    P01Male5480.08412.68%Yes
    P02Male4240.0434.98%No
    P03Female634−0.1075.28%No
    P04Female63100.49065.57%No
    P05Male4680.02411.11%No
    P06Male61150.6995.75%No
    P07Female6640.0032.70%Yes
    P08Male6913−0.0059.34%No
    P09Female449−0.0041.24%Yes
    P10Male58120.86337.13%Yes
    P11Male61140.7393.32%Yes
    P12Male71190.7403.81%No

    aCBS: Catherine Bergego Scale [32].

    bCoC: center of cancellation [33].

    cLBT: Line Bisection Text (relative deviation in % [34]).

    ‎
    Figure 1. Patient flowchart from enrollment to analysis.
    View this figure

    The inclusion criterion was a pathological score in 1 of the following 3 assessments: Catherine Bergego Scale (CBS) [32], Sensitive Neglect Test (SNT) [35], and Line Bisection Test [34].

    The CBS is an established questionnaire allowing to detect the presence and severity of neglect based on the observation of everyday life activities (cutoff for neglect: CBS score >1). The SNT is a paper-pencil cancellation task. The spatial distribution and number of missed targets are evaluated using the center of cancellation (CoC; cutoff: CoC >0.081) [33]. The CoC reflects the mean position from the center to the missed targets and is normalized to values from −1 to 1. Zero indicates no spatial bias, negative values indicate a shift towards the left, and positive values indicate a shift towards the right. Furthermore, the Line Bisection Test [34] is another frequently used neuropsychological task to assess neglect severity, with a cutoff value of ≥11% mean relative rightward deviation [34].

    Somatosensory impairment, and hearing and auditory extinction were assessed clinically. Somatosensory impairment was assessed by comparing the sensitivity for touch on the forehead and the temporal head region between the left and right. To assess hearing and auditory extinction, rustling was presented to each ear individually or to both ears simultaneously, and patients’ reports were compared. Based on this assessment, patients were assigned to the following 2 subgroups: patients with and without sensory impairment. As no patient had auditory extinction, no auditory extinction group was formed.

    Ethics Approval

    The study was approved by the Ethics Committee of the Cantons of Bern and Lucerne (ID 2017-02195), and was conducted in accordance with the latest version of the Declaration of Helsinki. All participants signed written informed consent forms before participation.

    Questionnaires

    A selection of different questionnaires was administered to assess the usability and side effects of the VR task, as previously described by Gerber et al [36,37].

    For assessments of acceptance, usability, and participant perception of the visual search task and the VR system, the System Usability Scale (SUS) [38] was used. To assess side effects and cybersickness [39], the Simulator Sickness Questionnaire (SSQ) [40] was used.

    Technical Setup

    The VR hardware consisted of a stand-alone head-mounted display (HMD) and a hand-held controller. During the task, the positions of the controller and the HMD were continuously recorded (20 Hz sample rate).

    The resolution of the HMD (Oculus Quest, Facebook Technologies) was 1440×1600 pixels, with a horizontal field of view of 110 degrees and a frame rate of 72 Hz. For the development of our bird search task, the platform Unity [41] was used.

    To monitor the patient’s behavior during the task, the patient’s view was projected to a laptop computer using a wireless streaming tool via Sidequest [42]. The experimenter was thus able to see what the patient saw in real-time and could intervene if needed.

    Additionally, for the application of the tactile cue, a special cushion as an inlay piece for the HMD was used, as described by Knobel et al [29]. The cushion contains 6 coin vibrators symmetrically distributed over the forehead. Each coin vibrator could be started individually. The sound was presented via over-ear headphones.

    Bird Search Task and Study Procedure

    The main goal of the bird search task was to detect the appearing birds as quickly as possible. The task took place in a virtual environment and contained 3 main features (Figure 2).

    ‎
    Figure 2. (A) Scenario setup in the virtual environment, with the following 3 main features: (1) An empty floor, on which the player was positioned at the center of the scene; (2) A central fixation cross; and (3) Four presentation angles (−70°, −30°, 30°, and 70°) where the birds could appear in the bird search task. (B) Patients view when starting the task with the floor (1) and the central fixation cross (2).
    View this figure

    First, there was a plane surface, looking like a floor, which prevented the patient from feeling like floating or even falling. Second, directly in front of the patient, a colored fixation cross was presented. The patient’s initial position was aligned, so the fixation cross was straight ahead. Third, there were 4 presentation angles at which the stimuli (blue birds), one at a time, could appear. These presentation angles were on a horizontal line at −70°, −30°, 30°, and 70°, as defined with respect to the patient’s trunk (see the presentation angles of 4 birds in Figure 2). In this study, we will consider the 30° and −30° angles as paracentral angles and the 70° and −70° angles as lateral angles.

    At the beginning of each trial (a full round in Figure 3), the patients were asked to orient the HMD toward a central fixation cross (red cross in Figure 2; Figure 3A), thereby aligning their head to the trunk straight ahead. The fixation cross had the property to turn green if aligned with the HMD, thereby giving feedback for being correctly fixated (Figure 3B). After fixating for 2 seconds on the central fixation cross, it disappeared and, at the same time, a target bird appeared (Figure 3C). Consequently, the disappearance of the central fixation cross was a signal for the patient to start searching for the target bird. The patient was asked to confirm the detection of the target bird by flagging it with a hand-held controller. A flagged bird disappeared from the scene by falling. This started a new trial (ie, central fixation cross for 2 seconds, disappearance of the latter, and concomitant appearance of the next target bird; Figure 3D). If the target bird was not found within 11 seconds, it simply disappeared, and the next trial started.

    ‎
    Figure 3. Schematic representation of an exemplary trial of the bird search task. The grey birds represent the potential presentation angles, where the birds could appear. (A) The patient’s head (in blue) is not oriented toward the fixation cross, and therefore the task cannot start. (B) After reorienting the head toward the fixation cross, the cross turns green. (C) After 2 seconds of being correctly oriented, the fixation cross disappears and the bird appears (in this case, the bird appears at the presentation angle −70°). (D) The patient orients toward the bird and flags it, so it disappears. This results in the reappearance of the fixation cross that stays red as long as the patient has not reoriented toward it.
    View this figure

    Each target bird could appear either with or without additional spatial cues. There were 2 different possible spatial cues (auditory or tactile), resulting in the following 4 different conditions: None (no cue), Audio (only auditory cue), Tactile (only tactile cue), and Combo (auditory and tactile cues; for more details, see the “Cues” section below).

    In the None condition, the patient had to start looking for the target as soon as the fixation cross disappeared, but no additional hint for the direction was given. In the 3 other conditions, the patient received an additional hint from the presentation angles of the newly appeared target bird at the same time the target appeared. The cues were repeated after 3 seconds until the maximum presentation time of 11 seconds.

    The bird search task was organized into 4 sessions, each containing a single spatial cue type (ie, None, Audio, Tactile, and Combo). In each session, 80 target birds were presented (ie, each of the 4 presentation angles were tested 20 times). The order of the presentation angles at which the target birds appeared was random, with the constraint that 2 target birds could not appear at the same presentation angle in 2 consecutive trials. The order of the 4 sessions was randomized. The 4 sessions took place over 2 consecutive days (ie, 2 sessions per day). On the first day, all the conditions were explained to the patient, and 3 practice trials were performed. During the practice trials, each cue type and each presentation angle was presented. First, the patient was verbally guided to the target, and if the position was not detected correctly, the corresponding practice trial was repeated up to 3 times. If the position was detected correctly, the next angle/cue was presented. After completing the practice, the first 2 sessions were performed. On the second day, the corresponding practice trials of the 2 remaining cueing conditions were repeated, and then, the 2 remaining sessions were performed.

    Cues

    The task included auditory and tactile spatial cues. The auditory cue was a 1-second tone of 500 Hz with 0.1 seconds fading in and out to reduce the sound’s sharpness. The spatial information of the auditory cue was generated by the audio spatializer software development tool kit that is part of the Unity game development platform [41]. The head-related transfer function of the spatializer is based on the KEMAR data set (set of pre-ear impulse recordings of a dummy head; Bill Garnder at MIT Media Lab [43]). In the task, the sound was realistically perceived as coming from the left (due to different sound volume levels between the 2 ears) if the sound source was on the left side of the head and as coming from the front if the head was oriented toward the sound source.

    The tactile cue (1-second vibration) was applied using punctual vibration that came from a special inlay of the HMD that contained 6 symmetrically positioned individually controllable coin vibrators [29]. The coin vibrators were controlled in a way that mimicked the spatial behavior of sound. This means that if the head is oriented to the front and a cue is given on the left side, the most left coin vibrator is activated, signaling that the cue is on the left side. If the head is then turned and faces the cue, the middle coin vibrators are activated, signaling that the cue is now directly in the front of the patient. If the head is turned even more, the right coin vibrators are activated, signaling that the cue is now on the right side.

    In the Combo condition, auditory and tactile cues were given simultaneously for 1 second each.

    In-Task Parameters

    Performance

    The main parameters assessed were the mean time until targets were flagged and the percentage of found and flagged birds for each presentation angle and condition. From the percentage found and the mean time of found targets, we calculated a performance measure [44]. The performance measure was calculated for every presentation angle and condition by dividing the percentage of found targets by the mean time needed to flag the targets. A higher value as a result of this calculation thus represents better performance.

    This performance measure allows combining both behavioral aspects (ie, accuracy and speed of reactions) within a single parameter. With respect to the cognitive impairments of neglected patients, this performance measure offers several advantages. First, it allows quantifying performance even if a neglect patient does not find any target for a given angle/condition. Indeed, in this case, it would not be possible to calculate the mean time to flag targets. However, as the value is multiplied by the percentage of found targets (in this case, 0%) in the formula, the result would correctly be 0 (indicating very low performance for that particular presentation angle and condition). Second, this performance measure is robust against extreme values.

    If, for instance, a patient finds only 1 target in a very fast way in a certain presentation angle/condition combination, this low reaction time would be overrepresented if only the mean time to flag targets is analyzed. Instead, in the performance measure formula, the inclusion of the percentage of found targets reduces the weight of this extreme value [44].

    Early Orientation

    During the task, the angular position of the HMD with respect to the trunk was continuously recorded, thus reflecting the head rotation over time. Based on these data, the early orientation [45-47], that is, the direction (to the left or right) of the first head rotation movement after the presentation of a stimulus, was extracted. We then used the ratio of correct early orientation instances (ie, the instances in which the head was initially turned to the left even though the target appeared on the right, and vice versa; Figure 4) per condition and presentation angle as an in-game performance parameter.

    ‎
    Figure 4. Schematic representation of 7 trials and how the ratio of correct early orientation was calculated. The x-axis shows the head angle from the point where the target appears until it is found. The angle is in relation to the starting position of the trunk. Green represents traces of correct orientation and red represents traces of incorrect orientation.
    View this figure

    Figure 4 shows a schematic representation of the early orientation parameter. The traces (green and red lines) represent the head orientation during the presentation of 6 targets (blue birds). In this example, when the fourth and sixth targets were presented (red traces), the patient first turned the head toward the right, even though the target appeared on the left. When the first, second, third, and fifth trials (green traces) were performed, the orientation was correct from the beginning. Thus, the ratio of correct early orientation instances for the right side is 1 (ie, all early orientation instances were correct when the target appeared on the right side) and for the left side is 1/3.

    The early orientation was determined by comparing the head’s angle when the target appeared (central) with the head’s angle after 1.5 seconds. If the difference (start angle minus angle after 1.5 seconds) was negative, the patient had turned the head to the right; otherwise, the patient had turned the head to the left.

    Data Collection and Statistical Analyses

    Statistical analyses were performed once for all patients together, and comparisons were performed between the with and without somatosensory impairment groups (both groups had no auditory extinction).

    First, we analyzed the effects of the different cueing conditions and of the different spatial positions on in-game parameters by means of a 2-way repeated measures ANOVA, with cue type (levels: None, Audio, Tactile, and Combo) and angle (levels: −70°, −30°, 30°, and 70°) as within-subject factors for all participants.

    Second, since it is assumed that auditory and tactile cueing require intact somatosensory processing to be effective, we aimed to assess the effect of impairment in the respective modality. For this purpose, we grouped the patients according to somatosensory impairment (yes/no) and auditory extinction (yes/no), and reran the ANOVA with group as a between-subject factor (levels: with and without somatosensory impairment), and cue type (levels: None, Audio, Tactile, and Combo) and angle (levels: −70°, −30°, 30°, and 70°) as within-subject factors.

    Post-hoc analyses with least significant difference were applied for the identification of significant differences for cues within presentation angles. The study data were managed using Research Electronic Data Capture [48,49], a web-based tool to support data handling for research studies. Data analyses were performed with R (R Foundation for Statistical Computing) and MATLAB (MathWorks).


    Subgroups

    With regard to the neuropsychological measures, the mean results were as follows: 10.0 (SD 4.79) points for the CBS score [32], 0.30 (SD 0.37) for the CoC [33], and 13.6% (SD 19.0%) relative deviation toward the right for the Line Bisection Test [34].

    On separation for somatosensory impairment, there were 7 patients without and 5 with somatosensory impairment of the front head. On comparing age and neuropsychological measures between the groups, there were no significant differences for age (t9.94=0.480; P=.64) and the neuropsychological measures (CBS: t10.0=0.376, P=.72; CoC: t7.78=−0.289, P=.78; Line Bisection Test: t9.99=0.343, P=.74).

    Questionnaires

    Usability (based on the SUS ratings) was rated with the sum of 3 questions (responses ranging from 0 [unusable] to 4 [highly usable]) and reached a value of 10.2 (SD 1.85) out of a maximum of 12. Both groups provided similar ratings, with no significant difference between the groups (t8.95=−1.54; P=.16).

    The occurrence of side effects was assessed with the sum of 7 frequent items from the SSQ (responses ranging from 0 [no side effects] to 3 [severe side effects]), and the score was 0.833 (SD 0.834) out of a theoretical maximum of 21, indicating a very low rate of side effects. The results were not significantly different between the groups (SSQ: t9.86=−1.77; P=.11).

    In-Task Parameters

    Performance: All Patients

    Results concerning all patients are shown in Figure 5. Two-way repeated measures ANOVA showed significant main effects of cue type (F33,3=7.60; P<.001) and presentation angle (F19.35,1.76=50.9; P<.001), but not of their interaction (cue type × presentation angle) (F99,9=0.469; P=.89).

    ‎
    Figure 5. (A) Performance per cue type for all patients (n=12). The whiskers represent the standard error of means. The asterisks represent the level of significance of post-hoc tests (*P<.05, **P<.01, ***P<.001). (B) Visualization of the performance per cue type and presentation angle.
    View this figure

    Post-hoc analyses concerning the main effects of cue type (ie, irrespective of presentation angle) revealed a significantly better performance for auditory or combined cues but not for tactile cues compared with no cue. Furthermore, auditory cues were better than tactile cues.

    Performance: Subgroups

    Detailed examination of the results (Figure 6) included a 3-way mixed model ANOVA that showed significant main effects of cue type (F30,3=9.863; P<.001) and presentation angle (F17.24,1.72=47.609; P<.001), and a significant 3-way interaction between cue type, presentation angle, and group (F90,9=2.057; P=.04). There were no other significant interactions.

    ‎
    Figure 6. Visualization of the performance, split for the group with somatosensory impairment (A; n=5) and the group without somatosensory impairment (B; n=7). Results of the post-hoc tests are shown as significance bars (level of significance: *P<.05, **P<.01, ***P<.001). The whiskers represent the standard error of means.
    View this figure

    The post-hoc analysis revealed that for patients without somatosensory impairment, any cue led to better performance than no cue for targets on the left side. In patients with somatosensory impairment, performance was better with both auditory and audio-tactile cueing than with no cue, at every presentation angle; conversely, tactile cueing alone had no significant effect at any presentation angle.

    Early Orientation: All Patients

    Results of the ratio of correct early orientation for all patients are shown in Figure 7. Repeated measures ANOVA showed significant main effects of cue type (F36,3=26.934; P<.001), presentation angle (F36,3=10.207; P<.001), and their interaction (F99,9=4.798; P=.001). Having cues at lateral angles led to an improvement in the ratio of correct early orientation. Comparison of the same cues at different presentation angles showed that in the None and Audio conditions, there was a significant left-right difference for the paracentral (None: P=.002; Audio: P=.008) and lateral (None: P=.008; Audio: P=.047) angles. This pattern was not observed in the Tactile and Combo conditions, where only the lateral (Tactile: P=.01) and paracentral (Combo: P=.03) angles differed significantly. The significance bars for direct cue comparisons are not shown in Figure 7.

    ‎
    Figure 7. Visualization of the ratio of correct early orientation instances. The whiskers represent the standard error of means. Results of the post-hoc tests are shown as significance bars. The asterisks above the bars represent the level of significance (*P<.05, **P<.01, ***P<.001).
    View this figure
    Early Orientation: Subgroups

    A mixed model ANOVA for cue type, presentation angle, and group showed significant main effects of cue type (F30,3=32.671; P<.001) and presentation angle (F30,3=13.97; P<.001), as well as the following 2 significant 2-way interactions: group × presentation angle (F30,3=6.738; P=.001) and cue type × presentation angle (F90,9=4.412; P<.001). No other interaction reached significance.

    The lack of a significant 3-way interaction also showed that any type of cue (auditory, tactile, or combo) triggered better orientation in both groups for lateral angles (Figure 8).

    ‎
    Figure 8. Visualization of the interaction result of presentation angle and cue type, split for the group with somatosensory impairment (A) and the group without somatosensory impairment (B). The whiskers represent the standard error of means. Results of the post-hoc tests are shown as significance bars. The asterisks above the bars represent the level of significance (*P<.05, **P<.01, ***P<.001).
    View this figure

    The significant interaction between group and presentation angle showed a significant difference between the groups for left paracentral angles and a left-right difference for lateral and paracentral angles in the group without somatosensory impairment.


    Overview

    This study showed that our new multimodal VR setup, including visual, auditory, and tactile cues, is highly usable and that it is suitable to provide multimodal spatial cues to patients who have spatial attention deficits. Furthermore, the measurements provided some important information concerning the peculiarities of the application of such a setup in this population. Indeed, all patients seemed to benefit from auditory cues; however, the positive effect of tactile cues on in-task performance seemed to depend on the presence of somatosensory impairment. Patients without somatosensory impairment did benefit from tactile cues. Nevertheless, there seemed to be a consistent alerting effect for all cue conditions (auditory, tactile, and combined) among all patients, which could help them to overcome the initial tendency to orient toward the right, a common symptom observed in neglect. Finally, we did not find an additive effect of combining auditory and tactile cues in any measure or group.

    Usability

    In line with our first hypothesis, patients rated the device’s usability as very high and did not report any relevant side effects. The high usability of our new VR setting, including tactile stimulation, is similar to that in one of the few previous studies in stroke patients with a similar visual and auditory setting, which however did not entail any tactile stimulation [14,37]. Moreover, similar levels of usability have been reported by healthy participants using new VR tools including visual and auditory stimulation, but without tactile stimulation [36,50,51]. Hence, in our study, the additional presentation of tactile stimulation did not change usability or cause discomfort. Interestingly, in our last study in healthy participants [29], tactile stimulation, similar to that presented here, caused some side effects. We hypothesize that one reason for the minor discomfort caused by tactile stimulation is the duration of application of the tactile stimulation. Indeed, in our previous study, tactile stimulation was continuously presented over several minutes, whereas in this study, it was only presented during short intervals (ie, up to a maximum of 4 seconds per target). This study and our previous study [29] thus represent in some way maximum and minimum usage of tactile stimulation. Future studies should therefore target an optimal tactile stimulation time for maximum effectiveness, but without side effects.

    In-Task Parameters

    Our second hypothesis concerned in-task parameters and assumed that patients with spatial attention disorder would benefit from spatial cues, as assessed by means of a compound performance measure, considering both search time and percentage of found targets. Usually, those cues are presented on a 2D screen with a limited visual angle. The advantage of our VR approach is that we can present the patients with far more lateral cues in a virtual environment, supporting them in orienting toward the left by means of not only eye movements, but also head movements. Even though some tools have been developed and tested to examine the effects of visual, auditory, or even tactile cues in patients with impaired spatial attention [21,52], to the best of our knowledge, so far, no study has examined the effects of tactile cues in neglect patients using a VR system.

    The auditory cueing of our VR setup was effective in all patients, increasing performance and confirming our hypothesis. The new approach with tactile cueing in VR was also effective, as long as patients had preserved somatosensory processing. This is in line with the principles of unimodal or multimodal cueing, a common approach to guide the attention of patients with spatial attention disorders toward the neglected side [24,53,54].

    The fact that tactile cueing can induce positive effects in patients without somatosensory impairment is particularly remarkable. Indeed, tactile cues were presented at different locations in space than visual stimuli; the tactile cues were presented on the skin of the forehead (ie, within the personal space), whereas visual targets were presented in the peripersonal space. This configuration is different from the one concerning auditory cues, were visual targets and auditory cues are both presented at the same location in the peripersonal space [55,56]. In this group of patients, this suggests the activation of spatial attention networks through not only spared supramodal mechanisms [52,57] but also “supraspatial” (ie, entailing different spatial reference frames) mechanisms.

    Our results seem to not provide support for the third hypothesis, that is, an advantage of the combined application of tactile and auditory cues in comparison with unimodal cues, since this did not lead to a significant increase in performance or a higher rate of correct early orientation. Some evidence in the literature shows that the use of multimodal cues can have an additive effect [29,31], whereas other studies have shown no benefit of using multimodal cues when compared with unimodal cues [54]. A possible explanation for these disparities could be associated with the level of spatiotemporal matching [58,59] and cross-modal intensity matching [60] needed for cross-modal cues to have an additive effect. In our study, auditory cues had a high spatiotemporal match with the visual target, but tactile cues did not [54]. This might be even more relevant for neglect patients, as they typically show problems with spatial transformations [61-63].

    Besides performance parameters (eg, search time and percentage of found targets), we also assessed early orientation behavior. Interestingly, in this case, all types of cues (auditory, tactile, and combination) had positive effects on early orientation, even in patients who had a somatosensory impairment and could not correctly localize a tactile cue. This might be explained through a general alerting effect, as it has been shown that a temporary alertness enhancement can ameliorate attentional orienting in neglect patients [64-66], but this effect is short lived [67,68]. Therefore, it seems reasonable to hypothesize that all types of cues can ameliorate early orientation through their alerting effect and that this effect is not long enough to further support performance to find targets.

    Limitations

    In this pilot study, we aimed to show the feasibility and usability of our VR setup in a diverse and complex patient group. On the one hand, the variance increases the difficulty of the interpretability of the task results, and on the other hand, the variety increases the representativeness for this patient group. Neglect severity shows spontaneous fluctuations and intraday variations [69]. We tried to minimize this effect by having the 2 sessions on consecutive days and at the same time; nevertheless, factors like medication changes and exhausting therapies beforehand could not be controlled. Future studies with a larger sample size should try to control or at least assess such confounders

    Conclusion and Outlook

    This study showed the usability and feasibility of a new approach entailing auditory, tactile, and combined audio-tactile cueing in VR among patients with different combinations of attentional and somatosensory impairments. Our data suggest that auditory and tactile cues may be equally efficient in ameliorating attentional performance in neglect patients, at least in those with spared somatosensory processing. Moreover, combined audio-tactile stimulation did not show an additive effect in our setup. Future studies are needed to assess these preliminary findings in a larger group of patients. One of the possible directions to reach intermodal additive effects would be to assess the effects of tactile cues presented “nearer” to the source of the visual and auditory stimuli (eg, tactile stimulation on the hand, with variation in presentation side and intensity according to how near the patient moves the hand to the target).

    Overall, audio-tactile cueing seems to be a promising method to guide patient attention. For instance, in the future, it could be used as an add-on approach that supports attentional orientation during established therapeutic approaches (eg, optokinetic stimulation).

    Acknowledgments

    This work was supported by Swiss National Science Foundation (SNSF) Grants (P2BEP3_195283 to BCK, 32003B_196915 and 320030_169789 to TNyffeler, and Z00P3_154714/1 to DC). We are grateful to the patients who took part in our study and to the clinical teams of the Inselspital and the Luzerner Kantonsspital for their support.

    Authors' Contributions

    SEJK, DC, BCK, RMM, TNef, and TNyffeler designed the study. SEJK, DC, and TNef developed the tool and the setup. SEJK and BCK recruited the participants. SEJK, DC, BCK, NG, TNyffeler, and RMM analyzed the data. SEJK, DC, BCK, NG, and TNef wrote the manuscript. All authors approved the final manuscript.

    Conflicts of Interest

    None declared.

    1. Berg LP, Vance JM. Industry use of virtual reality in product design and manufacturing: a survey. Virtual Reality 2016 Sep 12;21(1):1-17. [CrossRef]
    2. Wang T, Huang H, Huang H. Design and implementation of cancellation tasks for visual search strategies and visual attention in school children. Computers & Education 2006 Aug;47(1):1-16. [CrossRef]
    3. Rizzo A, Parsons TD, Lange B, Kenny P, Buckwalter JG, Rothbaum B, et al. Virtual reality goes to war: a brief review of the future of military behavioral healthcare. J Clin Psychol Med Settings 2011 Jun 7;18(2):176-187. [CrossRef] [Medline]
    4. Liu X, Zhang J, Hou G, Wang Z. Virtual Reality and Its Application in Military. IOP Conf. Ser.: Earth Environ. Sci 2018 Jul 17;170:032155. [CrossRef]
    5. Izard SG, Juanes JA, García Peñalvo FJ, Estella JMG, Ledesma MJS, Ruisoto P. Virtual Reality as an Educational and Training Tool for Medicine. J Med Syst 2018 Mar 01;42(3):50. [CrossRef] [Medline]
    6. Mazurek J, Kiper P, Cieślik B, Rutkowski S, Mehlich K, Turolla A, et al. Virtual reality in medicine: a brief overview and future research directions. hm 2019;20(3):16-22. [CrossRef]
    7. Zaid MB, Dilallo M, Shau D, Ward DT, Barry JJ. Virtual Reality as a Learning Tool for Trainees in Unicompartmental Knee Arthroplasty: A Randomized Controlled Trial. J Am Acad Orthop Surg 2022 Jan 15;30(2):84-90. [CrossRef] [Medline]
    8. Bartlett J, Kazzazi F, To K, Lawrence J, Khanduja V. Virtual Reality Simulator Use Stimulates Medical Students' Interest in Orthopaedic Surgery. Arthrosc Sports Med Rehabil 2021 Oct;3(5):e1343-e1348 [FREE Full text] [CrossRef] [Medline]
    9. Maples-Keller JL, Bunnell BE, Kim S, Rothbaum BO. The Use of Virtual Reality Technology in the Treatment of Anxiety and Other Psychiatric Disorders. Harv Rev Psychiatry 2017;25(3):103-113. [CrossRef]
    10. Rothbaum BO, Hodges LF. The use of virtual reality exposure in the treatment of anxiety disorders. Behav Modif 1999 Oct 26;23(4):507-525. [CrossRef] [Medline]
    11. Coelho CM, Waters AM, Hine TJ, Wallis G. The use of virtual reality in acrophobia research and treatment. J Anxiety Disord 2009 Jun;23(5):563-574. [CrossRef] [Medline]
    12. Torkington J, Smith SG, Rees BI, Darzi A. Skill transfer from virtual reality to a real laparoscopic task. Surg Endosc 2001 Oct;15(10):1076-1079 [FREE Full text] [CrossRef] [Medline]
    13. Bossard C, Kermarrec G, Buche C, Tisseau J. Transfer of learning in virtual environments: a new challenge? Virtual Reality 2008 Mar 26;12(3):151-161. [CrossRef]
    14. Knobel SEJ, Kaufmann BC, Gerber SM, Urwyler P, Cazzoli D, Müri RM, et al. Development of a Search Task Using Immersive Virtual Reality: Proof-of-Concept Study. JMIR Serious Games 2021 Jul 02;9(3):e29182 [FREE Full text] [CrossRef] [Medline]
    15. Paraskevopoulos I, Tsekleves E, Warland A, Kilbride C. Virtual Reality-Based Holistic Framework: A Tool for Participatory Development of Customised Playful Therapy Sessions for Motor Rehabilitation. 2016 Presented at: 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES); September 7-9, 2016; Barcelona, Spain p. 1-8. [CrossRef]
    16. Maggio MG, Latella D, Maresca G, Sciarrone F, Manuli A, Naro A, et al. Virtual Reality and Cognitive Rehabilitation in People With Stroke: An Overview. J Neurosci Nurs 2019 Apr;51(2):101-105. [CrossRef] [Medline]
    17. Bray S, Shimojo S, O'Doherty JP. Direct Instrumental Conditioning of Neural Activity Using Functional Magnetic Resonance Imaging-Derived Reward Feedback. Journal of Neuroscience 2007 Jul 11;27(28):7498-7507. [CrossRef]
    18. Stone SP, Halligan PW, Greenwood RJ. The Incidence of Neglect Phenomena and Related Disorders in Patients with an Acute Right or Left Hemisphere Stroke. Age Ageing 1993;22(1):46-52. [CrossRef]
    19. Bowen A, McKenna K, Tallis RC. Reasons for variability in the reported rate of occurrence of unilateral spatial neglect after stroke. Stroke 1999 Jun;30(6):1196-1202 [FREE Full text] [CrossRef] [Medline]
    20. Jehkonen M, Laihosalo M, Kettunen JE. Impact of neglect on functional outcome after stroke: a review of methodological issues and recent research findings. Restor Neurol Neurosci 2006;24(4-6):209-215. [Medline]
    21. Hommel M, Peres B, Pollak P, Memin B, Besson G, Gaio J, et al. Effects of passive tactile and auditory stimuli on left visual neglect. Arch Neurol 1990 May 01;47(5):573-576. [CrossRef] [Medline]
    22. Schenke N, Franke R, Puschmann S, Turgut N, Kastrup A, Thiel CM, et al. Can auditory cues improve visuo-spatial neglect? Results of two pilot studies. Neuropsychol Rehabil 2021 Jun 27;31(5):710-730. [CrossRef] [Medline]
    23. Frassinetti F, Pavani F, Làdavas E. Acoustical vision of neglected stimuli: interaction among spatially converging audiovisual inputs in neglect patients. J Cogn Neurosci 2002 Jan 01;14(1):62-69. [CrossRef] [Medline]
    24. Kaufmann B, Cazzoli D, Bartolomeo P, Frey J, Pflugshaupt T, Knobel S, et al. Auditory spatial cueing reduces neglect after right-hemispheric stroke: A proof of concept study. Cortex 2022 Mar;148:152-167. [CrossRef] [Medline]
    25. Bailey MJ, Riddoch MJ, Crome P. Treatment of Visual Neglect in Elderly Patients With Stroke: A Single-Subject Series Using Either a Scanning and Cueing Strategy or a Left-Limb Activation Strategy. Physical Therapy 2002;82(8):782-797. [CrossRef]
    26. Parsons TD. Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences. Front Hum Neurosci 2015;9:660 [FREE Full text] [CrossRef] [Medline]
    27. Baheux K, Yoshizawa M, Tanaka A, Seki K, Handa Y. Diagnosis and rehabilitation of hemispatial neglect patients with virtual reality technology. THC 2005 Jul 25;13(4):245-260. [CrossRef]
    28. Huygelier H, Schraepen B, Lafosse C, Vaes N, Schillebeeckx F, Michiels K, et al. An immersive virtual reality game to train spatial attention orientation after stroke: A feasibility study. Appl Neuropsychol Adult 2020 Sep 18:1-21. [CrossRef] [Medline]
    29. Knobel SEJ, Gyger N, Nyffeler T, Cazzoli D, Muri RM, Nef T. Development and evaluation of a new virtual reality-based audio-tactile cueing-system to guide visuo-spatial attention. Annu Int Conf IEEE Eng Med Biol Soc 2020 Jul;2020:3192-3195. [CrossRef] [Medline]
    30. Lindeman RW, Sibert J, Mendez-Mendez E, Patil S, Phifer D. Effectiveness of directional vibrotactile cuing on a building-clearing task. In: CHI '05: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2005 Presented at: SIGCHI Conference on Human Factors in Computing Systems; April 2-7, 2005; Portland, Oregon, USA p. 271-280. [CrossRef]
    31. Hancock PA, Mercado JE, Merlo J, Van Erp JB. Improving target detection in visual search through the augmenting multi-sensory cues. Ergonomics 2013 May;56(5):729-738. [CrossRef] [Medline]
    32. Bergego C, Azouvi P, Samuel C, Marchal F, Louis-Dreyfus A, Jokic C, et al. Validation d'une échelle d'évaluation fonctionnelle de l'héminégligence dans la vie quotidienne: l'échelle CB. Annales de Réadaptation et de Médecine Physique 1995 Jan;38(4):183-189. [CrossRef]
    33. Rorden C, Karnath H. A simple measure of neglect severity. Neuropsychologia 2010 Jul;48(9):2758-2763 [FREE Full text] [CrossRef] [Medline]
    34. Wilson B, Cockburn J, Halligan P. Development of a behavioral test of visuospatial neglect. Arch Phys Med Rehabil 1987 Mar;68(2):98-102. [Medline]
    35. Reinhart S, Leonhard E, Kerkhoff G. Sensitive Neglect Test (SNT) single and dual task. Saarland University. 2016.   URL: https:/​/www.​uni-saarland.de/​fileadmin/​upload/​lehrstuhl/​kerkhoff/​Materialien_f%C3%BCr_Diagnostik_Therapie/​Instructions_SNT_single_and_dual_task.​pdf [accessed 2022-04-29]
    36. Gerber SM, Jeitziner M, Wyss P, Chesham A, Urwyler P, Müri RM, et al. Visuo-acoustic stimulation that helps you to relax: A virtual reality setup for patients in the intensive care unit. Sci Rep 2017 Oct 16;7(1):13228 [FREE Full text] [CrossRef] [Medline]
    37. Knobel SEJ, Kaufmann BC, Gerber SM, Cazzoli D, Müri RM, Nyffeler T, et al. Immersive 3D Virtual Reality Cancellation Task for Visual Neglect Assessment: A Pilot Study. Front Hum Neurosci 2020 May 25;14:180 [FREE Full text] [CrossRef] [Medline]
    38. Brooke J. SUS: A 'Quick and Dirty' Usability Scale. In: Jordan PW, Thomas B, McClelland IL, Weerdmeester B, editors. Usability Evaluation In Industry. Boca Raton, FL, USA: CRC Press; 1996:189-194.
    39. LaViola JJ. A discussion of cybersickness in virtual environments. SIGCHI Bull 2000 Jan 01;32(1):47-56. [CrossRef]
    40. Kennedy R, Lane N, Berbaum K, Lilienthal M. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The International Journal of Aviation Psychology 1993 Jul;3(3):203-220. [CrossRef]
    41. Unity. Unity Technologies.   URL: https://unity.com/ [accessed 2022-04-29]
    42. SideQuestVR.   URL: https://sidequestvr.com/ [accessed 2022-04-29]
    43. HRTF Measurements of a KEMAR Dummy-Head Microphone. MIT Media Lab.   URL: https://sound.media.mit.edu/resources/KEMAR.html [accessed 2022-02-17]
    44. Vandierendonck A. Further Tests of the Utility of Integrated Speed-Accuracy Measures in Task Switching. J Cogn 2018 Jan 12;1(1):8 [FREE Full text] [CrossRef] [Medline]
    45. Pflugshaupt T, Bopp SA, Heinemann D, Mosimann UP, von Wartburg R, Nyffeler T, et al. Residual oculomotor and exploratory deficits in patients with recovered hemineglect. Neuropsychologia 2004 Jan;42(9):1203-1211. [CrossRef] [Medline]
    46. Kaufmann BC, Knobel SEJ, Nef T, Müri RM, Cazzoli D, Nyffeler T. Visual Exploration Area in Neglect: A New Analysis Method for Video-Oculography Data Based on Foveal Vision. Front Neurosci 2019 Jan 22;13:1412 [FREE Full text] [CrossRef] [Medline]
    47. Azouvi P, Samuel C, Louis-Dreyfus A, Bernati T, Bartolomeo P, Beis J, French Collaborative Study Group on Assessment of Unilateral Neglect (GEREN/GRECO). Sensitivity of clinical and behavioural tests of spatial neglect after right hemisphere stroke. J Neurol Neurosurg Psychiatry 2002 Aug;73(2):160-166 [FREE Full text] [CrossRef] [Medline]
    48. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009 Apr;42(2):377-381 [FREE Full text] [CrossRef] [Medline]
    49. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, REDCap Consortium. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform 2019 Jul;95:103208 [FREE Full text] [CrossRef] [Medline]
    50. Gerber S, Muri R, Mosimann U, Nef T, Urwyler P. Virtual reality for activities of daily living training in neurorehabilitation: a usability and feasibility study in healthy participants. 2018 Presented at: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC); July 18-21, 2018; Honolulu, HI, USA p. 1-4. [CrossRef]
    51. Wenk N, Penalver-Andres J, Buetler KA, Nef T, Müri RM, Marchal-Crespo L. Effect of immersive visualization technologies on cognitive load, motivation, usability, and embodiment. Virtual Reality 2021 Aug 16. [CrossRef]
    52. Zigiotto L, Damora A, Albini F, Casati C, Scrocco G, Mancuso M, et al. Multisensory stimulation for the rehabilitation of unilateral spatial neglect. Neuropsychol Rehabil 2021 Oct 19;31(9):1410-1443. [CrossRef] [Medline]
    53. Kerkhoff G. Modulation and rehabilitation of spatial neglect by sensory stimulation. Prog Brain Res 2003;142:257-271. [CrossRef] [Medline]
    54. Ngo MK, Spence C. Auditory, tactile, and multisensory cues facilitate search for dynamic visual stimuli. Attention, Perception, & Psychophysics 2010 Aug;72(6):1654-1665. [CrossRef]
    55. Ho C, Reed N, Spence C. Assessing the effectiveness of "intuitive" vibrotactile warning signals in preventing front-to-rear-end collisions in a driving simulator. Accid Anal Prev 2006 Sep;38(5):988-996. [CrossRef] [Medline]
    56. Ladavas E, Farnè A. Neuropsychological Evidence for Multimodal Representations of Space near Specific Body Parts. In: Spence C, Driver J, editors. Crossmodal Space and Crossmodal Attention. Oxford, UK: Oxford University Press; 2004:69-98.
    57. Bolognini N, Vallar G. Hemianopia, spatial neglect, and their multisensory rehabilitation. In: Sathian K, Ramachandran VS, editors. Multisensory Perception. Cambridge, MA, USA: Academic Press; 2020:423-447.
    58. Paladini RE, Diana L, Zito GA, Nyffeler T, Wyss P, Mosimann UP, et al. Attentional reorienting triggers spatial asymmetries in a search task with cross-modal spatial cueing. PLoS One 2018 Jan 2;13(1):e0190677 [FREE Full text] [CrossRef] [Medline]
    59. Mclntire JP, Havig PR, Watamaniuk SNJ, Gilkey RH. Visual search performance with 3-D auditory cues: effects of motion, target location, and practice. Hum Factors 2010 Mar 04;52(1):41-53. [CrossRef] [Medline]
    60. Pitts B, Riggs SL, Sarter N. Crossmodal Matching: A Critical but Neglected Step in Multimodal Research. IEEE Trans. Human-Mach. Syst 2016 Jun;46(3):445-450. [CrossRef]
    61. Manfredini A, Mancini F, Posteraro L, Savazzi S. The two sides of spatial representation in neglect patients: the same spatial distortion for different patterns of performance. Neuropsychologia 2013 Aug;51(10):1867-1877. [CrossRef] [Medline]
    62. Karnath H. Disturbed coordinate transformation in the neural representation of space as the crucial mechanism leading to neglect. Neuropsychological Rehabilitation 1994 Jun;4(2):147-150. [CrossRef]
    63. Bisiach E, Luzzatti C. Unilateral Neglect of Representational Space. Cortex 1978 Mar;14(1):129-133 [FREE Full text] [CrossRef] [Medline]
    64. Posner MI. Measuring alertness. Ann N Y Acad Sci 2008;1129:193-199. [CrossRef] [Medline]
    65. Niemi P, Näätänen R. Foreperiod and simple reaction time. Psychological Bulletin 1981;89(1):133-162. [CrossRef]
    66. Van der Burg E, Olivers CNL, Bronkhorst AW, Theeuwes J. Pip and pop: nonspatial auditory signals improve spatial visual search. J Exp Psychol Hum Percept Perform 2008 Oct;34(5):1053-1065. [CrossRef] [Medline]
    67. Cazzoli D, Kaufmann BC, Paladini RE, Müri RM, Nef T, Nyffeler T. Anterior insula and inferior frontal gyrus: where ventral and dorsal visual attention systems meet. Brain Commun 2021;3(1):fcaa220 [FREE Full text] [CrossRef] [Medline]
    68. Chandrakumar D, Keage HA, Gutteridge D, Dorrian J, Banks S, Loetscher T. Interactions between spatial attention and alertness in healthy adults: A meta-analysis. Cortex 2019 Oct;119:61-73. [CrossRef] [Medline]
    69. Li K, Malhotra PA. Spatial neglect. Pract Neurol 2015 Oct 28;15(5):333-339 [FREE Full text] [CrossRef] [Medline]

    ‎
    CBS: Catherine Bergego Scale
    CoC: Center of Cancellation
    HMD: head-mounted display
    SNT: Sensitive Neglect Test
    SSQ: Simulator Sickness Questionnaire
    SUS: System Usability Scale
    VR: virtual reality

    Edited by N Zary; submitted 17.11.21; peer-reviewed by R Calabrò; comments to author 08.01.22; revised version received 17.02.22; accepted 07.04.22; published 25.05.22

    Copyright

    ©Samuel Elia Johannes Knobel, Brigitte Charlotte Kaufmann, Nora Geiser, Stephan Moreno Gerber, René M Müri, Tobias Nef, Thomas Nyffeler, Dario Cazzoli. Originally published in JMIR Serious Games (https://games.jmir.org), 25.05.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.