Background: Immersive virtual reality (IVR) has been investigated as a tool for treating psychiatric conditions. In particular, the practical nature of IVR, by offering a doing instead of talking approach, could support people who do not benefit from existing treatments. Hence, people with mild to borderline intellectual disability (MBID; IQ=50-85) might profit particularly from IVR therapies, for instance, to circumvent issues in understanding relevant concepts and interrelations. In this context, immersing the user into a virtual body (ie, avatar) appears promising for enhancing learning (eg, by changing perspectives) and usability (eg, natural interactions). However, design requirements, immersion procedures, and proof of concept of such embodiment illusion (ie, substituting the real body with a virtual one) have not been explored in this group.
Objective: Our study aimed to establish design guidelines for IVR embodiment illusions in people with MBID. We explored 3 factors to induce the illusion, by testing the avatar’s appearance, locomotion using IVR controllers, and virtual object manipulation. Furthermore, we report on the feasibility to induce the embodiment illusion and provide procedural guidance.
Methods: We conducted a user-centered study with 29 end users in care facilities, to investigate the avatar’s appearance, controller-based locomotion (ie, teleport, joystick, or hybrid), and object manipulation. Overall, 3 iterations were conducted using semistructured interviews to explore design factors to induce embodiment illusions in our group. To further understand the influence of interactions on the illusion, we measured the sense of embodiment (SoE) during 5 interaction tasks.
Results: IVR embodiment illusions can be induced in adults with MBID. To induce the illusion, having a high degree of control over the body outweighed avatar customization, despite the participants’ desire to replicate their own body image. Similarly, the highest SoE was measured during object manipulation tasks, which required a combination of (virtual) locomotion and object manipulation behavior. Notably, interactions that are implausible (eg, teleport and occlusions when grabbing) showed a negative influence on SoE. In contrast, implementing artificial interaction aids into the IVR avatar’s hands (ie, for user interfaces) did not diminish the illusion, presuming that the control was unimpaired. Nonetheless, embodiment illusions showed a tedious and complex need for (control) habituation (eg, motion sickness), possibly hindering uptake in practice.
Conclusions: Balancing the embodiment immersion by focusing on interaction habituation (eg, controller-based locomotion) and lowering customization effort seems crucial to achieve both high SoE and usability for people with MBID. Hence, future studies should investigate the requirements for natural IVR avatar interactions by using multisensory integrations for the virtual body (eg, animations, physics-based collision, and touch) and other interaction techniques (eg, hand tracking and redirected walking). In addition, procedures and use for learning should be explored for tailored mental health therapies in people with MBID.
Immersive virtual reality (IVR) has been investigated as a treatment tool for a variety of psychiatric disorders, for instance, in people with psychosis, addictive disorders, and eating disorders [, ]. However, so far, the clinical effectiveness has only been proven in anxiety disorders, as (randomized) controlled trials in other mental illnesses are still required. However, the practical nature as doing instead of talking approach makes IVR therapy appealing for people who do not profit from existing treatments, such as people with mild to borderline intellectual disability (MBID; IQ=50-85). People with MBID constitute a diverse group with low intellectual and adaptive capabilities (eg, problems in planning, problem solving, abstract thinking, and judgment), which negatively affects the development of essential skills for independent living. By using the term MBID, we combine the groups mild intellectual disability (IQ=50-69) and borderline intellectual functioning (IQ=70-85), as they often encounter similar challenges in life, for instance, regarding mental health treatments [ - ]. Previous studies suggest that IVR could help to reduce learning barriers, by making abstract concepts and interrelations graspable [ - ], bypassing the need for a disembedded thinking [ ]. In addition, IVR for the MBID group could transfer tangible content for an active rather than passive learning [ ], thus evading the need for excessive language use and fostering skill acquisition by making mistakes [ ]. However, applications of IVR and knowledge about requirements in MBID remain low [ ], as few researchers have explored the interaction design using state-of-the-art hardware [ - ]. However, turning with one’s own body and interacting via hand-based manipulations were found to benefit usability. Hence, implementing interaction techniques that provide a user experience similar to that of real life seems vital, for instance, by immersion into a virtual body. This embodiment illusion could facilitate life-like behavior and therefore improve the access to IVR for our group [ ].
Embodiment illusions in IVR allow us to substitute the real body with a virtual body or certain body parts, such as arms or hands [- ]. The phenomenon is often assessed by the sense of embodiment (SoE) toward the virtual body (ie, avatar) [ , ]. The “SoE toward a body B is the sense that emerges when B’s properties are processed as if they were the properties of one’s own biological body.” (p375) [ ]. Hence, the embodiment illusion is induced through 3 main factors: sense of self-location, agency, and ownership [ , ]. The sense of self-location refers to the feeling of being inside the body [ ]; the sense of agency comprises the “global motor control, including the subjective experience of action, control, intention, motor selection and the conscious experience of will” (p7) [ ]; and the sense of body ownership involves the self-attribution to the avatar [ ]. However, so far, the significance of each factor for the illusion remains ambiguous [ ]. Nonetheless, illusions of virtual body ownership (IVBO) were found to influence the user’s attitudes and behavior [ ], which makes them promising for enhancing therapy outcomes in groups that hardly benefit from cognitively demanding paradigms, such as people with MBID.
Previous findings in people devoid of MBID showed that embodying a Black avatar can reduce racial bias and that embodying a child can influence implicit attitudes and object size perception in IVR [, ]. Both refer to the proteus effect, derived from the Greek myth of a shape shifter, describing the phenomenon that we (humans) tend to change our beliefs and behavior based on our (digital) self-representations [ ]. For instance, as empathy training, body swapping was used to present power relationships between offender and victim in sexual harassment, subsequently reducing conformity in social pressure scenarios [ ]. In addition to such implicit approaches, explicit learning could be applied, for instance, psychomotor addiction therapy with a focus on bodily signals (eg, cravings) [ ], by using the virtual body as a multimodal feedback system. However, despite various studies that report on the design requirements for such IVBO, no study has focused on people with MBID. Hence, this study aimed to design IVR avatars for embodiment illusions in individuals with MBID. As the spatial immersion into the IVR avatar and implementation of plausible actions (eg, controls) can evoke realistic behaviors [ ], we decided to look into three important components for embodiment illusions: (1) avatar appearance, (2) controller-based locomotion, and (3) object manipulation.
In the following sections, we examine related studies concerning (1) avatar immersion, (2) controller-based locomotion, and (3) object manipulation. Given the lack of studies in our target group, we report on the existing evidence in non-MBID samples to identify crucial factors for our initial prototype and immersion design. We conclude the Introduction section with a summary of potential benefits and barriers of embodiment illusions for people with MBID and our research questions. Then, we describe our user-centered design method with 3 iterations and report the results per iteration. Subsequently, we discuss relevant factors in the context of previous studies, limitations, and directions for future research. Finally, we conclude our paper with a summary of our contribution to the field.
Immersion Into IVR Avatars for IVBO
Several factors contributing to IVR avatar immersion have been investigated to influence SoE, such as the point of view (POV; ie, the perspective), body appearance, control, and haptics (ie, the experience of touch) . For instance, an egocentric POV has been shown to reliably induce the sense of self-location [ ], whereas a third-person perspective tends to lower it [ , ]. The sense of agency is induced through the experienced control of the virtual body [ ], influenced by the visuomotor congruence between the real body and avatar [ - ], whereas incongruences tend to lower it [ , ]. Finally, the sense of ownership is influenced by body appearance and has been induced through avatar models with different degrees of anthropomorphism [ ]. However, despite the possibilities to feel ownership toward avatars that differ from oneself in terms of gender and morphological characteristics [ , ], matching gender, skin tone, and clothes can boost IVBO [ , ]. However, the SoE factors cannot be considered to be isolated from each other, as interrelations have been identified [ ], such as influence of appearance on agency [ ] and control and haptics on ownership [ - ]. Here, recent findings showed that primarily visuoproprioceptive congruence contributes to the sense of agency and ownership and better task performance [ ]. Moreover, Fribourg et al [ ] explored the user preferences for 3 vital factors (ie, POV, control, and appearance), showing the need for an egocentric perspective and high motor control to outweigh the avatar’s appearance. However, these findings seemed to be task dependent, with POV being relevant for locomotion and avatar appearance when manipulating (virtual) objects using the upper body [ , , ].
Controller-Based Locomotion for IVR Avatars
Controller-based locomotion, as an essential component of immersion into IVR avatars, can be divided into physical and artificial approaches . Physical techniques can be more intuitive (ie, room scale); however, an intensive bodily involvement and unnaturalness (eg, walking in place) may cause the opposite effect. In contrast, artificial techniques (eg, teleport and joystick) tend to increase the cognitive workload and are prone to cause cybersickness (ie, motion sickness) [ , ]. As space for natural locomotion is often limited, adding artificial techniques of continuous (eg, controller-based) or noncontinuous (eg, teleport-based) nature could form a viable solution [ ]. Continuous approaches are preferred in open settings, whereas noncontinuous approaches are widely used owing to their user-friendliness [ ]. However, few studies have explored virtual locomotion in combination with IVR avatars, showing its influences on task performance and obstacle avoidance [ - ]. The virtual body can improve walking behavior in IVR, with fewer collisions, more precise paths using a realistic avatar [ ], and more natural behavior [ ]. Here, using walking animations that mimicked natural behavior were preferred over the user’s real motions (ie, walking in place); however, this could lead to unintended steps [ ]. Nevertheless, few studies have examined the effects of virtual locomotion on the SoE factors. Dewez et al [ ] compared natural walking, walking in place, and virtual steering and found a similar SoE, with equal performance with or without an avatar. Consistent with previous findings, movement incongruences between the user and avatar animation did not break the embodiment illusion [ ].
Object Interaction for IVR Avatars
Similar to avatar immersion and locomotion design, interacting with objects and user interfaces (UIs) are essential components for immersive self-representations. Here, using avatars influences the interaction with objects and vice versa . The alignment of this reciprocity to design for both high SoE and usability remains understudied in the current literature, especially when combined with artificial locomotion. Previous studies that used IVR avatars during interaction tasks reported performance enhancements over controllers or virtual hands [ ], independent of the model’s human-likeness, when comparing a realistic avatar with a generic or robot appearance [ , ]. However, as spatial biases were found in IVR [ ], the body may operate as a reference frame [ ], as the object size perception can be altered when using avatars [ ]. Here, avatars can produce occlusions during interactions, which can affect the usability negatively, especially when using more anthropomorphic models [ , ]. However, using congruent body feedback could circumvent this issue, considering that haptics (eg, self-touch) benefits SoE and manipulation performance [ , , ]. Finally, identified usability barriers are objects that are out of reach or placed low. A solution devoid of altering the avatar or breaking the embodiment illusion could be artificial interactions (eg, raycasting) implemented into the avatar’s hands [ , ], allowing interaction with objects without substantial bodily movements.
Goal of This Study
In summary, embodying an IVR avatar may improve usability , spatial awareness [ , ], and (self) presence [ , ]; however, adverse effects can occur owing to an increase in complexity [ ]. Nonetheless, so far, design requirements for such IVR avatars and the feasibility to induce IVBO have not been explored in people with MBID. Despite the proposed use for the treatment of psychiatric disorders, IVR applications focusing on life skills (eg, public transport and grocery shopping) [ , ], vocational training [ ], and (motor) rehabilitation for MBID could be beneficial [ , ]. The virtual body may reduce the cognitive workload and enables novel forms of visuomotor feedback, for instance, to support the problematic hand-eye coordination of individuals with intellectual disability in IVR [ ]. So far, IVBO was mostly investigated in controlled laboratory settings with motion-capture systems or several body trackers to congruently map the user’s bodily movements onto the virtual body. Although these systems seem to provide the highest control, they lack consumer-friendliness to enter care institutions, given the high costs and difficulty in using the equipment. Here, solutions based on inverse kinematics (IK) that use 3-point tracking of the head-mounted display (HMD) and related controllers could provide an alternative, as most interactions focus on the upper body [ ]. Hence, we aimed to explore guidelines for such IVBO in people with MBID, by conducting a user-centered development based on three factors that contribute to functional and plausible actions [ ]:
- How to design IVR avatars for IVBO in people with MBID?
- How to design a virtual embodiment illusion for people with MBID based on IK?
- How to design a controller-based locomotion technique for people with MBID?
- How to design a controller-based (object) manipulation for people with MBID?
- To what extent do participants experience SoE during the examined interaction task?
- To what extent do participants experience a sense of presence (SoP) in the immersive virtual environment (IVE)?
We conducted a user-centered design approach to explore the 3 factors for IVR avatar immersion (ie, avatar, controller-based locomotion, and manipulation), initial feasibility of procedures, and proof of concept of IVBO in people with MBID. For this, we developed an IVR avatar prototype to identify design recommendations for IVBO using 3 consecutive iterations with end users in Dutch care facilities. Throughout these iterations, we refined the IVR avatar system and immersion procedure according to the participants’ needs. Hence, in this study, we established design recommendations for the 3 components and explored the SoE levels and SoP in the IVE to support others in creating accessible IVR avatars.
In total, 29 adults with MBID were recruited through convenience sampling by local therapists from an addiction clinic for individuals with MBID and Dutch care facility for people with MBID. Exclusion criteria included having a history of migraine, epilepsy, visual or motor impairment, or severe mental disorder (eg, schizophrenia, psychosis, or active substance use disorder); susceptibility to COVID-19; proneness to motion sickness; or inability to wear the HMD.
We built the interaction system with consumer hardware and available software. The game engine Unity3D (version 2019.4 LTS; Unity Technologies) was used with the Mecanim IK and the eXtended Reality interaction toolkit (preview; version 0.94) packages to develop an IVBO based on 3-point tracking of the HMD and the related 2 controllers. We implemented the three identified components for IVR avatars: (1) customizable avatar, (2) controller-based locomotion, and (3) object manipulation.
The customizable IVR avatar component () included an egocentric embodiment illusion. The participants were able to enter their height and arm dimensions (ie, by going into the T-pose), customize their gender (woman or man), and select a skin tone.
The controller-based locomotion component () involved a visuomotor experience of moving in the IVE, divided into physical and artificial approaches. The physical approach comprised basic room-scale locomotion (2×2 m), with walking animation when moving. Overall, 3 artificial locomotion approaches were implemented — divided into joystick locomotion with 45° snap turn and walking animation, teleportation locomotion using raycasting with a projectile curve, and a combination of both (hybrid). Haptics were used at the beginning and when executing teleportation by using the controller’s vibration motors. Furthermore, a teleport travel technique that enables the transition to the different interaction contexts by using a screen-space UI was implemented [ ], which followed the user’s rotation on the y-axis when holding the A button.
The (object) manipulation component () included a synchronous visuomotor experience to grab, pick up from low areas, place, and throw virtual objects. We used hand animations for grabbing (grip button) and pinching (trigger button), including haptics, when grabbing and releasing the objects by using the controller’s vibration motors. Raycasting on both hands was implemented to pick up objects that are placed low or out of reach and interact with UIs.
Hardware and IVE
We used an Oculus Quest HMD with 6 df, 1440×1600 pixels per eye, 72 Hz refresh rate, and 90° field of view (FOV); touch controllers; and a compatible IVR-laptop (Intel Core i7 9750H central processing unit; 16 GB RAM; NVIDIA GeForce RTX 2060) with Oculus Link (beta; USB 3.1 cable).
The IVE encompassed an open-world mechanic (200×200 m) to evaluate the system’s components. In the first room setting (15×15×2.5 m), the participants customized the IVR avatar. In the second room, artificial locomotion techniques were evaluated by completing a maze (50×50×2.3 m) with 4 destinations and obstacles to provoke different user movements. On the basis of common game design, we used a vantage point to support spatial understanding and reduce unease. Further, destinations were cued using light beams of different color, with matching leading lines on the walls . In the third context (15×15×2.5 m), we evaluated 4 basic object manipulation tasks to ensure a broad coverage of possible IVR interactions. For this, we used 3 different objects (ie, large cylinder, cube, and small cylinder) to grab and release each object ( A), pick up the object from the ground ( B), place objects at another location ( C), and throw all objects into a box ( D). The corresponding task completion was detected by the system automatically (eg, object grabbed and released), allowing users to transition to the next task. Participants used object-spaced UIs with low hierarchy to customize the avatar, select locomotion approaches, and control interaction tasks. A plain design was used to reduce bias, and we implemented landmarks (pink in color) to aid user’s orientation in the IVE.
A semistructured interview () was conducted after each of the 5 interaction tasks: IVR avatar customization, teleport, joystick, hybrid locomotion, and object manipulation. For the IVR avatar, we aimed to explore the first impression, customization choices, usability issues, ownership perception, and points for improvement. For locomotion, we explored the first impression, usability issues, and impression of the body during locomotion. The questions for all locomotion techniques were identical. Regarding object manipulation, we asked for the first impression, usability issues, enjoyable aspects, and perception of the body during interaction. Finally, we evaluated the impressions and usability issues concerning IVE, UI interactions, and intentions for using the system.
SoE was assessed using an adapted version of the Virtual Embodiment Questionnaire (VEQ) . The VEQ is a 12-item questionnaire assessing the SoE subscales ownership (Cronbach α=.78), agency (Cronbach α=.76), and change (Cronbach α=.77). In addition, 3-items assessing the sense of self-location were adapted to this research context to extend VEQ [ , ]. Scores for each item ranged from 1 (“strongly disagree”) to 7 (“strongly agree”).
SoP was assessed using an adapted version of the Igroup Presence Questionnaire (IPQ) . The IPQ (Cronbach α=.85) is a 14-item questionnaire assessing the SoP subscales general presence, spatial presence (Cronbach α=.80), involvement (Cronbach α=.76), and experienced realism (Cronbach α=.68). Scores for each item ranged from 1 (“strongly disagree”) to 7 (“strongly agree”).
Considering the needs of people with MBID, we adapted questionnaires in language and complexity (by using plain Dutch language) with an expert from the field. This implies that questions asking for 2 different concepts were reduced to one; for example, “I felt like the form or appearance of my own body had changed” was changed to “I felt like the form of my own body had changed” . In addition, complex formulations were simplified; for example, “Somehow I felt that the virtual world surrounded me” was changed to “I felt that the virtual world surrounded me” [ ].
Ethics approval was obtained from the University of Twente’s ethics committee (RP 2020-164) and the care institution’s scientific board.
To comply with COVID-19 precautions, the researcher disinfected the materials and IVR apparatus before evaluation. Before evaluation, disinfection of hands and forearms was required, a medical mask was used by the researcher, and a distance of 1.5 m was maintained whenever possible.
Participants were welcomed and informed about the study procedure before starting the experiment to comply with the ethical principles in accordance with the Declaration of Helsinki. The researcher explained the IVR technology, controls, and possible adverse effects. After informed consent was obtained, the participants were immersed into the IVE. In addition to visual in-game cues, verbal instructions were used to guide the user through the procedure.
Before assessing the prototype version, participants found themselves in the customization room with controller models enabled, but deactivated avatar. First, users were asked to set the interpupillary distance using the HMD slider for proper vision. Then, a short acclimatization period was conducted to enhance spatial understanding, which includes the basic room-scale boundaries and locomotion. After the remaining questions were answered, the assessment of the different components was initiated.
The first task involved avatar customization (). Participants were instructed to go into T-pose to conduct the scaling procedure, followed by the selection of gender and skin tone on the UI ( B), which enabled the avatar ( A). The participants were given a maximum of 5 minutes to explore the avatar, hand, and walking animations using room-scale locomotion. After approximately 3 minutes, the participants were asked to touch the nondominant hand by using the dominant one to explore the self-location of hands through a tactile sensation ( D). Then, users were asked to remove the HMD, so that the extended VEQ and dedicated semistructured interview questions can be assessed by the researcher. After completion, participants were asked to wear the HMD again to proceed to the next component.
The second task evaluated the controller-based locomotion techniques to move in the IVE (). The participants were asked to teleport travel to the vantage point by using the related UI ( D). Then, participants enabled the predefined locomotion approach, that is, joystick ( A), teleport ( B), or hybrid ( C). Following an introduction to the technique, participants were asked to complete the maze. In case of severe motion sickness, participants were allowed to stop early to complete the remaining procedure. Upon completion, participants were asked to remove the HMD to assess the extended VEQ and corresponding interview questions. Then, end users were asked to wear the HMD again to evaluate the remaining locomotion techniques by following the same procedure in an overall counterbalanced manner.
The third task included different manipulations of 3 objects in a room setting (). First, participants were asked to teleport travel to the locomotion UI to enable the preferred technique. Then, participants were instructed to teleport travel to the manipulation tasks and move to the interactables and related UI. The participants were instructed to (1) grab and release each object ( A), (2) pick up the object from the ground using raycasting ( B), (3) place objects at another location based on cues ( C), and (4) throw objects into a box ( D). After completion, the participants were again asked to remove the HMD and the extended VEQ and related interview questions were assessed.
Following the evaluation of the 3 avatar components, participants were asked to provide demographic information and to complete the IPQ and remaining interview questions. Finally, users were debriefed and encouraged to express remaining questions or concerns, and they were subsequently thoroughly answered. The participants received a small nonmonetary gift as a sign of gratitude (approximately €10 [US $10]).
Qualitative data were analyzed based on the thematic analysis approach by Braun and Clarke . To account for the research design, we divided data sets from the iterations into three segments each: (1) avatar customization, (2) artificial locomotion, and (3) manipulation. In these segments, coding was applied to the data that were transcribed verbatim to identify themes by conducting a recursive process using Atlas.ti (version 9.1.4; ATLAS.ti GmbH). The coding process was continuously discussed among the researchers (ie, SL, JV, and RK). Quantitative data regarding the extended VEQ and IPQ subscales were described for each iteration and on an aggregated level. Descriptive analyses were conducted using RStudio (version 1.3.1093).
presents the sociodemographic characteristics and technological experience of the sample. Of the 29 participants, 5 participants (17%) terminated prematurely owing to severe motion sickness (3/5, 60%), anxiety (1/5, 20%), or use inability (1/5, 20%), resulting in missing experimental and demographic data. The remaining participants (24/29, 83%) had a mean age of 34.2 (SD 9.8) years, and most identified as male (23/24, 96%). The sample was equally composed from the 3 institutions (8/24, 33% from each) and included participants with borderline intellectual functioning (IQ=70-85; 13/24, 54%) and mild intellectual disability (IQ=50-69; 11/24, 46%). The technology experience with computers and videogames was rated high compared with virtual reality. The following sections describe the process that led to our final prototype and procedural considerations identified during the design process.
|Sample characteristics||Iteration 1 (n=6)||Iteration 2 (n=12)||Iteration 3 (n=6)||Full sample (n=24)|
|Age (years), mean (SD)||33.83 (9.24)||36 (8.77)||30.83 (12.78)||34.17 (9.77)|
|Gender, n (%)|
|Men||6 (100)||11 (92)||6 (100)||23 (96)|
|Women||0 (0)||0 (0)||0 (0)||0 (0)|
|Diverse||0 (0)||1 (8)||0 (0)||1 (4)|
|Intelligence, n (%)|
|Borderline intellectual functioning||3 (50)||6 (50)||4 (67)||13 (54)|
|Mild intellectual disability||3 (50)||6 (50)||2 (33)||11 (46)|
|Institution, n (%)|
|Addiction clinic||2 (33)||4 (33)||2 (33)||8 (33)|
|Care institution||2 (33)||4 (33)||2 (33)||8 (33)|
|Forensic addiction clinic||2 (33)||4 (33)||2 (33)||8 (33)|
|Technology experiencea, mean (SD)|
|Computer||5.83 (0.75)||5.50 (1.38)||5.17 (1.47)||5.50 (1.25)|
|Video games||4.17 (0.75)||5.83 (1.34)||6.17 (0.98)||5.50 (1.35)|
|Virtual reality||2.17 (1.47)||3.08 (1.88)||3.33 (2.66)||2.92 (1.98)|
aTechnology experience was assessed using a 7-point Likert scale, ranging from 1 (“No experience”) to 7 (“A lot of experience”).
Iterative Prototype Development
Findings From Iteration 1
Most participants (4/6, 67%) reported a positive first impression regarding the IVR avatar system. The scaling procedure was feasible; however, visual in-game instructions were lacking. Here, the avatar’s congruence with one’s own self-concept was essential, because users selected their own skin tone and gender, reporting on the desire to replicate their own body image:
I’m really a slim puppet now. In real life, I have a bit of a belly.
Furthermore, technical issues were described, such as unrealistic wrist movements and arm glitches and the absence of haptics (self-touch) properties:
You cannot grasp it, so it is not yours.
Regarding joystick locomotion, participants reported usability issues when using the 45° snap turn, further contributing to the prevalent cybersickness:
When you hit the wall, it gets really bad.
In contrast, cybersickness was absent during teleport locomotion:
The teleporting went better. I did feel better.
However, usability issues owing to the limited flexibility and own pace were described:
At one point it went too fast. Then it seems too easy, but then you have to take a step back.
In contrast to the joystick approach, during teleport use, participants missed the human-like walking illusion:
Seems like I just really walk, so to speak.
The hybrid approach (ie, joystick and teleport) showed no added value, as participants relied on their preferred technique. However, all approaches showed a need for control habituation and attention shift from avatar to task.
Finally, for (object) manipulation, the usability was rated positively; however, participants reported issues with raycasting, either because it was always enabled or because it was difficult to hit the objects on the ground. Owing to the lack of intuitiveness (“Normally you can bend down and grab.” [participant 2]) and haptics, a need for control habituation was essential:
Because it feels very different from when you’re actually grabbing something.
Of the 6 participants, 2 (33%) reported on interaction realism (“But you know, all the movements, the behavior is indeed real.” [participant 5]), whereas another participant missed realistic gabbing animations by using the virtual hands instead of the controller. The UI interaction showed good usability, despite the need for repositioning to use the object-spaced UIs.
Changes for Iteration 2
Regarding the IVR avatar, the snap turn was refined from 45° to 15° to remove usability issues and alleviate cybersickness. To improve manipulations, the grabbing attachment was changed to the avatar’s hands instead of the controller anchor, and raycast activations were reduced to objects below 50 cm. To enable further customization, alteration of the model’s body dimension (size of the arm, belly, leg, and feet) was implemented (C). We also improved implementation issues that led to a smaller scaling of the model. Furthermore, we refined the accuracy of the hand IK targets for better proprioception. Finally, as the VEQ items seemed complex for our target group, we added 2 questions to the semistructured interview ( ), asking for the sense of ownership after each interaction task and the perception of change after the evaluation procedure.
Findings From Iteration 2
Accordant with the first iteration, replicating one’s own body image was paramount, self-touch and physical collision were lacking, and some animation issues (ie, arm glitches and unrealistic leg movements) were reported. In contrast, participants reported on the clothing, either owing to the incongruence (“Because the suit I was wearing didn’t match with what I was wearing.” [participant 15]) or illusion of wearing the virtual clothes (“I was really convinced in my head, that I was wearing it today.” [participant 10]). Technical issues included a restricted view toward the lower body when bending (“When I look down like that, all of a sudden, I got a belly.” [participant 9]), which also hindered customization owing to occlusion. Moreover, hand size adjustments and customization aids (ie, presets) were lacking. Notably, the human-likeness was described as mostly positive; however, a user missed the haptics and described the uncanny valley:
I actually found that a bit creepy. Because your hands actually looked like real hands.
Regarding artificial locomotion, cybersickness and snap turn issues remained during joystick walking. Further usability remarks included inaccurate wall collisions with lacking haptics, inaccurate physics (ie, weight), unrealistic foot tilting (“So when I walked fast, my feet just shuffled.” [participant 17]), preferences for walking using room scale, and advanced movements (ie, running, jumping, and climbing). As in the previous iteration, participants missed the human-like walking illusion (“I did walk by myself but also didn’t.” [participant 13]) during teleport (“It was a little inhuman.” [participant 19]); however, some participants habituated:
At some point when you do figure it out, yes, then it will probably be a little easier.
Nonetheless, other usability problems, such as limited range, restricted mobility, fast pace resulting in errors, and activation issues, were described. The required bodily turning was perceived as ambiguous, with a participant suggesting the addition of a snap turn. Consistent with the previous iteration, users relied on their preferred technique for hybrid locomotion, and all techniques showed a need for control habituation and attention shift from body to task.
Finally, manipulation usability was rated positive; however, the need for habituation periods for movements and controls, that is, switching between locomotion and object manipulation, controller assignment (“What is where? A and B, joystick.” [participant 8]), and limited room-scale area (“If you had more space, you could just walk there.” [participant 9]), were described. As in the first iteration, hitting objects with raycasting was troublesome. Furthermore, a participant reported on missing haptics:
On the one hand, it feels very familiar and on the other, it’s unrealistic that I don’t feel.
Here, half of the participants (6/12, 50%) described the interactions as realistic; however, few participants mentioned the lack of grabbing realism and unrealistic physics or collision resulting in occlusion. Despite needing habituation, all participants (12/12, 100%) reported good usability regarding the UIs.
Changes for Iteration 3
For the third iteration, we simulated bending using backward placement of the virtual body, aiming to increase the visuoproprioceptive congruence for more natural behavior. Furthermore, we refined the accuracy of the IK targets and improved the smoothness of the body rotation, by including influences of the hand locations. Moreover, we removed arm scaling owing to the preponderant symmetric nature of human bodies and difficult scaling procedures. Notably, we deactivated the HMD’s energy saving option, because we discovered floating floor levels after reactivation, which we aimed to account for during the iteration. To improve object manipulation realism and remove usability issues, the idling hand animation was refined, and objects were picked up with spherecasts instead of raycasts (ie, magnetic toward the object). To allow further customization, we added an option for hand size adjustment to the related UI. Finally, we implemented a dynamic FOV reduction (ie, vignetting) to alleviate cybersickness during artificial locomotion.
Findings From Iteration 3
As in the previous iterations, replicating one’s own body image through customization was key. Participants described the avatar as human-like (“It looks real, and I also felt that I was touching my own hand.” [participant 24]) with congruent haptics, and 33% (2/6) of the participants justified customization choices (ie, skin tone) in contexts of social meaning:
And it’s not because I’m racist.
Similar to the previous iterations, minor technical issues such as an unrealistic wrist movement and imprecise bending of legs remained.
Regarding joystick locomotion, cybersickness and snap turn issues remained, but were reported to be less severe. Participants rated the embodiment as positive, reporting on the human-like walking illusion; however, a participant described an unrealistic foot tilting. Furthermore, the preference for turning using one’s own body, inaccurate wall collision, and attention shift to the task were described. Consistent with the previous iterations, cybersickness was absent during teleport locomotion; however, usability issues owing to the fast pace, activation issues, and turning using one’s own body remained:
I had to turn but I couldn’t walk.
In addition, control issues that rotate the user after teleporting were reported. However, the avatar was rated as positive, even though participants described an ambiguous human-likeness when teleporting and attention shift from avatar to task. Accordant with the other iterations, all approaches showed a need for control habituation, and the hybrid locomotion remained mostly unused.
Consistent with the previous iterations, participants reported positive manipulation usability despite the need for initial (control) habituation. Only 17% (1/6) of the participants mentioned selection issues when using the object-spaced UI, whereas another participant preferred the screen-spaced approach over the object-spaced one. Finally, the embodiment during manipulations was rated as positive and human-like, with a participant describing the feeling of haptics through the controller’s vibration motors (“When I grabbed something, I also felt a vibration through my hand...It really felt like I was holding something.” [participant 19]) and unused artificial locomotion owing to the immersion (“I forgot that I could also walk with my joystick.” [participant 19]).
SoE Related to IVR Avatar Task
shows the extended VEQ scores throughout our iterative development. The contextual differences indicate that the sense of ownership tends to increase with growing interaction capabilities, whereas the perception of change (in the perceived body schema) decreases. In contrast, the sense of self-location and agency scores remained relatively stable across measurements, with positive agency trends during interactions, whereas self-location feelings decreased. Interestingly, ownership and agency scores regarding teleport locomotion were lower than those in other active contexts, which matches the qualitative data.
The qualitative data indicate that IVBO was dependent on habituation (“Just a matter of getting used to it.” [participant 3]), sense of agency (“He does what you do, so to speak.” [participant 5]), self-location (“Because you are controlling that body, so you are looking at it from the eyes of the virtual person.” [participant 15]), customization (“Because I just chose the same that I am.” [participant 3]), human-likeness, and haptics (“It looks real, and I also felt that I was touching my own hand.” [participant 24]). Throughout the iterations, ownership perceptions ranged from overall heterogenous to mostly positive; however, some participants remained ambivalent:
...Because I still know this in my real body and not that.
Regarding the teleport locomotion, participants reported heterogenous ownership feelings, illustrated by unrealistic movements and low agency, with a participant questioning the self-location after teleporting:
...Because you move forward so quickly I thought: “Will that body come with me.”
In contrast, joystick locomotion showed mostly positive ownership remarks, illustrated by the human-like movement illusions and agency through controller operation:
The movements I made with the joysticks, it made those too.
Furthermore, object manipulations showed positive ownership remarks owing to the gain of agency, manipulation realism, and human-likeness. In contrast, the perception of change decreased throughout the iterations. Although some participants in the second iteration felt lighter, smaller, or taller (“I was tall anyway, but I felt even taller when I was there in that game.” [participant 14]), participants in the third iteration reported only minor remarks (“My body just felt the same all the time.” [participant 20]). Notably, some participants disliked embodying an incongruent avatar (“I don’t want to be someone else.” [participant 18]), for example, in contexts of social interactions:
Because I think it’s important that I don’t mislead people.
|Context||Avatar customization, mean (SD)||Teleport locomotion, mean (SD)||Joystick locomotion, mean (SD)||Hybrid locomotion, mean (SD)||Object interaction, mean (SD)|
|Sense of ownership|
|Iteration 1||4.08 (1.69)||4.75 (2.41)||4.92 (2.04)||5.46 (2.28)||5.25 (2.32)|
|Iteration 2||5.15 (1.32)||4.83 (1.24)||5.62 (1.07)||5.81 (0.82)||5.96 (1)|
|Iteration 3||4.29 (1.16)||4.17 (1.72)||5.92 (1.19)||5.21 (1.44)||6.21 (0.95)|
|Overall||4.67 (1.41)||4.65 (1.65)||5.52 (1.38)||5.57 (1.40)||5.84 (1.41)|
|Sense of agency|
|Iteration 1||5.71 (0.75)||5.71 (2.14)||6.08 (0.61)||5.96 (1.09)||5.96 (1.50)|
|Iteration 2||6 (1.19)||5.23 (1.35)||6.17 (0.86)||6.02 (0.98)||6.15 (1.01)|
|Iteration 3||5.67 (1.24)||5.46 (1.49)||5.96 (1.10)||5.38 (1.81)||6.38 (0.89)|
|Overall||5.84 (1.08)||5.41 (1.55)||6.09 (0.84)||5.84 (1.23)||6.16 (1.08)|
|Change (in the perceived body schema)|
|Iteration 1||5 (1.59)||3.75 (2.24)||3.38 (2.22)||3.79 (2.33)||3.08 (2.78)|
|Iteration 2||3.65 (1.32)||3.06 (1.45)||3.42 (1.54)||2.85 (1.54)||2.56 (1.20)|
|Iteration 3||3.75 (1.69)||3 (1.74)||3.42 (2.06)||3.17 (2.08)||3.33 (2.04)|
|Overall||4.01 (1.53)||3.22 (1.69)||3.41 (1.77)||3.17 (1.84)||2.89 (1.84)|
|Sense of self-location|
|Iteration 1||6.56 (0.66)||5.83 (1.01)||5.50 (1.66)||5.56 (2.33)||5.83 (1.76)|
|Iteration 2||6.44 (0.59)||6.22 (0.78)||6.14 (0.77)||6.42 (0.61)||6.22 (0.96)|
|Iteration 3||5.67 (0.97)||5.06 (1.83)||5.56 (1.03)||4.94 (1.85)||5.94 (1.04)|
|Overall||6.28 (0.77)||5.83 (1.22)||5.83 (1.10)||5.83 (1.58)||6.06 (1.17)|
Locomotion Preferences and SoP
Most participants described a preference for joystick locomotion (15/24, 63%). Few participants selected the hybrid (5/24, 21%) or teleport locomotion (4/24, 17%). The latter was predominantly chosen by users who had experienced (severe) cybersickness. However, the dropouts (5/29, 17%) did not indicate their preference, which should be considered carefully.
The general presence (mean 6.12, SD 0.90) and spatial presence (mean 6.03, SD 0.81) were rated high compared with moderate involvement (mean 4.27, SD 1.88) and low realism (mean 3.59, SD 1.38) scores. The IVR environment was often described as unrealistic and boring; hence, participants suggested improving the graphics and realism, including some agents, objects (eg, chair, cars, and plants), or games, to make the experience more appealing. However, according to participant 11, this may cause overstimulation and distress.
This study reports on the feasibility and related design guidelines for IVBO in adults with MBID, by conducting a user-centered design approach with 3 iterations. In contrast to previous studies on IVR embodiment illusions, our avatar was tailored to the needs of our vulnerable group, by gradually adding interaction and customization abilities. In particular, we investigated the IVR avatar with related IK, controller-based locomotion, and (object) manipulation ([ , , , , , , , , ]).
In the following sections, we discuss the findings related to our research questions. First, we discuss the feasibility to induce the illusion, influence of interactions on SoE, and guidance to enhance the immersion. Then, we discuss the design insights from our three IVR avatar components: (1) avatar appearance, (2) controller-based locomotion, and (3) object manipulation. Finally, we report on the limitations of our study, provide guidance for future studies, and provide a succinct summary of our contribution.
Immersing People With MBID Into IVR Avatars
Our findings indicate that adults with MBID can embody anthropomorphistic IVR avatars from an egocentric perspective , even when avatar dimensions slightly differ from the self [ ]. As expected, the highest ownership scores were achieved during object manipulation, requiring the amalgamation of interaction and navigation; however, adding locomotion that mimicked human walking was sufficient to enhance the IVBO compared with baseline [ ]. Despite the participants’ desire to replicate their own body image through customization, this did not lead to effectual IVBO using our IVR. In contrast, adding body control was found to be decisive, suggesting that the sense of agency is vital for inducing ownership illusions in people with MBID [ - ]. This finding is further supported by a decreasing perception of change in the body schema during more extensive interactions, despite the unaltered avatar dimensions. However, the obtained sense of agency and self-location scores showed variance in active contexts, possibly owing to visuomotor incongruences or missing human-likeness during locomotion [ , ], occlusions during interaction [ ], and extended insights into the limitations of the IK. Hence, we suggest further multisensory integrations [ ], that is, advanced IK, animations, and physical interactions (eg, collision) with haptics to amplify the illusion [ , ]. Moreover, implementing more appealing IVEs could improve user involvement and realism, potentially enhancing IVBO [ , ]. However, using IVR avatars for people with MBID required extensive habituation periods when inducing and ending the IVBO, for example, by gradually adding control and providing support after acclimatization, as some participants described prolonged body sensations:
But for my own body I have to get used to it very much. Also when I take off the glasses, all at once bam, oh I’m here huh.
This process proved to be time consuming and complex, potentially hindering uptake and usability in practice. However, tailoring the IVR avatar to the user and use may circumvent this issue, allowing to integrate solely essential (and plausible) interactions, while considering user characteristics (eg, short attention and motor coordination issues) for a fitting immersion procedure.
Designing IVR Avatars for People With MBID
The initial IVR avatar was developed based on the relevant literature and comprised models with high anthropomorphism from an egocentric perspective [, ], customizable gender (man or woman) [ ], skin tone [ ], and body dimensions (ie, model and arms) [ , ]. In contrast to other studies, we omitted a mirror to inspect the virtual body, given that negative influences on ownership were suggested in previous studies [ ]. Our results indicate that extended avatar customization could increase feelings of ownership for people with MBID, given the desire to replicate their own body image, in particular, the body dimensions. However, precise replication methods remain complex and are subject to future studies [ , ], limiting their applicability in consumer settings. However, replication fidelity in our design questions the need for personalization to induce IVBO in our target group. Instead, identification with the virtual body through a customization procedure seemed paramount, by replicating major body image characteristics with generic presets (“I’m really a slim puppet now. In real life I have a bit of a belly.” [participant 4]), as used in commercial social IVR applications (eg, Meta Horizon). Here, modifiable features (eg, clothing) appeared more trivial than body image features (eg, gender, skin tone, and corpulence). However, the body as reference frame could affect agency, interaction usability [ ], and perception of the world [ , ], possibly resulting in unintended effects [ ]. Furthermore, the lack of mirror and plain IVE could have reduced the incongruence awareness in our study [ ], as IVR environments can influence perception [ ], and facial properties may backfire when not personalized [ ]. Nonetheless, our IK system proved sufficient to induce IVBO; however, avoiding impaired control was crucial, as occlusions showed more negative remarks than visual mismatches regarding leg movements [ , ]. Hence, functions for bending should be implemented to achieve sufficient proprioceptive congruence with the user’s body.
Designing Controller-Based Locomotion Approaches for People With MBID
We investigated the design and user preferences for artificial IVR avatar locomotion approaches of continuous (ie, joystick) and noncontinuous nature (ie, teleport). Our findings in people with MBID indicate a favor for the joystick in contrast to the teleport or hybrid approach. This difference was explained by the human-likeness and fidelity during joystick locomotion, which can be supported by high ownership and agency values. In contrast to others, we considered user preferences during our design process, used approaches of different nature, and explored the effects on SoE . Accordant with previous studies, natural walking animation was vital [ , ], and visuomotor incongruences between the model and stagnant user did not break the illusion [ , , ]. Instead, users described a sense of agency via controller operation, which can be supported by the obtained SoE scores. Similar findings were observed in the study by Dewez et al [ ], suggesting that control over the IVR avatar is paramount to visual congruence. A potential explanation for this walking illusion may be the user’s attention shift toward navigation, which reduces the awareness of visuomotor incongruences while providing a realistic movement illusion. In contrast to the similar SoE levels when comparing continuous techniques in populations that are not impaired [ ], we found lower SoE scores when using the noncontinuous teleport. However, the prevalence of cybersickness and the resulting dropouts during joystick locomotion indicate severe usability drawbacks. Hence, designing for cybersickness alleviation seems essential to achieve both high SoE and usability, for instance, through adaptable locomotion. Our findings suggest tailoring FOV (eg, vignetting), turning (eg, snap turn and bodily turning), pace (eg, speed and range), and experience (eg, avoiding collision and stairs) to account for the needs of our group. In addition, enabling control habituation was crucial, given that artificial approaches tend to increase the cognitive workload [ ]. Finally, hybrid locomotion was redundant because users relied on their preferred technique. However, it remains interesting to explore this approach in more experienced users, as it allows fast movement without cybersickness, while providing fidelity for object manipulation.
Designing Controller-Based (Object) Manipulations for People With MBID
We further explored the controller-based IVR avatar interaction by allowing users to engage in object manipulation tasks with the customized body and preferred locomotion approach. Here, designing for an intuitive interaction was decisive, with realistic animations of virtual hands, physical collisions, and related haptics, further supporting the suggested multisensory integration to enhance IVBOs. Although not implemented in our prototype, tailored hand animations could be used to avoid visual interpenetration with virtual objects . Previous study has shown that users favor defined hand poses [ ]; however, constraints through limited animations could reduce SoE and affect performance [ ]. For interactions with objects that are placed low, implementing a spherecast that is magnetic outperformed raycasting and bending. Although bending was attempted intuitively by our participants, it resulted in severe balance errors that can potentially cause injury. In contrast, raycasting showed severe usability drawbacks for small objects, presumably because the visual and haptic feedback was merely activated when hitting the object. Notably, using artificial interactions did not entail negative remarks, presuming that the control remained unimpaired. Nonetheless, object interaction using full IVBO is understudied, particularly when combined with artificial locomotion. During our design process for people with MBID, we observed usability issues when both were combined. Although control habituation could reduce these issues, providing a generous room-scale area for object manipulation seemed more user-friendly; however, physical walking was limited to 2×2 m. Nonetheless, as space is mostly restricted, we encourage others to further explore the requirements for an unobtrusive amalgamation of interaction and locomotion. Finally, the operation of object-spaced and screen-spaced UIs showed good usability with no negative effects, indicating the potential for autonomous use of such IVR applications by our target users.
Limitations and Future Studies
Our study has some limitations that should be considered. First, our convenience sampling in the design process included mainly male participants with some technology literacy, which may reduce the generalizability of the findings to the diverse group with MBID. Second, we failed to achieve an accurate scaling method in the first 2 iterations owing to technical issues, considering that the state-of-the-art system was still in the beta stage and applied outside the controlled laboratory setting. However, the findings provide valuable insights for our design and hint toward applications of implicit learning (eg, proteus effect) , as SoE was observed despite inaccurate avatar dimensions. Third, severe cybersickness issues resulted in dropouts, which may have biased the obtained data, such as locomotion preferences. Fourth, questionnaires were assessed verbally, possibly leading to an increased social desirability bias, whereas paper-based approaches can increase complexity. Previous study from our group suggests that a Visual Analogue Scale implemented in IVR may be more appropriate [ ]. Finally, we used a plain IVE that may reduce spatial awareness, such as height and object size perception [ ]. Hence, we suggest using spatial cues in future studies, which should be carefully selected to avoid distress (ie, overstimulation) in people with MBID.
Future studies should build upon our findings to further refine our guidelines for IVR avatars for people with MBID to design natural IVR interactions and learning (eg, psychotherapy, health education, and life skills training). Here, influences on SoE should be investigated to evaluate the interaction design and confirm the feasibility of IVBO in diverse samples (eg, technology literacy and intellectual and adaptive functioning). From a technical standpoint, exploring multisensory integrations (eg, advanced IK, interaction animations, haptics, and physics-based manipulations) appears to be paramount to enhance the feeling of agency, as natural and unimpaired interactions seem to be pivotal for IVBO. However, investigating advanced body replication methods as opposed to more generic presets seems to be important to understand the self-attribution to IVR avatars in people with MBID. Our prototyping in the care setting revealed that customization and habituation procedures were complex and tedious, potentially hindering the applicability of IVBO in people with MBID. Hence, using a balanced design by conducting habituation periods (ie, adapting locomotion and interaction) before avatar customization seems promising to reduce the required time for inducing IVBO. This implies neglecting properties that are more trivial in the given use context, such as clothing or facial features, which may be more relevant in social or collaborative IVR. Furthermore, the application of our locomotion and manipulation modules should be investigated with varying degrees of embodiment (eg, full body vs hands) to tailor the interaction design to the individual user and use case. This could reduce the tailoring effort and occurrence of adverse effects (eg, cybersickness), for instance, by limiting locomotion to room scale for body swapping scenarios, whereas public transport trainings may profit from artificial techniques for an extended range. For cueing, using game design and narratives seems promising, as common visual interaction cues (eg, light beams, leading lines, and placement cues) and aids (eg, vantage points and landmarks) showed adequate usability. Finally, we combined promising design components; however, a plethora of other interaction techniques can be explored, such as redirected walking to further alleviate cybersickness.
Our findings suggest that adults with MBID can embody gender-matched IVR avatars with high anthropomorphism. To induce IVBO, having a high sense of agency over the virtual body appeared to be crucial, ideally with corresponding multisensory feedback, such as physics-based collisions and haptics. This is consistent with previous studies on place illusion and plausibility illusion , suggesting that plausible interactions are vital for IVBO in our group. However, implementing artificial aids into the virtual body (ie, spherecasting and raycasting) was not perceived as disruptive, presuming that the control was not impaired. Customizing the avatar according to the participant’s body image appeared to boost the illusion; however, it was complex and tedious, affecting the practicability of IVBO, as individuals with MBID showed an extensive need for (control) habituation. Therefore, balancing IVBO immersion by focusing on habituation and lowering customization effort seems to be crucial to achieve both high SoE and usability. Owing to the limited attention span of people with MBID, tailoring to user and use appears to be important. Considering the cognitive limitations, we advise to avoid artificial interaction techniques that are implausible and increase the cognitive workload (eg, teleport) or evoke severe side effects, if possible, for the intended use context. In contrast, the use of artificial techniques comes at the expense of learning time and cognitive load, possibly interfering with other immersion parts. In conclusion, although designing IVR avatars for people with MBID is not fundamentally different, users’ limitations challenge designers to develop tailored immersion procedures. Future studies should further investigate guidelines for IVR avatars in people with MBID by designing natural interactions, including multisensory integrations and other interaction approaches (eg, hand tracking and redirected walking). In addition, procedures and use cases for implicit and explicit learning should be explored, for instance, as a tool for playful health behavior change interventions. For this, the necessity of interactions should be reviewed carefully to avoid adverse effects (eg, cybersickness) and reduce the burden when interacting with IVR for people with MBID.
SL constructed the study design and immersive virtual reality prototype, conducted data collection and analysis, and drafted the manuscript. The other authors (JV, RK, and DH) supervised the project and provided continuous input in all phases. All authors contributed to the final version of the manuscript. The project was funded by the Tactus Addiction Care–Centre of Clinical Excellence in Addiction and Intellectual Disability, in collaboration with the University of Twente–Department of Human Media Interaction. The authors gratefully acknowledge the contribution of Jan Kolkmeier, Sara Falcone, Louise Kemna, Saskia van Horsen, Laura Brouwer, Leonie Hebbink, Marloes Leijser-van de Vosse, Marian Assink, Tactus Johannes Wierhuis Rekken, Tactus Piet Roordakliniek Zutphen, Aveleijn De Wonde Almelo, and all our participants. Furthermore, the authors would like to acknowledge the tutorials from Valem on YouTube to build the immersive virtual reality prototype, VR Tunneling Pro plug-in from Sigtrap games, models and animations from Mixamo, and VoxHands plug-in from Hiroki Omae to create hand animation clips.
Conflicts of Interest
Semi-structured interview –IVR avatars for embodiment illusions in people with MBID.DOCX File , 16 KB
Guidelines for designing IVR avatars for embodiment illusions in people with MBID.DOCX File , 17 KB
- Emmelkamp PM, Meyerbröker K. Virtual reality therapy in mental health. Annu Rev Clin Psychol 2021 May 07;17:495-519. [CrossRef] [Medline]
- Langener S, Van Der Nagel J, van Manen J, Markus W, Dijkstra B, De Fuentes-Merillas L, et al. Clinical relevance of immersive virtual reality in the assessment and treatment of addictive disorders: a systematic review and future perspective. J Clin Med 2021 Aug 18;10(16):3658 [FREE Full text] [CrossRef] [Medline]
- Emerson E. Health status and health risks of the "hidden majority" of adults with intellectual disability. Intellect Dev Disabil 2011 Jun;49(3):155-165. [CrossRef] [Medline]
- Urfer-Parnas A, Lykke Mortensen E, Saebye D, Parnas J. Pre-morbid IQ in mental disorders: a Danish draft-board study of 7486 psychiatric patients. Psychol Med 2010 Apr;40(4):547-556. [CrossRef] [Medline]
- Whittle EL, Fisher KR, Reppermund S, Lenroot R, Trollor J. Barriers and enablers to accessing mental health services for people with intellectual disability: a scoping review. J Ment Health Res Intellect Disabil 2018;11(1):69-102. [CrossRef]
- de Oliveira Malaquias FF, Malaquias RF. The role of virtual reality in the learning process of individuals with intellectual disabilities. Technol Disabil 2016;28(4):133-138. [CrossRef]
- Langener S, VanDerNagel J, Klaassen R, Van der Valk P, Heylen D. “Go up in smoke”: feasibility and initial acceptance of a virtual environment to measure tobacco craving in vulnerable individuals. In: Proceedings of the IEEE 9th International Conference on Serious Games and Applications for Health. 2021 Presented at: SeGAH '21; August 4-6, 2021; Dubai, United Arab Emirates p. 1-8. [CrossRef]
- Keizer A, van Elburg A, Helms R, Dijkerman HC. A virtual reality full body illusion improves body image disturbance in anorexia nervosa. PLoS One 2016 Oct 6;11(10):e0163921 [FREE Full text] [CrossRef] [Medline]
- Standen PJ, Brown DJ. Virtual reality and its role in removing the barriers that turn cognitive impairments into intellectual disability. Virtual Reality 2006 Sep 22;10(3-4):241-252. [CrossRef]
- Rose F, Brooks B, Attree EA. Virtual reality in vocational training of people with learning disabilities. In: Proceedings of the 3rd International Conference on Disability, Virtual Reality and Associated Technologies. 2000 Presented at: ICDVRAT '00; September 23-25, 2000; Sardinia, Italy.
- Cunha RD, Neiva FW, Silva RL. Virtual reality as a support tool for the treatment of people with intellectual and multiple disabilities: a systematic literature review. Rev Inform Teor Apl 2018 Feb 18;25(1):67-81. [CrossRef]
- Brown R, Sitbon L, Fell L, Koplick S, Beaumont C, Brereton M. Design insights into embedding virtual reality content into life skills training for people with intellectual disability. In: Proceedings of the 28th Australian Conference on Computer-Human Interaction. 2016 Nov Presented at: OzCHI '16; November 29-December 2 2016; Launceston, Australia p. 581-585. [CrossRef]
- Shaker A, Lin X, Kim DY, Kim J, Sharma G, Devine MA. Design of a virtual reality tour system for people with intellectual and developmental disabilities: a case study. Comput Sci Eng 2020 May 1;22(3):7-17. [CrossRef]
- Cunha RD, Neiva FW, Silva RL. Virtual reality-based training for the motor developmentof people with intellectual and multiple disabilities. Rev Inform Teor Apl 2019 Nov 30;26(3):40-49. [CrossRef]
- Harris MC, Brown DJ, Vyas P, Lewis J. A methodology for the co-design of shared VR environments with people with intellectual disabilities: insights from the preparation phase. In: Proceedings of the 16th International Conference on Universal Access in Human-Computer Interaction. User and Context Diversity. 2022 Presented at: UAHCI '22; June 26-July 1, 2022; Virtual p. 217-230. [CrossRef]
- Slater M. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos Trans R Soc Lond B Biol Sci 2009 Dec 12;364(1535):3549-3557 [FREE Full text] [CrossRef] [Medline]
- Slater M, Perez-Marcos D, Ehrsson HH, Sanchez-Vives MV. Inducing illusory ownership of a virtual body. Front Neurosci 2009 Sep;3(2):214-220 [FREE Full text] [CrossRef] [Medline]
- de Vignemont F. Embodiment, ownership and disownership. Conscious Cogn 2011 Mar;20(1):82-93. [CrossRef] [Medline]
- Kilteni K, Groten R, Slater M. The sense of embodiment in virtual reality. Presence (Camb) 2012 Nov 1;21(4):373-387. [CrossRef]
- Roth D, Latoschik ME. construction of the virtual embodiment questionnaire (VEQ). IEEE Trans Vis Comput Graph 2020 Dec;26(12):3546-3556. [CrossRef] [Medline]
- Longo MR, Schüür F, Kammers MP, Tsakiris M, Haggard P. What is embodiment? A psychometric approach. Cognition 2008 Jun;107(3):978-998. [CrossRef] [Medline]
- Blanke O, Metzinger T. Full-body illusions and minimal phenomenal selfhood. Trends Cogn Sci 2009 Jan;13(1):7-13. [CrossRef] [Medline]
- Slater M. Implicit learning through embodiment in immersive virtual reality. In: Liu D, Dede C, Huang R, Richards J, editors. Virtual, Augmented, and Mixed Realities in Education. Singapore, Singapore: Springer; 2017:19-33.
- Banakou D, Groten R, Slater M. Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. Proc Natl Acad Sci U S A 2013 Jul 30;110(31):12846-12851 [FREE Full text] [CrossRef] [Medline]
- Peck TC, Seinfeld S, Aglioti SM, Slater M. Putting yourself in the skin of a black avatar reduces implicit racial bias. Conscious Cogn 2013 Sep;22(3):779-787. [CrossRef] [Medline]
- Neyret S, Navarro X, Beacco A, Oliva R, Bourdin P, Valenzuela J, et al. An embodied perspective as a victim of sexual harassment in virtual reality reduces action conformity in a later milgram obedience scenario. Sci Rep 2020 Apr 10;10(1):6207 [FREE Full text] [CrossRef] [Medline]
- Gorisse G, Christmann O, Amato EA, Richir S. First- and third-person perspectives in immersive virtual environments: presence and performance analysis of embodied users. Front Robot AI 2017 Jul 17;4:33. [CrossRef]
- Galvan Debarba H, Bovet S, Salomon R, Blanke O, Herbelin B, Boulic R. Characterizing first and third person viewpoints and their alternation for embodied interaction in virtual reality. PLoS One 2017 Dec 27;12(12):e0190109 [FREE Full text] [CrossRef] [Medline]
- Maselli A, Slater M. Sliding perspectives: dissociating ownership from self-location during full body illusions in virtual reality. Front Hum Neurosci 2014 Sep 11;8:693 [FREE Full text] [CrossRef] [Medline]
- Caspar EA, Cleeremans A, Haggard P. The relationship between human agency and embodiment. Conscious Cogn 2015 May;33:226-236. [CrossRef] [Medline]
- Slater M, Spanlang B, Corominas D. Simulating virtual environments within virtual environments as the basis for a psychophysics of presence. ACM Trans Graph 2010 Jul 26;29(4):1-9. [CrossRef]
- Falcone S, Brouwer AM, Cocu I, Gijsbertse K, Heylen D, van Erp J. The relative contribution of five key perceptual cues and their interaction to the sense of embodiment. Technol Mind Behav 2022 Mar 10;3(1). [CrossRef]
- Farrer C, Bouchereau M, Jeannerod M, Franck N. Effect of distorted visual feedback on the sense of agency. Behav Neurol 2008;19(1-2):53-57 [FREE Full text] [CrossRef] [Medline]
- Sanchez-Vives MV, Spanlang B, Frisoli A, Bergamasco M, Slater M. Virtual hand illusion induced by visuomotor correlations. PLoS One 2010 Apr 29;5(4):e10381 [FREE Full text] [CrossRef] [Medline]
- Lugrin JL, Latt J, Latoschik ME. Anthropomorphism and illusion of virtual body ownership. In: Proceedings of the 25th International Conference on Artificial Reality and Telexistence and 20th Eurographics Symposium on Virtual Environments. 2015 Presented at: ICAT - EGVE '15; October 28-30, 2015; Kyoto, Japan p. 1-8. [CrossRef]
- Laha B, Bailenson JN, Won AS, Bailey JO. Evaluating control schemes for the third arm of an avatar. Presence (Camb) 2016 Nov 01;25(2):129-147. [CrossRef]
- Slater M, Spanlang B, Sanchez-Vives MV, Blanke O. First person experience of body transfer in virtual reality. PLoS One 2010 May 12;5(5):e10564 [FREE Full text] [CrossRef] [Medline]
- Maselli A, Slater M. The building blocks of the full body ownership illusion. Front Hum Neurosci 2013 Mar 21;7:83 [FREE Full text] [CrossRef] [Medline]
- Waltemate T, Gall D, Roth D, Botsch M, Latoschik ME. The impact of avatar personalization and immersion on virtual body ownership, presence, and emotional response. IEEE Trans Vis Comput Graph 2018 Apr;24(4):1643-1652. [CrossRef] [Medline]
- Fribourg R, Argelaguet F, Lecuyer A, Hoyet L. Avatar and sense of embodiment: studying the relative preference between appearance, control and point of view. IEEE Trans Vis Comput Graph 2020 May;26(5):2062-2072. [CrossRef] [Medline]
- Argelaguet F, Hoyet L, Trico M, Lécuyer A. The role of interaction in virtual embodiment: effects of the virtual hand representation. In: Proceedings of the 2016 IEEE Virtual Reality. 2016 Presented at: VR '16; March 19-23, 2016; Greenville, SC, USA p. 3-10. [CrossRef]
- Steptoe W, Steed A, Slater M. Human tails: ownership and control of extended humanoid avatars. IEEE Trans Vis Comput Graph 2013 Apr;19(4):583-590. [CrossRef] [Medline]
- Gonzalez-Franco M, Perez-Marcos D, Spanlang B, Slater M. The contribution of real-time mirror reflections of motor actions on virtual body ownership in an immersive virtual environment. In: Proceedings of the 2010 IEEE Virtual Reality Conference. 2010 Presented at: VR '10; March 20-24, 2010; Boston, MA, USA p. 111-114. [CrossRef]
- Kokkinara E, Slater M. Measuring the effects through time of the influence of visuomotor and visuotactile synchronous stimulation on a virtual body ownership illusion. Perception 2014;43(1):43-58. [CrossRef] [Medline]
- Dewez D, Hoyet L, Lécuyer A, Argelaguet Sanz F. Towards “avatar-friendly” 3D manipulation techniques: bridging the gap between sense of embodiment and interaction in virtual reality. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 2021 Presented at: CHI '21; May 8-13, 2021; Yokohama, Japan p. 1-14. [CrossRef]
- Boletsis C. The new era of virtual reality locomotion: a systematic literature review of techniques and a proposed typology. Multimodal Technol Interact 2017 Sep 28;1(4):24. [CrossRef]
- Fernandes AS, Feiner SK. Combating VR sickness through subtle dynamic field-of-view modification. In: Proceedings of the 2016 IEEE Symposium on 3D User Interfaces. 2016 Presented at: 3DUI '16; March 19-20, 2016; Greenville, SC, USA p. 201-210. [CrossRef]
- Pan Y, Steed A. How foot tracking matters: the impact of an animated self-avatar on interaction, embodiment and presence in shared virtual environments. Front Robot AI 2019 Oct 30;6:104 [FREE Full text] [CrossRef] [Medline]
- McManus EA, Bodenheimer B, Streuber S, de la Rosa S, Bülthoff HH, Mohler BJ. The influence of avatar (self and character) animations on distance estimation, object interaction and locomotion in immersive virtual environments. In: Proceedings of the ACM SIGGRAPH Symposium on Applied Perception in Graphics and Visualization. 2011 Aug Presented at: APGV '11; August 27-28, 2011; Toulouse, France p. 37-44. [CrossRef]
- Dewez D, Hoyet L, Lécuyer A, Argelaguet F. Studying the inter-relation between locomotion techniques and embodiment in virtual reality. In: Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality. 2020 Presented at: ISMAR '20; November 9-13, 2020; Porto de Galinhas, Brazil p. 452-461. [CrossRef]
- Medeiros D, dos Anjos RK, Mendes D, Pereira JM, Raposo A, Jorge J. Keep my head on my shoulders!: why third-person is bad for navigation in VR. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology. 2018 Nov Presented at: VRST '18; November 28-December 1, 2018; Tokyo, Japan p. 1-10. [CrossRef]
- Mestre DR, Louison C, Ferlay F. The contribution of a virtual self and vibrotactile feedback to walking through virtual apertures. In: Proceedings of the 18th International Conference on Human-Computer Interaction. Interaction Platforms and Techniques. 2016 Presented at: HCI '16; July 17-22, 2016; Toronto, Canada p. 222-232. [CrossRef]
- Park C, Jang K. Investigation of visual self-representation for a walking-in-place navigation system in virtual reality. In: Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces. 2019 Presented at: VR '19; March 23-27, 2019; Osaka, Japan p. 1114-1115. [CrossRef]
- Gao B, Lee J, Tu H, Seong W, Kim H. The effects of avatar visibility on behavioral response with or without mirror-visual feedback in virtual environments. In: Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops. 2020 Presented at: VRW '20; March 22-26, 2020; Atlanta, GA, USA p. 780-781. [CrossRef]
- Lok B, Naik S, Whitton M, Brooks FP. Effects of handling real objects and self-avatar fidelity on cognitive task performance and sense of presence in virtual environments. Presence (Camb) 2003 Dec 01;12(6):615-628. [CrossRef]
- Schwind V, Mayer S, Comeau-Vermeersch A, Schweigert R, Henze N. Up to the finger tip: the effect of avatars on mid-air pointing accuracy in virtual reality. In: Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. 2018 Presented at: CHI PLAY '18; October 28-31, 2018; Melbourne, Australia p. 477-488. [CrossRef]
- Plumert JM, Kearney JK, Cremer JF, Recker K. Distance perception in real and virtual environments. ACM Trans Appl Percept 2005 Jul;2(3):216-233. [CrossRef]
- Hall ET. The Hidden Dimension. Garden City, NY, USA: Doubleday; Sep 1, 1990.
- Mohler BJ, Creem-Regehr SH, Thompson WB, Bülthoff HH. The effect of viewing a self-avatar on distance judgments in an HMD-based virtual environment. Presence (Camb) 2010 Jun 01;19(3):230-242. [CrossRef]
- Tran TQ, Shin H, Stuerzlinger W, Han J. Effects of virtual arm representations on interaction in virtual environments. In: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. 2017 Nov Presented at: VRST '17; November 8-10, 2017; Gothenburg, Sweden p. 1-9. [CrossRef]
- Bovet S, Debarba HG, Herbelin B, Molla E, Boulic R. The critical role of self-contact for embodiment in virtual reality. IEEE Trans Vis Comput Graph 2018 Apr;24(4):1428-1436. [CrossRef] [Medline]
- Swapp D, Pawar V, Loscos C. Interaction with co-located haptic feedback in virtual reality. Virtual Reality 2006 Apr 27;10(1):24-30. [CrossRef]
- Mine MR. Virtual environment interaction techniques. Department of Computer Science, University of North Carolina. 1995. URL: http://www.cs.unc.edu/techreports/95-018.pdf [accessed 2021-12-02]
- Skarbez R, Brooks Jr FP, Whitton MC. A survey of presence and related concepts. ACM Comput Surv 2018 Nov 30;50(6):1-39. [CrossRef]
- Bozgeyikli L, Bozgeyikli E, Clevenger M, Raij A, Alqasemi R, Sundarrao S, et al. VR4VR: vocational rehabilitation of individuals with disabilities in immersive virtual reality environments. In: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 2015 Presented at: PETRA '15; July 1-3, 2015; Corfu, Greece p. 1-4. [CrossRef]
- Standen PJ, Brown DJ. Virtual reality in the rehabilitation of people with intellectual disabilities: review. Cyberpsychol Behav 2005 Jun;8(3):272-288. [CrossRef] [Medline]
- Rose FD, Brooks BM, Attree EA. An exploratory investigation into the usability and usefulness of training people with learning disabilities in a virtual environment. Disabil Rehabil 2002;24(11-12):627-633. [CrossRef] [Medline]
- Oberdörfer S, Fischbach M, Latoschik ME. Effects of VE transition techniques on presence, illusion of virtual body ownership, efficiency, and naturalness. In: Proceedings of the Symposium on Spatial User Interaction. 2018 Oct Presented at: SUI '18; October 13-14, 2018; Berlin, Germany p. 89-99. [CrossRef]
- Kim J, Hwang E, Shin H, Gil YH, Lee J. Top-down, bottom-up, and history-driven processing of multisensory attentional cues in intellectual disability: an experimental study in virtual reality. PLoS One 2021 Dec 21;16(12):e0261298 [FREE Full text] [CrossRef] [Medline]
- Schubert T, Friedmann F, Regenbrecht H. The experience of presence: factor analytic insights. Presence (Camb) 2001 Jun;10(3):266-281. [CrossRef]
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006 Jan;3(2):77-101. [CrossRef]
- Latoschik ME, Roth D, Gall D, Achenbach J, Waltemate T, Botsch M. The effect of avatar realism in immersive social virtual realities. In: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. 2017 Nov Presented at: VRST '17; November 8-10, 2017; Gothenburg, Sweden p. 1-10. [CrossRef]
- Lugrin JL, Landeck M, Latoschik ME. Avatar embodiment realism and virtual fitness training. In: Proceedings of the 2015 IEEE Virtual Reality. 2015 Presented at: VR '15; March 23-27, 2015; Arles, France p. 225-226. [CrossRef]
- Pyasik M, Burin D, Pia L. On the relation between body ownership and sense of agency: a link at the level of sensory-related signals. Acta Psychol (Amst) 2018 Apr;185:219-228. [CrossRef] [Medline]
- Seghezzi S, Giannini G, Zapparoli L. Neurofunctional correlates of body-ownership and sense of agency: a meta-analytical account of self-consciousness. Cortex 2019 Dec;121:169-178. [CrossRef] [Medline]
- Cioffi MC, Hackett J, Moore JW. Synchronous stimulation in the rubber hand illusion task boosts the subsequent sense of ownership on the vicarious agency task. Conscious Cogn 2020 Apr;80:102904. [CrossRef] [Medline]
- Weijs ML, Macartney E, Daum MM, Lenggenhager B. Development of the bodily self: effects of visuomotor synchrony and visual appearance on virtual embodiment in children and adults. J Exp Child Psychol 2021 Oct;210:105200 [FREE Full text] [CrossRef] [Medline]
- Lenggenhager B, Mouthon M, Blanke O. Spatial aspects of bodily self-consciousness. Conscious Cogn 2009 Mar;18(1):110-117. [CrossRef] [Medline]
- Dewez D, Fribourg R, Argelaguet F, Hoyet L, Mestre D, Slater M, et al. Influence of personality traits and body awareness on the sense of embodiment in virtual reality. In: Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality. 2019 Presented at: ISMAR '19; October 14-18, 2019; Beijing, China p. 123-134. [CrossRef]
- Pujades S, Mohler B, Thaler A, Tesch J, Mahmood N, Hesse N, et al. The virtual caliper: rapid creation of metrically accurate avatars from 3D measurements. IEEE Trans Vis Comput Graph 2019 May;25(5):1887-1897. [CrossRef] [Medline]
- van der Hoort B, Guterstam A, Ehrsson HH. Being Barbie: the size of one's own body determines the perceived size of the world. PLoS One 2011;6(5):e20195 [FREE Full text] [CrossRef] [Medline]
- Kokkinara E, Kilteni K, Blom KJ, Slater M. First person perspective of seated participants over a walking virtual body leads to illusory agency over the walking. Sci Rep 2016 Jul 01;6:28879 [FREE Full text] [CrossRef] [Medline]
- Prachyabrued M, Borst CW. Visual interpenetration tradeoffs in whole-hand virtual grasping. In: Proceedings of the 2012 IEEE Symposium on 3D User Interfaces. 2012 Presented at: 3DUI '12; March 4-5, 2012; Costa Mesa, CA, USA p. 39-42. [CrossRef]
|FOV: field of view|
|HMD: head-mounted display|
|IK: inverse kinematics|
|IPQ: Igroup Presence Questionnaire|
|IVBO: illusions of virtual body ownership|
|IVE: immersive virtual environment|
|IVR: immersive virtual reality|
|MBID: mild to borderline intellectual disability|
|POV: point of view|
|SoE: sense of embodiment|
|SoP: sense of presence|
|UI: user interface|
|VEQ: Virtual Embodiment Questionnaire|
Edited by N Zary, G Eysenbach; submitted 30.05.22; peer-reviewed by 冲 李, G Barbareschi; comments to author 01.09.22; revised version received 22.09.22; accepted 31.10.22; published 07.12.22Copyright
©Simon Langener, Randy Klaassen, Joanne VanDerNagel, Dirk Heylen. Originally published in JMIR Serious Games (https://games.jmir.org), 07.12.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.