This paper is in the following e-collection/theme issue:

Exergames, Active Games and Gamification of Physical Activity (180) Extended Reality, Virtual Reality and Virtual Worlds (560) Serious Games for Health and Medicine (683) Games and Gamification for Health (650) mHealth for Wellness, Behavior Change and Prevention (2871)

Published on in Vol 11 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/40421, first published .
Differences in Brain Activity and Body Movements Between Virtual Reality and Offline Exercise: Randomized Crossover Trial

Differences in Brain Activity and Body Movements Between Virtual Reality and Offline Exercise: Randomized Crossover Trial

Differences in Brain Activity and Body Movements Between Virtual Reality and Offline Exercise: Randomized Crossover Trial

Authors of this article:

Hee Jin Kim1 Author Orcid Image ;   Jea Woog Lee2 Author Orcid Image ;   Gangta Choi1 Author Orcid Image ;   Junghoon Huh3 Author Orcid Image ;   Doug Hyun Han1 Author Orcid Image
Article Authors Cited by (2) Tweetations (5) Metrics

    Original Paper

    1Department of Psychiatry, College of Medicine, Chung-Ang University, Seoul, Republic of Korea

    2Department of Information & Technology in Sport, College of Sports Science, Chung-Ang University, Anseong-si, Gyeonggi-do, Republic of Korea

    3Department of Human Motor Behavior, College of Sports Science, Chung-Ang University, Anseong-si, Gyeonggi-do, Republic of Korea

    *these authors contributed equally

    Corresponding Author:

    Doug Hyun Han, MD, PhD

    Department of Psychiatry

    College of Medicine

    Chung-Ang University

    Heuk Seok Ro 84

    Seoul, 06974

    Republic of Korea

    Phone: 82 2 6299 3132

    Fax:82 2 6298 1508

    Email: hduk70@gmail.com


    Background: Virtual reality (VR) has been suggested to be effective at enhancing physical exercises because of its immersive characteristics. However, few studies have quantitatively assessed the range of motion and brain activity during VR exercises.

    Objective: We hypothesized that 3D immersive VR could stimulate body movement and brain activity more effectively than standard exercises and that the increased range of motions during 3D immersive VR exercises would be associated with orbitofrontal activation.

    Methods: A randomized crossover trial was conducted to compare exercises with and without VR. A total of 24 healthy males performed the same motions when exercising with and without 3D immersive VR, and the recorded videos were used for motion analysis. Hemodynamic changes in the prefrontal cortex were assessed using functional near-infrared spectroscopy.

    Results: There were significant differences in the total angle (z=−2.31; P=.02), length (z=−2.78; P=.005), calorie consumption (z=−3.04; P=.002), and change in accumulated oxygenated hemoglobin within the right orbitofrontal cortex (F1,94=9.36; P=.003) between the VR and offline trials. Hemodynamic changes in the right orbitofrontal cortex were positively correlated with the total angle (r=0.45; P=.001) and length (r=0.38; P=.007) in the VR exercise; however, there was no significant correlation in the offline trial.

    Conclusions: The results of this study suggest that 3D immersive VR exercise effectively increases the range of motion in healthy individuals in relation to orbitofrontal activation.

    Trial Registration: Clinical Research Information Service KCT0008021; https://cris.nih.go.kr/cris/search/detailSearch.do/23671

    JMIR Serious Games 2023;11:e40421

    doi:10.2196/40421

    Keywords

    virtual reality exercise; near-infrared spectroscopy; spectroscopy; hemodynamic; blood flow; hemoglobin; brain; prefrontal cortex; orbitofrontal cortex; immersion; virtual reality; VR; exercise; range of motion; physical activity; fitness; motion; movement; randomized; calorie 


    Virtual reality (VR) is an artificially created sensory experience using digital technology, which provides users with a subjective sense of “being there” [1]. The format of VR, referring to the structure of the information displayed, can be either 2D or 3D multimedia. The main difference between the 2 formats is the level of interactivity, with 3D environments allowing changes in the user’s point of view, navigation, and interaction with objects and people. The display devices, which are the technological equipment used to visualize the formats, are classified based on the level of immersion they provide: nonimmersive, semi-immersive, and immersive. Nonimmersive systems are simple devices that use a single screen, such as a desktop PC. Semi-immersive systems, such as the Cave automatic virtual environment and the Powerwall display, provide a stereo image of an environment using a projection linked to the observer’s position. Immersive systems, such as a head-mounted display (HMD), isolate the user from external world stimuli [2]. An HMD gradually follows the users’ movements, quantifies the position and direction of articles in reality, and creates a corresponding stereoscopic view. Users perceive themselves to be situated in a virtual environment and are temporarily unable to recognize behaviors and objects in the real environment [1].

    VR is expected to have enormous potential in fields such as education, training, and entertainment [3]. In particular, the application of VR technology is promising in the field of sports, as it can overcome human limitations due to technical innovations, thus allowing for the development of effective training methods [4].

    VR application in sports can increase motivation, enjoyment, and physical performance [5]. This may be due to the unique characteristics of VR, such as immersion, interaction, and infinite degrees of freedom in spatial and temporal situations [6,7]. Fox and Bailenson [8] showed that physical activity could be increased through a reinforcement mechanism using immersive VR technology. Jones et al [9] demonstrated that immersion in VR exercises was positively correlated with motivation, pleasure, and enjoyment after exercises. In addition, participants can interact with objects in a stereoscopic visual space without spatial limitations, which can be manipulated in various ways, depending on individual needs [10]. Athletes can use VR exercises to learn new sports strategies and compete with their virtual partners [10]. By using the unlimited spatial and temporal boundaries of VR, injury-prone skills can be safely trained [11]. For example, VR allows ski jumps and downhill skiing in a safe environment [11].

    The shortcomings of physical exercise using an immersive VR have been attributed to the use of HMDs. Exercising while wearing an HMD can be uncomfortable due to sweating and head bumps [12]. In addition, HMDs can be impractical for movement accuracy and speed. They can also be potentially dangerous (eg, when the device blocks the vision of the moving treadmill while running [12]). Furthermore, interactive VR display systems linked to various eye-movement systems can cause motion sickness [13].

    VR exercises are effectively used in the rehabilitation of patients who have lost motor skills [5,14]. They are also used to increase the physical fitness of patients with chronic medical conditions, such as hemodialysis or dementia, and developmental disorders, such as intellectual disability or autism [15,16]. Most previous studies on VR exercises have been conducted on patient groups [5,14-16]. However, VR exercises are increasingly used by athletes and other sports-related professionals, as they enable individualized training with real-time feedback without coaches [11,12]. Moreover, VR exercises have recently been widely used in the public sphere to promote physical fitness [5]. When applied to healthy individuals, VR exercise can increase exercise speed, heart rate, balance, motivation, enjoyment, adherence, executive function, and neuroplasticity [17-20]. Although many studies have suggested the qualitative effectiveness of VR exercise, few have quantitatively assessed its effectiveness [12].

    Previous studies have suggested that the brain regions of interest in response to VR and physical exercises are the dorsolateral prefrontal cortex (DLPFC), ventrolateral prefrontal cortex (VLPFC), and orbitofrontal cortex (OFC) [9,21,22]. Of these 3 major prefrontal cortical regions, a functional near-infrared spectroscopy (fNIRS) study showed that VR stimuli activated the OFC [21]. The OFC has been associated with emotional and behavioral regulation, decision-making, maintenance of behavioral flexibility, and processing of anticipated rewards and punishments [23]. Inappropriate functioning of the OFC can lead to disinhibition, preservation, and impulse control problems [24]. Owing to the functions of rewards and decisions, the OFC can be associated with VR-induced immersion and flow [8,25].

    This study aimed to investigate whether immersive VR technology can enhance physical exercise, in terms of the range of motion and brain activity, in healthy individuals. Kinematics and resting state fNIRS methodologies were adopted to demonstrate the quantitative effectiveness of 3D immersive VR exercise. Kinematics is useful for objectifying human movements and comparing different subjects or situations, such as before and after treatment or training in various fields (eg, sports science) [26]. For example, knee and hip angles at foot strikes during running have been quantified using 2D video recording and motion analysis software [27]. Vertical jump height, frequently used as an indirect measure of muscle power in the lower extremities, was also estimated using the video method [28]. In VR rehabilitation studies, the difference in ranges of motion before and after treatment was measured to assess improvement [29]. fNIRS is a noninvasive functional brain imaging tool that measures cortical hemodynamic activity [30]. Near-infrared light penetrates the brain, and oxygenation changes in regional cerebral blood flow are recorded [31]. fNIRS has the advantages of safety, low cost, portability, tolerance to motion artifacts, and good temporal and spatial resolution, overcoming the shortcomings of conventional brain imaging modalities, such as electroencephalography and functional magnetic resonance imaging (fMRI) [32,33]. fNIRS has been used in various fields, including sports medicine, neuroscience, behavioral science, clinical studies, and brain-computer interfaces [30].

    We hypothesized that 3D immersive VR exercises would be more effective than offline physical exercises in increasing the range of motion and calorie consumption during exercise. In addition, we hypothesized that the effectiveness of 3D immersive VR exercises is associated with brain activation within the OFC before and after exercise.


    Sample Size

    The sample size was calculated using G*power software (Heinrich-Heine-Universität Düsseldorf) [34] based on a statistical test using repeated measures ANOVA. A type 1 error of .05 and a statistical power of 0.9 were used. The correlation among repeated measures was set conservatively at 0. Based on previous similar studies, an effect size of 0.25 was estimated. Based on these calculations, 22 participants were required. After estimating a 10% dropout rate, the required total sample size was set at 24 participants.

    Participants

    Through flyer advertisements, 24 healthy males were recruited for this study from Chung-Ang University. The inclusion criteria were as follows: (1) male sex, (2) age 20 to 29 years, and (3) no psychiatric or medical illness. The exclusion criteria were as follows: (1) history of head trauma; (2) history of substance abuse, including alcohol, tobacco, and drugs; and (3) IQ<80. The participants were instructed not to consume any food, caffeine, or alcohol 3 hours prior to participation in the study.

    Ethics Approval

    The institutional review board of Chung-Ang University approved this research protocol (1041078-201908-HRSB-231-01). Written informed consent was obtained from all participants.

    Study Procedure

    Overview

    This study was a randomized crossover trial that compared responses to 3D immersive VR and offline exercises. The participants were blinded to the study hypotheses. Each participant underwent 1 3D immersive VR trial and 1 offline trial in a randomly assigned order at 10-minute intervals. Each session consisted of (1) a 2-minute practice to become familiarized with each exercise; (2) a 2-minute pre-exercise resting-state fNIRS measurement; (3) a 5-minute exercise, either 3D immersive VR or offline; and (4) a 3-minute postexercise resting-state fNIRS measurement (Figure 1). This trial was conducted in a curtained, dimly lit gym at a temperature of 23 °C with minimal ambient noise to control external noises as much as possible. The participants were instructed not to speak or move their heads during the fNIRS measurement to maintain good tissue-electrode contact. A 10-minute interval was given between sessions to return noncortical hemodynamic variables, such as skin blood flow and middle cerebral artery blood flow, to baseline levels.

    ‎
    Figure 1. Study design. fNIRS: functional near-infrared spectroscopy; VR: virtual reality.

    Both VR and offline exercises consisted of 40 identical movements derived from Pilates. Pilates was chosen because it is a beneficial exercise method for healthy adults that enhances flexibility, muscular activity, and coordination [35]. In both exercises, the sequence was in the order of 8 types of simple behaviors involving just the body, arms, or legs; 16 types of 2 complex behaviors involving the body plus arms or legs; and 16 types of 3 complex behaviors involving 3 parts of the body, arms, and legs. The reason for exercising in this order was to gradually increase the number of muscle groups involved, starting from warming up. A resistance band (TheraBand) was applied to each participant in both sessions to maintain adequate exercise intensity and prevent less controlled behaviors. Pilates exercise with a resistance band was reported to increase muscle activity by more than 50%, whereas Pilates exercise without a resistance band increased muscle activity by only 20% [36].

    Before the VR exercise, the research staff provided brief instructions on the 3D immersive VR system and environment and asked the participants to report whether they experienced any discomfort while wearing the HMD, such as head bumps, sweating, or motion sickness. The research staff checked for any obstacles the participants might encounter during the VR exercise and monitored and provided immediate assistance to the participants during the exercise in case of danger. With the help of the research staff, the participants were positioned 2 m horizontally away from the VR device, wearing the HMD and holding resistance bands in both hands at shoulder level.

    In this study, the Vive Cosmos Elite (High Tech Computer Corp) and Kinect V1 (Microsoft) were used as the HMD and motion sensors, respectively. A 3D map–based immersive VR software system that allows participants to interact with the VR environment was developed using Unity3D Engine (Unity Technologies). The Grand Canyon landscape was designed to enable participants to fly between canyons without crashing by performing the aforementioned movements in sequence. During the VR exercise, participants were asked to fly over the canyon without bumping into it, following visual and audio guidance. The direction in which to move, whether to accelerate or decelerate, and flight speed were displayed on the VR screen in real time, serving as visual instructions (Figure 2). When the participants tilted their upper body right, left, forward, or backward in the virtual space, they rotated right, left, upward, or downward, respectively. They could accelerate or decelerate by lifting or lowering their right arm.

    In contrast, during the offline exercise, the participants performed movements in a standard manner following a demonstration by a professional instructor. In both sessions, audio guidance, such as “lean right and raise your left arm” were provided.

    The research staff helped the participants accurately perform each movement in both sessions. They provided immediate feedback for incorrect movements and high-risk situations. The movements performed by the participants in the VR and offline conditions were considered identical since the audio guidance, use of the resistance band, and real-time feedback on behavior by the research staff were the same for all participants.

    ‎
    Figure 2. A representation of the virtual environment.
    Motion Analysis to Measure Motion Angle, Length, and Retention Time

    Participants’ movements during the VR and offline exercises were recorded using an iPhone 11 camera (Apple). The participants were asked to stand at the designated site 1.5 m away from the camera to maintain a constant camera angle. The recorded video was analyzed using the open-source video analysis software Kinovea (version 0.8.15; Kinovea Open-Source Project) [21]. Kinovea determines the distance between the camera and the recorded object by measuring the subject passing in front of the camera [21]. It has various analysis and measurement tools for adding annotations, drawing lines, and calculating distances and angles [37] and has been used in numerous sports and clinical studies [22-24]. Previous studies have shown the reliability and validity of the software at distances of up to 5 m with an angle of 90° to 45° [21].

    In the motion analysis, eight types of motion angles were measured: (1) right waist angle, (2) left waist angle, (3) right body angle, (4) left body angle, (5) right leg angle, (6) left leg angle, (7) forward body angle, and (8) backward body angle. Additionally, four types of movement lengths were measured: (1) right arm movement length, (2) left arm movement length, (3) right leg movement length, and (4) left leg movement length (Figure 3). The total angle and movement length for simple behaviors, 2 complex behaviors, and 3 complex behaviors were calculated using each angle and movement length involved in each behavior. For example, for simple behaviors, 8 angles and 4 lengths were used to calculate the total angle and movement lengths. Two complex behaviors consisting of 16 movements, 24 angles, and 16 lengths were measured to calculate the total angle and movement length. Finally, 3 complex behaviors consisting of 16 movements, 24 angles, and 32 lengths were measured to calculate the total angle and movement length (Multimedia Appendix 1).

    ‎
    Figure 3. Movement angle and length. From top: Rt (Lt)-WA: right (left) waist angle; Rt (Lt)-BA: right (left) body angle; Rt (Lt)-LA: right (left) leg angle; FBA (BBA): forward (backward) body angle; Rt ArML: right arm movement length; Lt ArML: left arm movement length; Rt lgML: right leg movement length; Lt lgML: left leg movement length.
    Comparison of Calories Using the Metabolic Equivalent of Task Formula and Motion Retention Time

    Calorie consumption during each session was calculated using each participant’s weights, motion retention time (from the start to the end of the movement), and the metabolic equivalent of task (MET) of the Pilates motion, according to the MET formula [38]. The MET formula has been adopted in various clinical studies, and its reliability has been demonstrated through meta-analyses [39,40]. MET is defined as the level of intensity of various physical activities, including daily activities and low-intensity to high-intensity exercises. The Pilates movements performed by the participants in this study were rated as 3.5 MET.

    Hemodynamic Changes in the Frontal Cortex

    Hemodynamic changes within the prefrontal cortex were assessed using a high-density fNIRS device (NIRSIT, OBELAB Inc). The curved panel of the NIRSIT has 24 laser diodes (sources) emitting 2 wavelengths (780 nm and 850 nm) of light and 32 photodetectors with a sampling rate of 8.138 Hz. The unit distance between the source and photodetectors was 15 mm. In this study, only the 30-mm channels were analyzed, since 30 mm is the most suitable sensor-detector separation distance for measuring cortical hemodynamic changes.

    The fNIRS data were processed using the analysis toolbox provided by the fNIRS device manufacturer. The light signals in each wavelength within the 48 channels were filtered using a band-pass filter (between 0.0 Hz and 0.1 Hz) to reduce noise due to external light and body movements. Data derived from channels representing low-quality information (signal-to-noise ratio<30 dB) were not included in the hemodynamic analysis set to prevent misinterpretation. Relative hemodynamic changes during exercise were calculated using the modified Beer-Lambert law [41]. The accumulated oxygenated hemoglobin (accHbO2) values represent the activation of the prefrontal cortex during a resting state. Although both oxygenated and deoxygenated hemoglobin data could be obtained, previous studies have revealed that oxygenated hemoglobin has superior sensitivity and signal-to-noise ratio; therefore, only oxygenated hemoglobin data were used for this analysis [26,28].

    The values (mean and SD) of accHbO2 were gathered from 8 regions of interest: the right and left DLPFC, right and left frontopolar cortex (FPC), right and left VLPFC, and right and left OFC. The right and left DLPFCs were composed of channels 1, 2, 3, 5, 6, 11, 17, and 18 and channels 19, 20, 33, 34, 35, 38, 39, and 43, respectively. The right and left FPC were composed of channels 7, 8, 12, 13, 21, 22, 25, and 26 and channels 23, 24, 27, 28, 36, 37, 41, and 42, respectively. The right and left VLPFCs were composed of channels 4, 9, and 10 and channels 40, 44, and 45, respectively. The right and left OFCs were composed of channels 14, 15, 16, 29, and 30, and channels 31, 32, 46, 47, and 48, respectively (Figure 4).

    ‎
    Figure 4. The channel configuration.

    Statistical Analyses

    For total behaviors, simple behavior, 2 complex behaviors, and 3 complex behaviors, the differences in total angles, total movement length, and consumed calories were compared using the Mann-Whitney U test. The statistical significance of the total angle and total movement length in the total behaviors was set at 0.02 (0.05/3, angle, length, and calories). In the post hoc test, the statistical significance of the total angle and total movement length in the simple behaviors, 2 complex behaviors, and 3 complex behaviors was set at P=.02 (.05/3, angle, length, and calories). Between the VR and offline situations, the difference in the change in accumulated oxygenated hemoglobin (ΔaccHbO2) from baseline and exercise was compared using repeated measures ANOVA. The statistical significance was set at P=.006 (.05/8, 8 brain regions). Correlations between the differences in accHbO2 within the right OFC, total angles, and total movement lengths were assessed using Pearson correlation coefficient. Statistical significance was set at P=.03 (.05/2, angle and length). Statistical analyses were performed using SPSS software (version 24.0; IBM Corp).


    Differences in Movement Including Angle and Length Between Offline and VR Trials During Exercise

    During exercise, there were significant differences in the total angle (z=−2.31; P=.02) and length between the VR and offline trials (z=−2.78; P=.005). The VR group showed a 13.3% wider total angle range and an increase of 14.1% in the total movement length compared with the offline group. In the post hoc analysis, the VR group moved significantly more in simple and complex behaviors, except for the total angle in 2 complex behaviors, compared to the offline group (Table 1).

    Table 1. Differences in angle and distance between the VRa and offline trialsb.
    Types of behavior and parametersVR trial, mean (SD)Offline trial, mean (SD)Statistics
    Total behavior

    		Angle total (°)1359.39 (125.55)1200.26 (195.68)z=−2.31; P=.02

    		Length total (cm)2568.20 (342.38)2250.82 (382.20)z=−2.78; P=.005

    		Calorie total (kcal)9.36 (2.60)5.79 (3.01)z=−3.04; P=.002
    Simple behavior (trunk leaning over)

    		Angle total (°)172.30 (19.2)147.8 (27.64)z=−2.74; P=.005

    		Length total (cm)224.93 (34.3)197.70 (31.9)z=−2.53; P=.01

    		Calorie total (kcal)2.46 (0.55)1.18 (0.69)z=−4.30; P<.001
    2 complex behaviors (trunk leaning over + lifting arm or leg)

    		Angle total (°)449.26 (118.57)415.87 (69.17)z=−1.14; P=.27

    		Length total (cm)966.09 (118.57)860.06 (107.01)z=−3.10; P=.001

    		Calorie total (kcal)4.42 (1.35)2.95 (1.58)z=−2.55; P=.01
    3 complex behaviors (trunk leaning over + lifting arm + lifting leg)

    		Angle total (°)737 .83 (63.61)636.55 (112.77)z=−2.72; P=.006

    		Length total (cm)1377.18 (202.88)1193.05 (125.55)z=−2.69; P=.006

    		Calorie total (kcal)2.47 (0.86)1.65 (0.97)z=−2.63; P=.009

    aVR: virtual reality.

    bP<.02 was considered to be significant.

    Differences in Consumption Between Offline and VR Trials During Exercise

    During exercise, there were significant differences in the total calories between the VR and offline trials (z=−3.04; P=.002). During exercise, the VR group consumed 61.7% more calories than the offline group. In the post hoc analysis, the VR group showed significant calorie consumption with 2 complex and 3 complex behaviors compared to the offline group (Table 1).

    Differences in ΔaccHbO2 Between Offline and VR Trials During Exercise

    During exercise, significant differences were observed in ΔaccHbO2 between the offline and VR trials within the right OFC (F1,94=9.36; P=.003) but not within the left VLPFC (F1,94=5.69; P=.02), left DLPFC (F1,94=0.06; P=.81), right DLPFC (F1,94=0.02; P=.89), right VLPFC (F1,94=0.06; P=.81), left OFC (F1,94=0.01; P=.91), left frontopolar prefrontal cortex (F1,94=0.05; P=.89), or right frontopolar prefrontal cortex (F1,94=0.21; P=.65) (Figure 5).

    ‎
    Figure 5. Difference in the accumulated oxygenated hemoglobin (ΔaccHbO2) between the offline and virtual reality trials during exercise. P<.006 was considered to be significant. Oxy-Hb: oxygenated hemoglobin; VR: virtual reality.

    Correlation of ΔaccHbO2 With Total Angle and Movement Length

    In all participants, the ΔaccHbO2 within the right OFC was positively correlated with the total angle (r=0.36; P=.005). However, it was not significantly associated with the total movement length (r=0.28; P=.03). In the VR group, the ΔaccHbO2 within the right OFC was positively correlated with total angle (r=0.45; P=.001) and total movement length (r=0.38; P=.007). In the offline group, the ΔaccHbO2 was not significantly correlated with total angle (r=0.28; P=.40) or total movement length (r=0.29; P=.37) (Figure 6).

    ‎
    Figure 6. Correlation between accumulated oxygenated hemoglobin in the orbitofrontal cortex (OFC) and movement change. P<.025 was considered to be significant. Oxy-Hb: oxygenated hemoglobin.

    User Experience During VR Exercise

    Of the 24 participants, 3 (12.5%) reported motion sickness, and 8 (33.3%) reported sweating after wearing the HMD device; however, none reported HMD slipping or severe discomfort.


    Principal Results

    In this study, VR exercise increased the range of motion, calorie consumption, and brain activity within the OFC compared with offline exercise. In addition, increased brain activity within the right OFC was correlated with an increased range of motion.

    Improvement of Movement Range and Calorie Consumption in Response to Immersive VR Stimuli

    Our findings are consistent with previous studies on various patient groups. However, no studies have reported changes in the range of motion due to VR exercise in healthy individuals, as in this study [5]. VR exercises have been suggested to improve the range of motion in patients undergoing rehabilitation, both in the short term [42,43] and in the long term [14,44]. Immersive VR physical therapy significantly reduces pain and enhances the range of motion in patients with burn injuries (immediate effect) or chronic frozen shoulders (chronic effect) compared with standard therapies [14,42]. In addition, a 4-week VR exercise program in patients who underwent a stroke was more effective than a conventional program in improving the active range of motion and other scores, such as the Fugl-Meyer assessment score, Wolf motor function test score, and modified Barthel Index [44]. Children with cerebral palsy also reported a greater range of motion, better motion control, and greater interest as an acute effect after performing VR exercises than after conventional exercises [43]. In addition, the results of this study are in line with those of previous studies showing that participants who engaged in VR exercises had higher heart rates and burned more calories than those who performed standard exercises [45]. Therefore, VR has the potential to enhance physical exercises, and it may be a viable complement or alternative to traditional weight loss programs [46].

    The larger range of motion and caloric consumption in the VR exercise may be associated with immersion. Immersion can be divided into 3 forms: sensory, imaginative, and challenge-based [47]. Sensory immersion is associated with audiovisual stimulation, and imaginative immersion is related to absorption in the narrative or identification with a character (eg, feelings of empathy and atmosphere). Challenge-based immersion is related to the balance between the activity’s demands and an individual’s motor and mental skills [48]. Challenge-based immersion is very close to the “flow” experience described by Csikszentmihalyi [49]. Immersion and flow share common features such as concentration, distortion of time perception, loss of self-awareness, and intrinsic motivation toward an activity [49]. The flow of physical exercise is related to peak performance [50]. The flow experienced during exercise is an autotelic experience with total concentration, merging of action and awareness, and the paradox of control [51]. In this respect, we cautiously suggest that VR exercise could be more immersive and helpful in achieving peak performance than exercise alone since sensory and imaginative components are added to the challenge-based immersion of physical exercise.

    Increased Brain Activity Within OFC in Response to VR Stimuli

    Another important finding of our study was that there were significant differences in brain activation within the right OFC between offline and exercise groups. To date, only a few studies have specifically investigated orbitofrontal activity in response to VR exercises. Most studies have focused on prefrontal activation caused by VR stimuli. Mao et al [52] suggested that VR training activates the prefrontal cortex and improves spatial orientation and motor function. However, recent studies have suggested that the OFC is one of the candidate brain regions that respond to VR [29]. Landowska et al [21] reported hemodynamic changes within the DLPFC and OFC in response to VR therapy for acrophobia. Dong et al [53] suggested that the activation of the OFC in response to VR tasks was greater than that observed in response to slide-based (control) tasks. Moro et al [54] reported that oxygenation in the OFC was increased when an incremental swing balance task in an immersive VR environment was performed. One possible explanation for this is that VR-induced immersion stimulates reward circuits involving the OFC. The OFC is responsible for sensory integration, regulation of visceral responses, learning, prediction, and decision-making for reward and affective values [55,56]. In addition, visual stimulation and immersion in VR are robustly involved in reward circuits [57].

    The results of the correlation study between ΔaccHbO2 within the right OFC and the range of motion during VR and offline exercise showed that an increase in the range of motion and right OFC activation was correlated only in the VR group but not in the offline group. Thus, we suggest that immersion and visual stimulation of 3D immersive VR distracts the user from unpleasant interoceptive sensations caused by physical exercise. It is suggested that distraction caused by VR can reduce the perception of physical discomfort through an intercortical modulation of the anterior cingulate and OFC [9,58,59].

    Additionally, the functional hemispheric differences shown in the results of this study are in line with a previous study that suggested that the more pronounced the shift in brain activity to the right hemisphere, the more flow experienced by elite tennis players [60]. Less synchronized brain activity in the left hemisphere and more coherent brain activity in the right hemisphere have been suggested to reflect less interference from irrelevant verbal-analytical processes with motor control mechanisms [60].

    Strengths

    To the best of our knowledge, this is one of the earliest studies to quantitatively evaluate the effects of 3D immersive VR exercise on brain hemodynamics in healthy individuals. Each participant’s movement was measured using professional video analysis software, unlike other studies based on subjective performance improvement or satisfaction. Another strength of this study is that we directly compared performance in 3D immersive VR and real-world environments while performing the same activities. This comparison is important to reveal how 3D immersive VR influences exercise performance and brain activity. Finally, this study presents the potential for developing smart headsets by integrating wearable devices and connected technologies, such as VR, brain activity measurement, and motion tracking. Although these were performed with different devices in our study, using an integrated smart headset could enable effective exercise and immediate checking of the exercise amount and the consequent changes in brain activity. These wearable technologies and connected solutions with VR capabilities are already widely adopted in the workplace to promote occupational safety, productivity, and worker health. Examples include the Xsens MVN Animate and Xsens MTw Awinda for body movement tracking and the Muse 2 Melon's headband and IMEC's wireless electroencephalogram headset for brain wave sensing [61].

    Limitations

    This study had some limitations. First, due to the small number and gender disparity of the participants, the results cannot be generalized. In a follow-up study on VR exercise, scaling up the sample size by including virtual participants could be considered. However, this was not possible in this study due to the crossover design comparing VR and offline exercise. Second, there were limitations in the adequate pixel rate, capture rate, maximum aperture, depth of field capture, and frame capture rate of the iPhone 11, which was used as a video recording device. Third, since the fNIRS device used in this study can only measure brain activity within the prefrontal lobe, activity in other cortical regions and deep brain areas was not measured. Further studies using other functional imaging devices, such as fMRI, are required to determine the activity of the entire brain. Fourth, we did not employ additional physiological measures. The use of systemic physiologically augmented fNIRS in future studies may yield more meaningful results. Finally, a standardized questionnaire to check the inclusion and exclusion criteria and to assess motion sickness after VR exercise was not used in this study.

    Conclusions

    This study confirmed that 3D immersive VR exercise is more effective at increasing the range of motion and calorie consumption during exercise in healthy individuals via activation within the OFC.

    Acknowledgments

    This study was supported by the Ministry of Education of the Republic of Korea and the National Research Foundation of Korea (NRF-2018S1A5B6070270).

    Conflicts of Interest

    None declared.

    Editorial Notice

    This randomized study was only retrospectively registered. The authors regret that the trial could not be registered prospectively due to an oversight in the process. The editor granted an exception from ICMJE rules mandating prospective registration of randomized trials. However, readers are advised to carefully assess the validity of any potential explicit or implicit claims related to primary outcomes or effectiveness, as retrospective registration does not prevent authors from changing their outcome measures retrospectively.

    ‎
    Multimedia Appendix 1

    Performances for simple and complex behaviors.

    DOCX File , 17 KB
    ‎
    Multimedia Appendix 2

    CONSORT-eHEALTH checklist (V 1.6.2).

    PDF File (Adobe PDF File), 97 KB
    1. Sanchez-Vives MV, Slater M. From presence to consciousness through virtual reality. Nat Rev Neurosci 2005 Apr;6(4):332-339. [CrossRef] [Medline]
    2. Marín-Morales J, Llinares C, Guixeres J, Alcañiz M. Emotion recognition in immersive virtual reality: from statistics to affective computing. Sensors (Basel) 2020 Sep 10;20(18) [FREE Full text] [CrossRef] [Medline]
    3. Sherman WR, Craig AB. Understanding Virtual Reality: Interface, Application, and Design. 2nd edition. Burlington, MA: Morgan Kaufmann; 2018.
    4. Ahir K, Govani K, Gajera R, Shah M. Application on virtual reality for enhanced education learning, military training and sports. Augment Hum Res 2019 Nov 29;5(1). [CrossRef]
    5. Qian J, McDonough DJ, Gao Z. The effectiveness of virtual reality exercise on individual's physiological, psychological and rehabilitative outcomes: a systematic review. Int J Environ Res Public Health 2020 Jun 10;17(11) [FREE Full text] [CrossRef] [Medline]
    6. Dorta T, Kinayoglu G, Hoffmann M. Hyve-3D and the 3D cursor: architectural co-design with freedom in virtual reality. Int J Archit Comput 2016 Apr 21;14(2):87-102. [CrossRef]
    7. Ryan M. Immersion vs interactivity: virtual reality and literary theory. SubStance 1999;28(2):110-137. [CrossRef]
    8. Fox J, Bailenson JN. Virtual self-modeling: the effects of vicarious reinforcement and identification on exercise behaviors. Media Psychol 2009 Mar 05;12(1):1-25. [CrossRef]
    9. Jones L, Ekkekakis P. Affect and prefrontal hemodynamics during exercise under immersive audiovisual stimulation: improving the experience of exercise for overweight adults. J Sport Health Sci 2019 Jul;8(4):325-338 [FREE Full text] [CrossRef] [Medline]
    10. Hoffmann CP, Filippeschi A, Ruffaldi E, Bardy BG. Energy management using virtual reality improves 2000-m rowing performance. J Sports Sci 2014;32(6):501-509. [CrossRef] [Medline]
    11. Düking P, Holmberg H, Sperlich B. The potential usefulness of virtual reality systems for athletes: a short SWOT analysis. Front Physiol 2018;9:128 [FREE Full text] [CrossRef] [Medline]
    12. Neumann DL, Moffitt RL, Thomas PR, Loveday K, Watling DP, Lombard CL, et al. A systematic review of the application of interactive virtual reality to sport. Virtual Real 2017 Jul 19;22(3):183-198. [CrossRef]
    13. Munafo J, Diedrick M, Stoffregen TA. The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Exp Brain Res 2017 Mar;235(3):889-901. [CrossRef] [Medline]
    14. Sveistrup H, McComas J, Thornton M, Marshall S, Finestone H, McCormick A, et al. Experimental studies of virtual reality-delivered compared to conventional exercise programs for rehabilitation. Cyberpsychol Behav 2003 Jun;6(3):245-249. [CrossRef] [Medline]
    15. Segura-Ortí E, Pérez-Domínguez B, Ortega-Pérez de Villar L, Meléndez-Oliva E, Martínez-Gramage J, García-Maset R, et al. Virtual reality exercise intradialysis to improve physical function: A feasibility randomized trial. Scand J Med Sci Sports 2019 Jan;29(1):89-94. [CrossRef] [Medline]
    16. Lotan M, Yalon-Chamovitz S, Weiss PLT. Improving physical fitness of individuals with intellectual and developmental disability through a Virtual Reality Intervention Program. Res Dev Disabil 2009;30(2):229-239. [CrossRef] [Medline]
    17. Anderson-Hanley C, Arciero PJ, Brickman AM, Nimon JP, Okuma N, Westen SC, et al. Exergaming and older adult cognition: a cluster randomized clinical trial. Am J Prev Med 2012 Feb;42(2):109-119. [CrossRef] [Medline]
    18. Annesi JJ, Mazas J. Effects of virtual reality-enhanced exercise equipment on adherence and exercise-induced feeling states. Percept Mot Skills 1997 Dec;85(3 Pt 1):835-844. [CrossRef] [Medline]
    19. Cho GH, Hwangbo G, Shin HS. The effects of virtual reality-based balance training on balance of the elderly. J Phys Ther Sci 2014 Apr;26(4):615-617 [FREE Full text] [CrossRef] [Medline]
    20. Murray EG, Neumann DL, Moffitt RL, Thomas PR. The effects of the presence of others during a rowing exercise in a virtual reality environment. Psychol Sport Exerc 2016 Jan;22:328-336. [CrossRef] [Medline]
    21. Landowska A, Roberts D, Eachus P, Barrett A. Within- and between-session prefrontal cortex response to virtual reality exposure therapy for acrophobia. Front Hum Neurosci 2018;12:362 [FREE Full text] [CrossRef] [Medline]
    22. Moro SB, Carrieri M, Avola D, Brigadoi S, Lancia S, Petracca A, et al. A novel semi-immersive virtual reality visuo-motor task activates ventrolateral prefrontal cortex: a functional near-infrared spectroscopy study. J Neural Eng 2016 Jun;13(3):036002. [CrossRef] [Medline]
    23. Kringelbach ML, Rolls ET. The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog Neurobiol 2004 Apr;72(5):341-372. [CrossRef] [Medline]
    24. Schoenbaum G, Setlow B, Nugent SL, Saddoris MP, Gallagher M. Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn Mem 2003;10(2):129-140 [FREE Full text] [CrossRef] [Medline]
    25. Schüler J, Brunner S. The rewarding effect of flow experience on performance in a marathon race. Psychol Sport Exerc 2009 Jan;10(1):168-174. [CrossRef]
    26. Puig-Diví A, Escalona-Marfil C, Padullés-Riu JM, Busquets A, Padullés-Chando X, Marcos-Ruiz D. Validity and reliability of the Kinovea program in obtaining angles and distances using coordinates in 4 perspectives. PLoS One 2019;14(6):e0216448 [FREE Full text] [CrossRef] [Medline]
    27. Damsted C, Nielsen RO, Larsen LH. Reliability of video-based quantification of the knee- and hip angle at foot strike during running. Int J Sports Phys Ther 2015 Apr;10(2):147-154 [FREE Full text] [Medline]
    28. Dias JA, Dal Pupo J, Reis DC, Borges L, Santos SG, Moro ARP, et al. Validity of two methods for estimation of vertical jump height. J Strength Cond Res 2011 Jul;25(7):2034-2039. [CrossRef] [Medline]
    29. Guzmán-Valdivia CH, Blanco-Ortega A, Oliver-Salazar MY, Escobedo J. Therapeutic motion analysis of lower limbs using Kinovea. Int J Soft Comput Eng 2013;3(2):2231-2307.
    30. Hong K, Bhutta MR, Liu X, Shin Y. Classification of somatosensory cortex activities using fNIRS. Behav Brain Res 2017 Aug 30;333:225-234. [CrossRef] [Medline]
    31. Yoo S, Santosa H, Kim C, Hong K. Decoding multiple sound-categories in the auditory cortex by neural networks: an fNIRS study. Front Hum Neurosci 2021;15:636191 [FREE Full text] [CrossRef] [Medline]
    32. Yang D, Hong K. Quantitative assessment of resting-state for mild cognitive impairment detection: a functional near-infrared spectroscopy and deep learning approach. J Alzheimers Dis 2021;80(2):647-663. [CrossRef] [Medline]
    33. Kim HJ, Bae S, Huh JH, Lee JW, Han DH. Hemodynamic changes in response to aerobic exercise: near-infrared spectroscopy study. Int J Sports Med 2021 Apr;42(4):377-385. [CrossRef] [Medline]
    34. Faul F, Erdfelder E, Lang A, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007 May;39(2):175-191. [CrossRef] [Medline]
    35. Bernardo LM. The effectiveness of Pilates training in healthy adults: An appraisal of the research literature. J Bodyw Mov Ther 2007 Apr;11(2):106-110. [CrossRef]
    36. Petrofsky J, Morris A, Bonacci J, Hanson A, Jorritsma R, Hill J. Muscle use during exercise: a comparison of conventional weight equipment to Pilates with and without a resistive exercise device. J Appl Res 2005;5(1):a.
    37. Balsalobre-Fernández C, Tejero-González CM, del Campo-Vecino J, Bavaresco N. The concurrent validity and reliability of a low-cost, high-speed camera-based method for measuring the flight time of vertical jumps. J Strength Cond Res 2014 Feb;28(2):528-533. [CrossRef] [Medline]
    38. Ainsworth BE, Haskell WL, Herrmann SD, Meckes N, Bassett DR, Tudor-Locke C, et al. 2011 Compendium of Physical Activities: a second update of codes and MET values. Med Sci Sports Exerc 2011 Aug;43(8):1575-1581. [CrossRef] [Medline]
    39. Strath SJ, Kaminsky LA, Ainsworth BE, Ekelund U, Freedson PS, Gary RA, et al. Guide to the assessment of physical activity: clinical and research applications: a scientific statement from the American Heart Association. Circulation 2013 Nov 12;128(20):2259-2279 [FREE Full text] [CrossRef] [Medline]
    40. Ross R, Blair SN, Arena R, Church TS, Després J, Franklin BA, American Heart Association Physical Activity Committee of the Council on Lifestyle Cardiometabolic Health, Council on Clinical Cardiology, Council on Epidemiology Prevention, Council on Cardiovascular Stroke Nursing, Council on Functional Genomics Translational Biology, Stroke Council. Importance of assessing cardiorespiratory fitness in clinical practice: a case for fitness as a clinical vital sign: a scientific statement from the American Heart Association. Circulation 2016 Dec 13;134(24):e653-e699. [CrossRef] [Medline]
    41. Delpy DT, Cope M, van der Zee P, Arridge S, Wray S, Wyatt J. Estimation of optical pathlength through tissue from direct time of flight measurement. Phys Med Biol 1988 Dec;33(12):1433-1442. [CrossRef] [Medline]
    42. Carrougher GJ, Hoffman HG, Nakamura D, Lezotte D, Soltani M, Leahy L, et al. The effect of virtual reality on pain and range of motion in adults with burn injuries. J Burn Care Res 2009;30(5):785-791 [FREE Full text] [CrossRef] [Medline]
    43. Bryanton C, Bossé J, Brien M, McLean J, McCormick A, Sveistrup H. Feasibility, motivation, and selective motor control: virtual reality compared to conventional home exercise in children with cerebral palsy. Cyberpsychol Behav 2006 Apr;9(2):123-128. [CrossRef] [Medline]
    44. Park M, Ko M, Oh S, Lee J, Ham Y, Yi H, et al. Effects of virtual reality-based planar motion exercises on upper extremity function, range of motion, and health-related quality of life: a multicenter, single-blinded, randomized, controlled pilot study. J Neuroeng Rehabil 2019 Oct 24;16(1):122 [FREE Full text] [CrossRef] [Medline]
    45. McMahon DD, Barrio B, McMahon AK, Tutt K, Firestone J. Virtual reality exercise games for high school students with intellectual and developmental disabilities. J Spec Educ Technol 2019 Apr 11;35(2):87-96. [CrossRef]
    46. Gao Z, Lee JE, McDonough DJ, Albers C. Virtual reality exercise as a coping strategy for health and wellness promotion in older adults during the COVID-19 pandemic. J Clin Med 2020 Jun 25;9(6) [FREE Full text] [CrossRef] [Medline]
    47. Ermi L, Mäyrä F. Fundamental components of the gameplay experience: analysing immersion. 2005 Presented at: Digital Games Research Conference 2005; June 16-20; Vancouver, BC.
    48. Nacke L, Lindley CA. Affective ludology, flow and immersion in a first-person shooter: measurement of player experience. J Can Game Stud Assoc 2010;3(5):1-21. [CrossRef]
    49. Csikszentmihalyi M. Flow: The Psychology of Optimal Experience. New York, NY: Harper & Row; 1990.
    50. Stavrou NA, Jackson SA, Zervas Y, Karteroliotis K. Flow experience and athletes? Performance with reference to the orthogonal model of flow. Sport Psychol 2007;21:457. [CrossRef]
    51. Jackson SA. Toward a conceptual understanding of the flow experience in elite athletes. Res Q Exerc Sport 1996 Mar;67(1):76-90. [CrossRef] [Medline]
    52. Mao Y, Chen P, Li L, Huang D. Virtual reality training improves balance function. Neural Regen Res 2014 Sep 01;9(17):1628-1634 [FREE Full text] [CrossRef] [Medline]
    53. Dong D, Wong LKF, Luo Z. Assess BA10 activity in slide-based and immersive virtual reality prospective memory task using functional near-infrared spectroscopy (fNIRS). Appl Neuropsychol Adult 2019;26(5):465-471. [CrossRef] [Medline]
    54. Basso Moro S, Bisconti S, Muthalib M, Spezialetti M, Cutini S, Ferrari M, et al. A semi-immersive virtual reality incremental swing balance task activates prefrontal cortex: a functional near-infrared spectroscopy study. Neuroimage 2014 Jan 15;85 Pt 1:451-460. [CrossRef] [Medline]
    55. Kringelbach ML. The human orbitofrontal cortex: linking reward to hedonic experience. Nat Rev Neurosci 2005 Sep;6(9):691-702. [CrossRef] [Medline]
    56. Han DH, Kim YS, Lee YS, Min KJ, Renshaw PF. Changes in cue-induced, prefrontal cortex activity with video-game play. Cyberpsychol Behav Soc Netw 2010 Dec;13(6):655-661. [CrossRef] [Medline]
    57. Chen K, Barnes-Horowitz N, Treanor M, Sun M, Young KS, Craske MG. Virtual reality reward training for anhedonia: a pilot study. Front Psychol 2020;11:613617 [FREE Full text] [CrossRef] [Medline]
    58. Gold JI, Belmont KA, Thomas DA. The neurobiology of virtual reality pain attenuation. Cyberpsychol Behav 2007 Aug;10(4):536-544. [CrossRef] [Medline]
    59. Bantick SJ, Wise RG, Ploghaus A, Clare S, Smith SM, Tracey I. Imaging how attention modulates pain in humans using functional MRI. Brain 2002 Feb;125(Pt 2):310-319. [CrossRef] [Medline]
    60. Wolf S, Brölz E, Keune PM, Wesa B, Hautzinger M, Birbaumer N, et al. Motor skill failure or flow-experience? Functional brain asymmetry and brain connectivity in elite and amateur table tennis players. Biol Psychol 2015 Feb;105:95-105. [CrossRef] [Medline]
    61. Patel V, Chesmore A, Legner CM, Pandey S. Trends in workplace wearable technologies and connected‐worker solutions for next‐generation occupational safety, health, and productivity. Advanced Intelligent Systems 2021 Sep 23;4(1):2100099. [CrossRef]

    ‎
    accHbO2: accumulated oxygenated hemoglobin
    DLPFC: dorsolateral prefrontal cortex
    fMRI: functional magnetic resonance imaging
    fNIRS: functional near-infrared spectroscopy
    FPC: frontopolar cortex
    HMD: head-mounted display
    MET: metabolic equivalent of task
    OFC: orbitofrontal cortex
    VLPFC: ventrolateral prefrontal cortex
    VR: virtual reality
    ΔaccHbO2: change in accumulated oxygenated hemoglobin

    Edited by N Zary, G Eysenbach; submitted 20.06.22; peer-reviewed by J O'Neil, S Pandey; comments to author 04.08.22; revised version received 28.09.22; accepted 31.10.22; published 05.01.23

    Copyright

    ©Hee Jin Kim, Jea Woog Lee, Gangta Choi, Junghoon Huh, Doug Hyun Han. Originally published in JMIR Serious Games (https://games.jmir.org), 05.01.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.