This paper is in the following e-collection/theme issue:

Game Design and Efficacy of Game Elements (86) Extended Reality, Virtual Reality and Virtual Worlds (560) Games and Gamification for Health (650) Serious Games for Health and Medicine (683)

Published on in Vol 10, No 3 (2022): Jul-Sep

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/36397, first published .
A New Approach for Reducing Virtual Reality Sickness in Real Time: Design and Validation Study

A New Approach for Reducing Virtual Reality Sickness in Real Time: Design and Validation Study

A New Approach for Reducing Virtual Reality Sickness in Real Time: Design and Validation Study

Authors of this article:

JuHye Won1 Author Orcid Image ;   Yoon Sang Kim2 Author Orcid Image
Article Authors Cited by (4) Tweetations (3) Metrics

    Original Paper

    1BioComputing Lab, Department of Computer Science and Engineering, Korea University of Technology and Education, Cheonan-si, Republic of Korea

    2BioComputing Lab, Institute for Bio-engineering Application Technology, Department of Computer Science and Engineering, Korea University of Technology and Education, Cheonan-si, Republic of Korea

    Corresponding Author:

    Yoon Sang Kim, PhD

    BioComputing Lab, Institute for Bio-engineering Application Technology

    Department of Computer Science and Engineering

    Korea University of Technology and Education

    1600, Chungjeol-ro, Byeongcheon-myeon, Dongnam-gu

    Cheonan-si, 31253

    Republic of Korea

    Phone: 82 0415601496

    Email: yoonsang@koreatech.ac.kr


    Background: Recently, technology that provides virtual reality (VR) content based on streaming services has been rapidly developed. However, there have been few studies to reduce VR sickness that occurs while the user watches VR content while wearing a head-mounted display (HMD) in real time.

    Objective: Based on this background, we propose a new approach to measure and reduce VR sickness that occurs while the user watches VR content while wearing an HMD in real time.

    Methods: The proposed approach is to apply VR sickness reduction methods in accordance with the user’s real-time VR sickness level. Three methods that are known to be effective in reducing VR sickness and a single type of VR content were used to examine the effectiveness of the proposed approach, which was confirmed by the experimental results.

    Results: Our results show that VR sickness significantly decreased when a new approach was applied to VR content (in all cases, P<.05).

    Conclusions: From our results, it was confirmed that VR sickness could be measured without wearing additional equipment, and its reduction method could be applied in real time in accordance with the user’s condition by the proposed approach in this paper.

    JMIR Serious Games 2022;10(3):e36397

    doi:10.2196/36397

    Keywords

    virtual reality; VR; VR sickness; VR sickness reduction method; simulator sickness questionnaire; SSQ, visual guide; field of view; serious game; VR sickness reduction; VR content; technology; digital health 


    Recently, technology that provides virtual reality (VR) content based on streaming services (such as YouTube VR, Netflix, etc) have been rapidly developed. Users of head-mounted displays (HMDs) are also increasing, and according to ResearchAndMarkets.com [1], the global HMD market is expected to grow by more than US $36 billion by 2026. However, VR sickness that occurs while the user watches VR content wearing an HMD does not have a positive effect on the proliferation of VR content. To solve this problem, research in the following 3 directions is being conducted.

    The first direction is the identification of the cause of VR sickness. Several studies confirmed that speed [2], watching time [3], pitch, and roll rotation [4] affect VR sickness. Another study confirmed that the level of VR sickness varies depending on gender [5]. In addition, studies [6-8] were conducted to confirm the correlation between VR sickness and VR content’s elements, devices, and human factors.

    The second direction is the derivation of the VR sickness measurement method. VR sickness measurement methods are divided into subjective and objective methods. Subjective methods were conducted through a survey such as simulator sickness questionnaires (SSQs) [9-11], the Motion Sickness Susceptibility Questionnaire (MSSQ) [12], Game Experience Questionnaire [13,14], Immersive Tendencies Questionnaire, and Presence Questionnaire [14]. Furthermore, in the objective method, studies were conducted to predict VR sickness using biological signals such as an electrocardiograms, electrodermal activity, electrooculogram, and breathing [9,10,15]. However, it is difficult to apply a VR sickness measurement method using biological signals to general users because additional equipment should be used. Furthermore, subjective measurement methods require surveys, and it is difficult to measure VR sickness in real time while VR content is being played.

    The third direction is the derivation of VR sickness reduction methods. According to Singla et al [16] who conducted VR sickness reduction studies in terms of hardware, it was confirmed that HTC Vive provides an environment with a lower level of VR sickness than Oculus Rift. However, it is difficult to conclude that specific hardware is more effective in reducing VR sickness because new HMDs are constantly being developed. Therefore, studies are being conducted to reduce VR sickness in terms of content. A study was conducted to reduce VR sickness using the visual effects of VR content [17], and other studies have attempted to reduce VR sickness by applying a virtual human nose as an earth-fixed grid to the VR content [18,19]. A virtual human nose technique features the tip of a nose being fixed at the center-bottom of a VR user’s view, acting as a rest-frame, which the brain can use to make natural spatial adjustments, thus reducing simulator sickness [18]. In addition, “Virtual Guiding Avatar” [20] combines various motion attributes with an independent visual background and Dynamic field of view (FOV) modification technology [21], which partially limits the user’s FOV developed to reduce VR sickness. However, the above methods are only applied in advance in the content development step but do not apply VR sickness reduction methods in real time to suit the user’s condition while VR content is being played.

    As such, few studies have attempted to reduce VR sickness that occurs while the user watches VR content wearing an HMD in real time. Therefore, a new approach is proposed to measure and reduce VR sickness that occurs while the user watches VR content while wearing an HMD in real time. The proposed approach uses the VR sickness response, which is the result of the direct response of VR sickness that occurs while the user watches VR content wearing an HMD. Three methods that are known to be effective in reducing VR sickness have been used to examine the effectiveness of the proposed approach, which is confirmed by the experimental results. Furthermore, based on our results, the effect of the new approach for real-time VR sickness reduction and the effect of the VR sickness response are discussed.


    A New Approach for VR Sickness Measurement and Reduction

    This section describes a new approach for real-time VR sickness reduction. In the proposed approach, when VR sickness occurs while the user watches VR content wearing an HMD, the user clicks a button to directly express the VR sickness responses. In this paper, the response directly expressed by the user is defined as the “VR sickness response.” Figure 1 shows a conceptual diagram of a new approach proposed to reduce VR sickness in real time. Users click a button when they experience VR sickness while wearing an HMD and watching VR content, and the sum of clicks becomes the VR sickness response. Then, the VR sickness reduction method is applied in accordance with the value of the VR sickness response. The following rules show how to apply a VR sickness reduction method in accordance with the VR sickness response:

    For example, if the VR sickness response is equal to or greater than the threshold (α in the equation) within a certain the time interval (β in the equation), the VR sickness reduction method is applied. Furthermore, if the VR sickness response is less than the threshold (α in the equation) during a certain the time interval (β in the equation) while the VR sickness reduction method is applied, the VR sickness reduction method is not applied. The parameters required to apply the proposed approach, the time interval, and threshold are derived from a preliminary experiment as shown in Figure 2.

    The subject clicks a button when he/she experiences VR sickness while watching VR content. In addition, whether the subject clicked the button every 1 second is saved (clicked, 1; nonclicked, 0). For example, if video playtime is a total of 60 seconds, 60 of the data points expressed as 0 or 1 are saved. Using this data set, the time interval and threshold are determined by the following 4 steps.

    First, the sections of VR content are evenly divided in accordance with the time interval of several cases (eg, the time interval=5, 10, 15…n). Second, the average of the subject’s VR sickness response in the evenly divided sections for each case is calculated. Third, the maximum and minimum values are selected from each case’s average, and the difference is calculated. Finally, the time interval of the case with the smallest difference between the maximum and minimum values is set as the time interval of the proposed approach, and the same case’s average VR sickness response is set as the threshold.

    ‎
    Figure 1. A conceptual diagram of a new approach proposed to reduce virtual reality (VR) sickness in real time. HMD: head-mounted display.
    View this figure
    ‎
    Figure 2. The Procedure for deriving the time interval and threshold. VR: virtual reality.
    View this figure

    Experiments

    This section describes the experimental method for confirming the effectiveness of the proposed new approach to reducing VR sickness in real time. The experiment was conducted on 40 subjects (20 male and 20 female) in their 20s and 30s. In addition, as shown in Figure 3, a 3D VR space flight video was selected as the original VR content and it was named M0.

    A view of original VR content is changed in accordance with the subject’s head movement (Figure 3B, which transitions to Figures 3A and 3C according to the head movement). Original VR content made subjects move the 3D space along a predetermined path for 60 seconds. In addition, acceleration, deceleration, and rotation (yaw, pitch, and roll) of the camera were applied to cause VR sickness. As shown in Figure 4, subjects watched VR content using HTC Vive Pro Eye, and they clicked the Xbox controller button to express their response to VR sickness in real time.

    First, a preliminary experiment was conducted to derive the parameters of the proposed new approach (the time interval and threshold). In the preliminary experiment, VR sickness responses and SSQ for 40 subjects were measured. Figure 5 shows the time interval and threshold derived by the preliminary experiment. The original VR content used in the prior experiment were divided into a total of 4 cases in accordance with the time interval as shown in Figure 5A (the time interval of case 1 was 5 seconds; case 2, 10 seconds; case 3, 15 seconds; and case 3, 20 seconds). Then, in each case, the VR sickness response average value in the divided section was derived as shown in Figure 5B. As a result, the time interval of case 3, with the smallest difference between the maximum and minimum values of VR sickness response, was derived as the time interval of the proposed approach (time interval=15 seconds). In addition, the average value of VR sickness response in case 3 was derived as the threshold (threshold=3). After the parameters were derived, the VR sickness reduction method to be used in the proposed approach was selected. To this end, VR sickness reduction methods known to be effective were referred. Visual guide was a visual element that induces gaze movement and is known to be effective in reducing VR sickness [21]. In addition, it was known that the effect of VR sickness reduction is higher as the FOV decreases [22]. As a result, as shown in Table 1, a total of 3 VR sickness reduction methods were designed to be used in the proposed approach to reduce VR sickness in real time, and each method was named M1, M2, and M3.

    The first VR sickness reduction method (M1) was applied with the visual guide, which had a 30% size of aspect ratio, and a position synchronized with the direction of the user’s head movement. The second VR sickness reduction method (M2) applied the FOV that had a size of 90° and a position synchronized with the direction of the user’s head movement.

    When M2 is applied, if the subject moves their head from the center to the left of the screen, the FOV is limited on the basis of the left side of the screen.

    The third VR sickness reduction method (M3) was applied, the FOV which had a size of 90° and a position synchronized to the direction of the user’s gaze movement. When M3 is applied, if the subject moves their gaze from the center to the left of the screen, the FOV is limited on the basis of the left side of the screen.

    Figure 6 shows examples of the VR sickness reduction methods to be used in the proposed new approach.

    The experiment was performed using the protocol shown in Figure 7 for 3 VR sickness methods (M1-M3). The subject responded to MSSQ and SSQ before the experiment, and after wearing the HMD, calibration was performed for eye tracking. The experiment was conducted for a total of 35 min, and each of the methods (M1-M3) was randomly followed to ensure reliability. The subject’s real-time VR sickness response was measured with respect to those 3 methods while watching VR content.

    During the experiment, if the VR sickness response is measured more than 3 times within 15 seconds, the aforementioned 3 methods are applied.

    Furthermore, the VR sickness reduction method is applied during the time interval, and if the VR sickness response is less than the threshold after the time interval, the method is discontinued.

    After watching each VR content, subjects had time to respond to an SSQ and a questionnaire on fatigue and immersion; then, they had a period of rest to lower the level of VR sickness.

    ‎
    Figure 3. An example of the original virtual reality content: (A) and (C) are views changed in accordance with the user's head movement and (B) depicts the front view.
    View this figure
    ‎
    Figure 4. Experimental environment. HMD: head-mounted display; VR: virtual reality.
    View this figure
    ‎
    Figure 5. The time interval and threshold derived by the preliminary experiment: (A) are four cases of the preliminary experiment according to the time interval and (B) are the result of the preliminary experiment.
    View this figure
    Table 1. Three virtual reality sickness reduction methods were used for the proposed approach.
    MethodFeatureProperty
    M1Visual guide 1
    • Size: 30% of aspect ratio
      • ‎
    • Position: movement with the direction of head movement
      • ‎
    M2Field of view 1
    • Size: 90°
      • ‎
    • Position: movement with the direction of head movement
      • ‎
    M3Field of view 2
    • Size: 90°
      • ‎
    • Position: movement with eye tracking (every second)
      • ‎
    ‎
    Figure 6. Examples of the virtual reality (VR) sickness reduction methods to be used in the proposed new approach (where, M0 is original VR content).
    View this figure
    ‎
    Figure 7. The experimental protocol. SSQ: simulator sickness questionnaire; VR: virtual reality.
    View this figure

    Ethics Approval

    This study was approved by the institutional review board of Korea University of Technology and Education (approval 19090401).


    This section describes the experimental results for confirming the effectiveness of the proposed new approach. In total, 26 out of 40 subjects did not experience VR sickness; hence, VR sickness reduction methods were not applied, and results based on 14 subjects who experienced VR sickness were analyzed. First, the SSQ scores of M0 and those of M1 to M3 were compared using a paired t test (2-tailed). As a result of the analysis, when VR sickness reduction methods (M1-M3) were used, the scores of nausea, oculomotor discomfort, and disorientation were significantly reduced (for all, P<.05).

    The lowest SSQ score was observed in M2 and those of M1 and M3 were similar. Table 2 shows the results of VR sickness reduction in accordance with the SSQ score. Figure 8 shows the SSQ scores of the VR sickness reduction methods.

    Furthermore, the VR sickness response of M0 and that of M1 to M3 were compared using a paired t test. All of the VR sickness reduction methods (M1-M3) showed significant VR sickness reduction.

    Similar to the results of the SSQ scores, the lowest result was observed in M2, and the results of M1 and M3 were similar.

    Table 3 shows the results of VR sickness reduction based on the VR sickness response. Figure 9 shows the VR sickness response to the methods.

    Finally, from the results of the fatigue and immersion questionnaire, it was confirmed that M3 caused the most fatigue and simultaneously caused the lowest level of immersion. Table 4 shows the questionnaire results for fatigue and immersion. Figure 10 shows the questionnaire score for fatigue and immersion.

    Table 2. The results of virtual reality sickness reduction method based on the simulator sickness questionnaire score.
    MethodNauseaOculomotor discomfortDisorientationTotal score

    		Scoret test (df)P valueScoret test (df)P valueScoret test (df)P valueScoret test (df)P value
    M047.02—aN/Ab44.40—N/A79.54—N/A61.71—N/A
    M122.492.917c (13).0121.663.261d (13).00626.853.241d (13).00626.713.230d (13).007
    M215.673.175b (13).00717.873.430d (13).00422.873.277d (13).00621.103.378d (13).005
    M320.442.385c (13).0323.282.668c (13).0226.853.061d (13).00926.712.766c (13).02

    aNot determined.

    bN/A: not applicable.

    cSignificant at P<.05.

    dSignificant at P<.01.

    ‎
    Figure 8. The simulator sickness questionnaire (SSQ) score of virtual reality (VR) sickness reduction methods (M).
    View this figure
    Table 3. The results of virtual reality (VR) sickness reduction based on the VR sickness response.
    Real-time VR sickness measurementScoret test (df)P value
    M03.53—aN/Ab
    M11.664.988 (13)<.001
    M21.553.706 (13).003
    M31.674.645 (13)<.001

    aNot determined.

    bN/A: not applicable.

    ‎
    Figure 9. The average score of the virtual reality (VR) sickness response for the VR sickness reduction methods (M).
    View this figure
    Table 4. The questionnaire results for fatigue and immersion.
    MethodsFatigueImmersion
    M12.005.28
    M21.925.71
    M32.424.71
    ‎
    Figure 10. The questionnaire score for fatigue and immersion. VR: virtual reality. M: VR sickness reduction methods.
    View this figure

    In this study, a new approach was proposed to reduce VR sickness in real time. The proposed approach used the VR sickness response, which is the result of the direct response of VR sickness that occurs while the user watches VR content wearing an HMD. Parameters necessary for the proposed approach were derived through preliminary experiments, and experiments were conducted to verify the effect of reducing VR sickness.

    In addition, an experiment was conducted to confirm the effectiveness of the proposed approach, and from the experimental results, the following conclusions were drawn: (1) the methods (M1-M3) used previously [21,22] were effective in reducing VR sickness; (2) the VR sickness response can indicate the user’s VR sickness condition from the result that the subject’s VR sickness response and SSQ score have a similar pattern; (3) a new approach to providing a VR sickness reduction method based on the VR sickness response was significant; and (4) the VR sickness reduction method synchronized with gaze movement, which caused fatigue and reduced immersion.

    From our results, it was confirmed that VR sickness could be measured without wearing equipment, and the VR sickness reduction method could be applied in real time in accordance with the user’s condition by the approach proposed in this paper. The proposed approach is expected to contribute to the spread of VR content by being applied to content streaming services.

    This study has 2 limitations. First, a single type of VR content was used in the experiment; therefore, experiments using various types of VR content are needed to supplement the limitation. Second, the proposed method was applied after the user’s VR sickness occurred; hence, further studies attempting to predict and reduce VR sickness are required.

    Acknowledgments

    This work was supported by the National Research Foundation of Korea grant funded by the Korea government (grant NRF-2020R1F1A1076114). This study was partially supported by the Education and Research Promotion Program of the Korea University of Technology and Education in 2021.

    Conflicts of Interest

    None declared.

    1. Head-mounted Display Market with COVID-19 Impact Analysis by Type, Technology, Application, Product Type, Component, Connectivity and Geography - Global Forecast to 2026. GlobeNewswire. 2021 Jul 01.   URL: https://tinyurl.com/3zjfu6dk [accessed 2022-09-15]
    2. So RHY, Lo WT, Ho ATK. Effects of navigation speed on motion sickness caused by an immersive virtual environment. Hum Factors 2001;43(3):452-461. [CrossRef] [Medline]
    3. Porcino TM, Clua E, Trevisan D, Vasconcelos CN, Valente L. Minimizing cyber sickness in head mounted display systems: Design guidelines and applications. 2017 Presented at: 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH); April 2-4, 2017; Perth, WA, Australia. [CrossRef]
    4. Joseph JA, Griffin MJ. Motion sickness: effect of the magnitude of roll and pitch oscillation. Aviat Space Environ Med 2008 Apr 01;79(4):390-396. [CrossRef] [Medline]
    5. Freitag S, Weyers B, Kuhlen TW. Examining rotation gain in CAVE-like virtual environments. IEEE Trans Visual Comput Graphics 2016 Apr 21;22(4):1462-1471. [CrossRef]
    6. Nie G, Yue L, Wang Y. Prevention of visually induced motion sickness based on dynamic real-time content-aware non-salient area blurring. 2017 Presented at: 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct); October 9-13, 2017; Nantes. [CrossRef]
    7. Carnegie K, Rhee T. Reducing visual discomfort with HMDs using dynamic depth of field. IEEE Comput Grap Appl 2015 Sep;35(5):34-41. [CrossRef]
    8. Benzeroual K, Allison RS. Cyber (motion) sickness in active stereoscopic 3D gaming. 2013 Presented at: 2013 International Conference on 3D Imaging; December 3-5, 2013; Liege. [CrossRef]
    9. Nesbitt K, Davis S, Blackmore K, Nalivaiko E. Correlating reaction time and nausea measures with traditional measures of cybersickness. Displays 2017 Jul;48:1-8. [CrossRef]
    10. Egan D, Brennan S, Barrett J, Qiao Y, Timmerer C, Murray N. An evaluation of Heart Rate and ElectroDermal Activity as an objective QoE evaluation method for immersive virtual reality environments. 2016 Presented at: 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX); June 6-8, 2016; Lisbon. [CrossRef]
    11. Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviat Psychol 1993 Jul;3(3):203-220. [CrossRef]
    12. Kennedy R, Drexler JM, Compton DE, Stanney KM, Lanham DS, Harm DL. Configural scoring of simulator sickness, cybersickness and space adaptation syndrome: similarities and differences?. 2003.   URL: https://ntrs.nasa.gov/api/citations/20100033371/downloads/20100033371.pdf [accessed 2022-09-16]
    13. Stanney KM, Hale KS, Nahmens I, Kennedy RS. What to expect from immersive virtual environment exposure: influences of gender, body mass index, and past experience. Hum Factors 2003 Aug 28;45(3):504-520. [CrossRef] [Medline]
    14. Haans A, IJsselsteijn WA, de Kort YAW. Self-Report Measure [Database record]. APA PsycTests. 2008.   URL: https://doi.org/10.1037/t21169-000 [accessed 2022-09-16]
    15. Dennison MS, Wisti AZ, D’Zmura M. Use of physiological signals to predict cybersickness. Displays 2016 Sep;44:42-52. [CrossRef]
    16. Singla A, Fremerey S, Robitza W, Raake A. Measuring and comparing QoE and simulator sickness of omnidirectional videos in different head mounted displays. 2017 Presented at: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX); May 31 to June 2, 2017; Erfurt. [CrossRef]
    17. Buhler H, Misztal S, Schild J. Reducing VR sickness through peripheral visual effects. 2018 Presented at: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR); March 18-22, 2018; Tuebingen/Reutlingen. [CrossRef]
    18. Wienrich C, Weidner CK, Schatto C, Obremski D, Israel JH. A virtual nose as a rest-frame - the impact on simulator sickness and game experience. 2018 Presented at: 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games); September 5-7, 2018; Würzburg. [CrossRef]
    19. Whittinghill DM, Ziegler B, Case T, Moore B. Nasum Virtualis: A Simple Technique for Reducing Simulator Sickness in Head Mounted VR. 2015 Mar 2 Presented at: Games developers conference (GDC); March 2-6, 2015; San Francisco p. A.
    20. Lin JJW, Abi-Rached H, Lahav M. Virtual guiding avatar: an effective procedure to reduce simulator sickness in virtual environments. 2004 Presented at: CHI04: CHI 2004 Conference on Human Factors in Computing Systems; April 24-29, 2004; Vienna. [CrossRef]
    21. Won J, Kim YS. A study on visually induced VR reduction method for virtual reality sickness. Applied Sciences 2021 Jul 08;11(14):6339. [CrossRef]
    22. Fernandes AS, Feiner SK. Combating VR sickness through subtle dynamic field-of-view modification. 2016 Presented at: 2016 IEEE Symposium on 3D User Interfaces (3DUI); March 19-20, 2016; Greenville, SC. [CrossRef]

    ‎
    FOV: field of view
    HMD: head-mounted display
    MSSQ: Motion Sickness Susceptibility Questionnaire
    SSQ: simulator sickness questionnaire
    VR: virtual reality

    Edited by N Zary; submitted 13.01.22; peer-reviewed by B Concannon, J Lebiedz'; comments to author 28.04.22; revised version received 09.06.22; accepted 04.08.22; published 27.09.22

    Copyright

    ©JuHye Won, Yoon Sang Kim. Originally published in JMIR Serious Games (https://games.jmir.org), 27.09.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.