Original Paper
Abstract
Background: Although more people are experiencing cybersickness due to the popularization of virtual reality (VR), no official standard for the cause and reduction of cybersickness exists to date. One of the main reasons is that an objective method to assess cybersickness has not been established. To resolve this, research on evaluating cybersickness with physiological responses that can be measured in real time is required. Since research on deriving physiological responses that can assess cybersickness is at an early stage, further studies examining various physiological responses are needed.
Objective: This study analyzed the effects of cybersickness caused by head-mounted display–based VR on physiological responses.
Methods: We developed content that provided users with a first-person view of an aircraft that moved (with translation and combined rotation) over a city via a predetermined trajectory. In the experiment, cybersickness and the physiological responses of participants were measured. Cybersickness was assessed by the Simulator Sickness Questionnaire (SSQ). The measured physiological responses were heart rate, blood pressure, body temperature, and cortisol level.
Results: Our measurement confirmed that all SSQ scores increased significantly (all Ps<.05) when participants experienced cybersickness. Heart rate and cortisol level increased significantly (P=.01 and P=.001, respectively). Body temperature also increased, but there was no statistically significant difference (P=.02). Systolic blood pressure and diastolic blood pressure decreased significantly (P=.001).
Conclusions: Based on the results of our analysis, the following conclusions were drawn: (1) cybersickness causes significant disorientation, and research on this topic should focus on factors that affect disorientation; and (2) the physiological responses that are suitable for measuring cybersickness are heart rate and cortisol level.
doi:10.2196/37938
Keywords
Introduction
The recent development of technologies such as head-mounted displays (HMDs) and motion-tracking devices has enabled active research on virtual reality (VR). VR is used in various fields, such as in games, education, medicine, and health care [
]. Although VR can improve the user’s concentration by providing an immersive experience, some users may experience cybersickness, which is a type of motion sickness [ ].The most well-known theory for explaining motion sickness is the sensory conflict theory. According to the sensory conflict theory, motion sickness is caused by a discordance between the vestibular sense and the visual perception of body movement [
- ]. In addition, according to the sensory conflict theory, motion sickness is classified into motion-induced motion sickness (MIMS) and visually induced motion sickness (VIMS). MIMS is further classified according to the external environment as car, ship, and air (flight) sickness [ - ], and VIMS is further classified into simulator motion sickness and cyber motion sickness according to the display device [ , ]. Simulator motion sickness is caused in virtual training such as flying and driving [ - ], and cyber motion sickness is caused in virtual environments that are completely different from real ones [ ].Although more people are experiencing cybersickness due to the popularization of VR, no official standard for the cause and reduction of cybersickness exists to date. One of the main reasons is that an objective method to assess cybersickness has not been established. Vomiting has been used as a diagnostic criterion for motion sickness because it is difficult to assess other symptoms quantitatively [
]. However, because there are instances of motion sickness that do not accompany vomiting, the Motion Sickness Assessment Questionnaire (MSAQ) [ ] and the Simulator Sickness Questionnaire (SSQ) [ ] have been proposed to assess motion sickness symptoms. The MSAQ has been used extensively in traditional motion sickness studies; however, it is not suitable for VIMS assessment. The SSQ, which is optimized from the MSAQ and focuses on VIMS, is mostly used in studies assessing simulator sickness and cybersickness. Even though the SSQ is low-cost and easy to use, its objectiveness is questionable and its real-time implementation is difficult [ , ].To solve this problem, research on evaluating cybersickness with physiological responses that can be measured in real time is required [
, ]. To assess cybersickness in terms of physiological responses, it is necessary to find out the factors that are correlated with cybersickness. Conventional studies have reported that physiological responses, such as specific frequency power bands of the electroencephalogram [ - ], gastrointestinal activity [ ], heart rate [ - ], and skin conductance [ ], can be used to assess cybersickness. In particular, heart rate has been reported to be related to the stress task when playing a video [ , ]. Although conventional research into cybersickness is extensive, this issue remains in the HMD-based VR context [ ]. Many validation experiments are necessary to generalize these physiological responses. Since research on deriving physiological responses that can assess cybersickness is at an early stage, further research on various physiological responses is still required. Therefore, this paper deals with the effects of cybersickness caused by HMD-based VR on physiological responses.Methods
Design and Setting
We performed an experiment where participants watched HMD-based VR content in the environment shown in
.Conventional studies on the effect of the content itself have shown that rotational movement causes higher motion sickness than a linear one [
] and that a combined rotation of more than 1 axis causes greater motion sickness than a rotation of a single axis [ , ]. Based on those conventional studies, our HMD-based VR content was developed to intentionally cause cybersickness using Unity 3D (Unity Technologies) [ ]. In addition, the longer the exposure time, the higher the level of cybersickness, so the playing time of the developed content was configured to be the least amount of time needed to measure the physiological response.The developed content provided the user with a first-person view of an aircraft that moved (with translation and combined rotation) over a city via a predetermined trajectory.
Questionnaire, Variables, and Equipment
The SSQ [
] was used to assess cybersickness. This questionnaire consists of 16 questions with 3 subscales corresponding to symptom clusters (nausea, oculomotor symptoms, and disorientation). Each question is measured on a 4-point scale from 0 to 3 points. A total score represents the complete symptom level of motion sickness. A higher score indicates more severe motion sickness.In an experiment conducted on a Korean population [
], it was confirmed that the SSQ significantly increased in HMD-based environments compared to screen-based environments, which suggests it could have validity and reliability in measuring cybersickness.The occurrence of motion sickness is highly related to the autonomic nervous system [
]. Therefore, in this experiment, physiological responses related to the autonomic nervous system were measured to examine whether or not the responses related to motion sickness can be applied to HMD-based cybersickness. We measured the following physiological responses that relate to the autonomic nervous system: heart rate, blood pressure, body temperature, and cortisol level. Blood pressure was measured as 2 values: systolic and diastolic. Systolic blood pressure indicates the highest pressure in the artery when the heart is contracted, and diastolic blood pressure indicates the lowest pressure in the artery right before the heart contracts again. Body temperature was measured with a digital thermometer. Cortisol, which is produced under stress, was measured from 4 cc of blood collected over 2 minutes with the support of a clinician at Cheonan Medical Center [ ].The HMD used in the experiment was the HTC Vive (HTC Corporation) [
]. To minimize the effect of the vestibular sense, we controlled body motion in addition to head translation and rotation.Participants
A total of 16 undergraduate and graduate students (male: n=8, 50%; female: n=8, 50%) participated in the experiment. The participants had no history of problems associated with the nervous system, autonomic nervous system, and visual system. In addition, more than 8 hours of sleep was recommended to prevent increased cybersickness sensitivity among participants [
]. Prior to participation, we explained the experiment, apart from the objective, and then obtained written consent to participate.Procedures
The experimental procedure consisted of 3 steps (pre-experiment, experiment, and postexperiment) as shown in
. In the pre-experiment step, SSQ and the physiological responses of the participants were measured.In the experiment step, participants viewed the HMD-based VR content that we developed during the design phase. The participants sat and watched the VR content without moving. By making the participants concentrate only on watching the VR content, we ensured their stress level was affected solely by cybersickness.
In the postexperiment step, participants’ physiological responses and SSQ outcomes were measured. Each step was performed for 2 minutes, and the total experiment time was 10 minutes.
The experimental procedure.
Pre-experiment step
- Simulator Sickness Questionnaire (SSQ) measurement (2 minutes)
- Physiological response measurement (2 minutes)
Experiment
- Head-mounted display–based virtual reality content viewing (2 minutes)
Postexperiment step
- Physiological response measurement (2 minutes)
- SSQ measurement (2 minutes)
Data Analysis
We analyzed the data measured in the experiment using SPSS Statistics (version 21; IBM Corp) [
]. The data measured in the experiment were SSQ items, heart rate, body temperature, blood pressure, and cortisol. A statistical analysis (paired t test) was applied to find significant differences between the measured data in the pre- and postexperiment steps. SSQ scores from before and after the experiment were compared to detect the presence of cybersickness. If found, we analyzed how each physiological response was related to cybersickness in the HMD-based environment.Ethics Approval
The study was approved by the institutional review board of the Korea University of Technology and Education (IRB-17122602).
Results
SSQ Analysis
The SSQ scores measured before and after the experiment are shown in
. In the pre-experiment step, the mean SSQ scores for nausea, oculomotor, disorientation, and total score were 4.17, 15.63, 5.22, and 10.75, respectively. In the postexperiment step, they were 32.79, 38.77, 64.38, and 49.32, respectively. From the measurement results, it was confirmed that all SSQ scores increased significantly, as shown in (all Ps<.05). This indicates that cybersickness was experienced by participants viewing the HMD-based VR content.Physiological response | Pre-experiment score, mean (SD) | Postexperiment score, mean (SD) | t (df) | P value |
Nausea | 4.17 (6.94) | 32.79 (34.30) | –3.48 (15) | .003a |
Oculomotor | 15.63 (16.01) | 38.77 (24.97) | –3.37 (15) | .004a |
Disorientation | 5.22 (10.01) | 64.38 (58.15) | –3.93 (15) | .001a |
Total | 10.75 (11.74) | 49.32 (38.00) | –3.89 (15) | .001a |
aSignificant P values.
Physiological Responses Analysis
The physiological responses measured in the pre- and postexperiment steps are shown in
. Mean heart rate before and after the experiment was 78.06 bpm and 83.50 bpm, respectively. Our measurements confirmed that heart rate increased significantly (P=.01; ). This means that heart rate increased when cybersickness was experienced by participants viewing the HMD-based VR content.Physiological response | Pre-experiment score, mean (SD) | Postexperiment score, mean (SD) | t (df) | P value | |
Heart rate (bpm) | 78.06 (7.71) | 83.50 (10.41) | –2.92 (15) | .01a | |
Cortisol (ug/dl) | 7.75 (2.62) | 10.59 (4.12) | –4.72 (15) | .001a | |
Body temperature (°C) | 37.10 (0.28) | 37.14 (0.21) | –1.33 (15) | .20 | |
Blood pressure (mmHg) | |||||
Systolic | 130.81 (18.84) | 117.31 (15.78) | 5.43 (15) | .001a | |
Diastolic | 76.69 (9.30) | 67.50 (11.90) | 4.43 (15) | .001a |
aSignificant P values.
The mean cortisol level before and after the experiment was 7.75 ug/dl and 10.59 ug/dl, respectively. Our measurements confirmed that the cortisol level increased significantly (P=.001;
). This implies that the cortisol level increased when participants felt cybersickness.Mean body temperature before and after the experiment was 37.10 °C and 37.14 °C, respectively. As per the measurement results, body temperature increased (
), but there was no statistically significant difference (P=.20).Mean systolic blood pressure before and after the experiment was 130.81 mmHg and 117.31 mmHg, respectively, whereas mean diastolic blood pressure was 76.69 mmHg and 67.50 mmHg, respectively. As per the measurement results, systolic blood pressure and diastolic blood pressure decreased significantly (P=.001;
). This means that blood pressure decreased when cybersickness was experienced by participants.Discussion
Principal Findings
This paper examined the effects of cybersickness on physiological responses when people watch HMD-based VR content. To this end, we performed statistical analyses of SSQ scores and physiological responses (using questionnaire responses and measurements, respectively) before and after the experiment.
SSQ scores analysis in the pre- and postexperiment steps was performed to assess whether HMD-based VR content caused cybersickness. According to previous studies assessing various motion sicknesses [
], MIMS (car, ship, and airplane), simulator sickness, and cybersickness showed the highest increase in nausea, oculomotor, and disorientation, respectively. In this study, we found the highest increase in disorientation in cases of cybersickness. This result matches that of other studies (see and ). This indicates that when there is no vestibular stimulation caused by the movement of the body and cybersickness is caused by visual stimulation through the HMD, significant disorientation occurs. This means that there is a secondary risk of walking accidents due to disorientation as well as a primary risk of cybersickness when watching HMD-based VR content. Therefore, we believe that studies on reducing cybersickness should focus on disorientation.Physiological responses analysis in the pre- and postexperiment steps was performed to assess physiological response due to cybersickness. Significant effects on heart rate, blood pressure, and cortisol level were found in participants experiencing cybersickness (
). Heart rate and cortisol level are closely related to stress. Heart rate is explained separately by the heart-body linkage hypothesis and the heart-body dissociation hypothesis [ ]. The heart-body connection hypothesis states that when a person exercises, their metabolism increases, which in turn causes their heart rate to increase. The heart-body dissociation hypothesis explains more reasonably the presence of cybersickness in a motionless state than the heart-body connection hypothesis. The heart-body dissociation hypothesis states that when a person is under stress, their metabolism increases and their heart rate increases proportionally. Conventional studies [ , ] on heart rate and stress found that participants’ heart rates increased when watching a video that was assigned as a stress task. In this study, we found increased heart rate ( ) and cortisol level ( ) in participants experiencing cybersickness. We believe that cybersickness is accompanied by stress, and heart rate increases due to the accompanying stress, which confirms the findings of previous studies. In general, it is widely known that blood pressure ( ) increases as heart rate increases. However, in our study, blood pressure decreased when heart rate increased. This is because the central nervous system causes a blood pressure response [ - ] since motion sickness is an abnormal adaptation of the autonomic nervous system due to the discordance between the vestibular sense and visual perception in the central nervous system [ , ]. Therefore, we believe that the change in blood pressure that is caused by cybersickness is different from the general correlation between heart rate and blood pressure. In summary, we found that the physiological responses that can be objectively measured to indicate cybersickness are heart rate and cortisol level.Limitations
The number of participants (n=16) was too small to generalize the physiological responses statistically, even though they were appropriate for detecting physiological responses to cybersickness. Cybersickness is known to be sensitive to gender, age, and VR adaptation (number of experiences). However, this study did not consider these variables because our purpose was to find the physiological responses that can measure cybersickness objectively among various physiological responses. Subsequent studies should consider the number of experiences, gender, age, and VR adaptation of participants in addition to the physiological responses that were found in this study.
Conclusions
We analyzed the effects of cybersickness caused by HMD-based VR content on physiological responses. Heart rate, body temperature, cortisol level, and blood pressure were measured to analyze SSQ scores and physiological responses. A total of 16 participants watched the HMD-based VR content in a seated position and without moving to ensure their concentration was only on watching the VR content, which was developed to intentionally cause cybersickness.
From the results of our analysis, the following conclusions were drawn: (1) cybersickness causes significant disorientation, and research on cybersickness should focus on factors that affect disorientation; and (2) the physiological responses that are suitable for measuring cybersickness are heart rate and cortisol. This means that heart rate and cortisol level can be used as real-time factors to objectively assess cybersickness.
Acknowledgments
This work was supported by a National Research Foundation of Korea grant funded by the Government of Korea (Ministry of Science and ICT) (NRF-2020R1F1A1076114). This paper was partially supported by the Education and Research Promotion program of the Korea University of Technology and Education in 2021.
Data Availability
All data generated or analyzed during this study are included in this published article.
Conflicts of Interest
None declared.
References
- Benzeroual KR, Allison RS. Cyber (motion) sickness in active stereoscopic 3D gaming. 2013 Presented at: International Conference on 3D Imaging; Dec 3-5; Liege, Belgium p. 1-7. [CrossRef]
- Rebenitsch L, Owen C. Review on cybersickness in applications and visual displays. Virtual Real 2016 Apr 26;20(2):101-125. [CrossRef]
- Oman CM. Motion sickness: a synthesis and evaluation of the sensory conflict theory. Can J Physiol Pharmacol 1990 Feb 01;68(2):294-303. [CrossRef] [Medline]
- Reason J. Motion sickness: Some theoretical and practical considerations. Appl Ergon 1978 Sep;9(3):163-167. [CrossRef]
- Reason JT. Motion sickness adaptation: a neural mismatch model. J R Soc Med 2018 Mar 07;71(11):819-829. [CrossRef]
- Reason JT, Brand JJ. Motion Sickness. London, UK: Academic Press; 1975.
- O'Hanlon JF, McCauley ME. Motion sickness incidence as a function of the frequency and acceleration of vertical sinusoidal motion. Aerosp Med 1974 Apr;45(4):366-369 [FREE Full text] [Medline]
- Lawther A, Griffin MJ. Motion sickness and motion characteristics of vessels at sea. Ergonomics 1988 Oct 30;31(10):1373-1394. [CrossRef] [Medline]
- Bos J, Bles W. Modelling motion sickness and subjective vertical mismatch detailed for vertical motions. Brain Res Bull 1998 Nov;47(5):537-542. [CrossRef]
- Wertheim A, Bos J, Bles W. Contributions of roll and pitch to sea sickness. Brain Res Bull 1998 Nov;47(5):517-524. [CrossRef]
- Kennedy RS, Drexler J, Kennedy RC. Research in visually induced motion sickness. Appl Ergon 2010 Jul;41(4):494-503. [CrossRef] [Medline]
- Naqvi SAA, Badruddin N, Malik AS, Hazabbah W, Abdullah B. Does 3D produce more symptoms of visually induced motion sickness? 2013 Presented at: 35th Annual International Conference on Engineering in Medicine and Biology Society; July 3-7; Osaka, Japan p. 6405-6408. [CrossRef]
- Miller JW, Goodson JE. Motion sickness in a helicopter simulator. Aerosp Med 1960 Mar;31:204-212. [Medline]
- Crowley JS. Simulator sickness: a problem for army aviation. Aviat Space Environ Med 1987 Apr;58(4):355-357. [Medline]
- Lerman Y, Sadovsky G, Goldberg E, Kedem R, Peritz E, Pines A. Correlates of military tank simulator sickness. Aviat Space Environ Med 1993 Jul;64(7):619-622. [Medline]
- Mazloumi Gavgani A, Walker FR, Hodgson DM, Nalivaiko E. A comparative study of cybersickness during exposure to virtual reality and "classic" motion sickness: are they different? J Appl Physiol (1985) 2018 Oct 04;125(6):1670-1680. [CrossRef] [Medline]
- Shupak A, Gordon CR. Motion sickness: advances in pathogenesis, prediction, prevention, and treatment. Aviat Space Environ Med 2006 Dec;77(12):1213-1223. [Medline]
- Gianaros PJ, Muth ER, Mordkoff JT, Levine ME, Stern RM. A questionnaire for the assessment of the multiple dimensions of motion sickness. Aviat Space Environ Med 2001 Feb;72(2):115-119 [FREE Full text] [Medline]
- Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator Sickness Questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviat Psychol 1993 Jul;3(3):203-220. [CrossRef]
- McCauley ME, Sharkey TJ. Cybersickness: perception of self-motion in virtual environments. Presence (Camb) 1992 Jan;1(3):311-318. [CrossRef]
- Kennedy RS, Lane NE, Lilienthal MG, Berbaum KS, Hettinger LJ. Profile analysis of simulator sickness symptoms: application to virtual environment systems. Presence (Camb) 1992 Jan;1(3):295-301. [CrossRef]
- Davis S, Nesbitt K, Nalivaiko E. A systematic review of cybersickness. In: Proceedings of the 2014 Conference on Interactive Entertainment. 2014 Presented at: IE2014: Interactive Entertainment 2014; Dec 2-3; Newcastle, NSW, Australia p. 1-9. [CrossRef]
- Weech S, Kenny S, Barnett-Cowan M. Presence and cybersickness in virtual reality are negatively related: a review. Front Psychol 2019 Feb 4;10:158 [FREE Full text] [CrossRef] [Medline]
- Chen Y, Duann J, Chuang S, Lin C, Ko L, Jung T, et al. Spatial and temporal EEG dynamics of motion sickness. Neuroimage 2010 Feb 01;49(3):2862-2870. [CrossRef] [Medline]
- Min B, Chung S, Min Y, Sakamoto K. Psychophysiological evaluation of simulator sickness evoked by a graphic simulator. Appl Ergon 2004 Nov;35(6):549-556. [CrossRef] [Medline]
- Arsalan Naqvi SA, Badruddin N, Jatoi MA, Malik AS, Hazabbah W, Abdullah B. EEG based time and frequency dynamics analysis of visually induced motion sickness (VIMS). Australas Phys Eng Sci Med 2015 Dec 13;38(4):721-729. [CrossRef] [Medline]
- Dennison MS, Wisti AZ, D’Zmura M. Use of physiological signals to predict cybersickness. Displays 2016 Sep;44:42-52. [CrossRef]
- Holmes SR, Griffin MJ. Correlation between heart rate and the severity of motion sickness caused by optokinetic stimulation. J Psychophysiol 2001 Mar;15(1):35-42. [CrossRef]
- Glass DC, Krakoff LR, Contrada R, Hilton WF, Kehoe K, Mannucci EG, et al. Effect of harassment and competition upon cardiovascular and plasma catecholamine responses in type A and type B individuals. Psychophysiology 1980 Sep;17(5):453-463. [CrossRef] [Medline]
- Turner JR, Carroll D, Courtney H. Cardiac and metabolic responses to "space invaders": an instance of metabolically-exaggerated cardiac adjustment? Psychophysiology 1983 Sep;20(5):544-549. [CrossRef] [Medline]
- Gavgani AM, Nesbitt KV, Blackmore KL, Nalivaiko E. Profiling subjective symptoms and autonomic changes associated with cybersickness. Auton Neurosci 2017 Mar;203:41-50. [CrossRef] [Medline]
- Rangelova S, Motus D, André E. Cybersickness among gamers: an online survey. In: Ahram T, editor. Advances in Intelligent Systems and Computing. Cham, Switzerland: Springer; 2019:192-201.
- Lo W, So RH. Cybersickness in the presence of scene rotational movements along different axes. Appl Ergon 2001 Feb;32(1):1-14. [CrossRef]
- Bonato F, Bubka A, Palmisano S, Phillip D, Moreno G. Vection change exacerbates simulator sickness in virtual environments. Presence (Camb) 2008 Jun 01;17(3):283-292. [CrossRef]
- Keshavarz B, Hecht H. Axis rotation and visually induced motion sickness: the role of combined roll, pitch, and yaw motion. Aviat Space Environ Med 2011 Nov 01;82(11):1023-1029. [CrossRef] [Medline]
- Unity3D. Unity Technologies. URL: https://unity.com/ [accessed 2022-09-27]
- Jeeheon R, Seungbeon Y. The effects of head mounted display and treadmill on cyber sickness in the immersive virtual reality learning environment. The Korea Educational Review 2016;22(3):385-403 [FREE Full text]
- Muth ER. Motion and space sickness: intestinal and autonomic correlates. Auton Neurosci 2006 Oct 30;129(1-2):58-66. [CrossRef] [Medline]
- Cheonan Medical Center. URL: https://www.camc.or.kr/ [accessed 2022-09-27]
- Vive. HTC Corporation. URL: https://www.vive.com/ [accessed 2022-09-27]
- Kaplan J, Ventura J, Bakshi A, Pierobon A, Lackner JR, DiZio P. The influence of sleep deprivation and oscillating motion on sleepiness, motion sickness, and cognitive and motor performance. Auton Neurosci 2017 Jan;202:86-96. [CrossRef] [Medline]
- SPSS software. IBM Corporation. URL: https://www.ibm.com/analytics/spss-statistics-software [accessed 2022-09-27]
- Lee IH. Psychophysiology. Seoul, Korea: Hakjisa; 1997.
- Balaban CD. Vestibular autonomic regulation (including motion sickness and the mechanism of vomiting). Curr Opin Neurol 1999 Feb;12(1):29-33 [FREE Full text] [CrossRef] [Medline]
- Balaban CD. Projections from the parabrachial nucleus to the vestibular nuclei: potential substrates for autonomic and limbic influences on vestibular responses. Brain Res 2004 Jan 16;996(1):126-137. [CrossRef] [Medline]
Abbreviations
HMD: head-mounted display |
MIMS: motion-induced motion sickness |
MSAQ: Motion Sickness Assessment Questionnaire |
SSQ: Simulator Sickness Questionnaire |
VIMS: visually induced motion sickness |
VR: virtual reality |
Edited by N Zary; submitted 12.03.22; peer-reviewed by R Ciorap, K Toko; comments to author 28.04.22; revised version received 06.07.22; accepted 21.07.22; published 17.10.22
Copyright©Yoon Sang Kim, JuHye Won, Seong-Wook Jang, Junho Ko. Originally published in JMIR Serious Games (https://games.jmir.org), 17.10.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.