This cross-sectional descriptive study aimed to identify development priorities by analyzing the development needs for CNS-related VR programs for nursing students.

The participants of this study included nursing students in South Korea who were in their second year or higher and had taken courses in fundamental nursing or CNS. The survey took place from May 20 to June 25, 2021. A total of 337 copies of the relevant questionnaire were collected. Of these, 222 (66%) copies were used to conduct the final analysis; participants who did not have experience of a VR program and those who gave blank answers were excluded.

The collected data were coded and analyzed using SPSS statistics software (version 25.0; IBM Corp). The general characteristics of the participants were analyzed using descriptive statistics, such as frequencies and percentages, as well as means and SDs. To determine the priority of the demand for developing VR programs for CNS, the analysis method of Cho [9] was applied as follows.

First, the significance of the average difference between the PCL and RCL was analyzed using a 2-tailed t test.

Second, Borich priority was calculated to determine the priority of the development of VR programs of CNS [11]. The Borich priority formula is as follows:

RCL is each individual’s current importance level of CNS score, PCL is each individual’s importance level for developing VR programs of CNS score, is the average of the required level, and N is the total number of cases.

Third, priorities were visualized using the LFM. The items belonging to the first quadrant, higher than the average value of the RCL and PCL, were determined as priorities. The LFM is shown in Figure 1. The LFM is a method of visually deriving priorities using a coordinate plane by marking the RCL on the horizontal axis and the average difference between the RCL and PCL on the vertical axis [12]; the median value on the horizontal axis is the average RCL, and the median value on the vertical axis is the average difference between the RCL and PCL. Generally, the first quadrant is the high-discrepancy, high-importance (HH) quadrant, where the difference between the 2 levels and demand for development is higher than the average (Figure 1). The third quadrant is the low-discrepancy, low-importance (LL) quadrant, where the difference between the 2 levels and demand for development is lower than the average; hence, items in the LL quadrant are not considered development priorities. Although the LFM makes it easy to prioritize items in the first quadrant, there is a need to ascertain where the next-priority quadrant is. Moreover, it may be difficult to determine priorities even within the same quadrant [9].

Finally, both Borich priority and the LFM were combined to determine the highest priority. The LFM is a simple quadrant plot, but when used with the Borich formula, it has the advantage of comprehensively considering the current status and future importance of training needs and the discrepancy between the 2. Specifically, if 10 needs fall into the HH quadrant in the LFM, we checked whether those 10 needs are also ranked as the top 10 priorities by the Borich formula. If so, those needs were considered to have the highest priority.

A recruitment notice introducing the study, including the research purpose, ethics protocol, and survey URL, was posted on a social networking site frequently visited by nursing students. Students who wished to participate completed a web-based survey in Google Forms. The first question required participants to confirm their informed consent to take part in the study. The form advised participants that they could withdraw at any time and that their data would be used only for security maintenance and research purposes. No personal information, such as names and email addresses, was collected to ensure participants’ anonymity.

This study was approved by the Institutional Review Board of Wonkwang University (approval WKIRB-202011-SB-078).

A total of 222 nursing students participated in the survey, among whom women were the majority (n=201, 90.5% vs men, n=21, 9.5%), with an average age of 23.3 (SD 3.33) years. Most participants (n=95, 42.8%) were third-year students. Regarding the contents of VR programs experienced in real life, games were the most common (42/308, 13.6%), followed by movies or dramas (39/308, 12.7%). Unlike experience in real life, only 27 (N=222, 12.2%) students experienced VR in university subjects, with nursing-related subjects being the most frequent (20/44, 45.5%; Table 1).

The overall perception of the VR program (calculated as the mean score for the 10 survey items) was 3.57 (SD 0.57), which was above average. Regarding the questionnaire items, the subjects showed the most positive response to the items indicating that the core nursing VR program would enhance clinical performance (mean 3.90, SD 0.98) and the quality of CNS (mean 3.90, SD 0.95). In contrast, the items “How much do you think you know about the concept of VR?”(mean 3.22, SD 0.90) and “Do you think VR products have become popular?” (mean 3.22, SD 0.92) had the lowest score but moderate-to-high levels of awareness (Table 2).

To find out the needs of nursing students for the development of the CNS VR program, the 2-tailed t test and Borich priority were calculated. The differences between the average PCL and RCL were considered statistically significant in the t test for all 20 CNS. As a result of calculating Borich priority, enema showed the highest demand for the development of a VR program (3.29), followed by administration of intramuscular (IM) injections (3.25) and tube feeding (2.91). In contrast, intravenous (IV) infusion (1.11), administration of oral medication (1.30), and administration of subcutaneous (SQ) injection (1.48) were considered the CNS with the lowest demand for the development of a VR program (Table 3).

In the analysis of the priority for the development of a VR program using the LFM, the average RCL for the development of a VR program for CNS was 4.30, and the average level of the difference between the RCL and PCL was 0.51. As a result of dividing the coordinate planes using these averages as an axis, 8 items such as IM injection, ID injection, blood transfusion, tube feeding, enema, postoperative care, supplying oxygen via nasal cannula, and endotracheal suction were included in the HH quadrant (Figure 2).

Finally, both Borich priority and the LFM were combined to determine the highest priority. In other words, any number of the 8 items of the first quadrant (HH) using the LFM and the 8 items of the Borich ranking priority could be selected. As a result, 7 items were included in the top priority for development, including IM injection, ID injection, tube feeding, enema, postoperative care, supplying oxygen via nasal cannula, and endotracheal suction (Table 4). All but 1 of the 7 items (supplying oxygen via nasal cannula) were found to correspond to a moderate or higher level of difficulty set by KABONE, and 2 of them (ID injection and endotracheal suction) were found to correspond to a high level of difficulty.

The purpose of this study was to use the Borich priority formula and LFM to understand which CNS most require the development of VR programs to meet the needs of nursing students.

The study participants comprised 222 students in their second year or higher, who had taken courses on fundamental nursing or CNS and had experienced VR programs. Although 72.8% of the participants experienced VR programs in their daily lives, only 12.2% used them in the university curriculum. The participants showed the lowest score (mean 3.22, SD 0.90) for the questionnaire item regarding the concept of VR. This appeared to be consistent with the previous research results, which indicated that only 61.6% of students who had heard of VR or augmented reality (AR) before (99.7%) said they could accurately distinguish between VR and AR [13]. Nevertheless, the participants responded that VR programs for CNS would help enhance clinical performance (mean 3.90, SD 0.98), as well as the quality of CNS education (mean 3.90, SD 0.95), showing positive expectations for practical training using VR programs in the future. This was consistent with the results of previous related studies, which stated that VR- and AR-applied education would enhance learning and clinical performance [13]. In addition, the use of VR programs not only improves students’ understanding and proficiency in CNS but also allows them to experience, in advance, how to respond to various patient reactions when directly performing CNS in real nursing situations [14]. Training using VR programs that provided repetitive training under the supervision of the educator increased the skill-retaining period compared with traditional one-time face-to-face training or self-practice in an open laboratory without appropriate feedback from the educator [15,16]. These prior research results are consistent with the results of this study, which indicate that education using VR programs will help improve clinical performance in hospitals in the future.

Based on the results of this study, the participants identified the differences between the PCL and RCL in developing VR programs for CNS. In other words, the PCL was statistically significantly lower than the RCL for all the items. This result means participants showed awareness of the need to develop VR programs when there is a difference between the PCL and RCL [17]. The top development priority items according to Borich needs formula included enema (3.29), administration of IM injection (3.25), and tube feeding (2.91). On the other hand, the lowest rankings were IV infusion (1.11), administration of oral medication [1.30], and administration of SQ injection [18]. In the coordinate plane using the LFM, the priority items for development (HH quadrant) totaled 8 items, including IM injection, ID injection, blood transfusion, tube feeding, etc. The KABONE classifies 20 CNS into higher (6 skills), middle (9 skills), and lower (5 skills) levels of difficulty. The LFM analysis revealed that 3 of 8 items in the HH quadrant (ID injection, blood transfusion, and endotracheal suction) corresponded to higher-difficulty CNS according to the KABONE. Additionally, 7 items in the LL quadrant (vital sign, administration of oral medication, IV infusion, preoperative care, admission care, gowning and gloving technique, and tracheostomy tube care) were not considered priority items for the development of a VR program, whereas 3 items (vital sign, oral medication, and admission care) in that quadrant were classified as lower difficulty according to the KABONE. In other words, the difficulty of CNS set by the KABONE and priority in the development of a VR program by the LFM according to the results of this study were consistent.

In the last step, the items and number of items in the HH quadrant of the LFM, as well as the same number of priority items according to the Borich needs assessment, were identified to determine the overlapping items in the 2 methods. As a result of the analysis, a total of 7 items, including IM injection, ID injection, tube feeding, enema, postoperative care, supplying oxygen via nasal cannula, and endotracheal suction, were found to be the top-priority items for the development of a VR program.

This result was similar with the items identified in previous studies, indicating that new graduate nurses and nursing students had the lowest confidence in the necessary skills for enemas, tracheostomy tube care, tube feeding, postoperative care, etc [18-23]. Additionally, nursing students chose tracheostomy tube care and enema as the CNS that they did not have the opportunity to practice in person or observe. This finding means that most of the clinical practice of nursing students was focused on noninvasive, safe, and simple skills that do not invade patient’s privacy, involving low exposure of the patient’s body. In other words, the participants were found to have selected invasive items with few opportunities for direct execution and observation during practical apprenticeship training, despite their close association with patient safety and importance, as CNS of high priority for the development of a VR program. This finding can also be confirmed in that most of the skills belonging to LL quadrant in the LFM, an area that is not considered for development priorities, are skills that can be delivered verbally rather than through direct contact with patients.

Previous related studies indicated that students who undergo CNS training through a VR program were able to minimize possible harm to patients when exposed to the actual clinical environment [24,25]. VR programs are designed to prevent the student from proceeding to the next step if they make mistakes related to patient safety or choose the wrong method; this may have contributed to the students improving their skills. Therefore, the development of VR programs for invasive CNS should be prioritized to reduce the possibility of the occurrence of errors during clinical practice and the fear of students to learn skills that can harm patients through repetitive practice of the nursing skills in a safe and realistic environment. CNS are mostly taught in a preparatory course before clinical practice. Nursing students, therefore, want a program that allows for effective practice of CNS as a preparatory course in school [26]. Moreover, most of the items that necessitate the development of VR programs show a low frequency of indirect experience in practical apprenticeship training and in-school simulation practice [22]. Accordingly, the reinforcement of skill learning through VR programs for these items appears to be necessary.

Education comprises 3 elements: the educator, student, and educational content. The “student” variable is considered the most important factor in determining the quality of educational performance. Students are the end consumers of all the content provided in the curriculum and are substantially influenced in terms of their career paths through the enhancement of their abilities and competencies. Therefore, it is essential to first analyze the needs of learners and configure the curriculum accordingly in the new, normal post–COVID-19 era. Particularly, in the field of nursing, where practical education occupies a large part of the curriculum, it is necessary to identify the needs of students for practical education and develop a curriculum that reflects them [26]. Post–COVID-19 education requires a paradigm shift. In other words, it is necessary to establish an on-demand form of education that reflects the diverse competencies and needs of students [1]. In this respect, this study’s analysis of the demands for the development of VR programs for teaching CNS is important. In other words, it will be necessary to consider various approaches to teach the 20 CNS to further provide learner-centered personalized education, hence meeting the needs of students by applying traditional learning methods to the items that generate low-development demands and developing VR programs for items that generate high-development demands.

This study has the following limitations. First, in terms of study participants and sampling, the survey was conducted on a website visited by many nursing students. Therefore, it was not possible to perform more precise sampling by region and year of university. This limits generalization in the interpretation and application of the research results. Therefore, there is need for future research to increase the possibility of generalization through sampling by region and year of university. Second, there is a need for further research according to demographic characteristics, such as how participants take relevant classes (face to face or remotely) or their exposure to clinical or VR training. Previous studies on confidence in CNS showed differences in difficulty and confidence depending on the general characteristics of the subjects. In other words, conducting research by considering the variables more comprehensively according to the demographic characteristics of participants, such as how they take CNS-related courses, will enable the development of more practical and systematic VR programs for teaching CNS, providing appropriate content for students in each year of university. Third, this study was conducted among nursing students. Therefore, there is a need to conduct studies with participants with various experiences, such as new nurses or preceptors. In other words, it will be possible to establish a continuous and virtuous cycle of learning that connects schools to hospitals and back to schools by examining the training methods and confidence in CNS for new nurses and reflecting these results back into the curriculum of the university.

There are many studies on CNS, but there are no studies examining the needs of students following the development of CNS VR programs. As there are no studies similar to this study, it is difficult to compare its results with those of previous studies.

Nursing education is aimed at acquiring and integrating knowledge, attitudes, and skills to solve health problems through lectures and practice. CNS are practical skills that each individual nursing student must acquire through repeated practice before clinical practice, requiring self-directed learning capabilities. The analysis of the development demands and priorities for developing VR programs for CNS showed that nursing students generally asked for the development of VR programs for nursing skills that involved invasive procedures. The results of this study are intended to help various aspects of in-school practical education using VR programs in nursing departments, which are currently facing difficulties in teaching CNS on the web owing to COVID-19.