This paper is in the following e-collection/theme issue:

Game Design and Efficacy of Game Elements (81) Innovations and Technology for Healthy Eating Education (400) Parent and Child Education on Healthy Eating and Nutrition (161)

Published on in Vol 8, No 3 (2020): Jul-Sep

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/21813, first published .
Relationship Between Children’s Enjoyment, User Experience Satisfaction, and Learning in a Serious Video Game for Nutrition Education: Empirical Pilot Study

Relationship Between Children’s Enjoyment, User Experience Satisfaction, and Learning in a Serious Video Game for Nutrition Education: Empirical Pilot Study

Relationship Between Children’s Enjoyment, User Experience Satisfaction, and Learning in a Serious Video Game for Nutrition Education: Empirical Pilot Study

Authors of this article:

Ismael Edrein Espinosa-Curiel1 Author Orcid Image ;   Edgar Efrén Pozas-Bogarin1 Author Orcid Image ;   Juan Martínez-Miranda2 Author Orcid Image ;   Humberto Pérez-Espinosa2 Author Orcid Image
Article Authors Cited by (19) Tweetations (3) Metrics

    Original Paper

    1Centro de Investigación Científica y de Educación Superior de Ensenada, Unidad de Transferencia Tecnológica Tepic, Tepic, Nayarit, Mexico

    2Consejo Nacional de Ciencia y Tecnología, Centro de Investigación Científica y de Educación Superior de Ensenada, Unidad de Transferencia Tecnológica Tepic, Tepic, Nayarit, Mexico

    Corresponding Author:

    Ismael Edrein Espinosa-Curiel, PhD

    Centro de Investigación Científica y de Educación Superior de Ensenada

    Unidad de Transferencia Tecnológica Tepic

    Andador 10, entre calles 3 y 4, Ciudad del conocimiento

    Tepic, Nayarit, 63173

    Mexico

    Phone: 52 1295930 ext 28607

    Email: ecuriel@cicese.edu.mx


    Background: The design and use of serious video games for children have increased in recent years. To maximize the effects of these games, it is essential to understand the children’s experiences through playing. Previous studies identified that enjoyment and user experience satisfaction of the players are principal factors that can influence the success of serious video games and the learning of their players. However, research about the relationship between enjoyment and user experience satisfaction with learning in children 8 to 10 years old is sparse.

    Objective: We examined the relationship of enjoyment and user experience satisfaction with the learning of children aged 8 to 10 years while playing a serious video game for health, FoodRateMaster. This serious video game teaches children about the characteristics of healthy and unhealthy foods and how to identify them in their environment.

    Methods: Children aged 8 to 10 years were recruited from a primary school in Mexico. Participants completed 12 individual gaming sessions with FoodRateMaster in 6 weeks. A food knowledge questionnaire was administered before and after game play to assess the players’ food knowledge. In addition, after the gaming sessions, the children’s enjoyment and user experience satisfaction were evaluated using the EGameFlow questionnaire and the Game User Experience Satisfaction Scale (GUESS) questionnaire.

    Results: We found significant positive associations for children’s (n=60) posttest knowledge with enjoyment (r58=0.36, P=.005) and user experience satisfaction (r58=0.27, P=.04). The children’s posttest knowledge scores were also positively correlated with challenge (r58=0.38, P=.003), knowledge improvement (r58=0.38, P=.003), and goal clarity (r58=0.29, P=.02) EGameFlow subscales and with narrative (r58=0.35, P=.006), creative freedom (r58=0.26, P=.04), and visual esthetics (r58=0.32, P=.01) GUESS subscales. Regression analysis indicated that the EGameFlow (F7,52=2.74, P=.02, R2=0.27) and the GUESS (F8,51=2.20, P=.04, R2=0.26) ratings significantly predicted the children’s posttest knowledge scores. EGameFlow challenge (β=0.40, t52=2.17, P=.04) and knowledge improvement (β=0.29, t52=2.06, P=.04) subscales significantly contributed to predicting children’s learning. None of the GUESS subscales significantly contributed to predicting children’s learning.

    Conclusions: The findings of this study suggest that both enjoyment and user experience satisfaction for children aged 8 to 10 years were positively correlated with their learning and that were significant predictors of it. Challenge, knowledge improvement, narrative, creative freedom, and visual esthetics subscales correlated positively with children’s learning. In addition, challenge and knowledge improvement contributed to predicting their learning. These results are relevant to consider during the design stages of serious games developed for young children’s learning purposes.

    JMIR Serious Games 2020;8(3):e21813

    doi:10.2196/21813

    Keywords

    Serious video games; children; enjoyment; user experience; satisfaction; game-based learning; nutrition; serious game; pilot study 


    Serious Video Games for Children

    Serious video games are interactive digital programs or apps that have a goal beyond entertainment or fun. This type of video game is designed for promoting and encouraging a broad range of purposes such as education, training, skill development, knowledge acquisition, or even behavior and attitude changes [1,2]. The primary rationale of using video games for serious purposes is to take advantage of their ability to motivate, provide enjoyment, and engage players [1]. In addition, their versatility allows them to be used as tools in a broad spectrum of domains such as the military, government, educational, corporate, enterprise, tourism, and health [3]. Most serious games have reported positive outcomes, and in general, they are more effective than conventional instructional methods [4-7].

    The development and use of serious video games designed for children have increased over the past decade [8-11]. Researchers have encouraged their use in children, since children (regardless of age, sex, and background) are interested in video games [9], and because video games allow them to practice different skills in a safe environment. In addition, video games can be used as an alternative to influence children who are having difficulties learning with traditional education methods [1]. There are currently serious video games for children for a broad set of applications, such as STEM education, obesity prevention, nutrition education, chronic diseases, psychiatry, learning disabilities, and cognitive development [9-14].

    While there is a growing body of literature on the potential of serious video games in children [9-15], researchers have tended to ignore what children experience during playing sessions, and how these experiences influence the success, effectiveness, and outcomes of serious games. Having a better understanding of their experiences can help in designing more effective and engaging serious video games for children [16-20].

    Enjoyment and User Experience Satisfaction in Serious Games

    Two of the best-known factors that influence the acceptance, use, and success of any video game are the players’ enjoyment and the players’ experience satisfaction [21-26]. If players do not enjoy the game or have a satisfying gaming experience, they will not play the game [27]. However, there is a lack of consensus in the video game field regarding the definitions of enjoyment and user experience satisfaction [21,24]. Moreover, as terms, they are often used interchangeably with a host of other terms, some of which overlap conceptually (eg, engagement, flow, fun, playability, and immersion) [21,24].

    According to Crutzen et al [21] enjoyment refers to “the action or state of deriving gratification from a video game.” Enjoyment is a multidimensional concept that embraces dimensions such as concentration, goal clarity, feedback, challenge, autonomy, immersion, social interaction, knowledge improvement, competence, narrative transportation, and relevance [21,27,28]. Meanwhile, Phan et al [24] defined game user experience satisfaction as “the degree to which the players feel gratified with his or her experience while playing a video game.” Game user experience satisfaction involves different dimensions such as usability (or playability), narratives, creative freedom, audio and visual esthetics, and personal gratification [23,24,26].

    The dimensions of enjoyment and player experience satisfaction are important factors for the success and effectiveness of serious games [17,21,29] since boring or poorly designed serious video games run the risk of disappointing and eventually alienating their target audience [30]. Previous studies have identified that factors such as technological capacity, esthetic presentation, game design elements, and fun factors (eg, characters, dialogues, and humor) influence the acceptability of serious games [17]. In addition, factors such as game goals, freedom, narrative, interaction, challenge, sensation, feedback, level of fun, usability, and mystery are critical for the effectiveness of serious games [29,31]. These factors also can influence the mood [19], engagement [21,32], satisfaction [33-35], and performance [34,36] of players. Serious video games can provide excellent levels of usability [35,37] and enjoyment [38] in comparison with entertainment video games [17,39].

    Enjoyment, User Experience Satisfaction, and Learning in Serious Games

    The studies [20,40-44] that describe the relationship between enjoyment and user experience satisfaction with the learning of players in serious games show contradictory conclusions. While some studies have stated that enjoyment could be perceived as an outcome opposite to learning in serious games [40,41], other studies noted that enjoyment and user experience satisfaction could positively impact players’ motivation to learn and the learning outcomes. In particular, attributes such as fantasy, representation, sensory stimuli, mystery, control, assessment, narrative, realism, adaptivity, interaction, feedback, debriefing, graphics, fun, rules, and goals could support players’ learning [42], influence players’ cognitive engagement and motivation [20,42,43], and impact players’ learning outcomes [20,44].

    Despite enjoyment and user experience being essential concepts that are important in fostering learning in serious games, surprisingly few studies [45-50] have measured the dimensions of enjoyment and user experience satisfaction in the serious game context and analyzed how it relates to the learning of players. Giannakos [45], in a study where middle school students played a math game, identified that players’ enjoyment had a significant relationship with learning performance. Hamari et al [46], in a study where high school students played an optics game and an engineering dynamics game, identified that engagement had a positive effect on learning, challenge affected learning, and perceived challenge was a strong predictor of learning outcomes. Conversely, they determined that immersion did not have a significant effect on learning. Fokides et al [47], in a study where university students played a history game and a math game, identified that enjoyment, goal clarity, realism, and narration adequacy were the most influential factors shaping user views for serious game learning effectiveness; conversely, they determined that presence, ease of use, and motivation had a marginal effect. Iten and Petko [48], in a study where primary school students (aged 10 to 13 years old) played a game to develop internet skills, identified that enjoyment could encourage players to learn, but it had a small influence on learning gains. In a more recent study with students aged 9 to 12 years old, Iten and Petko [49] identified that self-reported cognitive learning gains were positively correlated with enjoyment. Ebrahimzadeth and Alavi [50], in a study where high school students played a commercial strategy game, identified that enjoyment significantly predicted players’ vocabulary learning.

    While there is a growing body of literature on the importance of enjoyment and experience satisfaction for players when playing serious video games and their relationship with players learning, currently, there is a dearth of studies that investigated the relationship between these concepts and the learning of young children prior to adolescence (aged between 8 to 10 years) in the context of serious games. Most abovementioned studies [45-50] were evaluated with adolescents (between 10 to 19 years old) [45-49] or young adults [50], and those that included children also included adolescents [48,49], despite the differences in their intellectual and emotional growth [51,52]. The importance of enjoyment and user experience satisfaction and the influence of these concepts on learning could be different for children than for adolescents or young adults [19].

    Objective

    This study responded to this research gap by examining the relationship between learning, user experience satisfaction, and enjoyment in children aged between 8 to 10 years when playing a serious video game.

    Hypotheses

    Hypothesis 1: Enjoyment relates positively to children’s learning.

    Hypothesis 2: Enjoyment influences children’s learning.

    Hypothesis 3: User experience satisfaction relates positively to children’s learning.

    Hypothesis 4: User experience satisfaction influences children’s learning.


    Overview

    This research is part of a comprehensive project to understand the effectiveness of serious video games in children. The video game FoodRateMaster and the research procedure used to obtain the learning data have previously been described in detail [53].

    FoodRateMaster

    A multidisciplinary team developed FoodRateMaster through an extensive formative research process. FoodRateMaster was designed specifically to teach young children about the suggested ranges for food nutrients to help them determine if they should decrease or maintain their intake of certain foods [53].

    FoodRateMaster has 6 levels (Figure 1) that replicate a real food establishment (eg, a food truck, a restaurant, or a grocery store). In each scenario (Figure 2), an evil chef prepares a menu; players, based on the food's nutritional information, determine whether food can be consumed (healthy) or whether its consumption must be reduced (unhealthy). Players use their avatar to take healthy foods (with green labels) and put them into the “keep basket” (green basket) and take unhealthy foods (yellow and red labels) and put them into the “reduce basket” (red basket). Players move the avatar to classify food and avoid obstacles. Maintaining healthy food or reducing unhealthy food allows them to maintain a healthy lifestyle and therefore win points. Additionally, players earn extra points when they correctly replace unhealthy food with healthy food. Otherwise, if players make too many errors, then they do not score enough points to unlock subsequent levels. Finally, a results screen specifies points earned, incorrect food classifications, and position in the global ranking of players (Figure 3).

    Several key elements of FoodRateMaster were designed to encourage enjoyment and produce a satisfying user experience [53]: (1) A history of why the players needs to complete the game mission is given using 2 characters: evil chefs and kids who need to be more selective about the food they eat (Figure 4). (2) Narrative, feedback mechanisms, and attractive audio and visual elements were used to encourage the players’ immersion, concentration, and enjoyment. (3) A graded task mechanism with a cumulative difficulty curve through different levels was used to adjust the challenge and encourage players’ fun through the end of the game (Figure 1). (4) Learning strategies, such as behavioral repetition and substitution (Figure 2) and cognitive restructuring were used to guide knowledge improvement (Figure 5). In addition, in FoodRateMaster, children have to use their creativity and curiosity to figure out how to use the information on nutrition labels and nutrition traffic lights to make better decisions about what foods to eat. An example of these strategies is to use the associations between foods to facilitate and speed up their decision making. (5) Emotional scenes of children were used (eg, when they consume an unhealthy meal, gain weight and can suffer from teasing and bullying). (6) A scoring system and ranking board assessed players’ gaming performances.

    ‎
    Figure 1. FoodRateMaster scenario map.
    View this figure
    ‎
    Figure 2. FoodRateMaster game scenario.
    View this figure
    ‎
    Figure 3. FoodRateMaster level results screen.
    View this figure
    ‎
    Figure 4. Story of FoodRateMaster game.
    View this figure
    ‎
    Figure 5. FoodRateMaster explanation of unhealthy food.
    View this figure

    Participant Recruitment

    Children aged to 10 years (n=62) at a primary school (grades 3, 4, and 5) in Mexico were invited to participate in the pilot study. We conducted a presentation of FoodRateMaster to the children to explain its purpose, characteristics, elements, and how to play it. We obtained written consent from the parents of the children who were interested in participating. Participation was voluntary, and no additional efforts for recruitment were made. The institutional review board of the Centro de Investigacion Cientifica y de Educacion Superior de Ensenada (Ensenada Center for Scientific Research and Higher Education) approved this study.

    Measures

    We used the following 3 questionnaires to collect data: a food knowledge questionnaire [53], the EGameFlow questionnaire [54], and the Game User Experience Satisfaction Scale (GUESS) questionnaire [24].

    The food knowledge questionnaire [53] was developed by a multidisciplinary team based on 90 frequently consumed foods in Mexico (49 healthy and 41 unhealthy). A 3-point response format is used to evaluate each food—healthy (maintain or increase intake), unhealthy (reduce intake), or I do not know. The score is the total number of questions answered correctly, with a maximum score of 90.

    The EGameFlow questionnaire [54] is a valid and reliable tool for evaluating the level of enjoyment provided by electronic learning games to their user. This scale includes 42 items in 8 subscales [27,54]: concentration—games should require concentration, and players should be able to concentrate on the game; goal clarity—games should provide players with clear goals at appropriate times; feedback—players must receive appropriate feedback about their actions and their progress toward their goals at appropriate times; challenge—games should be sufficiently challenging and match players’ skill level; autonomy—players should feel a sense of control over their actions in the game; immersion—players should experience deep but effortless involvement in the game; social interaction—games should support and create opportunities for social interaction; knowledge improvement—games support and motivate players to acquire, integrate, and apply the knowledge that is taught. The GUESS questionnaire [24] is a valid and reliable tool for evaluating user satisfaction of different video game types by a variety of users with 55 items in 9 subscales: usability (or playability)—games can be played easily with clear goals or objectives in mind and with minimum interference from the interfaces and controls; narratives—the story aspect of the game and its ability to capture players’ interest and shape players’ emotions; play engrossment—games should hold players’ attention and interest; enjoyment—the pleasure of players that results from playing the game; creative freedom—games should foster players’ creativity and curiosity; audio esthetics—the auditory aspects of the game (eg, sound effects) and how much they enrich the gaming experience; personal gratification—players’ sense of accomplishment and the desire to succeed and continue playing the game; social connectivity—games should facilitate social connections between players; visual esthetics—the graphics of the game and how attractive they appear to players. The EGameFlow scale is one of the most widely used questionnaires to evaluate the enjoyment of serious games [55].

    We used all subscales for both scales except EGameFlow social interaction and GUESS social connectivity because FoodRateMaster does not include social features. According to Phan et al [24] GUESS subscales that are not applicable (ie, features not included in the video game being evaluated) can be omitted. In both questionnaires, a 5-point Likert-type response format ranging from strongly disagree to strongly agree was used to measure each item. We used only 5 points because having additional points on the response scale provides little additional utility [56] and can influence the item values and the psychological distance [57]. In addition, children can discriminate among 5 response options and do not tend toward the neutral point [58].

    Data Collection

    In the pretest phase, the participants were assigned unique identifiers and completed the food knowledge questionnaire. During the next 45 days, the children conducted 12 game sessions of at least 15 minutes each with FoodRateMaster (playing time: mean 3.5 hours, SD 0.8). In the posttest phase (the day after the last game session), children completed the food knowledge questionnaire (again), the EGameFlow questionnaire [54], and the GUESS questionnaire [24]. The children took approximately 15 minutes to complete each questionnaire. Initially, we conducted a pilot test of these questionnaires and identified that children did not have any problem when answering them.

    Data Analysis

    Data analysis was carried out using the SPSS statistical software (version 26; IBM Corp). In all analyzes, the statistical significance was 5% (P<.05). A paired two-tailed t test was conducted to examine the difference between pretest and posttest knowledge scores. Pearson correlation was conducted to examine the relationships of enjoyment and user experience satisfaction, including their subscales, with posttest knowledge scores. We also performed standard multiple regression on EGameFlow and the GUESS scores to identify if their subscales could predict the results of the posttest children’s knowledge and to examine their correlations. Separate multiple linear regressions were calculated to predict the posttest children’s knowledge based on (1) EGameFlow and (2) GUESS subscales. Preliminary analyses were performed to ensure that the assumptions of linear regression analysis were not violated (the criteria are included in parentheses) [59,60]: linearity, normality, nonzero variance (variance >0), no data outliners (standardized residual values for each participant from −3.29 to 3.29), collinearity (for all variables, variance inflation factor is <10 or tolerance >0.1), and independent errors (Durbin-Watson values from 1.5 to 2.5).


    Data from 2 children were excluded from the analysis (ie, these 2 students did not complete all the questionnaires); thus, the study completion rate was 97% (60/62): 29 girls and 31 boys (age: mean 9, SD 0.8 years).

    The mean pretest and posttest knowledge scores were 56.95 (SD 10.71, range 30-75) and 67.88 (SD 10.71, range 30-85), respectively. In addition, the mean enjoyment and user experience satisfaction scores were 4.16 (SD 0.55, range 2.28-5.00) and 4.29 (SD 0.54, range 2.79-5.00), respectively. Knowledge scores were significantly lower in the pretest than in the posttest (mean difference −11.12, SD 8.27; t59=−10.41, P<.001). Thus, children increased their nutritional knowledge after game play.

    We found associations (Table 1) between posttest knowledge scores and enjoyment (EGameFlow scale: r58=0.36, P=.005), as well as between posttest knowledge scores and user experience satisfaction (GUESS scale: r58=0.34, P=.008). Additionally, we found associations between posttest knowledge and the following EGameFlow subscales: challenge (r58=0.38, P=.003), knowledge improvement (r58=0.38, P=.003), and goal clarity (r58=0.29, P=.02). Also, associations were found between posttest knowledge and the following GUESS subscales: narrative (r58=0.35, P=.006), creative freedom (r58=0.26, P=.04), and visual esthetics (r58=0.32, P=.01).

    Both models fulfilled all the assumptions of linear regression analysis. The regression results indicated that the model based on the EGameFlow scale explained 27% of the variance (large effect [61]) and that the model was a significant predictor of children’s learning (F7,52=2.74, P=.02). Table 2 describes the contribution of each subscale to the total explained variance; only 2 subscales had significant contributions, namely, challenge (β=0.40, t52=2.17, P=.04) and knowledge improvement (β=.29, t52=2.06, P=.04). Meanwhile, the regression results indicated that the model based on the GUESS scale explained 26% of the variance (large effect) and that the model was a significant predictor of children’s learning (F8,51=2.20, P=.04). However, as shown in Table 2, none of the subscales had a significant contribution.

    Table 1. Bilateral correlations of children’s posttest knowledge with EGameFlow and Guess scales and subscales.
    EGameFlow and GUESS subscalesPosttest knowledge score

    		rP value (bilateral)
    EGameFlow (Enjoymenta)0.36.005b

    		Concentration0.09.49

    		Goal clarity0.29.02b

    		Feedback0.17.19

    		Challenge0.38.003b

    		Autonomy0.01.93

    		Immersion0.06.65

    		Knowledge improvement0.38.003b
    GUESS (User experience satisfactionc)0.27.04b

    		Usability/playability0.21.11

    		Narratives0.35.006b

    		Play engrossment−0.15.25

    		Enjoyment0.09.47

    		Creative freedom0.26.04b

    		Audio esthetics0.09.45

    		Personal gratification0.15.24

    		Visual esthetics0.32.01b

    aEnjoyment as a whole (mean of subscale scores).

    bP<.05.

    cUser experience satisfaction as a whole (mean of subscale scores).

    Table 2. Model coefficients for EGameFlow and GUESS subscale ratings with posttest knowledge as the dependent variable.
    EGameFlow and GUESS subscalesβt valueaP value
    EGameFlow scale—Enjoyment



    		Concentration0.030.24.81

    		Goal clarity0.140.89.38

    		Feedback0.13−0.72.48

    		Challenge0.402.17.04b

    		Autonomy0.08−0.58.56

    		Immersion0.19−1.30.20

    		Knowledge improvement0.292.06.04b
    GUESS scale—User experience satisfaction



    		Usability/playability0.301.41.16

    		Narratives0.261.69.10

    		Play engrossment−0.23−1.79.08

    		Enjoyment0.020.12.91

    		Creative Freedom0.221.42.16

    		Audio esthetics−0.34−1.93.06

    		Personal gratification−0.21−0.99.32

    		Visual esthetics0.221.19.24

    aModel df=52 for EGameFlow and df=51 for GUESS.

    bP<.05.


    Principal Results

    This study investigated the relationships of enjoyment and user experience satisfaction with children’s learning while playing a serious video game. As far as we know, this is the first paper analyzing these relationships in children aged 8 to 10 years. Overall, the study’s findings suggest that serious games can provide enjoyment and satisfactory user experiences to children, as demonstrated by the levels of enjoyment and user experience satisfaction. The results specifically showed significant associations for children’s enjoyment and user experience satisfaction with their learning when playing serious video games. In addition, the ratings given by children on subscales of the questionnaires used to assess enjoyment and user experience satisfaction were significant predictors of their learning. Challenge and knowledge improvement (EGameFlow) were correlated with children’s learning and contributed to predicting it. Meanwhile, narrative, creative freedom, and visual esthetics (GUESS) were correlated with children’s learning; however, did not contribute toward predicting learning.

    Comparison With Prior Work

    Associating the findings with the results of previous research is a difficult task, given that our study examined the influence of enjoyment and user experience on the learning of young children (aged between 8 to 10 years old), in contrast to the existing studies that involved adolescents or young adults [45-47]. Even so, the findings that enjoyment and user experience were associated with learning and can help to predict player learning provide further support to findings in previous studies [45-47,49,50]. In addition, this is the first study (as far as we know) that analyzed the relationship of these factors in the context of a serious game for health.

    Enjoyment and Game-based Learning

    Hypotheses 1 and 2, which emerged from the expectation that enjoyment positively correlates to children’s learning and can predict it, were confirmed (hypothesis 1: r58=0.36, P=.005; hypothesis 2: F7,52=2.74, P=.02). These results are in line with previous findings that enjoyment had a significant relationship with learning performance [45-47,49] and that enjoyment can predict learning [50], and in addition, that this factor significantly contributed to the effectiveness of serious games [4,17].

    Using the EGameFlow scale, challenge and knowledge improvement were found to correlate with and contribute to predicting children’s learning. Regarding challenge, this finding was anticipated since the relationship between challenge and skill determines players’ engagement level during gameplay [62]. Thus, the optimal amount of difficulty should match user’s abilities to the skills required to accomplish each goal [27]. This result supports the findings of several studies that have indicated that challenge is a critical factor in the success of serious games [20,29,34,43] and related to players’ learning [46,50]. Regarding knowledge improvement, serious games should incorporate strategies to provide knowledge that players need to learn and integrate to fulfill the goals of the game [54]. Our results supports those of Ebrahimzadeth and Alavi [50], who identified that knowledge improvement is positively correlated with players’ learning. In addition, goal clarity correlated with children’s learning. This results add support to the findings of studies [43,47] that stated that goal clarity enhances the engagement levels of players and influences learning effectiveness. However, this result contrasts with the findings of other studies [46,47,50] that identified that goal clarity does not influence the players’ learning.

    Concentration (P=.49), feedback (P=.19), autonomy (P=.93), and immersion (P=.65) were not correlated with children’s learning, nor did they predicting it. These results may be related to how children perceive the feedback of serious games, their need for autonomy and cognition, and their sensation seeking [43]. This result gives further support to those of previous studies [46,47,50], noting that concentration, feedback and immersion do not influence players’ learning. However, this result contrasts with findings in other studies stating that concentration is essential for learning in serious games [18,27], that feedback influences the learning of players [18,20,36,43,44], and that autonomy is an important factor in the effectiveness of serious games [20,29,43] and is correlated with players’ learning [50]. Finally, the actual impact of immersion on learning outcomes seems more complicated in the use of video games for educational purposes [63]. While some studies [31,50,64] have noted that immersion is an important factor in the effectiveness of serious games [31] and is related to players’ learning [50,64], other studies [63,65] have identified that immersion can limit players’ learning because players can ignore the educational targets of video games due to the increased cognitive load.

    User Experience Satisfaction and Game-based Learning

    Hypotheses 3 and 4, emerging from the expectation that user experience satisfaction positively correlates to and can predict children’s learning were confirmed by the data analysis (hypothesis 3: r58=0.27, P=.04; hypothesis 4: F8,51=2.20, P=.04). Comparing these findings with those of previous research is difficult due to most existing studies focusing on using the GUESS scale to evaluate serious games (eg, [66,67]) and (as far we know) no previous studies have addressed the relationship between the GUESS scale and subscales with players’ learning.

    Using GUESS, narrative, creative freedom, and visual esthetics correlated with children’s learning, but none contributed toward predicting children’s learning. Narration facilitates situated cognition by immersing players in a setting that frames knowledge [68]. Our results support those of studies that noted the impact of a narrative on learning [17,21,29,43,44,69] and that identified that a narrative is positively correlated with players’ learning [47,50]. Regarding creative freedom, playing is a creative process by itself that can foster new and novel associations between ideas, objects, and behaviors [70]. In this way, serious games provide a safe environment for active, critical, and creative learning, allowing users to explore skills, methods, and concepts [71]. Previous studies [72,73] have reported the usefulness of serious games for ideation; however, no previous studies have analyzed the correlation between creative freedom and players’ learning, as far as we know. In addition, our results give further support to those of previous studies noting the influence of visual esthetics on the acceptability of serious games and the learning of players [17,20,29,33,42,44] and reporting a statistical association of the esthetic presentation of the game upon the learning outcome [74].

    In this study, usability (or playability) (P=.11), play engrossment (P=.25), enjoyment (P=.47), audio esthetics (P=.45), and personal gratification (P=.24) did not reach a statically significant correlation with children’s learning, nor did they contribute to predicting it. Our results support the results of Fokides et al [47], who found that there was no significant relationship between usability (or playability) and the learning of players and that it only influenced players’ enjoyment. However, our results are in contrast to the findings of Tolentino et al [35], who stated that serious video games should have a high level of usability. Player engrossment is similar to the immersion subscale of the EGameFlow scale, which was not associated with learning. The absence of correlation between the enjoyment subscale of the GUESS scale and children’s learning is surprising because there was a correlation between the score of the EGameFlow scale and children’s learning. We consider that this result is due to the enjoyment subscale of the GUESS scale and does not include all the factors that influence enjoyment considered in the EGameFlow scale. Finally, although previous research also noted the importance of audio esthetics [20,29,75] and personal gratification [29] to generate motivation and immersion in serious games, no previous studies have analyzed the correlation between these subscales and the learning of players, as far as we know.

    Limitations and Future Work

    This study faced some limitations. First, the self-report measure of enjoyment and user experience satisfaction can be highly sensitive to the respondent’s comprehension and willingness to provide honest answers. Second, the results should be interpreted with caution since a small sample of children participated in the study. The sample size could have been larger, allowing for more confidence in the robustness of the statistical analysis and results. However, given that our main objective was to explore the relationship of children’s learning with enjoyment and user experience satisfaction, we believe that our results provide a good starting point for researchers to explore the design of serious video games for children. Third, due to space and time constraints, children who were not from the same class attended at the same time to play on the play stations. This situation might have affected the participant behaviors (ie, higher or lower performance in the game). Fourth, some students were more familiar with video games, which might have affected their performance. Fifth, the frequency and duration of the sessions were predefined. In real environments, it is common for game sessions to be longer and more frequent, which could accelerate the rate at which players become bored with the video game and can even generate video gaming burnout [76], consequently affecting learning, enjoyment, and user’ satisfaction. Sixth, the students also had a limited age range, limiting the generalizability of the findings. Finally, the children played only one serious game. To overcome these issues, we suggest similar studies be carried out with students of different age groups and levels of experience with video games, using several different serious video games, and where players can carry out their sessions at their own pace.

    For future work, we plan to carry out a comprehensive study with users in a broad age range to provide generalizable results. In addition, based on the insight that the influence of enjoyment and user experience satisfaction could depend on the age of players, in a future study, we also plan to perform age-based analysis to assess the importance of age and determine its association with the relationship of enjoyment and user experience satisfaction with learning, as well as whether there is variability between different subscales among users of different ages.

    Conclusions

    In summary, the reported findings from this study can be useful to better understand the correlation and influence of enjoyment and user experience on children’s learning when playing serious games. These findings should be considered in the design stages during the development of serious video games for children and suggest that, because children’s enjoyment and user experience satisfaction are significantly associated with their learning, and enjoyment and user experience satisfaction are significant predictors of children’s learning while playing a serious video game, when serious video games are designed for children, it is essential to implement elements that foster enjoyment and user experience satisfaction. In particular, video games should be sufficiently challenging, match children's skills, and include elements supporting and motivating players to acquire and apply the learned knowledge. Clear goals, narrative, creative freedom, and visual esthetics are positively correlated with children’s learning; therefore, designers of serious video games for children should dedicate efforts to providing clear goals and producing elements that capture players’ interest, shape players’ emotions, and foster their creativity and curiosity, as well as include attractive graphical elements in the game.

    Acknowledgments

    We thank the Consejo Nacional de Ciencia y Tecnología (CONACYT, Mexico) for financial support (grant number PDCPN-2015-824). We thank the Colegio Inglés de Occidente for facilitating the conduct of this study and all of the teachers, students, and parents who participated.

    Authors' Contributions

    IEE-C designed the study, conducted data collection and processing, wrote the first draft, incorporated changes from all coauthors, and completed the data analyses. EEP-B developed FoodRateMaster and contributed to data collection. JM-M and HP-E assisted with the analysis and interpretation of the data and contributed to editing the manuscript.

    Conflicts of Interest

    None declared.

    1. Girard C, Ecalle J, Magnan A. Serious games as new educational tools: how effective are they? A meta-analysis of recent studies. Journal of Computer Assisted Learning 2013 Jun 13;29(3):207-219. [CrossRef]
    2. Thompson D, Baranowski T, Buday R, Baranowski J, Thompson V, Jago R, et al. Serious Video Games for Health How Behavioral Science Guided the Development of a Serious Video Game. Simul Gaming 2010 Aug 01;41(4):587-606. [CrossRef] [Medline]
    3. Laamarti F, Eid M, El Saddik A. An Overview of Serious Games. International Journal of Computer Games Technology 2014;2014:1-15. [CrossRef]
    4. Connolly TM, Boyle EA, MacArthur E, Hainey T, Boyle JM. A systematic literature review of empirical evidence on computer games and serious games. Computers & Education 2012 Sep;59(2):661-686. [CrossRef]
    5. Wouters P, van Nimwegen C, van Oostendorp H, van der Spek ED. A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology 2013;105(2):249-265. [CrossRef]
    6. Boyle EA, Hainey T, Connolly TM, Gray G, Earp J, Ott M, et al. An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games. Computers & Education 2016 Mar;94:178-192. [CrossRef]
    7. Zhonggen Y. A Meta-Analysis of Use of Serious Games in Education over a Decade. International Journal of Computer Games Technology 2019 Feb 03;2019:1-8. [CrossRef]
    8. Yanti PP, Rosmansyah Y, Dabarsyah B. Serious Games for Children: A Systematic Literature Review. In: International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS).: IEEE; 2019 Presented at: 2019 International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS); 24-25 Oct. 2019; Jakarta, Indonesia, Indonesia p. 79-84. [CrossRef]
    9. Parisod H, Pakarinen A, Kauhanen L, Aromaa M, Leppänen V, Liukkonen TN, et al. Promoting Children's Health with Digital Games: A Review of Reviews. Games Health J 2014 Jun;3(3):145-156. [CrossRef] [Medline]
    10. Holtz BE, Murray K, Park T. Serious Games for Children with Chronic Diseases: A Systematic Review. Games Health J 2018 Oct;7(5):291-301. [CrossRef] [Medline]
    11. Hainey T, Connolly TM, Boyle EA, Wilson A, Razak A. A systematic literature review of games-based learning empirical evidence in primary education. Computers & Education 2016 Nov;102:202-223. [CrossRef]
    12. Chow CY, Riantiningtyas RR, Kanstrup MB, Papavasileiou M, Liem GD, Olsen A. Can games change children’s eating behaviour? A review of gamification and serious games. Food Quality and Preference 2020 Mar;80:103823. [CrossRef]
    13. Baranowski T, Blumberg F, Buday R, DeSmet A, Fiellin LE, Green CS, et al. Games for Health for Children-Current Status and Needed Research. Games Health J 2016 Feb;5(1):1-12 [FREE Full text] [CrossRef] [Medline]
    14. Meluso A, Zheng M, Spires HA, Lester J. Enhancing 5th graders’ science content knowledge and self-efficacy through game-based learning. Computers & Education 2012 Sep;59(2):497-504. [CrossRef]
    15. Lu AS, Kharrazi H, Gharghabi F, Thompson D. A Systematic Review of Health Videogames on Childhood Obesity Prevention and Intervention. Games Health J 2013 Jun;2(3):131-141 [FREE Full text] [CrossRef] [Medline]
    16. Lu AS, Kharrazi H. A State-of-the-Art Systematic Content Analysis of Games for Health. Games Health J 2018 Feb;7(1):1-15. [CrossRef] [Medline]
    17. Shen C, Wang H, Ritterfeld U. Chapter 4. Serious Games and Seriously Fun Games: Can They Be One and the Same? In: Ritterfeld U, Cody M, Vorderer P, editors. Serious Games Mechanisms and Effects. New York, NY: Taylor & Francis; 2009:1-15.
    18. Drummond D, Hadchouel A, Tesnière A. Serious games for health: three steps forwards. Adv Simul (Lond) 2017 Feb 04;2:3 [FREE Full text] [CrossRef] [Medline]
    19. M.Nazry N, Romano DM. Mood and learning in navigation-based serious games. Computers in Human Behavior 2017 Aug;73:596-604. [CrossRef]
    20. Wilson KA, Bedwell WL, Lazzara EH, Salas E, Burke CS, Estock JL, et al. Relationships Between Game Attributes and Learning Outcomes: Review and Research Proposals. Simulation & Gaming 2008 May 07;40(2):217-266. [CrossRef]
    21. Crutzen R, van 't Riet J, Short CE. Enjoyment: A Conceptual Exploration and Overview of Experimental Evidence in the Context of Games for Health. Games Health J 2016 Feb;5(1):15-20. [CrossRef] [Medline]
    22. Schaffer O, Fang X. Digital Game Enjoyment: A Literature Review. In: HCI in Games.: Springer International Publishing; 2019 Presented at: First International Conference, HCI-Games 2019; July 26-31, 2019; Orlando, FL, USA p. 191-214. [CrossRef]
    23. González Sánchez JL, Gutiérrez Vela FL, Montero Simarro F, Padilla-Zea N. Playability: analysing user experience in video games. Behaviour & Information Technology 2012 Oct;31(10):1033-1054. [CrossRef]
    24. Phan MH, Keebler JR, Chaparro BS. The Development and Validation of the Game User Experience Satisfaction Scale (GUESS). Hum Factors 2016 Dec;58(8):1217-1247. [CrossRef] [Medline]
    25. Wiemeyer J, Nacke L, Moser C, Mueller F. Player Experience. In: Dörner R, Göbel S, Effelsberg W, Wiemeyer J, editors. Serious Games: Foundations, Concepts and Practice. Switzerland: Springer; Aug 2016:243-271.
    26. Moizer J, Lean J, Dell’Aquila E, Walsh P, Keary A, O'Byrne D, et al. An approach to evaluating the user experience of serious games. Computers & Education 2019 Jul;136:141-151. [CrossRef]
    27. Sweetser P, Wyeth P. GameFlow: a model for evaluating player enjoyment in games. Computers in Entertainment 2005 Jul 01;3(3):1-24. [CrossRef]
    28. Wang Y, Rajan P, Sankar CS, Raju PK. Let Them Play: The Impact of Mechanics and Dynamics of a Serious Game on Student Perceptions of Learning Engagement. IEEE Transactions on Learning Technologies 2017 Oct 1;10(4):514-525. [CrossRef]
    29. Yen-Ru S, Ju-Ling S. Game Factors and Game-Based Learning Design Model. International Journal of Computer Games Technology 2015;2015:1-11. [CrossRef]
    30. Baranowski T, Buday R, Thompson D, Lyons EJ, Lu AS, Baranowski J. Developing Games for Health Behavior Change: Getting Started. Games Health J 2013 Aug;2(4):183-190 [FREE Full text] [CrossRef] [Medline]
    31. Annetta LA. The “I's” have it: A framework for serious educational game design. Review of General Psychology 2010;14(2):105-113. [CrossRef]
    32. Wrzesien M, Alcañiz Raya M. Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project. Computers & Education 2010 Aug;55(1):178-187. [CrossRef]
    33. Wilson AS, Broadbent C, McGrath B, Prescott J. Chapter 23. Factors Associated with Player SatisfactionEducational Value of Serious Games. In: Ma M, Oikonomou A, editors. Serious Games and Edutainment Applications Volume II. Switzerland: Springer International Publishing; 2017:513-535.
    34. Nagle A, Novak D, Wolf P, Riener R. The effect of different difficulty adaptation strategies on enjoyment and performance in a serious game for memory training. In: IEEE International Conference on Serious Games and Applications for Health (SeGAH). 2014 Presented at: 2014 IEEE 3nd International Conference on Serious Games and Applications for Health (SeGAH); 2014; Rio de Janeiro, Brazil p. 1-8. [CrossRef]
    35. Pino Tolentino G, Battaglini C, Ventura Pereira AC, Jacó de Oliveria R, Mendes de Paula MG. Usability of Serious Games for Health. In: Conference on Games and Virtual Worlds for Serious Applications, VS-GAMES.: IEEE; 2011 Presented at: 2011 Third International Conference on Games and Virtual Worlds for Serious Applications; 4-6 May 2011; Athens, Greece p. 172-175. [CrossRef]
    36. Ifenthaler D, Eseryel D, Ge X. Assessment for Game-Based Learning. In: Ifenthaler D, Eseryel D, Ge X, editors. Assessment in Game-Based Learning: Foundations, Innovations, and Perspectives. New York, NY: Springer; 2012:1-8.
    37. Schneider KL, Ferrara J, Lance B, Karetas A, Druker S, Panza E, et al. Acceptability of an Online Health Videogame to Improve Diet and Physical Activity in Elementary School Students:. Games Health J 2012 Aug;1(4):262-268 [FREE Full text] [CrossRef] [Medline]
    38. Eckardt L, Robra-Bissantz S. EGameFlow in a Serious Game: Gaming Experience with the Same Game Design but Different Learning Content. In: Gaming Experience in a Serious Game with Different Learning Content. EGameFlow in a Serious Game: Gaming Experience with the Same Game Design but Different Learning Content. Twenty-Third Pac Asia Conf Inf Syst Xi'an, China; 2019 Presented at: Pacific Asia Conference on Information Systems (PACIS 2019); 8-12 July, 2019; Xi’an, China p. 1-8.
    39. Buday R, Baranowski T, Thompson D. Fun and Games and Boredom. Games Health J 2012 Aug;1(4):257-261 [FREE Full text] [CrossRef] [Medline]
    40. Kelley C, Wilcox L, Ng W, Schiffer J, Hammer J. Design Features in Games for Health: Disciplinary and Interdisciplinary Expert Perspectives. DIS (Des Interact Syst Conf) 2017 Jun;2017:69-81 [FREE Full text] [CrossRef] [Medline]
    41. Rieber LP, Noah D. Games, simulations, and visual metaphors in education: antagonism between enjoyment and learning. Educational Media International 2008 Jun;45(2):77-92. [CrossRef]
    42. Huang WD, Johnson TE, Han SC. Impact of online instructional game features on college students’ perceived motivational support and cognitive investment: A structural equation modeling study. The Internet and Higher Education 2013 Apr;17:58-68. [CrossRef]
    43. Alexiou A, Schippers MC. Digital game elements, user experience and learning: A conceptual framework. Education and Information Technologies 2018 May 17;23:2545-2567. [CrossRef]
    44. Ravyse WS, Seugnet Blignaut A, Leendertz V, Woolner A. Success factors for serious games to enhance learning: a systematic review. Virtual Reality 2016 Sep 20;21:31-58. [CrossRef]
    45. Giannakos MN. Enjoy and learn with educational games: Examining factors affecting learning performance. Computers & Education 2013 Oct;68:429-439. [CrossRef]
    46. Hamari J, Shernoff DJ, Rowe E, Coller B, Asbell-Clarke J, Edwards T. Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning. Computers in Human Behavior 2016 Jan;54:170-179. [CrossRef]
    47. Fokides E, Atsikpasi P, Kaimara P, Deliyannis I. Factors Influencing the Subjective Learning Effectiveness of Serious Games. Journal of Information Technology Education: Research 2019;18:437-466. [CrossRef]
    48. Iten N, Petko D. Learning with serious games: Is fun playing the game a predictor of learning success? British Journal of Educational Technology 2016 Jan;47(1):151-163. [CrossRef]
    49. Imlig-Iten N, Petko D. Comparing Serious Games and Educational Simulations: Effects on Enjoyment, Deep Thinking, Interest and Cognitive Learning Gains. Simulation & Gaming 2018 Aug 01;49(4):401-422. [CrossRef]
    50. Ebrahimzadeh M, Alavi S. Motivating EFL students: E-learning enjoyment as a predictor of vocabulary learning through digital video games. Cogent Education 2016 Nov 14;3(1255400):1-14. [CrossRef]
    51. Gilmore K, Meersand P. Chapter 6.The Latency Phase. In: Normal Child And Adolescent Development: A Psychodynamic Primer. Washington, DC: American Psychiatric Publishing; 2014:364.
    52. Colarusso CA. Child and Adult Development: A Psychoanalytic Introduction for Clinicians. New York: Springer Science & Business Media; 1992:220.
    53. Espinosa-Curiel IE, Pozas-Bogarin EE, Lozano-Salas JL, Martínez-Miranda J, Delgado-Pérez EE, Estrada-Zamarron LS. Nutritional Education and Promotion of Healthy Eating Behaviors Among Mexican Children Through Video Games: Design and Pilot Test of FoodRateMaster. JMIR Serious Games 2020 Apr 13;8(2):e16431 [FREE Full text] [CrossRef] [Medline]
    54. Fong-Ling F, Rong-Chang S, Sheng-Chin Y. EGameFlow: A scale to measure learners’ enjoyment of e-learning games. Computers & Education 2009 Jan;52(1):101-112. [CrossRef]
    55. Petri G, Wangenheim CGV. How to Evaluate Educational Games: a Systematic Literature Review. Journal of Universal Computer Science 2016;22(7):992-1021. [CrossRef]
    56. Lissitz RW, Green SB. Effect of the number of scale points on reliability: A Monte Carlo approach. Journal of Applied Psychology 1975 Feb;60(1):10-13. [CrossRef]
    57. Wakita T, Ueshima N, Noguchi H. Psychological Distance Between Categories in the Likert Scale: Comparing Different Numbers of Options. Educational and Psychological Measurement 2012 Jan 12;72(4):533-546. [CrossRef]
    58. Adelson JL, McCoach DB. Measuring the Mathematical Attitudes of Elementary Students: The Effects of a 4-Point or 5-Point Likert-Type Scale. Educational and Psychological Measurement 2010 Apr 13;70(5):796-807. [CrossRef]
    59. Verma J, Abdel-Salam G. Testing Statistical Assumptions in Research. Hoboken, NJ: John Wiley & Sons; Mar 2019:978.
    60. Weinberg SL, Abramowitz SK. Statistics using SPSS: An integrative approach, third edition. New York, NY: Cambridge University Press; 2015:595.
    61. Cohen J. A power primer. Psychological Bulletin 1992;112(1):155-159. [CrossRef]
    62. Csikszentmihalyi M. Beyond Boredom and Anxiety: Experiencing Flow in Work and Play. San Francisco, California: Jossey-Bass; 2000:272.
    63. Cheng M, She HC, Annetta L. Game immersion experience: its hierarchical structure and impact on game-based science learning. Journal of Computer Assisted Learning 2015 Jun;31(3):232-253. [CrossRef]
    64. Georgiou Y, Kyza EA. Relations between student motivation, immersion and learning outcomes in location-based augmented reality settings. Computers in Human Behavior 2018 Dec;89:173-181. [CrossRef]
    65. Cheng MT, Su T, Huang WY, Chen JH. An educational game for learning human immunology: What do students learn and how do they perceive? British Journal of Educational Technology 2014 Sep;45(5):820-833. [CrossRef]
    66. Smith PA, Dombrowski M, Buyssens R, Barclay P. Usability testing games for prosthetic training. In: IEEE International Conference on Serious Games and Applications for Health (SeGAH).: IEEE; 2018 Presented at: 018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH); 16-18 May 2018; Vienna, Austria p. 1-7. [CrossRef]
    67. Espinosa-Curiel IE, Martínez-Rosas MJ, del Hoyo-Ceja JM, Delgado-Pérez EE, Pozas-Bogarin EE. HealthyLunch: A Serious Game for Educating and Promoting the Intake of the Recommended Number of Daily Servings Among Children. In: Games and Learning Alliance. Cham: Springer; 2019 Presented at: International Conference on Games and Learning Alliance 2019 (GALA 2019); November 27–29; Athens, Greece p. A-361. [CrossRef]
    68. Van Eck R. Digital Game-Based Learning: It's Not Just the Digital Natives Who Are Restless. Educause Review 2006;41(2):16-30.
    69. Calderón A, Ruiz M. A systematic literature review on serious games evaluation: An application to software project management. Computers & Education 2015 Sep;87:396-422. [CrossRef]
    70. Bowman N, Kowert R, Ferguson C. Chapter 2 - The Impact of Video Game Play on Human (and Orc) Creativity. In: Green GP, Kaufman JC, editors. Video Games and Creativity. London, UK: Academic Press; 2015:39-60.
    71. Protopsaltis A, Pannese L, Hetzner S, Pappa D, De Freitas S. Creative Learning with Serious Games. International Journal of Emerging Technologies in Learning 2010 Dec;5:4-6. [CrossRef]
    72. Agogué M, Levillain K, Hooge S. Gamification of Creativity: Exploring the Usefulness of Serious Games for Ideation. Creativity and Innovation Management 2015 Sep;24(3):415-429. [CrossRef]
    73. Hauge JB, Duin H, Thoben KD. The Evaluation of Serious Games Supporting Creativity through Student Labs. In: Serious Games Development and Applications. Berlin, Heidelberg: Springer; 2013 Presented at: 4th International Conference, SGDA 2013; September 25-27, 2013; Trondheim, Norway p. 188-199. [CrossRef]
    74. Martin MW, Shen Y. The Effects of Game Design on Learning Outcomes. Computers in the Schools 2014 Apr 18;31(1-2):23-42. [CrossRef]
    75. Jabbar AIA, Felicia P. Gameplay Engagement and Learning in Game-Based Learning. Review of Educational Research 2015 Dec 1;85(4):740-779. [CrossRef]
    76. Badrinarayanan VA, Sierra JJ, Taute HA. Determinants and Outcomes of Online Brand Tribalism: Exploring Communities of Massively Multiplayer Online Role Playing Games (MMORPGs). Psychology and Marketing 2014 Oct;31(10):853-870. [CrossRef]

    ‎
    GUESS: Game User Experience Satisfaction Scale
    STEM: science, technology, engineering, math

    Edited by G Eysenbach; submitted 25.06.20; peer-reviewed by S Dick, K Murray, D Drummond; comments to author 11.07.20; revised version received 21.08.20; accepted 01.09.20; published 17.09.20

    Copyright

    ©Ismael Edrein Espinosa-Curiel, Edgar Efrén Pozas-Bogarin, Juan Martínez-Miranda, Humberto Pérez-Espinosa. Originally published in JMIR Serious Games (http://games.jmir.org), 17.09.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on http://games.jmir.org, as well as this copyright and license information must be included.