Original Paper
Abstract
Background: The COVID-19 pandemic has had a severe impact on students’ mental health. Interventions are needed to promote their psychological well-being and prevent mental illnesses in the aftermath of this unprecedented situation. Digital escape games can be an effective tool to support students’ mental health. A cocreation approach can improve the acceptability of these interventions by involving different stakeholders (eg, end users, game designers, and health professionals) to obtain audience-specific games.
Objective: This study aims to describe the process of testing and optimizing the game “EscapeCovid” on students’ mental health, to serve as a model for the cocreation of future similar interventions.
Methods: The PRODUCES (Problem, Objective, Design, End Users, Cocreators, Evaluation, Scalability) framework was used. Cocreation steps (test and optimization) were detailed for replicability. A total of 45 students tested a pilot version of the game, with 10 undergoing a semistructured interview. Meetings with a group of stakeholders and brainwriting were organized to optimize the game.
Results: We produced a new version of the game incorporating the suggestions provided by student testers and following the stakeholders’ guidelines. Improvements were made to both the content and the form of the new version of the pilot game. The storyline, including the protagonist and the scenes, was adapted to the student population.
Conclusions: Our results suggested that cocreation can contribute to the design of more widely accepted interventions aimed at promoting mental health and preventing psychological disorders. Results also suggest that an end user–centered approach can facilitate intervention tailoring. When conceiving a health-related escape game for students, we recommend using the cocreation approach to enhance players’ experience, thus positively influencing their learning process and overall well-being.
doi:10.2196/48545
Keywords
Introduction
University Students’ Mental Health and the COVID-19 Pandemic
University students are often likely to experience serious mental health problems during their studies because they are exposed to several stressors including academic pressure, taking on more adult-like responsibilities, or having limited financial resources [
].The COVID-19 pandemic has exacerbated students’ mental health, as demonstrated by a skyrocketing incidence of mental health disorders during the repeated lockdowns between 2020 and 2021 [
, ]. Shifting to online courses, uncertainty about academic and professional future, and a dramatic reduction of social interactions have largely contributed to compromising the mental health of the student population [ ]. Restrictive measures, in particular, were associated with high levels of depression, anxiety, and stress in students [ - ]. In 2020, nearly one-fifth of students experienced suicidal ideation as a result of COVID-19 [ ]. The prevalence of these mental health problems was more than 50% higher among students than in the general population [ ]. Students’ mental distress due to the COVID-19 pandemic persisted in the aftermath of the peak of the pandemic [ ].Against this background, there has been a high demand for mental health prevention programs addressed to students during and after the lockdowns [
]. Several studies have described the development and application of interventions aimed at supporting students during the health crisis. In particular, digital psychological interventions have produced positive effects on students by promoting resilience and well-being [ ]. During the lockdowns, when face-to-face contact was limited, digital interventions had the advantage of reaching a larger audience with no time or space limit. Examples of interventions were video clips, online booklets, mobile applications, virtual doctor appointments, etc. University students, in particular, actively sought this type of online help and interventions, probably because they are digital natives [ ].Gamification in Mental Health–Related Interventions
To optimize interventions, gamification is considered an essential strategy, including in the mental health field [
]. Gamification relies on the full involvement of the player and exploits several psychosocial determinants affecting the learning process (eg, self-efficacy, social interaction, and a positive learning environment) [ ]. Enhancing these factors can facilitate the recall of abstract concepts, such as the concept of mental health [ ]. Introducing gamified elements (eg, step-by-step sequencing, rewarding systems, and puzzle-solving activities) in a health promotion and prevention tool can influence the aforementioned psychosocial determinants and, consequently, stimulate participants’ learning loop and their cognitive capacity [ ].Over the last few years, increasing attention has been paid to the possibility of games improving well-being [
]. Games can engage players, especially young target populations, in understanding and retaining information in a more attractive and acceptable way [ ]. This means that they can increase their mental health literacy and their knowledge of both the symptoms of psychological problems and the different solutions to overcome them. By providing tips and skills to face psychological difficulties, games might also contribute to positive changes in individuals’ behaviors and attitudes.Escape Games as a Tool to Improve Psychological Well-Being and Prevent Mental Disorders
Escape games are a type of digital intervention based on gamification where players collaborate to find clues, complete tasks, and solve puzzles with the aim of achieving a specific, time-bound goal, which is usually to escape from a room. Previous research corroborated the constructive impact of escape games in improving health-related knowledge in players [
, ] using a learning-by-doing approach [ ].Escape games can contribute to delivering health-related messages by fostering motivation for behavioral change through an enjoyable and playful approach, according to the PRIME (Plan, Response, Impulses, Motives, and Evaluation) theory of motivation [
]. Based on this theory, a decision to engage in an activity will not result in action unless it generates the desire and the impulse to do it at the relevant moment. Thus, the stimuli generated from the act of playing a game—including different tasks, lights, sounds, and colors—trigger feelings, ideas, and brain activities for positive decision-making. In other words, the game gives the input to change.Additionally, gamification has the potential to increase motivation, engagement, and self-awareness, and even diminish symptoms of diseases such as depression and anxiety [
]. Indeed, gamification stimulates several components of good mental health. As an example, achieving goals in a game can result in a sense of satisfaction, accomplishment, and increased self-esteem, all of which improve overall well-being. Furthermore, game enjoyment is associated with positive well-being and social and emotional support [ ].The Cocreation of Escape Games
Cocreation occurs when end users and service providers, often along with other participants, work together in the early phases of the development of an intervention cycle [
]. Cocreation is a process facilitating the acceptability of an intervention because it primarily considers the needs and preferences of end users during the intervention development. Thus, the benefits of gamification tend to increase when cocreation is used [ ], and cocreating an escape game can foster its adoption [ ]. Based on this approach, game producers and end users must first exchange views to achieve a shared goal [ , ]. Indeed, when developing a public health–related game, players’ experience and needs are relevant for enhancing its effectiveness in promoting health and prevention. Ideally, players work alongside designers, health professionals, and researchers, to produce the intervention. The cooperation of players and other stakeholders is therefore essential to maximize end users’ acceptability and adherence to the game. As a result, cocreation is usually recommended to produce a successful game, including in the mental health field. Accordingly, sensitive topics and taboos should be addressed using players’ words and taking into account the levels of empathy and sympathy players display during the cocreation process. Including end users with lived experience of mental health disorders promotes a deeper understanding of the game topic [ ].The PRODUCES Framework
PRODUCES (Problem, Objective, Design, End Users, Cocreators, Evaluation, Scalability) is among the different existing frameworks facilitating the cocreation of health-related interventions [
]. It is well-known for using a systemic approach to participatory methodology. According to this framework, the problem is a narrowed-down behavioral issue that the researchers and the designers wish to address. The cocreation process has an objective (“what” and “how”) and follows a specific predefined design, engaging cocreators who represent end users (ie, a specified target population). For the latter, all characteristics must be considered, from age to socioeconomic status, to tailor the intervention coherently. Cocreated interventions can also be evaluated and their scalability can be assessed. The satisfaction of the end user as well as the effectiveness of the intervention are elements to consider for the final evaluation. A successful intervention can be scaled up to reach a wider public. Thus, the PRODUCES framework helps to guide the participatory methodology by providing specific instructions.Objective
The objective of this study was to describe the process of cocreation of the escape game “EscapeCovid”. The end goal of the game was to promote university students’ mental health literacy, their beliefs about mental health, management of emotions, and positive coping strategies during the COVID-19 pandemic. An applied methodology is presented here to be used as a model for cocreating an acceptable gamified mental health intervention addressed to young people. Providing this example also has the aim to illustrate one cocreation process for the benefit of other researchers and designers.
Methods
The First Pilot Version of “EscapeCovid”: The Escape Game “Manage Your Emotions”
“EscapeCovid” was based on an existing escape game that was used as the skeleton of the final game. “Manage Your Emotions” was created in 2021 during the pandemic by a start-up based in Bordeaux, France, specializing in producing both real-world and online escape games. Creators were game designers, programmers, and health care professionals aged under 35 years.
The game “Manage Your Emotions” is set in Tony’s room, a fictional university student living in a shared flat and experiencing the difficulties of the first lockdown. The goal of the game is to collect several tools to disclose emotion cards and combine them. The game session involves 4 players and a game guide. The role of the game guide is to coordinate the whole game, to give clues if the players are stuck, and to animate the debriefing session. The game lasts in total 2 hours: 45 minutes of play and 1 hour and 15 minutes of debriefing. During the debriefing, the game guide and the players discuss in more detail the concept of emotions (ie, how to identify and manage them). The game guide follows a predefined plot facilitating the interactions between participants.
During the game, players follow Tony during a typical day through 3 rooms of his apartment (his home office in the bedroom, living room, and bedroom). By doing so, players discover his emotions and their consequences on his daily life.
illustrates Tony’s home office in the bedroom with a set of clues for the players.Players solve puzzles by clicking on the elements on the screen to uncover emotion cards. The definition of the different emotions is based on Plutchik’s wheel of emotions [
] ( ) which is the theoretical framework of the game.Plutchik’s wheel of emotions covers 8 primary emotions: joy, trust, fear, surprise, sadness, anticipation, anger, and disgust. They can be combined into more complex secondary emotions—for example, the combination of joy and trust can result in love. In the wheel, darker colors correspond to more intense emotions. All combinations and intensities are explained in the cards. Plutchik’s theory posits that the more we know about emotions, the better we understand how various emotions are interlinked and how they can change over time. Plutchik’s wheel of emotions has been used in several studies as a scientific instrument to interpret emotions [
, ]. In this escape game, playing cards had to be associated to identify Plutchik’s emotions.As the name suggests, the game “Manage Your Emotions” exclusively focused on emotions and therefore did not cover the full range of features of mental health (eg, mental health literacy and positive coping strategies). Furthermore, the software presented several bugs and the scenarios did not reflect the real-life conditions of a student during the pandemic.
Cocreating “EscapeCovid”: Test and Optimization
Our cocreation process followed the PRODUCES framework [
]. The problem we chose was students’ mental health during the COVID-19 pandemic. We particularly focused on mental health literacy, beliefs about mental health, management of emotions, and positive coping strategies as the levers to act upon for increasing students’ psychological well-being. We addressed all types of mental health problems, but specifically anxiety and depression, among the most common troubles in young people [ ]. These problems were exacerbated during the repeated COVID-19–related lockdowns [ ].Our objective was to develop the “EscapeCovid” game. The project was born during the third lockdown in France (from April 3 to May 3, 2021 [not included], ie, 29 days), where students were especially penalized because all educational institutions, but universities, were open. At that time, the plight of university students was prominently featured in the French media, which in turn heightened the pressure on French politicians [
].As for the design aspect, we used a 2-step participatory methodology approach (test and optimization), as described below. Both steps involved students as players of the game before and during its improvement. Thus, through direct experimentation, cocreators were a sample of students representing all university students referred to as end users.
The evaluation was performed through questionnaires and semistructured interviews using a mixed methods approach. Students reported their opinions on the game allowing for an assessment of its qualities and defaults. In this sense, the design and the evaluation were strictly related.
In terms of scalability, our objective was to distribute the new game among additional universities catering to French-speaking students (eg, France, Africa, and Québec).
reports the components of our study corresponding to the PRODUCES framework, including the phases and steps of the project.
PRODUCES framework | Application in "EscapeCovid" | Corresponding element/phase |
Problem | To address students’ mental health during the COVID-19 pandemic | N/Ab |
Objective | To develop the “EscapeCovid” game | N/A |
Design | Participatory methodology approach | Cocreation (test + optimization) |
End users | Students | Optimization |
Cocreators | 45 health care students + 2 game guides + 1 developer + 1 project manager + 1 student intern + 1 designer+ 1 developer + 1 medical doctor + 1 researcher | Cocreation (test + optimization) |
Evaluation | 45 questionnaires and 10 semistructured interviews (mixed methods) | Test |
Scalability | Disseminate the new game to other French students | Optimization |
aPRODUCES: Problem, Objective, Design, End Users, Cocreators, Evaluation, Scalability.
bN/A: not applicable.
In practice, referring more specifically to design, cocreation was implemented following 2 steps: the test and the optimization. In the first step, the escape game “Manage Your Emotions” was tested by a sample of health care students, 2 game guides (both public health experts), and 1 developer (a computer scientist). Game guides trained with colleagues and friends to annotate their first impressions of the game flow. They commented on the difficulties encountered while animating the game, including interactions with players and technical issues. The collected information was used to improve the debriefing and to solve bugs in collaboration with the developer.
Then, the official test was launched. Health care students played the game in groups of 3 or 4, each group supervised by 1 game guide. At the end of the game session, health care students were asked to complete an online questionnaire to rate their experience and provide feedback for improvement. Semistructured interviews were conducted with some voluntary respondents to obtain more in-depth advice (for improving the game).
In the second step, the game was optimized using the data collected from the test with the collaboration of a group of stakeholders. The latter included 1 project manager from a public health research center, 1 student intern completing a degree in cognitive engineering, 1 game designer, the developer of the test step specialized in computer science, 1 medical doctor, and 1 psychology researcher. Meetings were organized to reshape the pilot game and brainwriting techniques were used to collect ideas and pass them on to stakeholders. The brainwriting technique involves the written generation of ideas by different individuals on separate sheets, which are then collated by the project manager in the same shared file. Ideas are categorized and synthetized in the shared document where stakeholders can discuss them with written comments and paragraphs. Then, the team meets in person to agree on a common solution. Meetings and brainwriting were done in an iterative loop [
]. illustrates the cocreation process we adopted.The Testers of “EscapeCovid”
The students testing the game were included exclusively if they were health care students registered at the University of Bordeaux (France). We accepted all specific health-related fields of study (eg, medicine, midwifery, speech therapy), genders, and ages. We opted for health care students to assess the relevance of the contents of the game given their expertise in medical and paramedical care. Furthermore, previous studies have shown that health care students are a population at risk of mental illness [
] and, as a consequence, tend to be more sensitive to this topic. Recruitment was conducted from April 27 to May 17, 2022. We used a snowball sampling approach starting with health care students doing their internship at the public health research center where the study was based. Additionally, health care–related student associations were asked to post a recruitment announcement on their social media pages. We aimed to recruit between 30 and 50 health care students, as this number would guarantee the feasibility of the study and the interactions required during the game. Thus, the recruitment was stopped when we reached a sample of 45 health care students and the recruitment strategies seemed to be no longer efficient (ie, no further responses). The final number of health care students who took part in the study was 45.Through an email or by clicking on a link on the association’s social media posts, participants in the study were directed to a form to schedule the game session and then randomly allocated to a session including 4 players each.
All 45 health care students received a €20 (US $22) gift card. Among them, 10 also volunteered to take part in a semistructured interview and received a supplementary €20 (US $22) gift card.
In addition to health care students, testers included 2 game guides and 1 developer employed by the start-up producing the game. No inclusion or exclusion criteria were considered for these testers who were all females and aged between 25 and 30 years.
The overall aim of the project was to coproduce a game and not to measure its impact on the mental health of health care students playing the game. Students were in charge of testing the intervention, as opposed to being on the receiving end. In other words, they were not the research sample but were actively engaged in designing and implementing the research process [
]. Nonetheless, they were provided with a list of mental health care services they could refer to if needed. The medical doctor and the researcher in psychology from the stakeholders’ group were also available upon request. Finally, respondents were asked to electronically sign a consent form stating that their answers were completely anonymous without tracing. Interviewees also signed a form assuring that the recording of the interview would be deleted after 5 years until the final report and the last published paper, according to the policy of the involved research center.Data Collection Instruments and Analysis During the Test
A mixed methods approach was applied using both questionnaires and semistructured interviews which were administered to our sample. The satisfaction questionnaire was sent by email to students 1 day after having played the game. It was created ad hoc by IM for this study and tested with 3 public health interns at the research center where the project was conducted. The interns played the escape game and answered the questions reporting to IM if they were adapted and appropriate, and whether it was easy to answer them. Some adjustments to the original items were made after this pilot testing. The final satisfaction questionnaire included 12 items on the degree of appreciation and relevance of the intervention. On a visual analog scale from 0 (not at all) to 10 (a lot), students had to rate the game in terms of how enjoyable it was, the quality of its content, its level of difficulty, the graphics, and the clarity and relevance of the objective. Students were also asked to state to whom they would recommend the game, whether they would pay to play it, whether they had understood the importance of talking about mental health, whether the game increased their knowledge about mental health, whether the game helped them speak more freely about mental health, and whether they felt the game destigmatized mental health. Participants were also asked to rate the game from 1 (very bad) to 5 (very good) stars. We included these specific questions because they provided concrete hints for improving the game. The start-up appraised the features with the lowest scores as the most important to consider when reshaping the game. For instance, they chose to work first and foremost on the graphics if players rated them low (ie, <5 points). Some questions helped understand if the game could have its own business model, with players advising and paying for it. Finally, the questions were aimed at assessing the impact the game had on students’ mental health literacy, ranging from destigmatization to readiness to seek help [
]. The items of the satisfaction questionnaire are available in . Sociodemographic characteristics were also collected, including students’ gender, age, and year of study. Variables were described as counts and percentages. The questionnaire allowed us to obtain a large number of answers in a short time from a young population that is often difficult to reach [ ].Semistructured interviews were based on a grid composed of 3 macro themes and related 13 subthemes. The first macro theme, called “General Description of the Participant” included the following 3 subthemes: students’ profile (sociodemographic characteristics), any previous experience with escape games, and the reason for participating in this study. The second macro theme was a “Brief Account of Participants’ Experience” during the game session of “Manage Your Emotions,” focusing on 5 subthemes: whether students enjoyed it, their satisfaction with the design and scenarios, the feasibility of the game, the learning outcomes, and any advice to improve the game. The last macro theme, “The Impact of the Game,” included questions on the effectiveness of the game in teaching 5 topics (each corresponding to a specific subtheme): mental health, stigmatization, understanding and managing emotions, the importance of help-seeking, and techniques for mental health promotion. All subthemes were applied deductively, meaning they had been determined before the interviews.
Then, individual students’ speeches were generalized to obtain an overall assessment of the game. Interviews were recorded, fully transcribed, and analyzed through qualitative coding. The framework method was used to cross-check results among individuals and within individuals to report common and consistent concepts [
]. This approach allowed us to list the guidelines for the optimization step.Ethics Considerations
As the goal of the project was to collect satisfaction data with no repercussions on participants’ health, no ethical approval was needed, in line with the French law for health-related research (Délibération n° 2018-155 du 3 mai 2018).
Results
Sociodemographic Characteristics
The quantitative sample of 45 students was purposely limited for a small-scale test. Among them, 34 were female students, 10 male, and 1 nonbinary. Their average age was 22 years (range 18-27 years). The years of study ranged from first-year students to PhD candidates, with the majority attending their fourth year (n=16). The qualitative sample (n=10) was composed of 7 female students and 3 male students. In the qualitative study, one-half of the sample declared having experienced a mental health problem and having seen a mental health specialist.
Students’ Gaming Experience
The sample of 45 students who answered the questionnaire and the sample of 10 students interviewed reported enjoying the game session.
We discuss between us, why and how it is this emotion and not another [...] it was really good.
[B, female PhD candidate, Public Health, first year]
Yeah, I really liked the associations of emotions [...] frankly, we spoke with people we didn't know, so frankly it went well, it was cool.
[D, male students, Pharmacy, fourth year]
The majority of the sample (30/45, 67%) gave a high score (between 8 and 10) when asked whether they enjoyed the game. For 34/45 (76%) it was interesting (scores from 8 to 10). Twenty-one students considered that the game was easy. The most frequent overall score given to the game was 4 out of 5 stars (25/45, 56%).
In line with this finding, 21/45 (47%) respondents gave a positive score between 8 and 10 regarding the appeal of the graphics. Concerning the visual staging of the game, 1 student declared that the storyline was not coherent:
Tony’s apartment is too big for being a student flat.
[MA, female student, Speech Therapy, second year]
Tony’s character was also discussed, with some students questioning his relatability:
When Tony was talking, I didn't really get into the thing, in the end I found it very tricky, too tricky, a bit like a fake student.
[L, female student, Speech Therapy, third year]
Regarding the overall content of the game, 27/45 (60%) participants found the objective of the game clear (scores from 8 to 10) and 30/45 (67%) considered the content of the game suitable for students (scores from 8 to 10).
Half of the sample (24/45, 53%) would recommend the game to their close friends and family, especially their friends attending university (43/45, 96%). However, the vast majority of students (36/45, 80%) would not pay to play it.
The Knowledge Acquired During the Online Game Session
For 27/45 (60%) of the respondents, the game made them understand the importance of talking about mental health and 38/45 (84%) thought that the game was likely to increase their knowledge about mental health. However, interviewed students reported that knowledge about mental health was addressed in an unsuitable way.
For students, the game enabled users to better understand and identify different emotions, but the general concept of mental health was missing:
It was really more about identifying emotions, and self-reflection.
[L, female student, Speech Therapy, fourth year]
There would be a wealth of important information to address on mental health.
[A, female student, fourth year of international health]
The Development of the “EscapeCovid” Game
Quantitative and qualitative data from the test (step 1) informed the optimization of the game “Manage Your Emotions” (step 2) to produce the new game “EscapeCovid”. Data were collated and analyzed by the stakeholders working on the development of the game. All results were considered to reshape the new escape game accordingly. The results of the mixed methods analyses were shared among stakeholders. This group of experts met 3 times to summarize the most important suggestions provided by the testers. Each meeting lasted from 3 to 4 hours. Then, 1 shared document was prepared and the stakeholders were asked to provide solutions for each suggested change. This was the beginning of the brainwriting process, where stakeholders updated the document once per week and met regularly every other week. Ideas were incorporated into a new working document, which was the basis for a new round of discussions (ie, five 2-hour meetings). Once consensus had been reached, the web developer revised the game following the guidelines written by the stakeholders on an online document and Figma (Figma, Inc.), a collaborative web application for interface design. Both the contents and the designs were discussed and modified.
reports the modifications made from the first version of the game to the final one (also see and for the topics addressed and educational content of versions 1 and 2).
Features | Version 1: “Manage Your Emotions” | Version 2: “EscapeCovid” |
Objectives |
|
|
Game flow |
|
|
Topics addressed and educational content |
|
|
Character(s) |
|
|
Team competition |
|
|
Storyline |
|
|
Game setting |
|
|
- Game
- This involved knowledge, identification, and management of emotions.
- Debriefing Session
- This involved tips and resources to identify and manage emotions.
- In addition, the emotions felt during the examination period were discussed.
- Game (examining symptoms of depression through emotions):
- Stress and anxiety: other emotions, fear.
- Anhedonia: sadness.
- Self-devaluation: disgust.
- Other topics related to mental health that were addressed, including the following:
- Names of some mental health illnesses.
- Stigmatization of mental health and mental illness.
- Resources
- Debriefing session
- Room 1: Home office in the bedroom within the bedroom
- Stress and anxiety: definitions and differences. Link with depression.
- Room 2: Living room
- Relationship between mental health and anhedonia. Link with depression.
- Room 3: Bedroom
- Relationship between mental health and self-devaluation. Association with depression.
- Room 1: Home office in the bedroom within the bedroom
- Debriefing/end of the game
- Emotions not previously addressed during the game.
- Experienced symptoms and depression.
- Stress on the importance of having good mental health.
- Resources available in the case of a mental health problem.
In particular, substantial modifications concerned the introduction of mental health–related information in the game. Students had confirmed that the first version of the game was exclusively oriented toward emotions and their management. There were no specific elements of mental health described as either mental diseases or psychological well-being. In “EscapeCovid,” the terms “depression” and “anxiety” were used by the main character. The symptoms and consequences of these mental health diseases were presented in the story. Depression and anxiety were selected because they are the most frequent psychological issues among young adults [
]. Players were supposed to learn more about mental health problems (mental health literacy), to destigmatize them (positive beliefs about mental health), and be able to tackle them (positive coping strategies). Puzzles and enigmas were used to teach these concepts with debriefing sessions to reinforce the learning process. Given their expertise in the field of health care, interviewees (health care students) helped with the writing of the plot, from the enigmas to the summary sheets. An example of a cocreated scenario within the story is available in . Thanks to a cocreation approach, the game content could be revised by all public health stakeholders who were experts in public health and psychology. The graphics were also modified as shown in .Playing the “EscapeCovid” Game
The escape game takes place in Thomas’ apartment which he shares with another student, Hana, during the first COVID-19 lockdown. Thomas is a university student and is taking his classes remotely. Throughout the game, we follow him during a typical day in lockdown. There are 3 rooms in Thomas’ apartment—a home office in the bedroom, a living room, and a bedroom. To move from 1 room to another, players must solve all the puzzles by clicking on the objects spread out in Thomas’ room. When players click on an object, a riddle appears and must be solved to move on to the following riddle. Players can only move to another room if they have solved all of the enigmas by uncovering clues or cracking the codes hidden in the sofa, among books, on the floor, etc. There is a limited number of clicks per participant.
At the end of each room scenario, a set of cards is shown, with each card containing a mental health–related message linked to the puzzles. For instance, in the living room, Hana is sleeping on the sofa in the dark and the books around her have titles containing the words “depression,” “pain,” etc. By solving clues and clicking, players can switch the light on and tidy up the room to make her recover strength. The cards synthesize the messages transmitted through the puzzles in the room. In this case, they explain the symptoms of depression and give tips for coping with distress.
“EscapeCovid” can be played in groups of 4-6 players who help each other and discuss using their computer cameras and headphones. This encourages team spirit and mutual aid, which can be the reflection of real life in the case of mental suffering. All along the game, the group of players is guided by a game guide who explains the rules and answers any questions. The same guide concludes the game session with a final debrief where all participants share their experiences. This final stage is essential for understanding and retaining the mental health–related takeaway messages.
Discussion
Principal Findings
We described the process we used to cocreate a digital game promoting students’ mental health during the COVID-19 pandemic. We followed a 2-step procedure. First, we collected quantitative and qualitative data from a manageable sample of students testing a preexisting game. Second, a group of stakeholders used these data to refine and optimize the game to obtain the final user-centered version.
The cocreation approach was very informative for developing the “EscapeCovid” game. In particular, during the test, students felt free to express their opinions openly and give feedback. They mostly appreciated the fact that they could support the development of an intervention addressed directly to them and their peers. Students were also motivated to cocreate the game because it was in line with their values. Students’ contribution to the design process nurtured new ideas following a collective creative approach [
] from the testing phase to the final optimization phase. Stakeholders’ work was facilitated by students’ guidelines while being creative and innovative.The Rationale and the Usefulness of “EscapeCovid”
During the COVID-19 crisis, several mental health diseases emerged in the young, and digital games were among the most accepted solutions to overcome psychological difficulties [
]. With this rationale, we conceived "EscapeCovid". This game was designed to alleviate anxiety and depression by encouraging interaction with peers and fostering empathy. Participants in this study also confirmed the usefulness and appreciation of digital games during and after the COVID-19 crisis. Previous studies have shown that playing games is helpful in dealing with trauma and improves well-being [ ]. This has also been observed in the context of the pandemic [ ]. For this, "EscapeCovid" combines the pleasure and the entertainment of games, with a positive psychological effect. This might be due to teamwork, engagement, learning of coping strategies, and creativity, which are all at the root of our game. Indeed, the objective of "EscapeCovid" was to trigger the need to speak out about mental health after having experienced the psychological difficulties of COVID-19. "EscapeCovid" pioneered the discussion of mental health, making it a common topic, and provided advice on how to improve one’s mental health, especially in the aftermath of the crisis.Guidelines for Successful Escape Games on Young’s People’s Mental Health
First, we confirmed that students enjoy playing escape games, which are linked to mental health. This was also found in other studies where health-related serious games were proven to facilitate experiential learning through an entertaining approach [
, ]. Thus, resorting to this type of intervention could be a good strategy to convey messages aimed at improving players’ mental health. Engaging in playing games has been reported to promote the potential to enhance life satisfaction and improve individuals’ mental well-being [ ].We observed that the plot was essential in capturing players’ attention. During the game, testers were attracted by the messages and the scenario, feeling interested in following Thomas’ story. They considered this aspect as crucial to transmit educational content, helping to convey new health-related topics, as shown in a previous study [
]. A meta-analysis on the gamification of learning confirmed that the use of personified narrative components is particularly effective in promoting behavioral learning [ ].Playing in groups was also a strategy to make connections and combat isolation, particularly experienced during the COVID-19 lockdown. The notion of interrelationship and mutual aid is a component to consider when developing games, even if they have a digital format.
According to testers, the “EscapeCovid” game had to be user-friendly, fun, and pedagogical. It had to present supplementary contents on mental health, with more specific details on mental health disorders and advice for preventing or treating them. We recommend that future game creators use precise and detailed content, providing accurate and uncensored mental health information and avoiding stigmatizing psychological disorders.
The Challenges of Cocreating Mental Health–Related Games With and For Young People
The involvement of end users entails a large proportion of subjectivity. This is especially true when handling topics such as mental health where feelings and emotions are at stake. End users give their opinions without any specific framework [
]. To mitigate this issue, the sample answering the questionnaire should be large enough to be representative of the target population. However, for the sake of feasibility in terms of time and financial efforts, it is not always possible to question more than 50-100 people. Qualitative interviews are meant to provide further information corroborating the quantitative data, but they still imply subjectivity. Per se, interviews cannot be representative [ ]. The limited number of stakeholders has its share of arbitrariness. Nonetheless, regardless of their number, cocreators are the bridge between the whole target population and the stakeholders [ ].Cocreation is time-consuming. The 2-step development demands at least twice as long as the standard time to produce a game. Data collection and analysis add work to the producers who need to incorporate the results into their creative process. Discussions among stakeholders and brainwriting also slow down the production process. This is a limit of cocreation which cannot be overcome while being the best solution for producing an intervention that is well-tailored to the needs of the end user. Qualitative interviews in particular require time and effort, but they are a crucial tool for an in-depth analysis.
Technological issues should also be considered. Players’ expectations might not be easily met because of software limitations. This could result in frustration from both parties and decrease adherence to the game. Start-ups and game industries should therefore keep up with new technologies and continuously update their services.
The Advantages of Cocreation
Cocreation has the advantage of considering the viewpoint of the end user, which might not be the case in classical processes of game development using a top–down approach. Collecting students’ opinions before the development of the game allowed us to obtain several inputs and ideas that a limited number of web developers and project managers could not provide. The filter of expert health care professionals was also essential during the process. New knowledge was produced through sharing among parties.
The consultation with students having experienced mental health disorders allowed us to address the escape game’s topic through a different lens. By considering their opinion, the game could be made more realistic and engaging. The disclosure of emotions and opinions can be facilitated through anonymous questionnaires and qualitative interviews, with students knowing that they are contributing to an intervention beneficial to them and their peers. The feeling of being useful to the community is another added value in the cocreation process [
].Two different teams—one from an academic environment and the other from a start-up—collaborating to develop the game was also an asset. Indeed, researchers’ scientific point of view informed the business goal of the start-up with the common will of creating an evidence-based marketable product.
Finally, cocreation provided useful information for the improvement of both the content and the format of the game. The latter was more contextually specific, adapted to a young population, namely, students, and bridging the gap between the preconceived ideas held by the start-up team and the real-world implementation of the game.
Recommendations for Researchers and Designers
The “EscapeCovid” game is an example of a digital game on mental health, which could be cocreated with young users. The guidelines we present might be applied to other similar interventions.
A 2-step approach is recommended with (1) an initial collection and analysis of combined quantitative and qualitative data, followed by (2) the integration of these data into the reflective and creative work of a group of experts and stakeholders. This approach, similar to a market survey, allows us to obtain clearer game instructions and broader insights, resulting in a more targeted and audience-specific final product.
We suggest basing the coconstruction process on an already existing pilot version because it facilitates the development of the final game. Although the game can be completely re-created, preliminary mock-ups will allow to save time and money. In our study, students were not required to design the game from scratch, and working on the first version of the game was an advantage for providing relevant, concrete, and realistic comments based on an existing version.
Stakeholders are also advised to take into account testers’ opinions seriously and implement them accordingly. Testers represent the end users and their preferences must be carefully considered to obtain a fully satisfactory end product. For this reason, it is essential to collect as much information as possible during the testing stage.
We suggest to try out the game again once it has been modified. An iterative loop of test-optimization-test will increase the quality of the game. However, it must be pointed out that this process is expensive and time-consuming, despite being extremely informative. It is therefore recommended to end the loop once the comments are saturated, which effectively means limiting the number of additional changes suggested by users and resulting work for developers. This approach can serve as a blueprint for future work on creating gamified interventions on health-related topics addressed to students. Successfully cocreated games can have a wide outreach and improved scalability.
Study Limitations
Testers were mostly student interns at the research center where the study was conducted. This might have biased the results because participating students were already made aware of the project and willing to contribute to its progress as members of the same research laboratory. The test was performed by health care students, meaning that the modifications of the game might be relevant to them and not to students of other subjects. This particular student population also faces specific forms of stress not experienced by their peers. However, we considered their opinion to be of paramount importance in terms of the contents of the game, which benefited from their skills and experience with stress. The game was more realistic and other students could relate to Thomas’ story imagined by young people their age.
Another limitation is that the students participating in the study were rewarded with a gift card, which could have significantly influenced the answers due to desirability bias. This phenomenon was even more likely in the case of interviewees who had received 2 gift cards. The gender balance among the participants was skewed in favor of female students, which may have influenced the results of the test.
Finally, we were not able to retest the game after its modification. Because of money and time constraints, we only produced a new version of the game without further refinement.
Conclusions
Our results suggest that cocreation contributes to improving the suitability of a health promotion and disease prevention intervention and that an end user–centered approach can facilitate intervention tailoring. When conceiving a health-related escape game, we recommend using a 2-step approach, including an initial collection of quantitative and qualitative data from end users testing the game (test), followed by the integration of these data into the development of the game by a restricted number of experts (optimization). This approach can serve as a model for future work on creating gamified interventions on health-related topics addressed to students.
Acknowledgments
The authors acknowledge and thank all the students who took part in the study. The authors are also indebted to the university student associations for helping recruit participants. Finally, the authors wish to thank Sara Garfield for revising, proofreading, and editing the paper. The project was funded by the French National Research Agency (ANR; grant number ANR-21-CE36- 0011-02). IM was supported by the Digital Public Health Graduate Program within the framework of the PIA3 (Investment for the Future; Project reference: 17-EURE-0019). Further support was given by the AUF CO//ectif (DREO-7450).
Authors' Contributions
DL was responsible for conceptualization, investigation, and writing—reviewing. CV performed data curation and writing—original draft preparation. DT collected and analyzed the quantitative data. HH and CT took part in data curation and writing. IM contributed to conceptualization, methodology, investigation, writing—reviewing and editing, and supervision.
Conflicts of Interest
DL, HH, and DT are employees of the start-up Tricky, which developed the game described in this paper. Their jobs are paid by other projects, and they did not take any financial benefit from the development of “EscapeCovid.” The game was developed for business, but data collection, analysis, and observation for this manuscript were conducted by CV, CT, and IM who are totally independent from Tricky. The study results are completely transparent and based on scientific integrity.
Satisfaction questionnaire.
DOCX File , 15 KBExample of a cocreated scenario in "EscapeCovid".
DOCX File , 329 KBReferences
- Montagni I, Qchiqach S, Pereira E, Tully PJ, Tzourio C. Sex-specific associations between sleep and mental health in university students: a large cross-sectional study. J Am Coll Health. Apr 07, 2020;68(3):278-285. [CrossRef] [Medline]
- Huckins JF, daSilva AW, Wang W, Hedlund E, Rogers C, Nepal SK, et al. Mental health and behavior of college students during the early phases of the COVID-19 pandemic: longitudinal smartphone and ecological momentary assessment study. J Med Internet Res. Jun 17, 2020;22(6):e20185. [FREE Full text] [CrossRef] [Medline]
- Savage MJ, James R, Magistro D, Donaldson J, Healy LC, Nevill M, et al. Mental health and movement behaviour during the COVID-19 pandemic in UK university students: prospective cohort study. SSRN Journal. 2020;19:100357. [CrossRef]
- Arsandaux J, Montagni I, Macalli M, Texier N, Pouriel M, Germain R, et al. Mental health condition of college students compared to non-students during COVID-19 lockdown: the CONFINS study. BMJ Open. Aug 19, 2021;11(8):e053231. [FREE Full text] [CrossRef] [Medline]
- Vindegaard N, Benros ME. COVID-19 pandemic and mental health consequences: systematic review of the current evidence. Brain Behav Immun. Oct 2020;89:531-542. [FREE Full text] [CrossRef] [Medline]
- Rossi R, Socci V, Talevi D, Mensi S, Niolu C, Pacitti F, et al. COVID-19 pandemic and lockdown measures impact on mental health among the general population in Italy. Front Psychiatry. Aug 7, 2020;11:790. [FREE Full text] [CrossRef] [Medline]
- Li Y, Zhao J, Ma Z, McReynolds LS, Lin D, Chen Z, et al. Mental health among college students during the COVID-19 pandemic in China: a 2-wave longitudinal survey. J Affect Disord. Feb 15, 2021;281:597-604. [CrossRef] [Medline]
- Jones L, Vereschagin M, Wang A, Munthali R, Pei J, Richardson C, et al. Suicidal ideation amongst university students during the COVID-19 pandemic: time trends and risk factors. Can J Psychiatry. Jul 2023;68(7):531-546. [FREE Full text] [CrossRef] [Medline]
- Macalli M, Texier N, Schück S, Côté SM, Tzourio C. A repeated cross-sectional analysis assessing mental health conditions of adults as per student status during key periods of the COVID-19 epidemic in France. Sci Rep. Nov 09, 2021;11(1):21455. [FREE Full text] [CrossRef] [Medline]
- Pandya A, Lodha P. Mental health consequences of COVID-19 pandemic among college students and coping approaches adapted by higher education institutions: a scoping review. SSM Ment Health. Dec 2022;2:100122. [FREE Full text] [CrossRef] [Medline]
- Theurel A, Witt A, Shankland R. Promoting university students' mental health through an online multicomponent intervention during the COVID-19 pandemic. Int J Environ Res Public Health. Aug 22, 2022;19(16):10442. [FREE Full text] [CrossRef] [Medline]
- Riboldi I, Cavaleri D, Calabrese A, Capogrosso CA, Piacenti S, Bartoli F, et al. Digital mental health interventions for anxiety and depressive symptoms in university students during the COVID-19 pandemic: a systematic review of randomized controlled trials. Rev Psiquiatr Salud Ment. Jan 2023;16:47-58. [FREE Full text] [CrossRef] [Medline]
- Montagni I, Tzourio C, Cousin T, Sagara JA, Bada-Alonzi J, Horgan A. Mental health-related digital use by university students: a systematic review. Telemed J E Health. Feb 01, 2020;26(2):131-146. [CrossRef] [Medline]
- Fleming T, Bavin L, Stasiak K, Hermansson-Webb E, Merry S, Cheek C, et al. Serious games and gamification for mental health: current status and promising directions. Front Psychiatry. 2016;7:215. [CrossRef] [Medline]
- Huotari K, Hamari J. A definition for gamification: anchoring gamification in the service marketing literature. Electron Markets. Jan 15, 2016;27(1):21-31. [CrossRef]
- DeSocio J, Stember L, Schrinsky J. Teaching children about mental health and illness: a school nurse health education program. The Journal of School Nursing. 2006;22(2):81. [CrossRef]
- Rodriguez-Ferrer JM, Manzano-León A, Cangas AJ, Aguilar-Parra JM. A web-based escape room to raise awareness about severe mental illness among university students: randomized controlled trial. JMIR Serious Games. May 05, 2022;10(2):e34222. [FREE Full text] [CrossRef] [Medline]
- Jones CM, Scholes L, Johnson D, Katsikitis M, Carras MC. Gaming well: links between videogames and flourishing mental health. Front Psychol. Mar 31, 2014;5:260. [FREE Full text] [CrossRef] [Medline]
- Fleming T, Cheek C, Merry S, Thabrew H, Bridgman H, Stasiak K. Serious games for the treatment or prevention of depression: a systematic review. Revista de Psicopatologia y Psicologia Clinica. 2014;19(3):227-242. [FREE Full text] [CrossRef]
- Edwards T, Boothby J, Succheralli L. Escape room: using an innovative teaching strategy for nursing students enrolled in a maternity clinical course. Teaching and Learning in Nursing. Oct 2019;14(4):251-253. [CrossRef]
- Eukel HN, Frenzel JE, Cernusca D. Educational gaming for pharmacy students - design and evaluation of a diabetes-themed escape room. Am J Pharm Educ. Sep 2017;81(7):6265. [FREE Full text] [CrossRef] [Medline]
- West R, Michie S. A brief introduction to the COM-B Model of behaviour and the PRIME Theory of motivation. Qeios. Apr 07, 2020.:1-6. [FREE Full text] [CrossRef]
- Cheng VWS. Recommendations for implementing gamification for mental health and wellbeing. Front Psychol. Dec 7, 2020;11:586379. [FREE Full text] [CrossRef] [Medline]
- Johannes N, Vuorre M, Przybylski AK. Video game play is positively correlated with well-being. R Soc Open Sci. Feb 17, 2021;8(2):202049. [FREE Full text] [CrossRef] [Medline]
- Torfing J, Sørensen E, Røiseland A. Transforming the public sector into an arena for co-creation: barriers, drivers, benefits, and ways forward. Administration & Society. Nov 28, 2016;51(5):795-825. [CrossRef]
- Lopes JM, Gomes S, Rodrigues I. Playing the gamification and co-creation game: a bibliometric literature review. Manag Rev Q. Nov 08, 2022;74(1):353-376. [CrossRef]
- Leask CF, Sandlund M, Skelton DA, Altenburg TM, Cardon G, Chinapaw MJM, et al. GrandStand‚ Safe StepTeenage Girls on the Move Research Groups. Framework, principles and recommendations for utilising participatory methodologies in the co-creation and evaluation of public health interventions. Res Involv Engagem. Jan 9, 2019;5(1):2. [FREE Full text] [CrossRef] [Medline]
- Ind N, Coates N. The meanings of co-creation. European Business Review. 2013;25(1):e1. [FREE Full text] [CrossRef]
- OHern M, Rindfleisch A. Customer co-creation: a typology and research agenda. Review of Marketing Research. Nov 2010;6:84-106. [FREE Full text] [CrossRef]
- Hanlon CA, McIlroy D, Poole H, Chopra J, Saini P. Evaluating the role and effectiveness of co-produced community-based mental health interventions that aim to reduce suicide among adults: a systematic review. Health Expect. Feb 14, 2023;26(1):64-86. [FREE Full text] [CrossRef] [Medline]
- Plutchik R. The Emotions: Facts, Theory and a New Model. New York, NY. Random House; 1962.
- Arroyo-Barrigüete JL. Sentiment analysis of Lovecraft's fiction writings. Heliyon. Jan 2023;9(1):e12673. [FREE Full text] [CrossRef] [Medline]
- Kaklauskas A, Abraham A, Ubarte I, Kliukas R, Luksaite V, Binkyte-Veliene A, et al. A review of AI cloud and edge sensors, methods, and applications for the recognition of emotional, affective and physiological states. Sensors (Basel). Oct 14, 2022;22(20):7824. [FREE Full text] [CrossRef] [Medline]
- Pedrelli P, Nyer M, Yeung A, Zulauf C, Wilens T. College students: mental health problems and treatment considerations. Acad Psychiatry. Oct 21, 2015;39(5):503-511. [FREE Full text] [CrossRef] [Medline]
- Arsandaux J, Montagni I, Macalli M, Texier N, Pouriel M, Germain R, et al. Mental health condition of college students compared to non-students during COVID-19 lockdown: the CONFINS study. BMJ Open. Aug 19, 2021;11(8):e053231. [FREE Full text] [CrossRef] [Medline]
- Trespeuch M, Tenret É. La crise sanitaire: une prise de conscience de la condition étudiante? Revue Française de Socio-Économie. 2021;26(1):5-11. [FREE Full text] [CrossRef]
- VanGundy A. Brainwriting for new product ideas: an alternative to brainstorming. J Consum Mark. 1984;1(2):67-74. [CrossRef]
- Quek, Tam, Tran, Zhang, Zhang, Ho, et al. Ho. The global prevalence of anxiety among medical students: a meta-analysis. Int J Environ Res Public Health. Jul 31, 2019;16(15):2735. [FREE Full text] [CrossRef] [Medline]
- Goodyear-Smith F, Jackson C, Greenhalgh T. Co-design and implementation research: challenges and solutions for ethics committees. BMC Med Ethics. Nov 16, 2015;16(1):78. [FREE Full text] [CrossRef] [Medline]
- Jorm AF. Mental health literacy. Public knowledge and beliefs about mental disorders. Br J Psychiatry. Nov 02, 2000;177(5):396-401. [CrossRef] [Medline]
- Lallukka T, Pietiläinen O, Jäppinen S, Laaksonen M, Lahti J, Rahkonen O. Factors associated with health survey response among young employees: a register-based study using online, mailed and telephone interview data collection methods. BMC Public Health. Feb 05, 2020;20(1):184. [FREE Full text] [CrossRef] [Medline]
- Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. Sep 18, 2013;13(1):117. [FREE Full text] [CrossRef] [Medline]
- Kumaraswamy N. Academic Stress, Anxiety and Depression among College Students-A Brief Review. International Review of Social Sciences and Humanities. 2013;5(1):135-143.
- Jessen S, Mirkovic J, Ruland CM. Creating gameful design in mHealth: a participatory co-design approach. JMIR Mhealth Uhealth. Dec 14, 2018;6(12):e11579. [FREE Full text] [CrossRef] [Medline]
- Marston HR, Kowert R. What role can videogames play in the COVID-19 pandemic? Emerald Open Res. Oct 5, 2020;2:34. [FREE Full text] [CrossRef]
- Colder Carras M, Kalbarczyk A, Wells K, Banks J, Kowert R, Gillespie C, et al. Connection, meaning, and distraction: a qualitative study of video game play and mental health recovery in veterans treated for mental and/or behavioral health problems. Soc Sci Med. Nov 2018;216:124-132. [FREE Full text] [CrossRef] [Medline]
- Barr M, Copeland-Stewart A. Playing video games during the COVID-19 pandemic and effects on players’ well-being. Games and Culture. May 06, 2021;17(1):122-139. [CrossRef]
- Barber C, Stavroulaki K, Santanello C. Examining student motivation to use a gamified system in an immunology and immunization training course. Innov Pharm. Nov 18, 2020;11(4):14. [FREE Full text] [CrossRef] [Medline]
- Sailer M, Homner L. The gamification of learning: a meta-analysis. Educ Psychol Rev. Aug 15, 2019;32(1):77-112. [CrossRef]
- Finn J. The promise of participatory research. J Progress Hum Serv. 2008;5(2):25-42.
- Queirós A, Faria D, Almeida F. Strengths and limitations of qualitative and quantitative research methods. European Journal of Education Studies. 2017;3(9):369-387. [FREE Full text] [CrossRef]
- Lee HM, van Dolen W. Creative participation: Collective sentiment in online co-creation communities. Information & Management. Dec 2015;52(8):951-964. [CrossRef]
Abbreviations
PRIME: Plan, Response, Impulses, Motives, and Evaluation |
PRODUCES: Problem, Objective, Design, End Users, Cocreators, Evaluation, Scalability |
Edited by T Rashid Soron; submitted 28.04.23; peer-reviewed by C Cederved, A Gavarkovs; comments to author 11.06.23; revised version received 16.07.23; accepted 09.02.24; published 18.03.24.
Copyright©David Labrosse, Clara Vié, Hana Hajjam, Clément Tisseron, Dimitri Thellier, Ilaria Montagni. Originally published in JMIR Serious Games (https://games.jmir.org), 18.03.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.