Viewpoint
Abstract
Game elements are increasingly used to improve user engagement in digital mental health interventions, and specific game mechanics may yield therapeutic effects per se and thereby contribute to digital mental health intervention efficacy. However, only a few commercial game–based interventions are available. We suggest that the key challenge in their development reflects the tension between the 2 underlying paradigms, health care and entertainment, which have disparate goals and processes in digital development. We describe 3 approaches currently used to negotiate the 2 paradigms: the gamification of health care software, designing serious games, and purpose shifting existing entertainment games. We advanced an integrative framework to focus attention on 4 key themes in intervention development: target audience, engagement, mechanisms of action, and health-related effectiveness. On each theme, we show how the 2 paradigms contrast and can complement each other. Finally, we consider the 4 interdependent themes through the new product development phases from concept to production. Our viewpoint provides an integrative synthesis that facilitates the research, design, and development of game-based digital mental health interventions.
JMIR Serious Games 2023;11:e42173doi:10.2196/42173
Keywords
Introduction
Background
Digital mental health interventions (DMHIs) are actively developed in response to the growing mental health crisis [
]. Some of the new interventions [ - ] use elements from entertainment games to improve user engagement and intervention effectiveness [ , ]. Using a game-based approach to pursue health-related aims requires developers to have competencies in both health care and game development; however, the 2 paradigms have considerable disparity in their goals. In health care, health-related aims are pursued by minimizing user interaction with the intervention, whereas entertainment products, largely oblivious to their health effects, seek to maximize user interaction with the content. This difference has led to specialized practices, institutions, and business models that are not readily compatible and challenge interdisciplinary development, which Mathews et al [ ] succinctly describe as follows:The “fail fast, fail often” mantra espoused by technology startups is frustrated by the confusing regulatory landscape of healthcare. This cultural clash is further exacerbated by the cautious, stepwise, and time-consuming process of healthcare innovation that is grounded in the risk-averse clinical principle of “first, do no harm.”
Existing models of intervention development [
- ], although comprehensive, do not sufficiently address the tension between health care and entertainment in the development of game-based DMHIs (gDMHIs). In this paper, we describe the tension and offer a framework to facilitate new product development and implementation.The Treatment, Engagement, and Implementation Gaps in Digital Interventions
Mental disorders are common and cause distress and burden to both individuals and society [
]. However, most people with mental disorders remain untreated. The median treatment gap, defined as the difference between the prevalence of a disorder and those treated for it, is >50% for many disorders [ ]. For instance, only a fourth of those living with anxiety disorders receive any treatment, with 1 (10%) in 10 receiving possibly adequate treatment [ ]. The mental health care system is globally unable to offer sufficient interventions to address patients’ needs.Solutions to the mental health burden are increasingly sought from scalable digital interventions. The evidence of their effectiveness for both depression and anxiety is already substantial [
- ], and their effectiveness compares to that of face-to-face interventions [ ]. Moreover, the treatments display a considerable dose-response relationship [ , , , ]: greater user interaction with the software-based intervention, that is, engagement, is associated with higher intervention effectiveness. However, digital interventions suffer from an engagement gap. High dropout rates and low user engagement are observed in digital interventions, particularly in self-guided programs [ , - ], where 40% of the participants may drop out before completing a fourth of the intervention [ ], and only 0.5% to 28.6% complete the entire intervention or continue its use [ ]. As engagement is related to intervention effectiveness, there is a substantial need to ensure that users find the interventions interesting, motivating, and meaningful.The engagement gap is also an indication of the implementation gap: researchers and developers struggle to transfer the effectiveness established in clinical settings to real-world environments [
]. The effectiveness of DMHIs in ideal and controlled research settings (efficacy trials) is almost double that in real-world settings (effectiveness trials) [ , ]. The intervention’s clinical effectiveness in optimal circumstances does not guarantee real-world impact, which calls for paying more attention to how the interventions are designed and developed with both users and clinicians in mind.Game-Based Approaches Seek to Increase Intervention Engagement and Effectiveness
Game-based approaches are increasingly developed with the ambition to improve user engagement with and the effectiveness of DMHIs [
, ]. This rationale reflects the immense popularity of digital entertainment games. Playing video games is a hobby for 71% of American youth and 65% of adults [ ], and globally, there are >2.7 billion players [ ]. Although youth and young adults are the most active players, the average player is aged 38 years, and those in their 30s still play, on average, >6 hours a week [ ]. Digital games are a familiar, accessible, attractive, and engaging medium for the general audience.Game-based interventions are currently developed for numerous psychiatric disorders, including depression [
], anxiety [ ], attention-deficit/hyperactivity disorder (ADHD) [ ], and autism spectrum disorder [ ], and serious mental illnesses, including schizophrenia and bipolar disorder [ ]. Fleming et al [ ] suggested that game-based interventions can extend treatment reach, thus helping close the treatment gap and improve user engagement and intervention effectiveness. There are numerous game-based interventions in development [ ], but only a few are in the market. To support their development, there is a considerable need for frameworks that address the particularities of the game-based medium and facilitate interdisciplinary collaboration.The Aim of This Paper
There is a substantial need for DMHIs that are engaging, effective, and feasible, and game-based approaches have potential in this regard. In this paper, we offer an interpretive synthesis that integrates and contrasts the literature in 2 fields: health care and entertainment. First, we argue that the 2 fields are in tension, which challenges the development of game-based interventions. Then, we discuss how to negotiate the tension. We focus on 4 themes, namely the target audience, engagement, mechanisms of action, and effectiveness (TEME) framework. We conclude the discussion by reflecting on the themes through new product development phases. Aimed at researchers, developers, and designers working with game-based interventions, our paper facilitates interdisciplinary collaboration and the wise use of game-based elements to ameliorate mental health.
The Tension Between Health Care and Entertainment
The Paradigms Address Different Needs
We suggest that the engagement gap with DMHIs reflects a tension between health care and entertainment, which becomes especially apparent in game-based interventions. Our approach is built on the notion of the differentiation of society into subsystems such as law, economy, politics, religion [
, ], health care, and entertainment. The thorough history of the 2 paradigms is beyond the scope of this paper, but their differences can be summarized in the code that they specialize in. Health care is concerned with the code of health, focusing on identifying and classifying sources of disability and seeking remedies for them [ ]. Moreover, health care has legitimized priority over the domain of health, manifesting in the authority of certified clinicians overviewed by regulatory bodies. Meanwhile, entertainment, also described as “audience-centered commercial culture” [ ], is a societal subsystem focusing on the code of leisure. The value of entertainment manifests through its ability to attract and captivate the attention of the audience over time in the theater and through literature, music, and games. The freedom of expression prevails in these domains because of the low risk to audiences’ health. The subsystem codes are associated with underlying universal human needs. According to the notions proposed by Max-Neef et al [ ], health care addresses the existential needs of subsistence and protection by curing and helping, whereas entertainment responds to the needs of idleness, creation, and identity by offering fantasies, relaxation, and opportunities to have fun both alone and together with others.The organizations catering to the same need differentiate into industries that share a high-level raison d’être and have specialized concepts, regulations, structures, competencies, and methodologies to support their work. This specialization both increases the effectiveness in addressing the underlying human needs and creates distance from other societal subsystems. Refocusing on game-based mental health interventions, they can be viewed as a combination of 2 domains: the entertainment game industry, which has developed specialized skills in digital art and animation, programming, project management, storytelling, game design, and media business, and mental health care, which focuses on psychiatric diagnoses and their etiology and treatment. To summarize, health care practices are not intended to craft digital entertainment and vice versa. The differences between DMHIs and entertainment games are illustrated in the
.DMHI | Digital entertainment games | |
Underlying paradigm | Health care | Entertainment |
Paradigm code | Health | Leisure |
Underlying need | Alleviating disorders and increasing well-being | Offering enjoyment, relaxation, and social connection |
Users | Patients, clients | Consumers, players, fans |
Goal | Introducing behavioral change and alleviating symptoms | Captivating and entertaining the player |
The scientific base | Extensive research base | Growing research base |
Categorized by | Therapeutic modality (eg, CBTa) | Game genre (eg, FPSb) |
Evaluated by | Efficacy and safety | Game experience, business metrics, and reviews |
Initiative to use | Often recommended by a health care professional | Chosen by the player from a wide variety of alternatives |
Entry to market | High threshold: clinical evidence, regulations, and gatekeepers | Low threshold: global digital marketplaces |
Availability | Growing number of interventions | High number of commercial games |
Purchase | Insurance often pays for the service. | The customer pays for the service. |
Business model | B2Bc | B2Cd |
aCBT: cognitive behavior therapy.
bFPS: first-person shooter.
cB2B: business to business.
dB2C: business to consumer.
We are not aware whether the tension between health care and entertainment would have been previously framed in this way. However, the disparate goals of health care and entertainment have attracted prior attention. Yardley et al [
] discussed the need for digital interventions to promote “effective engagement” rather than merely pursuing an increase in user interaction. They highlighted the need to establish a causal connection between user interaction with the intervention and the intended behavior change. Exploring gamified information systems, Liu et al [ ] described the phenomenon as “meaningful engagement”: the intervention needs to reach its experiential outcomes—to be sufficiently enjoyable and feasible—to reach its instrumental outcomes of behavior and symptom changes. Furthermore, Siriaraya et al [ ] separated “game value” from “therapeutic value,” highlighting the difference between the 2 paradigms. These considerations emphasize how engagement and effectiveness are distinct, and we suggest that this relates to the 2 paradigms and their codes.Differentiating Among Gamified Interventions, Serious Games, and Purpose-Shifted Entertainment Games
DMHIs with and DMHIs without game elements are actively developed, and the former particularly negotiates the underlying paradigms of health care and entertainment. We classified game-based interventions into the following 3 categories: gamified DMHIs, serious games, and purpose-shifted digital entertainment games. We refer to them collectively as gDMHIs, “game-based interventions” in short. As the intervention adapts more elements from entertainment games, on the one hand, its gameness [
] increases, and, on the other hand, its intentional therapeutic functionality transforms ( ).At one end of the continuum, DMHIs pursue health benefits and use minimal game-based elements. At the other end, there are digital entertainment games that may have incidental health benefits to their primary aim of capturing the interest and attention of the player. The former can be described as functional software that serves a particular purpose, whereas the latter is built to create experiences that are valuable in their own right [
, ]. The design of digital entertainment games is a specialized domain differentiated from traditional, functional software development [ , ], which is also reflected in the concepts used. Functional software has users, and its evaluation focuses on usability and user experience, whereas games are evaluated based on their playability and game experience [ ].Between health care and entertainment lie 3 categories of gDMHI. When game design elements are incorporated into a DMHI, the intervention becomes gamified [
]. The 2 most common rationales for using gamification in health care are improving user engagement and the effectiveness of the intervention, and the most common game elements include levels, progress feedback, points, rewards, narration, and personalization [ ]. The incorporated game elements should not be superficial and exogeneous to the designed intervention, but synergistic with the experience the intervention intends to create [ ]. In addition, gamification is not limited to the features visible to the user but can include the use of game design principles and methods in design and development [ ].In contrast to gamified applications, serious games are full-fledged games that are used for purposes beyond entertainment [
, ], often in education, health care, and organizational development. Gamified applications and serious games are frequently differentiated in the research literature [ ], but in practice, the line between the two is not easy to draw. To distinguish between gamified and full-fledged game interventions, Liu et al [ ] suggested that gamification incorporates game elements on top of real-world systems without sacrificing their functionality, whereas serious games are separate from real-world systems. Thus, a gamified intervention may more closely resemble and augment functional applications while retaining the instrumental functions of the system, whereas a full-fledged game often includes a fictional world for the player to immerse in.To further clarify, we differentiated game-based interventions from “serious games for health” serious games used within the health care system by clinicians and patients for therapeutic and educational purposes [
, ]. Not all game-based approaches within health care are interventions: only those that prevent, assess, and help manage disorders are interventions, in contrast to software with educational and information management aims [ ].Whereas gamified and serious game DMHIs are intentionally designed for therapeutic purposes, purpose-shifted games take an alternative approach. These are games designed for entertainment purposes but used for serious, therapeutic purposes, either with or without modifications [
]. The rationale for this approach lies in the finding that playing digital entertainment games may have a positive impact on well-being regardless of the design and use intention of the games [ , ]. Positive effects arise, for instance, from the users’ connection with other people, which that alleviates loneliness and creates meaningful relationships; the games’ cognitive demands, which train attention, perception, and executive functions; and the positive, eudaimonic experiences offered by the games [ , ].The forte of the purpose-shifted approach is that commercially available video games are accessible, affordable, and of high quality compared with many designed gamified interventions and serious games. Consequently, this approach is quite popular. Recent reviews found that 14 of 27 interventions for depression [
] and 13 of 28 interventions for anxiety [ ] used a purpose-shifted approach, and the rest of the interventions were designed. However, the approach also comes with a considerable downside: researchers have limited opportunities to continue intervention development because they do not control the intellectual property, code, art assets, or delivery of the game.Differentiating among gamified games, serious games, and purpose-shifted entertainment games exhibits the variance in gDMHIs. Moreover, it contributes to understanding the developer’s approach and position between the 2 underlying paradigms: is the intervention a functional application to which game elements are added, an entertainment game whose purpose is shifted, or a tailor-made serious game? Because game-based interventions draw from both health care and entertainment, there is a need to consider both perspectives in their development.
Bridging the Paradigms of Health Care and Entertainment
The TEME Framework
Overview
Interventions are intended for a particular audience who, by interacting with the interventions, hopefully, achieve positive changes that are explained by the interventions’ mechanisms of action [
- ]. To contrast and discuss the paradigms of health care and entertainment, we focus on 4 interrelated themes that are necessary, but not sufficient, for the development of new products ( ). We acknowledge that other aspects are also necessary, including privacy [ , ] and integration with existing infrastructure [ ]. However, we consciously focus on the 4, as they are illustrative of the differences between and strengths of the 2 paradigms and serve to solve the tension between them.Theme | Key question | Health care | Entertainment |
Target audience | Who is the intervention engaging and effective for? | Health indication and user characteristics frame the target audience. | Differences in game preferences create various audiences. |
Engagement | Does the user want to interact with the intervention? | Engagement is associated with effective mechanisms of action. | Subjective and objective engagement are measured. |
Mechanisms of action | What explains the intervention effects? | The mechanisms of action are evidence based. | The mechanisms of action are synergistic with their game-based implementation. |
Effectiveness | What does the intervention achieve? | The intervention helps achieve behavioral change and symptom reduction. | Interaction is satisfying and fulfills the players’ psychological needs. |
Target Audience: Who Is the Intervention Engaging and Effective for?
Intervention development begins with the target audience’s needs [
]. In mental health, there are 2 main ways in which user needs are conceptualized: a diagnostic approach and transdiagnostic approach [ ]. The former frames the need through diagnostic taxonomies, and the latter focuses on a particular symptom or health-related behavior. However, both approaches frame the intervention in terms of a health indication, and it is the health care paradigm that provides the initiative; goal; and, consequently, methods for evaluating the intervention’s success.Health indications, such as ADHD, schizophrenia, and depression, create the initial frame for the target audience. However, the actual target market is a subpopulation of this total addressable market influenced by several implicit factors. Users’ age, gender, education, personality, and prior experiences with mental health services and the severity of their symptoms influence user engagement [
]. Knowing these background factors provides an opportunity to target audiences that favor digital interventions and to extend the intervention reach to new and underserved audiences through inclusive and participatory design [ ]. Although our discussion emphasizes the end user, the intervention’s target audience may also include other stakeholders, such as therapists in case of interventions that blend web-based and face-to-face therapies [ ].Besides the factors influencing DMHI use in general, some aspects influence user engagement with gDMHIs specifically. This reflects the considerable differences in users’ game preferences [
]. Appreciating the divergence in player motivations goes back to Bartle [ ], who noticed that the players of multiuser dungeons (an obsolete multiplayer game genre) engage with the games for divergent reasons and in different ways. On the basis of “a long, heated discussion,” he identified the following 4 motivations to play: achievers play to pursue game-related goals, explorers seek to understand the fictional game world, socializers focus on role playing and interacting with others, and killers compete for dominance through conflict. Bartle’s [ ] insight was that players engage in an apparently similar activity for widely different reasons and use the affordances of the game to serve their preferences. Since his original work, player motivations have been explored further. A review of 12 player typologies found that there is surprising conceptual uniformity in the categorizations, concluding with 5 primary player motivations, adding immersion¸ which is concentration on the story, fantasy, and narrative, to Bartle’s original 4 [ ]. In addition to affecting how games are played, game preferences influence which games are played. Using survey data, Mandryk and Birk [ ] classified players into 4 categories: those who appreciate single-player games, those who appreciate first-person shooter or action games, those who appreciate casual games, and those who appreciate most genres. Moreover, the researchers found that their categorization was not associated with depression, indicating that people with depression appreciate various genres. Thus, the game genre decision partly defines who finds the genre attractive and engaging.We advocate an integrative approach to the target audience. The health indication provides a rationale for the intervention and limits the target audience. In addition to the factors influencing engagement with DMHIs, the chosen game genre influences who are drawn to the game-based intervention, continue to engage with it, and hence gain a positive impact from the interaction. Understanding the target audience allows developers to identify and cater to the variance in the users, their needs, play styles, and preferences and to remove frictions that prevent players from enjoying the intervention as much as they expect to.
Engagement: Does the User Want to Interact With the Intervention?
The user’s motivation to interact with the gDMHI is to gain certain benefits and enjoy their time while doing so. According to concepts proposed by Siriaraya et al [
], the “therapeutic value” of the intervention is a function of its “game value”: the more experientially pleasurable the intervention is, the more likely the player is to continue to interact with it. These 2 concepts are related through the behavioral change that the interaction invites. The capability, opportunity, motivation, and behavior (COM-B) system describes 3 antecedents for behavioral change [ ]. To build the user’s capabilities, opportunities, and motivation, the intervention can, for instance, educate, persuade, train, and model new behaviors, which we call the mechanisms of action. Behavioral change can lead to symptom change [ ], although often after a significant delay of days and weeks, which should motivate attention to the player experience.Mere interaction with the intervention, however, is not sufficient, which Yardley et al [
] highlighted through the concepts of microlevel and macrolevel engagement. For instance, an exergame delivers its effects when the user trains with it, exhibiting microlevel engagement. This may turn into macrolevel engagement with the broader goals of the intervention when the intervention teaches the user healthy exercise routines and encourages the transfer of new behavior outside the immediate interaction. Thus, unlike commercial entertainment games, whose success is often closely tied to microlevel engagement, gDMHIs are driven by 2-tier engagement, and a successful intervention becomes obsolete once the player has internalized the intended change, which is a considerable digression from the entertainment paradigm. Subjectively, microlevel engagement may be experienced as a reduced effort to interact with the intervention. Subjectively, microlevel engagement may be experienced as a reduced effort to interact with the intervention [ ]. This is also what the player may expect from a game-based approach: when the intervention is introduced through the notions of “game” and “play,” they allude to interactions that are more pleasurable than those with solutions more strongly associated with a functional approach.To design for microlevel engagement, the concept needs a clear definition and metrics. Here, we turn to Perski et al [
], who provide a useful definition: “(1) the extent (eg, amount, frequency, duration, depth) of use and (2) a subjective experience characterized by attention, interest and affect.” The 2 sides represent complementary aspects of engagement, objective and subjective aspects, which require different approaches in their evaluation [ , ]. The subjective criteria may be pursued through qualitative research, such as user interviews, think-aloud protocols, and focus groups that provide rich and detailed qualitative data on engagement [ ], or swiftly through questionnaires [ ]. Subjectively, high levels of engagement with gDMHIs may be experienced as immersion, where the player becomes unaware of the mediating technology, perceiving the interaction as unmediated [ ]. The phenomenon is also known as presence, a sense of being “in the game.” It has many similarities to the notion of flow, where the subject is absorbed in the task and becomes unaware of their surroundings [ , , ]. This pleasurable mental state is the experiential value players seek from the game and manifests as a sense of “want to” rather than “have to” engage with the game [ ].To complement the evaluation of a subjective sense of engagement, game analytics can provide objective indicators of engagement. Among the strongest and most valuable tools in commercial entertainment game development, game analytics provides proof, also in business terms, that the target audience enjoys spending time with the game [
]. User analytics offers insights into microlevel engagement by measuring the time spent with the intervention, accompanied by metrics of retention, that is, players returning to the intervention.Entertainment games are a medium focused on building engagement that is experienced as immersion. This provides the developers with a user-centered goal that can be evaluated both subjectively and objectively. The health care paradigm complements the approach by ensuring that evidence-based mechanisms of action are in place so that user interaction contributes to the expected health benefits.
Mechanisms of Action: What Explains the Intervention Effects?
Overview
Mechanisms of action explain how and why the intervention achieves the intended change in the user’s behavior and symptoms [
]. They have also been called “mechanisms of change” [ ], and “intervention functions” [ ], and they include sharing knowledge, building motivation, changing beliefs, modeling new behaviors, and persuading change. In game-based interventions, these rationales are given a digital form through their game-based implementation. Next, we describe and contrast 3 common and distinct approaches to game-based interventions: adapting existing psychotherapies, offering cognitive training, and encouraging physical exercise ( ).Approach | Mechanisms of action | |
Health care: “what” | Entertainment: “how” | |
Adapting existing psychotherapies | Behavior change through an increase in mentalization capabilities | Narrative and story-driven implementations |
Offering cognitive training | Training cognitive functions such as attention | High-paced action games |
Encouraging physical exercise | Increased physical activity | Virtual reality, augmented reality, and fitness games |
Adapting Existing Psychotherapies
Numerous existing psychotherapies have been adapted as gDMHIs, the most prominent of which is cognitive behavioral therapy [
, ]. There are numerous benefits to using an existing therapy to guide the development work: it provides a theoretical foundation, a rationale on how and why the intervention should work, credibility with stakeholders, and legitimacy for the work. Despite the differences between psychotherapies, their effects seem curiously similar [ ]. It has been suggested that there are common factors that explain their effectiveness [ ], although the research is ongoing [ ]. Leiman [ ] conceptualized that all psychotherapies seek to change the patient’s position toward their challenges. When the client begins the therapy process, they are in an object position to their problem. Through therapy, they gain an understanding of their problem and capabilities to control it and, consequently, shift toward a subject position. Thus, the effectiveness of psychotherapy is based on the growth of mentalization capabilities and self-reflection, which then lead to behavioral changes.Narratively rich game genres, such as role-playing and adventure games, may be particularly suited for adaptations of existing psychotherapies that invite an active reflection on one’s thoughts, emotions, and behaviors. The interactions with game characters can be used to, for instance, simulate challenging social situations through role playing, model effective behaviors, and develop emotional regulation. An example of this approach is SPARX, a serious game for adolescents living with depression. The computerized CBT intervention consists of 7 modules, including psychoeducation, building hope, encouraging behavioral activation, and coping with negative emotions [
].Offering Cognitive Training
Compared with psychotherapeutic approaches, the mechanisms of action of cognitive training games are considerably different. Their rationale lies in the finding that many mental disorders are associated with cognitive deficits [
]. For instance, depression is related to moderate deficits in memory, attention, and executive function, and these deficits may prevail partly even after depression is in remission [ ]. Computerized interventions have been designed to address these deficits, and this approach has been found effective in addressing depressive symptoms [ ].Compared with reflective psychotherapeutic games that rely on player interaction with the narrative, characters, and story, the mechanisms of action in cognitive training games are more closely associated with the game mechanics. For instance, fast-paced first-person shooter games, real-time strategy games, and other action games may provide pathways for improving cognitive skills [
] and alleviating cognitive deficits associated with mental health challenges. Furthermore, the mechanisms of action may also be related to game preferences: reflective therapies may be preferred by those with a tendency for immersion and socialization, whereas cognitive training games appeal to achievement, exploration, and domination motives. Bearing in mind that fast-paced games are preferred by younger audiences [ ], the interventions may be suited to addressing cognitive deficits associated with mood or neuropsychological disorders in the youth. An example of this approach is EndeavorRx, a gDMHI that seeks to alleviate pediatric ADHD [ ].Encouraging Physical Activity
To further contrast the mechanisms of action of reflective psychotherapeutic games and those of cognitive training games, the effectiveness of exergames is dependent on increasing physical activity. The rationale lies in the finding that physical exercise has significant and large antidepressant effects [
, ]. For instance, the augmented reality game Pokémon Go, which encourages finding, gathering, and collecting digital fantasy pets from various real-life locations, has been found to contribute to a greater number of daily steps and increased social interactions because the locations are frequented by like-minded players [ ]. These interactions, in turn, may have positive effects on mood [ ]. It appears that the interventions that encourage physical activity often use a purpose-shifted approach facilitated by the availability of exergames [ - , ]. Currently, however, the quality of evidence on the effectiveness of exergames for mental disorders is low.We highlight how development efforts need to find the synergy between the health research–based mechanisms of action and their game-based implementation. The 3 described mechanisms of action, built on existing psychotherapies, cognitive training, and physical exercise, exemplify how health care research can intertwine with the game genre implementation.
Effectiveness: What Does the Intervention Achieve?
The effectiveness of gDMHIs is indicated by behavioral and symptom changes [
, ]. Reaching a meaningful reduction in symptom scores indicates a clear benefit expected by clinicians and the players and payers of the intervention alike. To complement the symptom- or disorder-focused approach, the intervention may have other, equally meaningful benefits that occur in parallel or in addition to the symptom change. As the World Health Organization (WHO) [ ] states in its constitution, “health is a state of complete physical, mental and social well-being and not merely the absence of disease or infirmity.” In subjective terms, symptom alleviation may be related to improved quality of life [ ]. To illuminate the complexity of the concept, a qualitative synthesis of the experiences of people with mental disorders found that good quality of life was associated with feelings of well-being, positive self-perception, control, autonomy, a sense of belonging, participation in meaningful activities, and a positive future view [ ]. In other words, an improved quality of life is not perceived merely as the absence of symptoms.Expanding from the symptom-based approach, the impact of gDMHIs may be considered through the self-determination theory [
]. It describes the following 3 universal human needs that contribute to intrinsic motivation, self-regulation, and well-being: competence, autonomy, and relatedness. Digital games have a unique possibility to contribute to the 3 needs by fostering a sense of competence by presenting the players with increasingly difficult puzzles as their skill increases, creating a sense of connection with other players enjoying similar activities, and supporting player autonomy by offering choices and various ways to play. As opposed to mediums that are more passively consumed, games are characterized by a sense of agency [ ]: the player does not spectate the protagonist but becomes them, controls them, and sees the fiction through them. By answering to the players’ needs, game-based interventions can have positive effects across the cognitive, social, and emotional spheres [ ].However, whether the interaction serves the underlying human needs depends on both the game design and the players’ mindset. Games that serve the players’ needs are associated with continued motivation to play [
, ] and affective well-being [ ]. When the players use the game to fulfill their psychological needs, playing can be viewed as adaptive and healthy [ ], whereas using the game as an avoidance behavior is associated with mental distress and problematic gaming [ ]. Thus, creating designs that answer to the players’ deeper psychological needs and encourage healthy playing styles is vital.User interaction with the gDMHI produces a vast amount of data, including behavioral biomarkers [
], which may contribute toward understanding the psychological needs, mechanisms of action, and mental well-being beyond the disorders. Players’ interaction with the game mechanics and puzzles provides indications of their motor and cognitive performances, which are particularly useful in cognitive training interventions. Players’ affective states and changes in their social interactions may be derived from their text-based outputs and interactions with other players, which contributes to therapies that use reflective approaches. However, the use of behavioral biomarkers as outcome measurements is only growing. Recently, they have been used, for instance, in the assessment of social anxiety [ ], mood disorders [ ], and mild cognitive impairment [ ].To summarize, gDMHIs are expected to contribute to a significant reduction in mental health symptoms, which is preceded by player engagement and behavior change [
]. Thus, the overall effects of the intervention may extend beyond the symptom change that the digital medium affords to accurately measure. Leveraging in-game data provides corroboratory insights into why and to what extent the interventions are effective, including in terms of broader psychological needs. This contributes to understanding how the interaction impacts a user’s behavior, which is, hopefully, generalized in the broader context of the user’s life [ ], exhibiting macrolevel engagement.Translating the TEME Framework to Intervention Development
Overview
New product development is a gradual, evolving process [
, ]. It can be described in phases, bearing in mind that the research, design, and development efforts, particularly in a novel domain, are often characterized by exploration, iteration, looping back to earlier phases, and redesign based on feedback. Therefore, the development phases should be considered nonlinear.We summarized gDMHI development into 4 phases (
). The design begins with research into the target audience and their needs, which are performed through a high-level concept that outlines the intervention. The intervention, as well as the service concept more broadly, is advanced iteratively during development. The evaluation of the intervention likewise gradually grows more comprehensive, culminating in a randomized controlled trial (RCT) that is valued as a particularly strong proof in health care. Should the results prove favorable, the solution may be implemented, and its development may continue in live production.Theme | Concept design | Development | Evaluation | Production |
Target audience: who is the intervention engaging and effective for? | HF | HF | LF | LF |
Engagement: do users interact with the intervention? | LF | HF | HF | HF |
Mechanisms of action: what explains the intervention effects? | HF | LF | LF | LF |
Effectiveness: what does the intervention achieve? | LF | LF | HF | LF |
Throughout the 4 phases, the focus of the development team fluctuates between the paradigms of health care and entertainment: designing an effective health care intervention and an engaging video game experience [
], pursuing instrumental and experiential outcomes [ ], or, in other words, creating therapeutic value and game value [ ]. The 2 complementary perspectives intertwine through the development process.Concept Design: A Model for Addressing the Target Audience’s Needs
The concept provides an overview of what the intervention is, which is intimately related to the following question: who is it for? Understanding the target audience and their contextual needs and preferences allows defining the characteristics of the intervention [
, , ]. Interviews, questionnaires, focus groups, desk research, and ethnography can be used to create a rich understanding of the target audience’s preferences, media used, and target audience's thoughts about and frictions with the existing solutions and services. However, the tools are secondary to the aim of shifting one’s perspective through empathy, which is a cornerstone of design [ ]. In fact, several development frameworks, models, and philosophies focus on users. They include participatory design [ ]; service design [ ]; persuasive design [ ]; and user-centered design [ ], which is also common in gDMHI design. A study exploring 20 development processes found that 50% of them adopted a user-centered approach in the concept phase, and the rest invited user participation in the development phase [ ]. Accentuating the importance of users reflects the threats of overly focusing on the solution instead of the need it addresses, which may lead to users rejecting the intervention, and necessitating costly changes later in the development [ , ]. Starting from the target audience, as well as other necessary stakeholders, facilitates the definition of the intervention objectives, technology, and game genre [ ].It is a common misconception that user research would directly inform the design. Users can describe their experiences with existing solutions, but developers are responsible for integrating the understanding into a model that considers the mechanisms of action, technological possibilities, stakeholder dependencies, commercialization, and regulations. Often, the digital concept aims to challenge the dominant, nonscalable, one-to-one, and in-person model of mental health service delivery [
]. The concept can also include considerations of the business model: how the intervention is priced, purchased, and compensated [ ]. In contrast to the entertainment industry, which is dominated by the direct-to-consumer model, where the player chooses, uses, and pays for the game, health care characteristically includes more complicated commercial models. Aitken and Nass [ ] described 4 such commercial models: direct-to-consumer model, where the user pays for the service; device-like reimbursement model, where the cost of the intervention is covered by the medical benefit plan when the intervention is prescribed by a physician; drug-like reimbursement model, which relates the intervention to pharmacy benefit; and value-based contracting, where the intervention is provided for an organization and paid per the benefits achieved. Thus, the preliminary documented concept is a user-centered account of whom the team is designing for, a science-based account of how the intervention contributes to the user’s health, and a description of the intended commercial model.Development: Iterating the Design and Planning Its Implementation
During development, the team gradually turns the concept into an actual intervention. The phase is iterative: it oscillates between design and testing, which seeks to ensure that the team is progressing in the right direction [
, , ]. During development, the team can make use of methods from entertainment, which allow the team to focus specifically on the intervention features, and methods from health care, which focus on establishing and implementing the intervention in the complex health care ecosystem.The success of games is tied to the experience they create [
]. There are various perspectives on game experience [ ]; however, in general, it is built of layers, as the user interacts alone or with other players with the game system, its look and feel, and the underlying systems. The interaction leads to an experience that the player may find immersive, motivating, and pleasurable. Entertainment game design has a wealth of methodologies that can be used to hone the game-user interaction [ - ], which acts as a focus point for the interdisciplinary efforts in visual and audio design, software development, and storytelling [ ].The business-to-consumer digital entertainment industry has established distribution platforms that allow developers to focus on game development. Health care, in contrast, currently lacks such global, or even national, distribution platforms. Therefore, it is important to design for feasibility and consider the implementation of the intervention early [
]. If the intervention is introduced into an organizational context, it needs to fit the existing practices, improve current processes, and integrate with the existing software solutions [ ]. In fact, many interventions are expected not only to offer end user benefits but also to be easy to adopt and contribute to organizational efficiency. The Non-adoption and Abandonment of technologies, and the challenges to Scale-up, Spread, and Sustainability of such technologies (NASSS) framework structures the complex health care environment in which the intervention may be implemented [ ]. It highlights the interrelations among the health condition, technology, value proposition, stakeholders adopting the solution, and their organizational and wider context over time. In conclusion, the development process gradually builds not only the digital intervention, in the narrow sense of the word, but also the related services and the operating models that sustain it.Evaluation: Progressive and Comprehensive Intervention Evaluation
The evaluation of the intervention grows gradually more comprehensive. In development, the intervention is tested for its playability and game experience, ensuring that the game-based intervention is found sufficiently favorable by the players in the target audience [
] and is meaningful for other stakeholders. As the development progresses, there is increasing interest in evaluating the intervention’s health-related effectiveness. A feasibility study, a higher-order concept than playtesting, focuses on the following question: can the intervention work? [ ]. Feasibility studies allow for evaluating whether the intervention can attract the appropriate target audience, understanding how acceptable the participants consider the intervention and its procedures, and understanding how the intervention is to manage in practice and contribute to the development of data collection methodologies. However, a feasibility study provides only initial indications of the intervention’s effectiveness. Pilot studies can create stronger, although inconclusive, evidence of intervention effectiveness [ ]. Should the intervention pass the preliminary evaluations, an RCT can be conducted. It provides high-quality evidence on the effectiveness and safety of the intervention for regulators, clinical stakeholders, and the scientific community. However, because conducting an RCT is demanding, expensive, and slow, progressing to them without ensuring the overall feasibility of the intervention is not advised [ ].It is important to evaluate the intervention comprehensively beyond the summative results: formative evaluation can provide insights into how and why the intervention is or is not successful in its context [
]. Qualitative research can contribute to understanding the intervention’s impact and player experience [ , ], and evaluating engagement creates insights into the intervention’s feasibility, acceptability, attractiveness, and dose-response relationship. However, the evaluation of engagement is often lacking, and there is substantial heterogeneity in how it is reported [ , ]. One approach is reporting the following 6 factors: the number of users, their profiles, the number of modules in the intervention, the number of times they are accessed, the percentage of users receiving a therapeutic dose, and the achieved clinical change [ ]. Economic evaluation is not to be overlooked either, as it often forms the rationale for adopting a digital approach. Economic evaluation can be performed to understand, for instance, the cost-effectiveness of the intervention and to guide strategic decision-making and investments [ ].We encourage a progressive and comprehensive evaluation of the intervention, that is, considering the subjective user experience and objective engagement alongside the clinical metrics. Complementing summative evaluation with formative and economic evaluations allows for an understanding of the intervention feasibility and whether the benefits justify the costs, which facilitates translating the research to complex real-world environments should the intervention prove both effective and engaging.
Production: Implementing the Intervention in Real Life
When the intervention works in controlled research settings, it may be implemented in more complex, real-life settings. Following the principle of path dependence, the decisions made in the earlier stages regarding, for instance, the health indication, mechanisms of action, game genre, and technical implementation continue to exercise their influence in the production phase. Building on the established foundation, the attention turns to marketing, service production, partnerships, and continuing development.
Implementing the intervention often encounters challenges: the research-to-practice gap [
]. Common barriers include user preference for face-to-face therapies, the perceived complexity of the digital intervention, limited research evidence regarding the intervention, low user engagement, the costs of the intervention, and practitioners’ resistance. To overcome these challenges and achieve real-world impacts, developers should prepare for them using numerous models [ , , ]. The Reach, Efficacy, Adoption, Implementation, and Maintenance (RE-AIM) model provides an overview of the components necessary for creating an impact on a population level: the intervention needs to reach a broad audience, be effective, be adopted in numerous settings, be implemented as intended, and be maintained over time [ ]. Thus, besides the need for the intervention to be proven effective, the implementation of the intervention demands marketing and organizational support for dissemination. Another useful perspective is the consolidated framework for implementation research, which consists of 5 domains [ ]. Intervention implementation is dependent on the intervention characteristics, relationship of the intervention with external stakeholders, organization’s internal capabilities to produce the service, individuals within the organization delivering the intervention, and implementation processes. Outside the research setting, the development team needs to consider ways to deliver the intervention to users en masse, which demands changes in organizational structures and service management.Should the intervention reach a sufficiently considerable population, the developers may begin to view the software as a continuous service. Here, methodologies already in use in game development may prove useful. In contrast to the earlier, linear development process that considered the launch of the game the conclusion to the development, the prevailing game as a service model focuses attention also on postlaunch development [
]. This approach, also called live operations, relies on using business metrics and user feedback to guide the continuous development efforts and add new content [ ]. In the future, there is potential in considering gDMHIs as a continuous, evolving service rather than unaltered products [ ]. However, it is still unclear to what degree the digital intervention may be developed while retaining the effects and evidence gathered in the previous stages, and there is little research on gDMHI live operations. This reflects the nascent industry that is still waiting for successful interventions to attract a large number of users to fund the continuous research and development of a live product.Discussion
Summary
gDMHIs use elements of entertainment games to achieve health-related outcomes. We describe how these interventions draw from the health care and entertainment paradigms (
) and categorize them in a continuum between the two ( ). We then introduce 4 themes, the TEME framework ( ), to negotiate between the 2 paradigms and facilitate their interdisciplinary development from concept design to production ( ).Contributions to the Development Research
Previous research has discussed the tension of interventions being both engaging and effective [
- ]. By contrast, the existing development frameworks have facilitated the development of behavioral interventions, digital interventions, and serious games for health [ - ]. We expand on the prior literature by elaborating, contrasting, and negotiating the differences between the paradigms of health care and entertainment. The paradigm of health care frames and measures user needs through diagnoses and behavior, has expansive research on mechanisms of action, and is unrelenting in its focus on proving effectiveness, yet it has a shorter history in crafting and implementing engaging experiences in the digital setting. Meanwhile, digital entertainment leads and pioneers in this field. It has expansive practices in iteratively creating immersive experiences in numerous game genres and has advanced development methodologies to measure and design for subjective and objective engagement. However, the entertainment paradigm lacks an understanding of the health indications, mechanisms of action, and health care ecosystem. Thus, the interdisciplinary gDMHI development requires broad competencies in both paradigms and their methods: the digital game–based medium and the health care context.The TEME framework supports interdisciplinary collaboration by focusing on 4 themes necessary for development: understanding the target audience, ensuring that the intervention is found favorably by them, basing the intervention on proven mechanisms of action, and ensuring its effectiveness. When the 4 themes are reflected in development, developers can seek synergy between health care research and the game-based medium. Common approaches include adapting existing psychotherapies, offering cognitive training, and encouraging physical exercise. However, there are also other developments to be imagined and researched: perhaps the genre of peaceful and serene walking simulators [
] characterized by the ponderous, slow pace could be used to encourage mindfulness practice, or web-based communities could be used to offer peer support, a sense of belonging, and empowerment [ ]. We encourage iterative intervention development and evaluation beyond symptom change, considering the behavioral, economic, and organizational impacts.Earlier, gamification and serious games were considered 2 distinct lines of research [
]. Taking an integrative stance, we suggest that gamified interventions, serious games, and purpose-shifted digital entertainment games can also be viewed as a continuum between health care and entertainment. This distinction contributes a novel perspective to the classification of serious games and serious games in health [ , , ], allowing an understanding of the developer’s position between the 2 approaches.Earlier, Fleming et al [
] called for a paradigm shift in the development of digital interventions. In particular, they suggested increasing efforts in user-centered design, creating engaging interventions, fostering collaboration, and conducting rapid testing and implementation. Building on these principles, we describe how the development of gDMHIs requires using the strengths of both digital entertainment and health care through an integrative, interdisciplinary framework.Conclusion: Game-Based Elements Are More Than a Spoonful of Sugar
“In every job that must be done/There is an element of fun/You find the fun and snap!/The job’s a game,” said supernanny Mary Poppins when instructing unwilling children on how to get their chores done. With the mindset shift, the mislaid items find their place through the magic of motivation. Similarly, the effectiveness of a gDMHI depends on the design’s ability to conjure motivation and identification with the change in the users. Engagement and effectiveness depend on the target audience, the underlying mechanisms of action, and their execution as a game. When successful, the game-based approach is more than adding a spoonful of sugar to sweeten an otherwise uninteresting task. Rather, it allows creating interventions that bridge the treatment, engagement, and implementation gaps: they allow expanding intervention reach, inspire effective engagement, and allow viable intervention production.
Acknowledgments
This research was funded by the Technology Industries of Finland Centennial Foundation and Jane and Aatos Erkko Foundation Future Makers funding program “New Game Technologies to Create Digital Medicine for Neural Disorders and Sustaining Brain Health” granted to JMP. The authors would like to thank Isaac Moshe and Otso Saariluoma for their comments on the early versions of the manuscript, as well as the peer reviewers for their valuable feedback.
Authors' Contributions
LL originated the concept of the paper and wrote the manuscript. JMP revised the manuscript and contributed to the approach and structure of the manuscript.
Conflicts of Interest
None declared.
References
- Liu Q, He H, Yang J, Feng X, Zhao F, Lyu J. Changes in the global burden of depression from 1990 to 2017: findings from the Global Burden of Disease study. J Psychiatr Res. Jul 2020;126:134-140. [FREE Full text] [CrossRef] [Medline]
- Abd-Alrazaq A, Alajlani M, Alhuwail D, Schneider J, Akhu-Zaheya L, Ahmed A, et al. The effectiveness of serious games in alleviating anxiety: systematic review and meta-analysis. JMIR Serious Games. Feb 14, 2022;10(1):e29137. [FREE Full text] [CrossRef] [Medline]
- Abd-Alrazaq A, Al-Jafar E, Alajlani M, Toro C, Alhuwail D, Ahmed A, et al. The effectiveness of serious games for alleviating depression: systematic review and meta-analysis. JMIR Serious Games. Jan 14, 2022;10(1):e32331. [FREE Full text] [CrossRef] [Medline]
- Fitzgerald M, Ratcliffe G. Serious games, gamification, and serious mental illness: a scoping review. Psychiatr Serv. Feb 01, 2020;71(2):170-183. [CrossRef] [Medline]
- Zheng Y, Li R, Li S, Zhang Y, Yang S, Ning H. A review on serious games for ADHD. arXiv.. Preprint posted online March 31, 2021 [FREE Full text] [CrossRef]
- Silva GM, Souto JJ, Fernandes TP, Bolis I, Santos NA. Interventions with serious games and entertainment games in autism spectrum disorder: a systematic review. Dev Neuropsychol. Oct 01, 2021;46(7):463-485. [CrossRef] [Medline]
- Cheng VW, Davenport T, Johnson D, Vella K, Hickie IB. Gamification in apps and technologies for improving mental health and well-being: systematic review. JMIR Ment Health. Jun 26, 2019;6(6):e13717. [FREE Full text] [CrossRef] [Medline]
- Fleming TM, Bavin L, Stasiak K, Hermansson-Webb E, Merry SN, Cheek C, et al. Serious games and gamification for mental health: current status and promising directions. Front Psychiatry. Jan 10, 2017;7:215. [FREE Full text] [CrossRef] [Medline]
- Mathews SC, McShea MJ, Hanley CL, Ravitz A, Labrique AB, Cohen AB. Digital health: a path to validation. NPJ Digit Med. May 13, 2019;2:38. [FREE Full text] [CrossRef] [Medline]
- Verschueren S, Buffel C, Vander Stichele G. Developing theory-driven, evidence-based serious games for health: framework based on research community insights. JMIR Serious Games. May 02, 2019;7(2):e11565. [FREE Full text] [CrossRef] [Medline]
- van Gemert-Pijnen JE, Nijland N, van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, et al. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res. Dec 05, 2011;13(4):e111. [FREE Full text] [CrossRef] [Medline]
- Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. Apr 23, 2011;6:42. [FREE Full text] [CrossRef] [Medline]
- Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for internet interventions. Ann Behav Med. Aug 2009;38(1):18-27. [FREE Full text] [CrossRef] [Medline]
- GBD 2019 Mental Disorders Collaborators. Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet Psychiatry. Feb 2022;9(2):137-150. [FREE Full text] [CrossRef] [Medline]
- Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. Nov 2004;82(11):858-866. [FREE Full text] [Medline]
- Alonso J, Liu Z, Evans-Lacko S, Sadikova E, Sampson N, Chatterji S, et al. WHO World Mental Health Survey Collaborators. Treatment gap for anxiety disorders is global: results of the World Mental Health Surveys in 21 countries. Depress Anxiety. Mar 2018;35(3):195-208. [FREE Full text] [CrossRef] [Medline]
- Wright JH, Owen JJ, Richards D, Eells TD, Richardson T, Brown GK, et al. Computer-assisted cognitive-behavior therapy for depression: a systematic review and meta-analysis. J Clin Psychiatry. Mar 19, 2019;80(2):18r12188. [FREE Full text] [CrossRef] [Medline]
- Moshe I, Terhorst Y, Philippi P, Domhardt M, Cuijpers P, Cristea I, et al. Digital interventions for the treatment of depression: a meta-analytic review. Psychol Bull. Aug 2021;147(8):749-786. [CrossRef] [Medline]
- Andrews G, Basu A, Cuijpers P, Craske MG, McEvoy P, English CL, et al. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J Anxiety Disord. Apr 2018;55:70-78. [FREE Full text] [CrossRef] [Medline]
- Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther. Jan 2018;47(1):1-18. [CrossRef] [Medline]
- Gan DZ, McGillivray L, Han J, Christensen H, Torok M. Effect of engagement with digital interventions on mental health outcomes: a systematic review and meta-analysis. Front Digit Health. Nov 4, 2021;3:764079. [FREE Full text] [CrossRef] [Medline]
- Carpenter JK, Andrews LA, Witcraft SM, Powers MB, Smits JA, Hofmann SG. Cognitive behavioral therapy for anxiety and related disorders: a meta-analysis of randomized placebo-controlled trials. Depress Anxiety. Jun 16, 2018;35(6):502-514. [FREE Full text] [CrossRef] [Medline]
- Karyotaki E, Kleiboer A, Smit F, Turner DT, Pastor AM, Andersson G, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an 'individual patient data' meta-analysis. Psychol Med. Oct 2015;45(13):2717-2726. [FREE Full text] [CrossRef] [Medline]
- Cuijpers P, Noma H, Karyotaki E, Cipriani A, Furukawa TA. Effectiveness and acceptability of cognitive behavior therapy delivery formats in adults with depression: a network meta-analysis. JAMA Psychiatry. Jul 01, 2019;76(7):700-707. [FREE Full text] [CrossRef] [Medline]
- Garrido S, Millington C, Cheers D, Boydell K, Schubert E, Meade T, et al. What works and what doesn't work? A systematic review of digital mental health interventions for depression and anxiety in young people. Front Psychiatry. Nov 13, 2019;10:759. [FREE Full text] [CrossRef] [Medline]
- Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, Merry S. Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res. Jun 06, 2018;20(6):e199. [FREE Full text] [CrossRef] [Medline]
- Graham AK, Lattie EG, Powell BJ, Lyon AR, Smith JD, Schueller SM, et al. Implementation strategies for digital mental health interventions in health care settings. Am Psychol. Nov 2020;75(8):1080-1092. [FREE Full text] [CrossRef] [Medline]
- Singal AG, Higgins PD, Waljee AK. A primer on effectiveness and efficacy trials. Clin Transl Gastroenterol. Jan 02, 2014;5(1):e45. [FREE Full text] [CrossRef] [Medline]
- 2022 essential facts about the video game industry. Entertainment Software Association. Jun 2022. URL: https://www.theesa.com/resource/2022-essential-facts-about-the-video-game-industry/ [accessed 2023-08-18]
- Gaming: the next super platform. Accenture. Apr 27, 2021. URL: https://www.accenture.com/gb-en/insights/software-platforms/gaming-the-next-super-platform [accessed 2023-08-18]
- Kinnunen J, Taskinen K, Mäyrä F. Pelaajabarometri 2020: Pelaamista koronan aikaan. Tampere University. 2020. URL: https://trepo.tuni.fi/handle/10024/123831 [accessed 2023-08-18]
- Aitken M, Nass D. Digital health trends 2021: innovation, evidence, regulation, and adoption. IQVIA Institute for Human Data Science. Jul 22, 2021. URL: https://www.iqvia.com/insights/the-iqvia-institute/reports/digital-health-trends-2021 [accessed 2023-08-18]
- Gren M, Zierhofer W. The unity of difference: a critical appraisal of Niklas Luhmann's Theory of social systems in the context of corporeality and spatiality. Environ Plan A. Apr 01, 2003;35(4):615-630. [CrossRef]
- Roth S, Schütz A. Ten systems: toward a canon of function systems. Cybern Syst Anal. Dec 2015;22(4):11-31. [FREE Full text] [CrossRef]
- Engel GL. The need for a new medical model: a challenge for biomedicine. Science. Apr 08, 1977;196(4286):129-136. [CrossRef] [Medline]
- McKee A, Collis C, Nitins T, Ryan M, Harrington S, Duncan B, et al. Defining entertainment: an approach. Creative Ind J. Oct 06, 2014;7(2):108-120. [CrossRef]
- Max-Neef MA, Elizalde A, Hopenhayn M. Human Scale Development Conception, Application and Further Reflections · Volume 1. Muscat, Oman. Apex Press; 1991.
- Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. Nov 2016;51(5):833-842. [CrossRef] [Medline]
- Liu D, Santhanam R, Webster J. Toward meaningful engagement: a framework for design and research of gamified information systems. MIS Q. Apr 4, 2017;41(4):1011-1034. [CrossRef]
- Siriaraya P, Visch V, Boffo M, Spijkerman R, Wiers R, Korrelboom K, et al. Game design in mental health care: case study-based framework for integrating game design into therapeutic content. JMIR Serious Games. Dec 01, 2021;9(4):e27953. [FREE Full text] [CrossRef] [Medline]
- Marsh T. Serious games continuum: between games for purpose and experiential environments for purpose. Entertain Comput. Jan 2011;2(2):61-68. [CrossRef]
- Murphy-Hill E, Zimmermann T, Nagappan N. Cowboys, ankle sprains, and keepers of quality: how is video game development different from software development? In: Proceedings of the 36th International Conference on Software Engineering. Presented at: ICSE '14; May 31-June 7, 2014, 2014; Hyderabad, India. [CrossRef]
- Kasurinen J. Games as software: similarities and differences between the implementation projects. In: Proceedings of the 17th International Conference on Computer Systems and Technologies 2016. Presented at: CompSysTech '16; June 23-24, 2016, 2016; Palermo, Italy. [CrossRef]
- Schell J. The Art of Game Design A Book of Lenses, Second Edition. Milton Park, UK. Taylor & Francis; 2015.
- Zimmerman E, Salen K. Rules of Play: Game Design Fundamentals. Cambridge, MA. The MIT Press; 2003.
- Sánchez JL, Vela FL, Simarro FM, Padilla-Zea N. Playability: analysing user experience in video games. Behav Inf Technol. Oct 2012;31(10):1033-1054. [CrossRef]
- Deterding S, Dixon D, Khaled R, Nacke L. From game design elements to gamefulness: defining "gamification". In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments. Presented at: MindTrek '11; September 28-30, 2011, 2011; Tampere, Finland. [CrossRef]
- Floryan MR, Ritterband LM, Chow PI. Principles of gamification for internet interventions. Transl Behav Med. Nov 25, 2019;9(6):1131-1138. [CrossRef] [Medline]
- Susi T, Johannesson M, Backlund P. Serious Games - An Overview. Technical Report HS-IKI-TR-01-001. University of Skovde. 2007. URL: https://www.researchgate.net/publication/220017759_Serious_Games_-_An_Overview [accessed 2023-08-18]
- Warsinsky S, Schmidt-Kraepelin M, Rank S, Thiebes S, Sunyaev A. Conceptual ambiguity surrounding gamification and serious games in health care: literature review and development of game-based intervention reporting guidelines (GAMING). J Med Internet Res. Sep 10, 2021;23(9):e30390. [FREE Full text] [CrossRef] [Medline]
- Wattanasoontorn V, Boada I, García R, Sbert M. Serious games for health. Entertain Comput. Dec 2013;4(4):231-247. [CrossRef]
- Drummond D, Hadchouel A, Tesnière A. Serious games for health: three steps forwards. Adv Simul (Lond). Feb 4, 2017;2(1):3. [FREE Full text] [CrossRef] [Medline]
- Mccallum S. Gamification and serious games for personalized health. Stud Health Technol Inform. Sep 2012;177:85-96. [FREE Full text] [CrossRef]
- Lau HM, Smit JH, Fleming TM, Riper H. Serious games for mental health: are they accessible, feasible, and effective? A systematic review and meta-analysis. Front Psychiatry. 2016;7:209. [FREE Full text] [CrossRef] [Medline]
- Johannes N, Vuorre M, Przybylski AK. Video game play is positively correlated with well-being. R Soc Open Sci. Feb 17, 2021;8(2):202049. [FREE Full text] [CrossRef] [Medline]
- Granic I, Lobel A, Engels RC. The benefits of playing video games. Am Psychol. Jan 2014;69(1):66-78. [CrossRef] [Medline]
- Kowal M, Conroy E, Ramsbottom N, Smithies T, Toth A, Campbell M. Gaming your mental health: a narrative review on mitigating symptoms of depression and anxiety using commercial video games. JMIR Serious Games. Jun 16, 2021;9(2):e26575. [FREE Full text] [CrossRef] [Medline]
- Daneels R, Bowman ND, Possler D, Mekler ED. The ‘eudaimonic experience’: a scoping review of the concept in digital games research. Media Commun. May 06, 2021;9(2):178-190. [CrossRef]
- Huckvale K, Prieto JT, Tilney M, Benghozi PJ, Car J. Unaddressed privacy risks in accredited health and wellness apps: a cross-sectional systematic assessment. BMC Med. Sep 07, 2015;13:214. [FREE Full text] [CrossRef] [Medline]
- Lagan S, Sandler L, Torous J. Evaluating evaluation frameworks: a scoping review of frameworks for assessing health apps. BMJ Open. Mar 19, 2021;11(3):e047001. [FREE Full text] [CrossRef] [Medline]
- Chan S, Torous J, Hinton L, Yellowlees P. Towards a framework for evaluating mobile mental health apps. Telemed J E Health. Dec 2015;21(12):1038-1041. [CrossRef] [Medline]
- Murray E, Hekler EB, Andersson G, Collins LM, Doherty A, Hollis C, et al. Evaluating digital health interventions: key questions and approaches. Am J Prev Med. Nov 2016;51(5):843-851. [FREE Full text] [CrossRef] [Medline]
- Dalgleish T, Black M, Johnston D, Bevan A. Transdiagnostic approaches to mental health problems: current status and future directions. J Consult Clin Psychol. Mar 2020;88(3):179-195. [FREE Full text] [CrossRef] [Medline]
- Borghouts J, Eikey E, Mark G, De Leon C, Schueller SM, Schneider M, et al. Barriers to and facilitators of user engagement with digital mental health interventions: systematic review. J Med Internet Res. Mar 24, 2021;23(3):e24387. [FREE Full text] [CrossRef] [Medline]
- Lattie EG, Stiles-Shields C, Graham AK. An overview of and recommendations for more accessible digital mental health services. Nat Rev Psychol. Jan 26, 2022;1(2):87-100. [CrossRef]
- Wentzel J, van der Vaart R, Bohlmeijer ET, van Gemert-Pijnen JE. Mixing online and face-to-face therapy: how to benefit from blended care in mental health care. JMIR Ment Health. Feb 09, 2016;3(1):e9. [FREE Full text] [CrossRef] [Medline]
- Yee N. The gamer motivation profile: what we learned from 250,000 gamers. In: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play. Presented at: CHI PLAY '16: The annual symposium on Computer-Human Interaction in Play; October 16-19, 2016, 2016; Austin, TX. [CrossRef]
- Bartle R. Hearts, clubs, diamonds, spades: players who suit MUDs. J MUD Res. 1996;1:19. [FREE Full text]
- Hamari J, Tuunanen J. Player types: a meta-synthesis. Transact Digit Games Res Assoc. Mar 24, 2014;1(2):29-53. [FREE Full text] [CrossRef]
- Mandryk RL, Birk MV. Toward game-based digital mental health interventions: player habits and preferences. J Med Internet Res. Apr 20, 2017;19(4):e128. [FREE Full text] [CrossRef] [Medline]
- Tang YY, Tang R, Posner MI, Gross JJ. Effortless training of attention and self-control: mechanisms and applications. Trends Cogn Sci. Jul 2022;26(7):567-577. [FREE Full text] [CrossRef] [Medline]
- Perski O, Blandford A, West R, Michie S. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Transl Behav Med. Jun 2017;7(2):254-267. [FREE Full text] [CrossRef] [Medline]
- Ng MM, Firth J, Minen M, Torous J. User engagement in mental health apps: a review of measurement, reporting, and validity. Psychiatr Serv. Jul 01, 2019;70(7):538-544. [FREE Full text] [CrossRef] [Medline]
- Attfield S, Kazai G, Lalmas M, Piwowarski B. Towards a science of user engagement (Position Paper). In: Proceedings of the fourth ACM international conference on Web search and data mining. Presented at: WSDM'11; February 9-12, 2011, 2011; Hong Kong, China. URL: https://www.researchgate.net/publication/228542640_Towards_a_science_of_user_engagement_Position_Paper
- Short CE, DeSmet A, Woods C, Williams SL, Maher C, Middelweerd A, et al. Measuring engagement in eHealth and mHealth behavior change interventions: viewpoint of methodologies. J Med Internet Res. Nov 16, 2018;20(11):e292. [FREE Full text] [CrossRef] [Medline]
- Denisova A, Nordin AI, Cairns P. The convergence of player experience questionnaires. In: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play. Presented at: CHI PLAY '16: The annual symposium on Computer-Human Interaction in Play; October 16-19, 2016, 2016; Austin, TX. [CrossRef]
- Lombard M, Ditton T. At the heart of it all: the concept of presence. J Comput Mediat Commun. Sep 01, 1997;3(2):JCMC321. [CrossRef]
- Boyle EA, Connolly TM, Hainey T, Boyle JM. Engagement in digital entertainment games: a systematic review. Comput Hum Behav. May 2012;28(3):771-780. [CrossRef]
- Csikszentmihalyi M. Flow: The Psychology of Optimal Experience. New York City, NY. Harper & Row; 1990.
- Przybylski AK, Rigby CS, Ryan RM. A motivational model of video game engagement. Rev Gen Psychol. Jun 01, 2010;14(2):154-166. [CrossRef]
- Canossa A, Drachen A, El-Nasr MS. Game Analytics Maximizing the Value of Player Data. London, UK. Springer; Mar 30, 2013.
- Barth J, Munder T, Gerger H, Nüesch E, Trelle S, Znoj H, et al. Comparative efficacy of seven psychotherapeutic interventions for patients with depression: a network meta-analysis. PLoS Med. May 28, 2013;10(5):e1001454. [FREE Full text] [CrossRef] [Medline]
- Wampold BE. How important are the common factors in psychotherapy? An update. World Psychiatry. Oct 25, 2015;14(3):270-277. [FREE Full text] [CrossRef] [Medline]
- Cuijpers P, Reijnders M, Huibers MJ. The role of common factors in psychotherapy outcomes. Annu Rev Clin Psychol. May 07, 2019;15(1):207-231. [CrossRef] [Medline]
- Leiman M. Dialogical sequence analysis in studying psychotherapeutic discourse. Int J Dialogical Sci. 2012;6(1):123-147. [FREE Full text]
- Merry SN, Stasiak K, Shepherd M, Frampton C, Fleming T, Lucassen MF. The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial. BMJ. Apr 18, 2012;344(apr18 3):e2598. [FREE Full text] [CrossRef] [Medline]
- Etkin A, Gyurak A, O'Hara R. A neurobiological approach to the cognitive deficits of psychiatric disorders. Dialogues Clin Neurosci. Dec 2013;15(4):419-429. [FREE Full text] [CrossRef] [Medline]
- Rock PL, Roiser JP, Riedel WJ, Blackwell AD. Cognitive impairment in depression: a systematic review and meta-analysis. Psychol Med. Jul 29, 2014;44(10):2029-2040. [CrossRef] [Medline]
- Motter JN, Pimontel MA, Rindskopf D, Devanand DP, Doraiswamy PM, Sneed JR. Computerized cognitive training and functional recovery in major depressive disorder: a meta-analysis. J Affect Disord. Jan 01, 2016;189:184-191. [CrossRef] [Medline]
- Bediou B, Adams DM, Mayer RE, Tipton E, Green CS, Bavelier D. Meta-analysis of action video game impact on perceptual, attentional, and cognitive skills. Psychol Bull. Jan 2018;144(1):77-110. [CrossRef] [Medline]
- Kollins SH, DeLoss DJ, Cañadas E, Lutz J, Findling RL, Keefe RS, et al. A novel digital intervention for actively reducing severity of paediatric ADHD (STARS-ADHD): a randomised controlled trial. Lancet Digit Health. Apr 2020;2(4):e168-e178. [CrossRef]
- Schuch FB, Vancampfort D, Richards J, Rosenbaum S, Ward PB, Stubbs B. Exercise as a treatment for depression: a meta-analysis adjusting for publication bias. J Psychiatr Res. Jun 2016;77:42-51. [FREE Full text] [CrossRef] [Medline]
- Kvam S, Kleppe CL, Nordhus IH, Hovland A. Exercise as a treatment for depression: a meta-analysis. J Affect Disord. Sep 15, 2016;202:67-86. [CrossRef] [Medline]
- Lee JE, Zeng N, Oh Y, Lee D, Gao Z. Effects of Pokémon GO on physical activity and psychological and social outcomes: a systematic review. J Clin Med. Apr 25, 2021;10(9):1860. [FREE Full text] [CrossRef] [Medline]
- Cheng Z, Greenwood BN, Pavlou PA. Location-based mobile gaming and local depression trends: a study of Pokémon Go. J Manag Inf Syst. Apr 11, 2022;39(1):68-101. [CrossRef]
- Li J, Theng YL, Foo S. Effect of exergames on depression: a systematic review and meta-analysis. Cyberpsychol Behav Soc Netw. Jan 2016;19(1):34-42. [CrossRef] [Medline]
- Constitution. World Health Organization. 1946. URL: https://www.who.int/about/governance/constitution [accessed 2023-08-18]
- WHOQOL User manual, 2012 revision. World Health Organization. 2012. URL: https://apps.who.int/iris/handle/10665/77932 [accessed 2023-08-18]
- Connell J, Brazier J, O'Cathain A, Lloyd-Jones M, Paisley S. Quality of life of people with mental health problems: a synthesis of qualitative research. Health Qual Life Outcomes. Nov 22, 2012;10(1):138. [FREE Full text] [CrossRef] [Medline]
- Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55(1):68-78. [CrossRef]
- Thi Nguyen C. Games: Agency as Art. New York City, NY. Oxford University Press; 2020.
- Ryan RM, Rigby CS, Przybylski A. The motivational pull of video games: a self-determination theory approach. Motiv Emot. Nov 29, 2006;30(4):344-360. [CrossRef]
- Wu JH, Wang SC, Tsai HH. Falling in love with online games: the uses and gratifications perspective. Comput Hum Behav. Nov 2010;26(6):1862-1871. [CrossRef]
- Mills DJ, Milyavskaya M, Mettler J, Heath NL. Exploring the pull and push underlying problem video game use: a Self-Determination Theory approach. Pers Individ Differ. Dec 2018;135:176-181. [CrossRef]
- Ballabio M, Griffiths MD, Urbán R, Quartiroli A, Demetrovics Z, Király O. Do gaming motives mediate between psychiatric symptoms and problematic gaming? An empirical survey study. Addict Res Theory. Mar 27, 2017;25(5):397-408. [CrossRef]
- Mandryk RL, Birk MV. The potential of game-based digital biomarkers for modeling mental health. JMIR Ment Health. Apr 23, 2019;6(4):e13485. [FREE Full text] [CrossRef] [Medline]
- Dechant MJ, Frommel J, Mandryk R. Assessing social anxiety through digital biomarkers embedded in a gaming task. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Presented at: CHI '21: CHI Conference on Human Factors in Computing Systems; May 8-13, 2021, 2021; Yokohama, Japan. [CrossRef]
- Braund TA, Zin MT, Boonstra TW, Wong QJ, Larsen ME, Christensen H, et al. Smartphone sensor data for identifying and monitoring symptoms of mood disorders: a longitudinal observational study. JMIR Ment Health. May 04, 2022;9(5):e35549. [FREE Full text] [CrossRef] [Medline]
- Gielis K, Vanden Abeele ME, De Croon R, Dierick P, Ferreira-Brito F, Van Assche L, et al. Dissecting digital card games to yield digital biomarkers for the assessment of mild cognitive impairment: methodological approach and exploratory study. JMIR Serious Games. Nov 04, 2021;9(4):e18359. [FREE Full text] [CrossRef] [Medline]
- Peters D, Calvo RA, Ryan RM. Designing for motivation, engagement and wellbeing in digital experience. Front Psychol. May 2018;9:797. [FREE Full text] [CrossRef] [Medline]
- Scholten H, Granic I. Use of the principles of design thinking to address limitations of digital mental health interventions for youth: viewpoint. J Med Internet Res. Jan 14, 2019;21(1):e11528. [FREE Full text] [CrossRef] [Medline]
- Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. Mar 03, 2007;334(7591):455-459. [FREE Full text] [CrossRef] [Medline]
- Spinuzzi C. The methodology of participatory design. Tech Commun. May 2005;52(2):163-174. [FREE Full text]
- Oinas-Kukkonen H, Harjumaa M. Persuasive systems design: key issues, process model, and system features. Commun Assocr Inf Syst. 2009;24(1) [CrossRef]
- Fleming TM, de Beurs D, Khazaal Y, Gaggioli A, Riva G, Botella C, et al. Maximizing the impact of e-therapy and serious gaming: time for a paradigm shift. Front Psychiatry. Apr 18, 2016;7:65. [FREE Full text] [CrossRef] [Medline]
- Dekker MR, Williams AD. The use of user-centered participatory design in serious games for anxiety and depression. Games Health J. Dec 2017;6(6):327-333. [CrossRef] [Medline]
- Lukka L. Conquering the mobile. A study on the contemporary practices in mobile game development through nine cases and the introduction of the DPS model. Aalto University. 2017. URL: https://aaltodoc.aalto.fi/handle/123456789/28607 [accessed 2023-08-18]
- Kazdin AE, Rabbitt SM. Novel models for delivering mental health services and reducing the burdens of mental illness. Clin Psychol Sci. Jan 23, 2013;1(2):170-191. [CrossRef]
- Teece DJ. Business models, business strategy and innovation. Long Range Plan. Apr 2010;43(2-3):172-194. [CrossRef]
- Wiemeyer J, Nacke L, Moser C, ‘Floyd’ Mueller F. Player experience. In: Dörner R, Göbel S, Effelsberg W, Wiemeyer J, editors. Serious Games. Cham, Switzerland. Springer; Aug 26, 2016.
- Isbister K, Hodent C. Game Usability: Advice from the Experts for Advancing UX Strategy and Practice in Videogames. Boca Raton, FL. CRC Press; Mar 13, 2022.
- Bernhaupt R. Game User Experience Evaluation. Cham, Switzerland. Springer; Jun 24, 2015.
- Dörner R, Göbel S, Effelsberg W, Wiemeyer J. Serious Games: Foundations, Concepts and Practice. Cham, Switzerland. Springer; Sep 02, 2016.
- Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. Aug 07, 2009;4:50. [FREE Full text] [CrossRef] [Medline]
- Greenhalgh T, Abimbola S. The NASSS framework - a synthesis of multiple theories of technology implementation. Stud Health Technol Inform. Jul 30, 2019;263:193-204. [CrossRef] [Medline]
- Orsmond GI, Cohn ES. The distinctive features of a feasibility study: objectives and guiding questions. OTJR (Thorofare N J). Jul 06, 2015;35(3):169-177. [CrossRef] [Medline]
- Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. Feb 2006;21 Suppl 2(Suppl 2):S1-S8. [FREE Full text] [CrossRef] [Medline]
- O'Cathain A, Thomas KJ, Drabble SJ, Rudolph A, Hewison J. What can qualitative research do for randomised controlled trials? A systematic mapping review. BMJ Open. Jun 20, 2013;3(6):e002889. [FREE Full text] [CrossRef] [Medline]
- Cooper C, O'Cathain A, Hind D, Adamson J, Lawton J, Baird W. Conducting qualitative research within Clinical Trials Units: avoiding potential pitfalls. Contemp Clin Trials. Jul 2014;38(2):338-343. [FREE Full text] [CrossRef] [Medline]
- Knapp M, Wong G. Economics and mental health: the current scenario. World Psychiatry. Feb 10, 2020;19(1):3-14. [FREE Full text] [CrossRef] [Medline]
- Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. Sep 1999;89(9):1322-1327. [CrossRef] [Medline]
- Dubois LE, Weststar J. Games-as-a-service: conflicted identities on the new front-line of video game development. New Media Soc. Oct 02, 2022;24(10):2332-2353. [FREE Full text] [CrossRef] [Medline]
- Niva H. Understanding the LiveOps paradigm in mobile game studios. Aalto University. Jul 29, 2021. URL: https://aaltodoc.aalto.fi/handle/123456789/109377 [accessed 2023-08-18]
- Mohr DC, Weingardt KR, Reddy M, Schueller SM. Three problems with current digital mental health research . . . And three things we can do about them. Psychiatr Serv. May 01, 2017;68(5):427-429. [FREE Full text] [CrossRef] [Medline]
- Montembeault H, Deslongchamps-Gagnon M. The walking simulator’s generic experiences. Press Start. 2019;5(2):1-28. [FREE Full text]
- Smit D, Vrijsen JN, Groeneweg B, Vellinga-Dings A, Peelen J, Spijker J. A newly developed online peer support community for depression (depression connect): qualitative study. J Med Internet Res. Jul 12, 2021;23(7):e25917. [FREE Full text] [CrossRef] [Medline]
- De Lope RP, Medina-Medina N. A comprehensive taxonomy for serious games. J Educ Comput Res. Dec 12, 2016;55(5):629-672. [CrossRef]
Abbreviations
ADHD: attention-deficit/hyperactivity disorder |
COM-B: capability, opportunity, motivation, and behavior |
DMHI: digital mental health intervention |
gDMHI: game-based digital mental health intervention |
NASSS: Non-adoption and Abandonment of technologies, and the challenges to Scale-up, Spread, and Sustainability of such technologies |
RCT: randomized controlled trial |
RE-AIM: Reach, Efficacy, Adoption, Implementation, and Maintenance |
TEME: target audience, engagement, mechanisms of action, and effectiveness |
WHO: World Health Organization |
Edited by G Eysenbach; submitted 25.08.22; peer-reviewed by M Craven, M Bruno; comments to author 20.12.22; revised version received 24.01.23; accepted 15.07.23; published 04.09.23.
Copyright©Lauri Lukka, J Matias Palva. Originally published in JMIR Serious Games (https://games.jmir.org), 04.09.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.