Review
Abstract
Background: Young people are particularly at risk of developing mental health problems, a challenge exacerbated by the COVID-19 pandemic. Digital tools such as apps and chatbots show promise in providing accessible, cost-effective, and less stigmatized ways of strengthening their mental health. However, while these interventions offer benefits, they extend mental health measures beyond traditional therapeutic settings and relationships, which raises ethical concerns due to the absence of established guidelines and regulations. This is particularly notable for technologies incorporating serious gaming elements. In addition, adolescents are in a sensitive and at times vulnerable phase, which shows great potential for the effective use of preventive and sensitizing mental health measures. Considering the lack of an integration into existing mental health structures among many young users, ethical considerations become crucial.
Objective: This scoping review aims to build a knowledge base on the ethical aspects of developing and implementing gamified digital mental health interventions for young people.
Methods: We conducted a search on research articles and conference papers from 2015 to 2023 in English, German, and Spanish. We identified 1815 studies using a unique combination of keywords in the databases Scopus, Web of Science, MEDLINE, and PsycINFO. After removing duplicates (741/1816, 40.8%), we included a total of 38 publications in this review following a double screening process.
Results: This review found that ethically relevant aspects were discussed with regard to (1) research ethics, (2) ethical principles (including privacy, accessibility, empowerment and autonomy, cultural and social sensitivity, and co-design), (3) vulnerable groups, and (4) social implications (including implementation using facilitators in specific social contexts, relationship with other therapeutic options, economic aspects, and social embeddedness of technologies).
Conclusions: This scoping review identified a prevailing limited interpretation of “ethics” as research ethics across the included publications. It also shows a lack of discussion on the social embeddedness of technologies and that co-design is frequently viewed in instrumental terms and vulnerability is mostly addressed pragmatically. Through providing concrete examples of how mental health researchers and game designers thus far have addressed and mitigated ethical challenges in specific interventions, this review illustrates how ethical issues do or do not prompt diverse reflections, mitigation strategies, and actions. It advocates for ethics to be integrated as an ongoing practice throughout all stages of developing and implementing serious game elements in mental health interventions for young people.
doi:10.2196/64488
Keywords
Introduction
Background
Mental health is a major global concern that has been exacerbated by the COVID-19 pandemic [
]. The stage of life up to and including adolescence represents a window of both particular sensitivity and vulnerability but also opportunity with respect to mental health. Aversive experiences during this time can establish a lifetime trajectory of poor mental health, whereas a number of supportive factors can protect future mental health [ ]. Young people today are often described as “digital natives” due to their familiarity with digital technology, having grown up with it [ ]. Consequently, digital mental health interventions [ , ], including digital games [ ], are particularly promising in reaching and supporting this population with accessible, cost-effective, and less stigmatized ways of strengthening their mental health [ ].While digital mental health interventions offer benefits, they extend mental health measures beyond traditional therapeutic settings and relationships and, thereby, raise specific ethical concerns [
, ]. Although studies and guidelines on the ethical aspects of digital mental health technologies have been published [ - ], there is a knowledge gap regarding young people. Guidelines and regulations are still needed for this group [ ]. A rare exception is one scoping review on the ethical aspects of digital mental health for young people that included studies up to October 2020. It found ethical potential related to accessibility, therapy facilitation and prevention, empowerment, and high acceptability. Risks concerned privacy, patient mistrust, stigma, access inequalities, cross-cultural differences, clinical validation, ethical and legal guidance, and consent [ ]. Considering the rapid technological advancements, new insights are likely available now. In addition, the aforementioned review did not explicitly focus on serious games, namely, digital interactive tools designed to address mental health issues through engaging gameplay. Thus far, the literature on the ethics of serious games [ - ] has largely evolved separately from the literature on mental health interventions for young people.In light of this gap in the ethics literature, this scoping review showed ethical aspects of gamified digital mental health interventions for young people aged between 10 and 25 years. Such interventions have been designed for a broad spectrum of mental health needs, ranging from preventive measures for the general youth population to treatment for mild and severe conditions [
]. We define mental health broadly to include specific mental health diagnoses as well as more general well-being related to emotional regulation and feelings of connectedness and belonging. In this review, digital interventions encompass those designed for interactive use on computers and mobile devices and in extended realities such as augmented and virtual reality. This review included interventions self-identified as games or incorporating gamified elements without focusing on specific game mechanics.While we focused on specific predefined ethical principles and issues, such as autonomy, empowerment, privacy, and equity, we also explored additional ethical considerations that emerged from the discussed papers. This review conceptualized ethical aspects as multifaceted concerns that arise throughout all stages of intervention development and implementation. These extend beyond research ethics and institutional approvals to also encompass game design decisions and broader considerations, such as environmental impact, economic factors related to funding, and the roles of facilitators such as teachers and therapists.
Objectives
This review identified the various ethical considerations discussed by developers and researchers when describing specific interventions for young people that include gameplay elements. We asked the following research questions (RQs):
- What are ethical aspects of gamified digital mental health interventions for young people? (RQ 1)
- What needs to be considered in the development of gamified digital mental health interventions for adolescents to mitigate ethical challenges? (sub-RQ 1)
- What ethical aspects does the literature identify with regard to vulnerable groups and who is identified as a vulnerable group (eg, specific diagnoses and social markers)? (sub-RQ 2)
- What are relevant social implications (eg, public or private funding, school-based or home-based environment, and regulatory frameworks)? (sub-RQ 3)
This review is part of the larger Horizon Europe–funded project “ASPbelong” (2023-2027 [
]). The project aims to develop Augmented Social Play, a smartphone-based group psychotherapeutic intervention that enhances adolescent mental health by fostering real-world connections and a sense of belonging.Methods
Following established scoping review guidelines ([
]; [ ]), the selection process for the literature search followed 4 phases: identification, screening, eligibility, and inclusion. Moreover, the search was complemented by asking all team members of the interdisciplinary Horizon 2022 project ASPbelong, as well as the participants of a 2023 workshop on prosocial games in extended realities at the 22nd International Conference on Mobile and Ubiquitous Multimedia [ ], for additional publications meeting our inclusion criteria—resulting in the inclusion of one more publication.Literature Search
To identify studies for our review, we used the scientific databases Scopus, Web of Science, MEDLINE, and PsycINFO. These databases allowed for searches across the different disciplines relevant to this scoping review’s topic, including ethics, psychology, computer sciences, and design research. To answer our RQs, we aimed to find existing research on (1) ethical aspects of (2) gamified (3) digital (4) mental health interventions for (5) adolescents. Each part (1-5) was operationalized using a string of search terms. The search terms were combined using the Boolean operators OR (within search strings) and AND (across search strings), adapting the operators and syntax for different databases as necessary (for the full list of search terms and the search strings for each database, see
).To identify search terms for strings 2 to 5, we oriented ourselves using existing reviews on similar topics in high-quality journals [
- ], modifying them to this review’s focus and requirements. For the identification of search terms related to the ethical aspects (search string 1), existing reviews provided only moderate assistance. In the field of ethics, scoping reviews are still developing as a methodology. The few existing reviews on ethical aspects of digital mental health interventions have either omitted the outcome of ethics to avoid excessively narrowing the search [ ] or used solely the search term “ethics” or combinations thereof, such as “bioethical issues,” “ethical analysis,” and “ethical review” [ ]. Neither of these search strategies proved viable for our review. Initial searches yielded insufficient results when combining search strings 2 to 5 with “ethics” or related combinations (35 results in Scopus compared to 755 results retrieved using the final search string). Conversely, the number of results increased significantly when no ethics-related search string was included (1245 results in Scopus).In response to these considerations, we created a new search string for ethical aspects that included not only the search term “ethics” or combinations thereof but also concrete examples of ethical principles and issues. The search terms were inspired by a briefing note on the role of technology in mental health care by the Nuffield Council on Bioethics [
] and on search terms used in preceding reviews on ethical aspects of digital health technologies [ , , ]. The selection process involved collaborative brainstorming within the author team and was led by the ethics experts in our authorship team (GR and WS). The final search terms related to ethical aspects included (1) explicitly ethics-related search terms, (2) more general search terms for challenges and advantages, (3) concrete ethical principles and issues, and (4) a focus on access and equity ( ).Theme and search terms
- Explicitly ethics-related search terms: ethics, ethical, moral, value, ELSI, and ELSA
- More general search terms for challenges and advantages: risk, benefit, potential, and challenge
- Concrete ethical principles and issues: autonomy, empowerment, privacy, confidentiality, trust, consent, stigma, responsibility, regulatory framework, and safety
- Focus on access and equity: accessibility, equity, inequity, equality, inequality, bias, digital literacy, socioeconomic, social determinant, and exclusion
Eligibility Criteria
We included research articles and conference papers in English, German, and Spanish (languages spoken by the authors) that were published between 2015 and 2023. The rationale for excluding publications before 2015 was the rapid evolvement of digital health technologies that makes it difficult to compare newer digital interventions to older ones (eg, showing a patient a video as a digital intervention before 2015 vs the newest augmented reality technologies). Publications considered for inclusion addressed ethical aspects of gamified digital mental health interventions for young people (aged 10-25 years).
provides a detailed list of the inclusion and exclusion criteria.Inclusion criteria
- Period: papers published between 2015 and 2023
- Study types: Research articles and conference papers (plus conference abstracts if titles or abstracts focused on ethics to contact the authors for further information)
- Language: English, German, and Spanish
- Population: young people (aged 10-25 years; note for the scanning process: include studies with, eg, age ranges of 8-12 or 18-30 years)
- Intervention: the intervention was gamified, including interventions with a gamified aspect; the intervention was digital, including extended realities (augmented and virtual reality) and apps and other interactive content that can be used on mobile and other devices (ie, smartphones and computers); the intervention aimed at increasing, stabilizing, or informing about mental health, including mental illness prevention. Mental health is understood in a broad sense, including feelings of well-being, belonging, social connection, and relatedness; psychotherapeutic and nonpsychotherapeutic interventions
- Outcome: the publication addressed ethical challenges and advantages when designing and implementing gamified digital mental health interventions.
Exclusion criteria
- Period: papers published before 2015 and after 2023
- Study types: systematic reviews or reviews, opinion papers, editorials, special issue introductions, doctoral theses, workshops, protocols, and textbooks
- Language: other languages
- Population: people aged <10 years and >25 years; parenting interventions (eg, interventions designed for parents and interviews with or surveys on parents); interventions that were tested with students without being designed for young people
- Intervention: the publication studied the harmfulness of excessive media consumption; the intervention was not a mental health intervention but aimed at, for example, improved physical health or increasing learning motivation; the publication was not based on insights from an existing intervention, including prototype development, implementation, and user experiences (eg, broad and abstract introductory publications such as “Addressing children’s mental health issues in the 21st century”); the intervention was a digital tool just to screen for mental health status (ie, assessment tool); the intervention was tested with students without being designed for young people; the intervention was aimed at screening the current mental health state (eg, at the start of conventional therapy)
- Outcome: the publication only mentioned the ethics committee’s vote or briefly described some aspects of research ethics (eg, obtaining parental consent) without other discussions of ethical aspects; the publication only reported on ethically relevant decisions without discussing them.
Screening
Duplicates were removed from the collated papers for screening (using the review software Covidence [Veritas Health Innovation] and by hand). In total, 2 independent reviewers screened the remaining papers, regularly discussing inconsistencies and uncertainties in decisions (title and abstract screening: WS as first reviewer and 3 research assistants as second reviewers; they worked at the University of Birmingham during a work placement year between the second and final years of their bachelor’s degrees at other universities and received training and regular check-ins; full-text screening: VM and WS). During title and abstract screening, we did not attend to the outcome inclusion criteria, which addressed ethical aspects. While the terms in the search group for identifying ethical aspects (
) aimed to ensure the ethical relevance of the search hits, when jointly screening the titles and abstracts of the first papers (approximately 50 titles and abstracts assessed together by VM and WS), we realized that a full-text screening was necessary to determine the relevance of the publication to our RQs. We attuned our eligibility criteria when proceeding with abstract and title screening, adding further exclusion criteria (ie, interventions tested with students without being designed for young people and interventions aimed at screening mental health status). Early screened papers were reassessed to align with the revised criteria.During full-text screening, the focus was on the publications’ discussion of ethical aspects. We remained oriented to our predetermined topics, aligning with the search terms related to ethical aspects (
). In addition, we worked inductively, being mindful to the discussion of other ethical aspects.We excluded publications that did not report on any ethically relevant reflections or discussions. Papers that only mentioned the ethics committee’s vote or some aspects of research ethics in a brief way (eg, stating that parental consent was obtained when involving minors in intervention effectiveness measurement) were also excluded. We argue that simply including the reference to an obtained ethics committee vote and the brief addressing of consent procedures does not constitute ethical reflection but can best be understood as good scientific practice or as an appeal to authority. Moreover, we excluded publications that mentioned ethically relevant decisions (eg, design decisions on having avatars of different genders) but did not provide any reflections or further discussions of these decisions. Inconsistencies were jointly resolved in dedicated meetings between VM and WS.
Data Extraction and Analysis
Our approach to data analysis can be best described as an abductive approach [
] to ethics, being both theory informed and empirically oriented. This approach did not adhere to a rigid, predefined concept of ethics. Instead, we intentionally maintained an open and flexible definition of ethics. We drew upon ethical considerations mentioned in existing research and guidelines on digital mental health interventions, as well as our own experiences. This flexibility facilitated the exploration of unanticipated ethical aspects in an inductive manner. We began analyzing data during the full-text screening phase as this process helped refine our understanding of what ethical aspects may or may not entail. Thereafter, data analysis followed several steps.First, we created a template for extracting data from the 38 included publications with the easy-to-adapt tool from the review software Covidence (“data extraction template 2,” which is designed for customized reviews, such as scoping reviews). This template included categories for general information on the paper (title, authors, publication year, and outlet), the characteristics of the study (discipline, aim of the study, and method), the intervention (country, intervention funding sources, target population, intervention name, media, type of gamification, co-design elements, mental health understanding, and overview of the ethical aspects addressed in the publication), and ethical aspects (“research ethics (detailed considerations),” “ethical principle privacy,” “ethical principle: other,” “value conflicts,” “vulnerable groups,” “social implications,” and “other ethical aspects”). Information on ethical aspects was inserted within open-ended fields in the form of direct quotes preceded by a short summary of a few words. [Author] performed data extraction as a single reviewer, including a simple check on all the extracted data after completing extraction in Covidence plus harmonizing the data and cleaning them from mistakes after conversion to Microsoft Excel.
Second, we refined the list of ethical aspects in our data extraction template during data extraction in an inductive manner adding 4 subcategories that were mentioned across a considerable number of studies (ie, “ethical principle: accessibility,” “value conflicts: entertainment vs. psychological/educational value,” “other ethical aspects: avatar diversity,” and “other ethical aspects: value of co-design”). Third, we clustered the insights on each ethical aspect into meaningful topics based on our short topical summaries of each extracted quote. This step also involved the formation of new subaspects as they emerged from the data (eg, “cultural and social sensitivity” emerged as a new subaspect of “ethical principles”; see the Results section). Fourth, we analyzed the publications’ discussions of each ethical aspect and subaspect identified as a result based on the direct quotes. We described similarities across the studies as well as special or unique ethical insights (for a table with all the direct quotes and summaries extracted, see
[ - ]).Results
Overview
A total of 1075 studies were screened after removal of duplicates (741/1816, 40.8%). Of the 91 publications that were reviewed in full text, we excluded 22 (24%) because the described interventions did not match our inclusion criteria, 27 (30%) because they did not include ethically relevant outcomes, and 4 (4%) based on other reasons (
). In the following, we outline the main characteristics of the publications included, followed by a discussion of the ethical aspects addressed by them.Main Characteristics of the Included Publications
The 38 publications included in this review addressed 32 interventions, whereby 2 (5%) of the papers discussed 3 (9%) of the interventions each (for a list of each study’s key characteristics, see
[ - ]). shows a summarized overview of the studies’ key characteristics. There was a leaning toward more publications in later years. The distribution of studies showed a focus on the Global North, with most interventions developed in Europe (most of them in the Netherlands and Spain, with 3/32, 9% of the interventions each) followed by North America (7/32, 22% in the United States and 2/32, 6% in Canada) and Oceania (4/32, 12% in Australia; 3/32, 9% in New Zealand; and 1/32, 3% as a collaboration between the 2 countries).Studies, n (%)a | ||
Year of publication | ||
Between 2015 and 2017 | 8 (21) | |
Between 2018 and 2020 | 10 (26) | |
Between 2021 and 2023 | 20 (53) | |
Continent | ||
Europe | 15 (39) | |
North America | 9 (24) | |
Oceania | 8 (21) | |
Asia | 4 (11) | |
Africa | 1 (3) | |
South America | 1 (3) | |
Authors’ disciplines | ||
Interdisciplinary | 13 (34) | |
Psychology | 11 (29) | |
Human-computer interaction | 7 (18) | |
Medicine | 3 (8) | |
Education | 2 (5) | |
Aim of the study | ||
Understand user experiences: mixed methods | 12 (32) | |
Present intervention design | 9 (24) | |
Measure intervention impact | 6 (16) | |
Understand user experiences: qualitative methods | 6 (16) | |
Understand user experiences: quantitative methods | 3 (8) | |
Other | 3 (8) | |
Intervention funding source | ||
Not mentioned | 18 (47) | |
Nongovernmental organization | 5 (13) | |
University | 5 (13) | |
State institution | 5 (13) | |
Mixed funding | 4 (11) | |
Research grant | 1 (3) | |
Target population | ||
Vulnerable groups | 15 (39) | |
Specific age group | 8 (21) | |
Young people in school | 6 (16) | |
Other | 4 (11) | |
University students | 3 (8) | |
Young people in face-to-face therapy | 2 (5) | |
Digital media | ||
Mobile app | 18 (47) | |
Web-based video game | 11 (29) | |
Other | 9 (24) | |
Co-design elements | ||
Not mentioned | 17 (45) | |
Co-design approach | 12 (32) | |
Feedback from young people during development | 9 (24) | |
Mental health issue addressed | ||
Preventive | 11 (29) | |
Anxiety or depression | 9 (24) | |
Loneliness and belonging | 5 (13) | |
Other | 5 (13) | |
Social skills | 4 (11) | |
Mental health–related issue | 4 (11) | |
Therapeutic approach | ||
Other | 22 (58) | |
Cognitive behavioral therapy | 10 (26) | |
Socioemotional learning | 4 (11) | |
Behavioral activation theory | 1 (3) | |
Stress coping theory | 1 (3) |
aSome deviation in the cumulative sum due to decimal rounding.
More than half (21/38, 55%) of the studies aimed to understand user experiences, mostly applying mixed methods designs, such as combining surveys among young people with qualitative methods, or solely qualitative methods. Among the qualitative methods used were interviews with young people, teachers, school-based health providers, therapists, and parents, as well as focus groups and co-design workshops. Nearly half (18/38, 47%) of the publications did not indicate the funding source of the intervention, which is interesting from an ethical point of view because different donors can be expected to have different interests and influence certain decisions of intervention design. One-third of the publications (15/38, 39%) addressed interventions for what we interpreted as vulnerable groups specifically targeting young people with specific mental, physical, or social needs rather than interventions based on age or educational level.
In terms of digital media, nearly half (18/38, 47%) of the publications addressed interventions created as mobile apps, followed by web-based video games. There was a noticeable trend of increasing mobile app development over time, with a median publication year of 2022, compared to web-based video games, which had a median publication year of 2019. In addition, 9% (3/32) of the interventions incorporated biofeedback technologies; 3% (1/32) used automated, interactive SMS text messaging; 3% (1/32) were collaborative augmented reality apps; 3% (1/32) were designed as a computer-based game; and another (1/32, 3%) was designed for PC, website, and mobile app platforms. Notably, 3% (1/38) of the publications defined the intervention as comprising not only a mobile app but also in-person introductory lessons led by a researcher as well as a debriefing session facilitated by a person with lived experience of depression [
]. The integration of these face-to-face interactions alongside the digital components provides a holistic approach and can add depth to the digital experiences of young people.The most frequently used therapeutic approaches were cognitive behavioral therapy (12/38, 30% of the publications) and socioemotional learning (5/38, 13% of the publications). Others included behavioral activation theory (1/38, 3%), stress coping theory (1/38, 3%), and a strengths-based positive psychology framework (1/38, 3%). While few (3/38, 8%) reported a mix of several approaches, a considerable number (15/38, 39%) of the publications did not indicate following one specific approach, remaining vague on the mental health framework informing the intervention.
Finally, nearly all the publications cited previous studies and policy guidelines on ethically relevant advantages of gamified digital mental health technologies for young people in their introductions or conclusions. These advantages typically included providing cost-effective treatment to better meet mental health needs, particularly in health care systems with limited access to care; increasing engagement with therapeutic content by leveraging young people’s affinity for games and new digital technologies; and reaching underserved populations, such as economically disadvantaged youth, adolescents in low- and middle-income countries, and individuals fearing stigma, through affordable and widely available digital technologies, especially smartphones.
Detailed Considerations on Research Ethics
A total of 26% (10/38) of the publications provided detailed discussions on research ethics. In total, 20% (2/10) of these publications exhibited careful approaches to engaging with Indigenous youth in Canada [
] and New Zealand [ ]. They reflected on their own positions by acknowledging the Western and Indigenous backgrounds of the author teams. In addition, they shared their experiences of working with Indigenous communities in previous projects and emphasized close collaboration with Indigenous communities from the outset of study development. For example, the study in Canada formed an Indigenous committee with community leaders from various areas with hourly compensation, which jointly devised recruitment strategies and study design. The Indigenous committee’s recommendations included qualitative interview data on adult community members’ view on mental health apps, culturally cointerpreting findings “within a cultural lens” [ ], and planning to store data at the Indigenous community site in the course of “a post-study action plan” [ ]. Moreover, the study in New Zealand adopted the Indigenous kaupapa Maori methodology. Instead of a focus on individual change for improved mental health common to Western psychological models, it emphasized connections to extended family, past generations, tribal identity, the environment, and spiritual and physical well-being [ ].Other detailed reflections on research ethics addressed sensitive recruitment strategies [
] (see also the Vulnerable Groups section); informed consent [ - ], which was highlighted as an iterative process (eg, providing ongoing study information and ensuring attentiveness during data collection, including active teacher involvement) in the study by Høiseth et al [ ]; and specific financial compensations for study participants (eg, providing refreshments for and giving away smartphones to adolescents participating in co-design activities in sub-Saharan Africa in the study by Pozuelo et al [ ]). Furthermore, there were discussions on implementing additional safeguards for working sensitively with vulnerable groups (eg, recruiting people with psychosis through early psychosis teams, researchers carefully screening for acute symptoms, and maintaining regular contact with participants via SMS text message or calls to support with technical issues and other concerns in the study by Lim et al [ ]). Finally, 3% (1/38) of the publications addressed the power imbalance between researchers and vulnerable populations as well as the sensitive handling of data when collaborating with adolescents through a nongovernmental organization (eg, recordings uploaded by nongovernmental organization members with permission for viewing but not for downloading for researchers in the study by Sockolow et al [ ]).Ethical Principles
We now focus on how the publications implicitly and explicitly addressed the ethical principles of privacy, accessibility, empowerment and autonomy, and cultural and social sensitivity. Strengthening the principle of transparency at the meta level of communicating design decisions, one publication stated that “serious games for mental health are seldom described in depth and there is little research to elucidate components of serious games that might be useful or appealing” [
].Privacy
Approximately one-third (12/38, 32%) of the publications addressed privacy considerations [
, - , - ]. These were often raised as concerns by young people themselves who wanted to know how their data were used and protected and often preferred not to give their personal data [ , , ]. For example, one proposed solution to address privacy concerns was to customize privacy settings in a way that allowed students to decide whether to upload a profile picture and share personal information within the app [ ]. In an app used by adolescents in sub-Saharan Africa, where some individuals shared smartphones within households, the introduction of a personal unlocking code ensured confidentiality and contributed to establishing a “safe space” [ ]. On a regulative level, one publication addressed adaptations to comply with the European Regulation on Data Protection [ ].Moreover, data collection during gameplay was discussed in relation to privacy safeguards. One publication addressed maintaining anonymity (children were assigned random animal “code names” for log-in) while categorizing players’ actions as “selfish,” “neutral,” or “cooperative” [
]. These categorizations were used solely for game analysis and were kept from the children to avoid causing any negative feelings. In another intervention, players chose their own personal strengths, with pre- and postmeasurement data collected via a deidentified code [ ].Furthermore, the publications addressed how to navigate conflicts between privacy and other values. A home video game for young children during the pandemic raised questions about spontaneous parental involvement [
]. While unintended benefits included “parents observing more closely their child’s emotional processing, reinforcing new skills, being actively involved after the sessions, and reflecting on their parenting role” [ ], parent involvement also carried the risk of misconstruing the purpose of activities, sometimes even using them as punishment for their children [ ]. Another study thematized the risk of clear communication on privacy settings disengaging users and aimed at balancing one with the other [ ].In total, 8% (3/38) of the publications discussed a conflict between maintaining confidentiality and privacy and ensuring user safety. Different target groups may require a different weighting of these values and should ideally be consulted on this [
]. In the case of a mood self-management app, young users expressed a preference for retaining control over seeking help. They suggested using a visible icon, such as heart-shaped hands, to represent a “safe space to chat” [ ] rather than receiving notifications for immediate emergency assistance. In addition, they wished not to share personal details such as names, email addresses, and music preferences on the app to make sure they would not be put in contact with professional support services and avoid judgment from other users [ ]. In contrast, in the context of an intervention aimed at suicide prevention, it was decided to send direct notifications in the case of concerning input, framed by openly communicated safety protocols and repeated information on further counseling options [ ].Beyond game design, the publications addressed the clear communication of privacy rights, for example, including a privacy policy in easy language within an app [
] or stressing the “importance of training both staff and students to...to ensure that they understand their rights to confidentiality and data privacy” [ ] in the school context.Accessibility
A total of 24% (9/38) of the studies addressed a variety of accessibility issues. One focus was on adaptations for vulnerable groups, such as socioeconomically disadvantaged adolescents from ethnic minority groups [
], Indigenous youth [ ], and children with a diagnosis of autism spectrum disorder [ ]. For example, it was recommended to use audio voice-overs for low-literacy populations [ ]. In another study, an interviewed therapist expressed concerns about using text-based responses with children with anxiety, noting that one patient felt pressured to spell and punctuate perfectly, which increased anxiety. To address this issue, the authors instead recommended providing multiple-choice responses or emoticons [ ]. A study from Lebanon highlighted the issue of the digital divide in the context of displaced youth, with some individuals lacking access to devices and facing unstable internet connections [ ].More generally, the term accessibility was used to describe certain design elements, such as operable and navigable functions, understandable text and storylines, and robustness and reliability [
], or a mechanism to encourage help-seeking behavior and reduce dropout rates [ ]. In addition, discussions also covered accessibility issues in terms of technological aspects, including device availability [ ] and the compatibility of the interventions with various types of devices, with a focus on improving access by ensuring functionality across both desktop computers and mobile devices [ , ]. This was achieved through strategies such as using the Unity3D game engine and reducing server workload to enhance response time [ ]. One publication proposed to address limited storage space and unstable internet connections through “a low-storage app” [ ] and exploring features that enabled offline access once the app was downloaded [ ].Empowerment and Autonomy
Some publications (4/38, 11%) addressed the ethical principles of empowerment and autonomy, foregrounding, for example, user-controlled choices as important [
]. One study found that users felt empowered by customization options such as preference settings. This allowed them to choose between plot options and select which information the app tracked [ ]. Another study addressed how certain elements of serious games fostered autonomy through in-game activities such as exploring unfamiliar places; playing with another identity; customizing their own character; and providing perceivable and understandable information, an operable interface that allowed for pauses and the repetition of levels [ ], technical robustness and reliability, and encouragement of self-management and feelings of nonjudgment as well as the simulation of real life [ ]. Finally, one intervention aimed at neurodivergent children discussed autonomy as facilitated among therapists, parents, and children, for example, through collaboratively choosing in-app goals [ ].Cultural and Social Sensitivity
The studies addressed the need to adapt interventions to the target group’s cultural and social context. One recurring aspect, often highlighted by young people themselves [
], was character and avatar diversity [ , ], ranging from limited choices between male and female avatars [ ] to a broad range of customization options, which ensured a cast of culturally relatable characters also with regard to ages, body shapes, social classes, and common names [ ]. Young people’s own ethnicity and socioeconomic situation received particular reflection in two of the publications (2/38, 5%), which reported on qualitative insights from co-design sessions with adolescents from urban and socioeconomically disadvantaged communities in the United States [ ] and with South African and Ugandan youth [ ]. Both interventions adapted characters’ ethnicity (eg, the initial suggestion of characters in anime style replaced with a portrayal of adolescents’ body shapes and ethnicities deemed more appropriate by adolescent co-designers in the study by Sockolow et al [ ]) and game esthetics (eg, esthetics informed by photographs of schools and nearby areas, as well as by the media preferences of the participants, in the study by Pozuelo et al [ ]) to adolescents’ lived realities. In addition, the study by Sockolow et al [ ] described adaptations with regard to language (using adolescents’ speech analysis) and nonplayer characters. “[C]haracter types that the adolescents often mentioned as supports or challenges as they made important decisions in their lives” [ ], namely, the “trusted aunt,” the “good friend,” and the “jealous girlfriend,” were included [ ]. Moreover, adolescents’ wish to address problems common to their daily lives, such as alcohol and cannabis consumption and teenage pregnancy, and solutions were translated into game design through “a set of interactive vignettes located in age-appropriate settings (for example, at school, home, playground, etc.)” [ ].Sensitivity toward young people’s social situation was also shown in considering the school context for an intervention set in a classroom via school-based workshops with adolescents [
], as well as the context of the COVID-19 pandemic marked by the fear of illness and the experience of isolation [ ]. In addition, sensitivity toward country-specific cultural practices can inform design practices. One intervention adapted planned self-help goals to the strong reliance on authority figures in Indian schools and stressed the importance of incorporating local languages [ ].Co-Design
Around one quarter (9/38, 24%) of the studies highlighted the value of co-design approaches [
- , , , , , - ]. In general, co-design approaches hold ethical value as they involve the target group from the outset of intervention development and can, thereby, better address their needs and mitigate potential pitfalls. Studies understood co-design as a valuable process for aligning interventions with the needs and preferences of users [ ], involving vulnerable target audiences such as minority groups [ , ], and obtaining firsthand insights into issues such as school refusal viewing youth as experts [ ]. Often, the studies focused on the increase in engagement and enhancing effectiveness [ , , , , ] in rather instrumental terms. For instance, one study justified youth involvement as a strategy to design games as “relevant, appealing, and optimally engaging to their target audience, increasing the probability that they will also be shared with family and friends” [ ].Furthermore, two of the publications (2/38, 5%) reflected on making the co-design process feasible as an iterative process over the entire development period [
, ], for example, aiming to involve enthusiastic young people over a longer period [ ]. Another study illustrated the creativity inherent to applying co-design processes, for example, through using “active and spontaneous role play to elicit dialogue for script development” [ ].In addition, 13% (5/38) of the publications localized co-design not only as a practice targeted at user involvement but also involving multiple stakeholders and their knowledges [
, , , ]. For example, an opioid misuse prevention intervention engaged adolescents with and without misuse experiences, researchers on the topic, medical providers, and school representatives to reflect “their voices and perspectives for the greatest impact and reach” [ ]. One intervention addressing the topic of young people living with parents with mental illness emphasized “multiprofessional co-development” [ ] between adults with this experience and adolescents, as well as playwrights, game developers, computer scientists, and psychologists [ ]. Similarly, another publication explicitly framed “a robust co-design framework that involved children, parents, teachers, clinicians, academics, and technical experts in prototype design, development, and evaluation via rapid user-testing” [ ] as a strength of the intervention. Co-design was also understood as an ongoing working collaboration between game developers and psychology or education researchers [ , ].Psychological and Educational Value
Nearly a quarter (8/38, 21%) of the publications addressed how to align the pedagogical goals of serious games targeting mental health with entertainment logics. Three of these studies (3/8, 38%) merely mentioned this conflict as a general challenge in gamified intervention development [
, , ], for example, referring to the “critique of educational games being a ‘chocolate covered broccoli’” [ ]. The other studies included reflections on how they practically navigated these values, foregrounding the value of interdisciplinary collaboration between mental health or education experts and game designers involved in project development [ , , ]. One publication delineated an iterative process used by the development team for selecting therapeutic elements and their gamification, which was informed by young people acting as co-designers. It involved selecting the most beneficial psychological principles in a process of prioritization and feasibility reflection aimed at obtaining the “best ‘bang for our buck’” [ ]. Critiquing conventional gamification approaches, the publications emphasized targeting players’ intrinsic motivations [ , ].Moreover, the time- and energy-consuming practices of interdisciplinary collaboration among team members were expected to bring about “an exciting future...for games in the field of mental and emotional health” [
]. Another study on an in-therapy intervention showed how navigating psychological or educational and entertainment values depends on the previous experiences of users; an interviewed therapist cautioned against using the intervention for regular game players and the risk of adolescents using the intervention for entertainment only [ ].Finally, 2 of the publications (2/38, 5%) highlighted the potential of mitigating possible negative effects on mental health through game design. One publication emphasized young people’s worries about improper design, “such as when wording was explicitly directive rather than facilitating autonomous use” [
], worsening user well-being. Another publication used calming visuals and audio to counter bad mood effects from the game’s psychological or educational components [ ].Vulnerable Groups
Targeting vulnerable groups generally raises distinct ethical considerations. Interventions were designed to address vulnerability across various factors, including socioeconomic background [
], existing mental [ , , ] or physical [ ] health conditions in young people or their parents, disabilities [ , ], belonging to an ethnic or gender minority group [ ], indigeneity [ , , ], the experience of forced displacement [ ], and other factors such as school refusal [ ].Some studies (5/38, 13%) addressed representation and inclusivity concerns essential for meeting the needs of diverse populations [
, , , , ] (see also the Detailed Considerations on Research Ethics section). One study noted the overrepresentation of affluent, highly educated White families among their participants and highlighted the need to target socioeconomically disadvantaged and racially diverse demographic groups with limited access to mental health resources [ ]. Moreover, ensuring inclusivity for vulnerable groups was related to questions of access to digital technologies, in particular when developing interventions in the context of socioeconomically disadvantaged groups and regions [ , , ] (see also the Accessibility section). One publication discussed how enabling users to snooze app notifications allowed them to use the intervention without fear of stigma [ ].In addition, the studies focused on unique aspects of vulnerability and highlighted the importance of reflections on decision-making processes in intervention development [
, , , , - , , ]. For instance, one study emphasized the need to tailor virtual reality interventions to the special needs of socially isolated adolescents in medical settings. It provided a discussion of technical and design features that alleviate motion sickness, a common problem during chemotherapy treatments [ ].Finally, the studies underscored the limitations of one-size-fits-all approaches. This aimed at ensuring the relevance and effectiveness of interventions for vulnerable populations, for example, in the context of Indigenous communities [
], and advocating for cultural adaptations (see the Cultural and Social Sensitivity section). A publication on a collaborative in-class intervention implicitly noted the risk of reinforcing differences between children less familiar with video games or slower at tasks and those who finish quickly. To prevent faster players from getting bored, it suggested offering them additional mini games until the others caught up [ ]. One intervention aimed at children with social skill challenges reasoned to choose a single-player design to “create a safe environment in which to practice fledgling skills without social ramifications and avoid the possible iatrogenic effects of participants reinforcing negative behaviours in other children” [ ]. Moreover, the studies reflected on the challenge of adapting digital interventions to “a span of ages, disorders, and abilities” [ ] and to the personal needs of patients in the context of face-to-face therapy, in which personalization, through, for example, changing the order of levels, may “undermine the validated integrity of the intervention” [ ].Social Implications
Overview
Approximately two-thirds (23/38, 61%) of the publications addressed social implications, including issues related to implementation in specific social and cultural contexts, relationships with other therapeutic options, economic aspects, and the social embeddedness of technologies in broader power dynamics. Moreover, only one publication reflected on the accreditation process for health technologies. Going through the process with a regional health quality agency encouraged ethical reflection through safety, accessibility, usability, and updating requirements. Feedback from this process prompted changes such as implementing a revision calendar and a user tool for suggestions to the app’s administrators [
].Implementation Using Facilitators in Specific Social Contexts
Some publications (6/38, 16%) emphasized the importance of “a plan for real-world implementation” [
] that guarantees that young people actually use the intervention [ , , ]. Suggested strategies included involving youth ambassadors via social media and manuals for facilitators such as teachers [ ]. One intervention provided “guidelines about the resource’s good practices” [ ] for participating youth upon registration and the possibility to report misconduct and disrespectful messages [ ]. Often, the complementary use of digital interventions with face-to-face interactions was recommended, for example, advocating for a “blended facilitated approach” [ ]. One study adapted an intervention for anger and aggression initially tested in a hospital to provide nonstigmatized care to children from minority groups and of lower socioeconomic statuses, addressing the challenge that “most therapies for children fail in community ‘real-world’ settings” [ ].Several publications (4/38, 11%) addressed the role of facilitators. For example, an intervention aimed at refugee youth emphasized the importance of facilitators to debrief “hard to deal with” [
] themes, for example, through a relaxation exercise. Another intervention in the sub-Saharan African context involved peer mentors (ie, trained lay workers) who actively reached out by phone on a weekly basis to improve program adherence and answer technical questions [ ]. One publication recommended school-based interventions to be led by teachers instead of mental health professionals because of their preexisting connections with the adolescents [ ]. In a video game for children aged 6 to 10 years, empowerment was engendered by facilitator-led group activities, in particular “group processes like respect, inclusion, sharing and belonging, which were transferrable to a small online group through sensitive and skilled facilitation” [ ]. The same study thematized how facilitators’ initial hesitance toward digital mental health technologies was mitigated through intervention implementation, which resulted in increased “technical confidence and programme fidelity” [ ]. Thereby, it shows how the use of technologies can increase acceptability.Furthermore, the studies highlighted direct social interactions with persons experiencing mental disorders as beneficial and effective [
, ]. For instance, one study discussed how face-to-face interactions with “lived experience workers” [ ] who had a history of depression fostered “an environment of reciprocity, making it easier for students to share their own stories” [ ]. It also recommended that a trained teacher or, ideally, a mental health care professional should be present during these interactions to support students in need of assistance and familiarize them with existing mental health support offers in schools [ ]. Direct social interactions were also found to reinforce destigmatizing effects, for example, when young people shared their intervention experiences with friends and family [ ].Parent and family involvement were discussed across several studies (4/38, 11%) [
, , , ]. One study focusing on Maori youth highlighted a “collectivist approach” [ ], involving whanau (ie, family group) during both development and implementation, for example, providing resources and information to support children’s use of interventions [ ]. Critically reflecting on parent involvement, other publications raised concerns, especially when families are involved in therapeutic difficulties or when parents are hesitant to support program participation [ ]. In addition, one study noted positive effects of digital interventions on family dynamics, noting improvements in relationships and increased insights among family members [ ].Moreover, the studies highlighted the role of schools in successful implementation [
]. For example, it was recommended to integrate interventions into existing school-based prevention programs [ , ] and into the school curriculum to “increase normalization of mental health education at school” [ ]. Two of the studies (2/38, 5%) addressed concerns regarding adolescent screen time with the active involvement of schools [ , ], for example, through “counsellor-supported use of smartphones during dedicated school-based sessions” [ ].Finally, one publication posited normative claims, which are statements about how things should be or what actions are considered right, regarding developers’ and researchers’ responsibilities after intervention development. It claimed that “researchers should accept the ongoing responsibility to gather data that helps to establish the boundaries of acceptable use and update and evolve guidelines accordingly” [
].Relationship With Other Therapeutic Options
Several publications (4/38, 11%) emphasized the embeddedness of digital interventions within other therapeutic options, underscoring the ongoing importance of face-to-face therapy [
, , , ]. For instance, one study found that children generally preferred in-person interactions due to the intimacy and meaningfulness that arises from being physically together, the enjoyment of shared activities, and the ability to communicate openly. It highlighted “the potential for combined, engaging and resource-effective approaches” [ ] that blend digital and face-to-face elements to cater to varying levels of needs effectively [ ]. The studies framed digital interventions as “technology-enabled services, which serve to support the overall service or therapeutic process” [ ], rather than as stand-alone solutions. In addition, the establishment of “communities of practice” [ ] was suggested, where therapists and intervention developers could share positive and negative experiences with new technologies to prompt discussions about “how technologies fit with the broader ecosystem” [ ]. For example, therapists encountered challenges when installing interventions on organizational computers and when needing parental consent for app installation [ ].Regarding therapists’ autonomy, there was acknowledgment of the diverse ways in which therapists use digital interventions [
]. Some therapists used digital tools as their primary approach, whereas others only turned to them when traditional face-to-face methods were met with resistance from young people [ ]. One publication also mentioned the possibility to alternate between digital and other therapeutic elements within a single session. In terms of gamification elements, one approach involved implementing “a specific start and end” [ ] to allow children to transition seamlessly from device use to other therapy activities.Economic Aspects
Two publications (2/38, 11%) addressed the economic aspects of developing and implementing digital mental health interventions. One study advocated integrating cost-effective commercial digital interventions into clinical settings to address resource constraints and treatment delays at the health system level [
]. Moreover, one publication disclosed potential financial interests, indicating that the authors’ nonuniversity organization “may benefit financially from the sale of this game” [ ].Another topic was funding. The challenge of limited funding for serious games compared to commercial games was noted [
]. One publication stressed scientists’ responsibility to actively influence the commercial gaming industry, advocating for their proactive engagement to demonstrate “the financial, as well as health, benefits of providing beautiful, entertaining, and scientifically validated mental health tools” [ ]. In a nonprofit intervention, funding limitations were a significant concern, requiring cofunding during development and additional funding after development for maintenance and updates to enhance user engagement [ ].Social Embeddedness of Technologies
The studies rarely reflected on the social embeddedness of technologies within larger governance and power mechanisms. One publication addressed concerns of adolescents at risk of school refusal regarding a gamified intervention being “yet another thing to deal with” [
] among the already overwhelming demands of their daily lives. To mitigate this concern, it was suggested to provide players with a “sense of mastery from their particular position” [ ], offer positive feedback regardless of outcomes, and be mindful toward in-game formulations [ ].Another publication explicitly considered digital mental health interventions within larger power dynamics [
]. It found Indigenous youth’s reluctance to share personal information via an application being related to historical experiences of colonization. This reflects “the remaining ties between technology and colonization, which tend to position technology as having Western-European ontologies and the legacy of unethical research practices” [ ].Discussion
Principal Findings
From our review of 38 publications, we identified and classified various ethical aspects into four areas: (1) research ethics, (2) ethical principles (including privacy, accessibility, empowerment and autonomy, cultural and social sensitivity, co-design, and psychological and educational value), (3) vulnerable groups, and (4) social implications (including implementation using facilitators in specific social contexts, relationship with other therapeutic options, economic aspects, and social embeddedness of technologies). In the following sections, we highlight how our analysis shows instrumental conceptions of co-design and pragmatic approaches to vulnerability, a limited discussion of technologies’ social embeddedness in current research, and a limited interpretation of “ethics” as research ethics across the analyzed studies.
Instrumental Conceptions of Co-Design and Pragmatic Approaches to Vulnerability
While 18% (7/38) of the studies recognized the value of co-design, the rationale for adopting this approach often focused on enhancing appeal and acceptability rather than prioritizing inclusivity, fostering multiperspective reflection, or engaging in other ethical considerations. The risk here is reducing co-design to a tool for determining the preferences of particular groups of young people. In contrast, research on co-design in technology development has advocated for “the development of co-design methodologies that include ethical issues in more explicit and comprehensive ways” [
]. These research approaches shift the focus to shared responsibilities among developers, users, and the public.Studies focusing on vulnerable groups seldom discussed intersectionality, referring to the compounded impact of multiple disadvantages. Instead, these studies addressed the mental health needs of vulnerable groups pragmatically, aiming to enable the design and implementation of effective interventions for the targeted group. Moreover, while the papers emphasized the importance of addressing the needs of the specific vulnerable group under study, they lacked reflections on the decision-making process for prioritizing one vulnerable group over others. In addition, some studies highlighted the tension between personalized mental health services and one-size-fits-all digital interventions that may not cater to individual needs, especially when personally experiencing vulnerability. While customization options such as customizable avatars can address this issue by enhancing cultural and social sensitivity, therapists in particular warned about the potential drawbacks compared to personalized care practices.
Limited Discussion of the Social Embeddedness of Technologies
Social constructivists have established that the meaning and use of technology can only be understood by taking its social embeddedness into consideration [
]. Technology and society are interdependent, mutually shaping each other [ ]—social factors shape the purpose, methods, and objectives of technology design, whereas technology may facilitate social change. The studies included in this review rarely discussed this interdependency. An exception was a minor comment in one publication, which addressed how facilitators’ initial doubts about digital mental health tools were overcome during intervention implementation [ ]. These findings not only demonstrate how implementing a digital intervention can enhance acceptance but also implicitly address how it ultimately alters people’s perceptions of this technology.Moreover, only 2 of the publications (2/38, 5%) discussed the social embeddedness of technologies within larger governance and power mechanisms. One study on developing an intervention for Indigenous young people addressed the risk of taking up colonial legacies [
], and another publication reflected on how digital mental health interventions might reproduce the structural burden of work overload and stress [ ]. This relates to critical scholarship on serious games, which discusses the use of serious games for increasing mental health as part of neoliberal governance strategies, which control life by applying metrics of utility, productivity, and competitiveness [ ].In addition, future research should further explore how accreditation processes with governmental health agencies can influence ethically relevant design choices, which was only mentioned in the study by Duarte-Hueros et al [
]. In addition, insights on decisions not to seek accreditation for health technologies would be valuable. In fact, almost all the publications on gamified digital mental health technologies for young people either omitted or did not mention undergoing these regulatory procedures.Finally, most publications (37/38, 97%) largely overlooked environmental factors except for one study that tentatively claimed environmental friendliness due to reduced paper use compared to traditional therapeutic methods [
]. However, as part of reflecting accessibility issues, other publications implicitly discussed environmental considerations, such as addressing limited storage space and internet access in socioeconomically disadvantaged areas. However, it is also crucial to reflect on data storage and server load generated by digital interventions in more affluent contexts.Identifying Ethical Aspects Beyond Research Ethics
When excluding 43 studies at the full-text screening stage, we were surprised by how many publications did not report on “ethics” at all (n=8, 21%), only mentioned an obtained ethics committee vote (n=10, 26%), or reported on ethically relevant decisions without discussing them (n=9, 24%;
). While we cannot assert whether or how the broader projects underlying these 23 publications addressed ethical considerations elsewhere or through their practices, our review indicates a scarcity of ethical reflection in publications concerning gamified digital mental health interventions for young people. A considerable proportion of studies in this review (21/38, 55%) centered on user experiences. This is unsurprising given our inclusion criteria limited to studies addressing ethical aspects. Qualitative methodologies in particular tend to foreground ethical considerations, facilitating the emergence of novel themes and fostering critical reflection among users and their care providers regarding the intervention.Our results show reflections on diverse ethical challenges and advantages. However, the studies rarely framed these reflections as addressing ethical aspects. Hence, the terms “ethics” and “ethical” were only used in the context of research ethics across the 38 included publications. This indicates an overall narrow view of ethics, which confines ethics to aspects relevant only to interactions with research participants, potentially relegating it to a bothersome and technocratic prerequisite for institutional approval. This risks missing out on important reflections on ethical aspects, which are pertinent not only to research participant involvement during usability testing and effectiveness measurements but also across the entire technology development cycle. One exception is a short conference paper on an intervention with wearable biosensor technology and 3D holographic displays. It explicitly addressed “ethical challenges” [
] in the form of raising questions without providing further discussions. It asked the following: “Can a robotic agent manage or mitigate emotional or empathetic distress in young children? What are the negative consequences of enabling children to interact with each other’s e-worlds? How do children feel about sharing their memories in a public space?” [ ].Concerning research ethical reflection, while 82% (31/38) of the studies indicated an obtained research ethics committee vote, only 26% (10/38) provided detailed considerations of research ethics. These insights align with an ongoing scholarly debate on the drawbacks of the expansion of ethics committees and similar institutions. Social scientists warn of the potential disconnect between adhering to predefined ethical codes of conduct in scholarly research stemming from these developments [
- ]. This review shows how ethical reflections can help address critical decisions at every step of the technology development process.Limitations and Future Research
Several limitations as well as avenues for future research emerge. First, during the screening process, contrary to our initial expectations, it was not possible to assess the relevance of publications regarding ethical aspects based solely on titles and abstracts. Consequently, we opted to set aside ethics-related inclusion and exclusion criteria during abstract and full-text screening, considering them only during full-text assessment. While this merits further discussion on how the inclusion of ethics-related terms shape the search, one limitation of our methodology is that we did not cross-verify the relevance of studies excluded by our ethics-related search terms.
Second, we included relevant gray literature only in our discussion due to feasibility constraints, but future studies could explore it more thoroughly for potentially interesting results. Third, this review examined interventions targeting various mental health aspects across the board. In future research, it would be beneficial to address the specific ethical considerations tied to different understandings of mental health. For instance, interventions aimed at enhancing social connections may encounter distinct ethical challenges compared to those focused on raising awareness about depressive symptoms. Fourth, the disciplinary backgrounds of the study authors might deserve closer attention in future research as they might potentially foster discussions and negotiations of conflicting values.
Fifth, an existing ethical framework for gamified fitness-tracking apps distinguishes among ethical considerations related to design, use, and embeddedness in the broader social context [
]. Our findings implicitly reflect these distinctions. Future research could further clarify how ethical issues distinctly manifest at different project stages of gamified digital mental health intervention development and implementation. Moreover, the reviewed publications did not address common ethical concerns in the literature on ethical issues in gamification, such as exploitation, manipulation, competition, or addiction, which have been raised in other contexts [ ] such as corporate work [ ]. This omission may be due to the publications’ focus not being on ethics, or it could reflect the underexplored area of mental health in gamification. This yields opportunities to further examine the unique ethical issues within the mental health context.Seventh, although we initially aimed to analyze ethical advantages, the publications primarily mentioned these as part of the interventions’ general context. They referenced the work of others rather than providing concrete insights from their specific intervention developments, such as health economic calculations on the actual cost-effectiveness of a particular intervention. Such discussions tend to formulate overloaded expectations without an empirical basis. This aspect deserves closer attention to mitigate the risk of bordering on rhetoric and merely invoking “solutionism”—the belief that technology can solve all problems [
]. Thereby, digital “solutions” might hinder more holistic approaches and changes to structural flaws.Finally, only 16% (6/38) of the reviewed publications addressed interventions in Asia, Africa, and South America. Of these, only Uganda and India are classified by the World Bank as low- or lower-middle-income countries. Future research on digital mental health interventions for young people should further highlight the importance of understanding the ethical challenges in these areas of the world [
].Conclusions
The aim of this scoping review was to map the ethical aspects of developing and implementing gamified digital mental health interventions for young people. It showed how the 38 publications included for analysis discussed ethical aspects across the areas of research ethics, ethical principles, vulnerable groups, and social implications. It provided concrete examples from real-world intervention development. Thereby, our findings illustrate how ethical issues manifest in different interventions and (do not) prompt diverse reflections, mitigation strategies, and actions. From this perspective, ethics can be seen as an ongoing practice not only in research ethical considerations or in self-imposed “ethics checklists” but also across all project stages. Examples include economic considerations on funding, which become pertinent already at the very onset of a project, and the involvement of facilitators such as teachers and therapists during development but also afterward when implementing an intervention.
Methodologically, this review used an abductive approach [
] to ethics informed by existing research and guidelines on digital mental health interventions, our own practical knowledge as ethics researchers, and sensitivity toward empirically emerging ethical aspects from the included publications. By not working with a predefined and closed conception of ethics, we were able to effectively identify ethically significant decisions and considerations that were not explicitly labeled as ethical reflections in the publications selected for review.To conclude, while existing research has rarely addressed the ethical aspects of gamified digital mental health interventions for adolescents explicitly, this review identified and analyzed how publications have addressed ethically relevant decisions and considerations involved in developing and implementing these interventions. The examples of ethical reflections provided in this paper should not be taken as “good solutions” in the sense of best-practice examples. Rather, this review maps the breadth of ethical discussions, aiming to foster an understanding of serious game ethics as an ongoing practice across all project stages. Beyond ethics checklists, this review advocates for collaborative critical reflection among mental health researchers and game developers.
Acknowledgments
The authors are grateful to Jaspreet Kaur, Simran Kaur, and Robin Singh for their valuable support during the title and abstract screening process. This research was funded by the European Union and UK Research and Innovation. However, the views and opinions expressed are those of the authors only and do not necessarily reflect those of the European Union, the European Health and Digital Executive Agency, or UK Research and Innovation. Neither the European Union nor the granting authority can be held responsible for them.
Authors' Contributions
All authors contributed to the study design and revised the original draft. WS conducted the literature search. WS and VM conducted data extraction and data analysis. WS and GR authored the initial draft with contributions from VM. WS edited the final manuscript.
Conflicts of Interest
None declared.
PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) checklist.
PDF File (Adobe PDF File), 497 KBSearch terms and search strings for each database.
DOCX File , 25 KBTable with all ethics-related direct quotes and summaries extracted from the 38 included publications.
XLSX File (Microsoft Excel File), 101 KBList of the key characteristics of the 38 included publications.
XLSX File (Microsoft Excel File), 25 KBReferences
- Kauhanen L, Wan Mohd Yunus WM, Lempinen L, Peltonen K, Gyllenberg D, Mishina K, et al. A systematic review of the mental health changes of children and young people before and during the COVID-19 pandemic. Eur Child Adolesc Psychiatry. Jun 2023;32(6):995-1013. [FREE Full text] [CrossRef] [Medline]
- World mental health report: transforming mental health for all. World Health Organization (WHO). 2022. URL: https://iris.who.int/bitstream/handle/10665/356119/9789240049338-eng.pdf?sequence=1 [accessed 2024-01-20]
- Dingli A, Seychell D. Who are the digital natives? In: Dingli A, Seychell D, editors. The New Digital Natives: Cutting the Chord. Cham, Switzerland. Springer; 2015:9-22.
- Das JK, Salam RA, Lassi ZS, Khan MN, Mahmood W, Patel V, et al. Interventions for adolescent mental health: an overview of systematic reviews. J Adolesc Health. Oct 2016;59(4S):S49-S60. [FREE Full text] [CrossRef] [Medline]
- Lehtimaki S, Martic J, Wahl B, Foster KT, Schwalbe N. Evidence on digital mental health interventions for adolescents and young people: systematic overview. JMIR Ment Health. Apr 29, 2021;8(4):e25847. [FREE Full text] [CrossRef] [Medline]
- Fleming TM, Bavin L, Stasiak K, Hermansson-Webb E, Merry SN, Cheek C, et al. Serious games and gamification for mental health: current status and promising directions. Front Psychiatry. 2016;7:215. [FREE Full text] [CrossRef] [Medline]
- Gkintoni E, Vantaraki F, Skoulidi C, Anastassopoulos P, Vantarakis A. Promoting physical and mental health among children and adolescents via gamification-a conceptual systematic review. Behav Sci (Basel). Jan 29, 2024;14(2):102. [FREE Full text] [CrossRef] [Medline]
- Rubeis G. E-mental health applications for depression: an evidence-based ethical analysis. Eur Arch Psychiatry Clin Neurosci. Apr 2021;271(3):549-555. [CrossRef] [Medline]
- Rubeis G. iHealth: the ethics of artificial intelligence and big data in mental healthcare. Internet Interv. Apr 2022;28:100518. [FREE Full text] [CrossRef] [Medline]
- Jones N, Moffitt M. Ethical guidelines for mobile app development within health and mental health fields. Prof Psychol Res Pr. Apr 2016;47(2):155-162. [CrossRef]
- The role of technology in mental healthcare (Bioethics Briefing Note). Nuffield Council on Bioethics. 2022. URL: https://www.nuffieldbioethics.org/publications/technology-in-mental-healthcare [accessed 2024-01-20]
- Wykes T, Lipshitz J, Schueller SM. Towards the design of ethical standards related to digital mental health and all its applications. Curr Treat Options Psych. Jul 5, 2019;6(3):232-242. [CrossRef]
- Khanna MS, Carper M. Digital mental health interventions for child and adolescent anxiety. Cogn Behav Pract. Feb 2022;29(1):60-68. [CrossRef]
- Wies B, Landers C, Ienca M. Digital mental health for young people: a scoping review of ethical promises and challenges. Front Digit Health. 2021;3:697072. [FREE Full text] [CrossRef] [Medline]
- McCall R, Baillie L. Ethics, privacy, and trust in serious games. In: Nakatsu R, Rauterberg M, Ciancarini P, editors. Handbook of Digital Games and Entertainment Technologies. Cham, Switzerland. Springer; 2017:611-640.
- Sandovar A, Braad E, Streicher A, Söbke H. Ethical stewardship: designing serious games seriously. In: Dörner R, Göbel S, Kickmeier-Rust M, Masuch M, Zweig K, editors. Entertainment Computing and Serious Games. Cham, Switzerland. Springer; 2016:42-62.
- Zagal JP. Ethically notable videogames: moral dilemmas and gameplay. In: Proceedings of DiGRA 2009 Conference: Breaking New Ground on Innovation in Games, Play, Practice and Theory. 2009. Presented at: DiGRA '09; September 1-4, 2009:1-9; West London, UK. URL: https://dl.digra.org/index.php/dl/article/view/362/
- Ferrari M, Sabetti J, McIlwaine SV, Fazeli S, Sadati SM, Shah JL, et al. Gaming my way to recovery: a systematic scoping review of digital game interventions for young people's mental health treatment and promotion. Front Digit Health. 2022;4:814248. [FREE Full text] [CrossRef] [Medline]
- Home page. Augmented Social Play. URL: https://www.augmentedsocialplay.com [accessed 2024-11-11]
- Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. Sep 2015;13(3):141-146. [CrossRef] [Medline]
- Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467-473. [FREE Full text] [CrossRef] [Medline]
- Kriglstein S, Mittmann G, Barnard A, Woodcock K. Making a real connection: pro-social collaborative play in extended realities – trends, challenges and potentials. In: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia. 2023. Presented at: MUM '23; December 3-6, 2023:544-547; Vienna, Austria. URL: https://dl.acm.org/doi/10.1145/3626705.3626708 [CrossRef]
- Cheng VW, Davenport T, Johnson D, Vella K, Hickie IB. Gamification in apps and technologies for improving mental health and well-being: systematic review. JMIR Ment Health. 2019;6(6):e13717. [FREE Full text] [CrossRef] [Medline]
- Conley CS, Raposa EB, Bartolotta K, Broner SE, Hareli M, Forbes N, et al. The impact of mobile technology-delivered interventions on youth well-being: systematic review and 3-level meta-analysis. JMIR Ment Health. 2022;9(7):e34254. [FREE Full text] [CrossRef] [Medline]
- Williams JE, Pykett J. Mental health monitoring apps for depression and anxiety in children and young people: a scoping review and critical ecological analysis. Soc Sci Med. 2022;297:114802. [FREE Full text] [CrossRef] [Medline]
- Felber NA, Tian YJ, Pageau F, Elger BS, Wangmo T. Mapping ethical issues in the use of smart home health technologies to care for older persons: a systematic review. BMC Med Ethics. 2023;24(1):24. [FREE Full text] [CrossRef] [Medline]
- Gopichandran V, Subramaniam S, Thiagesan R. Ethical issues in m-Health applications in community health work in India - a scoping review. Indian J Med Ethics. 2023;VIII(4):266-273. [FREE Full text] [CrossRef] [Medline]
- Vandemeulebroucke T, Denier Y, Mertens E, Gastmans C. Which framework to use? A systematic review of ethical frameworks for the screening or evaluation of health technology innovations. Sci Eng Ethics. 2022;28(3):26. [CrossRef] [Medline]
- Tavory I, Timmermans S. Abductive Analysis: Theorizing Qualitative Research. New York, NY. University of Chicago Press; 2014.
- Gijzen M, Rasing S, van den Boogaart R, Rongen W, van der Steen T, Creemers D, et al. Feasibility of a serious game coupled with a contact-based session led by lived experience workers for depression prevention in high-school students. PLoS One. 2021;16(11):e0260224. [FREE Full text] [CrossRef] [Medline]
- Au-Yeung A, Marfatia D, Beers K, General DA, McQueen KC, Martin-Hill D, et al. Six Nations Youth Mental Wellness Committee. Exploring the feasibility of a mental health application (JoyPop) for Indigenous youth. Front Psychiatry. 2023;14:1269347. [FREE Full text] [CrossRef] [Medline]
- Shepherd M, Fleming T, Lucassen M, Stasiak K, Lambie I, Merry SN. The design and relevance of a computerized gamified depression therapy program for indigenous māori adolescents. JMIR Serious Games. 2015;3(1):e1. [FREE Full text] [CrossRef] [Medline]
- Sanchez R, Brown E, Kocher K, DeRosier M. Improving children's mental health with a digital social skills development game: a randomized controlled efficacy trial of adventures aboard the S.S. GRIN. Games Health J. 2017;6(1):19-27. [CrossRef] [Medline]
- Høiseth M, Alsos OA, Holme S, Ek S, Tendenes Gabrielsen C. Serious game design to support children struggling with school refusal. Int J Serious Games. Jun 04, 2021;8(2):109-128. [CrossRef]
- Mannweiler M, Schuermann H, Peechatka A, Kahn J. Biofeedback-based videogames: fostering emotion regulation at a diverse community summer camp. Games Health J. 2023;12(5):350-357. [CrossRef] [Medline]
- Parsons S, Karakosta E, Boniface M, Crowle S. Prosocial games for inclusion: interaction patterns and game outcomes for elementary-aged children. Int J Child Comput Interact. Dec 2019;22:100142. [CrossRef]
- Pozuelo JR, Moffett BD, Davis M, Stein A, Cohen H, Craske MG, et al. User-centered design of a gamified mental health app for adolescents in sub-Saharan Africa: multicycle usability testing study. JMIR Form Res. Nov 30, 2023;7:e51423. [FREE Full text] [CrossRef] [Medline]
- Lim MH, Gleeson JF, Rodebaugh TL, Eres R, Long KM, Casey K, et al. A pilot digital intervention targeting loneliness in young people with psychosis. Soc Psychiatry Psychiatr Epidemiol. Jul 2020;55(7):877-889. [CrossRef] [Medline]
- Sockolow P, Schug S, Zhu J, Smith T, Senathirajah Y, Bloom S. At-risk adolescents as experts in a new requirements elicitation procedure for the development of a smart phone psychoeducational trauma-informed care application. Inform Health Soc Care. Jan 2017;42(1):77-96. [CrossRef] [Medline]
- Cheek C, Fleming T, Lucassen MF, Bridgman H, Stasiak K, Shepherd M, et al. Integrating health behavior theory and design elements in serious games. JMIR Ment Health. 2015;2(2):e11. [FREE Full text] [CrossRef] [Medline]
- Aneni K, Fernandes CS, Hoerner LA, Szapary C, Pendergrass Boomer TM, Fiellin LE. A video game intervention to prevent opioid misuse among older adolescents: development and preimplementation study. JMIR Serious Games. Nov 03, 2023;11:e46912. [FREE Full text] [CrossRef] [Medline]
- Bordini RA, Korn O. Strengthening invisible ties: decreasing loneliness indices of university students through a gamified mobile app. In: Proceedings of the 2022 ACM Conference on Information Technology for Social Good. 2022. Presented at: GoodIT '22; September 7-9, 2022:424-430; Limassol, Cyprus. URL: https://dl.acm.org/doi/10.1145/3524458.3548489 [CrossRef]
- Duarte-Hueros A, Yot-Domínguez C, Merino-Godoy Á. Healthy Jeart. Developing an app to promote health among young people. Educ Inf Technol. Nov 26, 2019;25(3):1837-1854. [CrossRef]
- Freeland L, O’Reilly M, Fleury J, Adams S, Vostanis P. Digital social and emotional literacy intervention for vulnerable children in Brazil: participants’ experiences. Int J Ment Health Promot. 2022;24(1):51-67. [FREE Full text] [CrossRef]
- Garrido S, Oliver E, Chmiel A, Doran B, Boydell K. Encouraging help-seeking and engagement in a mental health app: what young people want. Front Digit Health. 2022;4:1045765. [FREE Full text] [CrossRef] [Medline]
- Gonsalves PP, Hodgson ES, Kumar A, Aurora T, Chandak Y, Sharma R, et al. Design and development of the “POD adventures” smartphone game: a blended problem-solving intervention for adolescent mental health in India. Front Public Health. 2019;7:238. [FREE Full text] [CrossRef] [Medline]
- Saleme P, Dietrich T, Pang B, Parkinson J. Design of a digital game intervention to promote socio-emotional skills and prosocial behavior in children. Multimodal Technol Interact. Sep 23, 2021;5(10):58. [CrossRef]
- Pisani AR, Wyman PA, Gurditta K, Schmeelk-Cone K, Anderson CL, Judd E. Mobile phone intervention to reduce youth suicide in rural communities: field test. JMIR Ment Health. May 31, 2018;5(2):e10425. [FREE Full text] [CrossRef] [Medline]
- Jaramillo-Alcázar A, Arias J, Albornoz I, Alvarado A, Luján-Mora S. Method for the development of accessible mobile serious games for children with autism spectrum disorder. Int J Environ Res Public Health. Mar 24, 2022;19(7):3844. [FREE Full text] [CrossRef] [Medline]
- van der Meulen H, O'Reilly G, Coyle D. Including end-users in evaluating and designing a game that supports child mental health. In: Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. 2018. Presented at: CHI PLAY '18; October 28-31, 2018:655-659; Melbourne, Australia. URL: https://dl.acm.org/doi/10.1145/3270316.3271546 [CrossRef]
- Schuler BR, Raknes S. Does group size and blending matter? Impact of a digital mental health game implemented with refugees in various settings. IJMHSC. Feb 24, 2022;18(1):83-94. [CrossRef]
- Schoneveld EA, Lichtwarck-Aschoff A, Granic I. Preventing childhood anxiety disorders: is an applied game as effective as a cognitive behavioral therapy-based program? Prev Sci. Feb 2018;19(2):220-232. [FREE Full text] [CrossRef] [Medline]
- Cangas AJ, Navarro N, Parra JM, Ojeda JJ, Cangas D, Piedra JA, et al. Stigma-stop: a serious game against the stigma toward mental health in educational settings. Front Psychol. 2017;8:1385. [FREE Full text] [CrossRef] [Medline]
- Johnson RW, White BK, Gucciardi DF, Gibson N, Williams SA. Intervention mapping of a gamified therapy prescription app for children with disabilities: user-centered design approach. JMIR Pediatr Parent. Aug 09, 2022;5(3):e34588. [FREE Full text] [CrossRef] [Medline]
- Mittmann G, Barnard A, Krammer I, Martins D, Dias J. LINA - a social augmented reality game around mental health, supporting real-world connection and sense of belonging for early adolescents. Proc ACM Hum Comput Interact. Oct 31, 2022;6(CHI PLAY):1-21. [CrossRef]
- Christie GI, Shepherd M, Merry SN, Hopkins S, Knightly S, Stasiak K. Gamifying CBT to deliver emotional health treatment to young people on smartphones. Internet Interv. Dec 2019;18:100286. [FREE Full text] [CrossRef] [Medline]
- Lockwood J, Williams L, Martin JL, Rathee M, Hill C. Effectiveness, user engagement and experience, and safety of a mobile app (Lumi Nova) delivering exposure-based cognitive behavioral therapy strategies to manage anxiety in children via immersive gaming technology: preliminary evaluation study. JMIR Ment Health. Jan 24, 2022;9(1):e29008. [FREE Full text] [CrossRef] [Medline]
- Tuijnman A, Granic I, Whitkin J, Engels RC. Developing and testing scrollquest: a video game targeting rejection sensitivity in adolescents. In: Proceedings of the 2017 Conference on Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play. 2017. Presented at: CHI PLAY '17; October 15-18, 2017:213-221; Amsterdam, The Netherlands. URL: https://dl.acm.org/doi/10.1145/3130859.3131302 [CrossRef]
- Cai J, Li XL, Chen B, Wang Z, Jia J. CatHill: emotion-based interactive storytelling game as a digital mental health intervention. In: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Syste. 2023. Presented at: CHI EA '23; April 23-28, 2023:1-7; Hamburg, Germany. URL: https://dl.acm.org/doi/10.1145/3544549.3585639 [CrossRef]
- Udapola UB. Gamified VR for socially isolated adolescents with significant illness. In: Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops. 2022. Presented at: VRW '22; March 12-16, 2022:924-925; Christchurch, New Zealand. URL: https://ieeexplore.ieee.org/document/9757634 [CrossRef]
- Egan JE, Corey SL, Henderson ER, Abebe KZ, Louth-Marquez W, Espelage D, et al. Feasibility of a web-accessible game-based intervention aimed at improving help seeking and coping among sexual and gender minority youth: results from a randomized controlled trial. J Adolesc Health. Oct 2021;69(4):604-614. [FREE Full text] [CrossRef] [Medline]
- Kriegshauser KD, Sexton CC, Bozsik FM, Blossom JB, Wiese AD, Adams Larsen M, et al. The feasibility of a family-focused CBT skills self-help app. Cogn Behav Pract. May 2024;31(2):230-249. [CrossRef]
- van der Meulen H, McCashin D, O'Reilly G, Coyle D. Using computer games to support mental health interventions: naturalistic deployment study. JMIR Ment Health. May 09, 2019;6(5):e12430. [FREE Full text] [CrossRef] [Medline]
- Bordini RA, Korn O. Noneliness: a gamified mobile app to reduce loneliness among university students. In: Proceedings of the Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play. 2021. Presented at: CHI PLAY '21; October 18-21, 2021:87-93; Virtual Event. URL: https://dl.acm.org/doi/10.1145/3450337.3483480 [CrossRef]
- Shum AK, Lai ES, Leung WG, Cheng MN, Wong HK, So SW, et al. A digital game and school-based intervention for students in Hong Kong: quasi-experimental design. J Med Internet Res. Apr 05, 2019;21(4):e12003. [FREE Full text] [CrossRef] [Medline]
- Antle AN, Sadka O, Radu I, Gong B, Cheung V, Baishya U. EmotoTent: reducing school violence through embodied empathy games. In: Proceedings of the 18th ACM International Conference on Interaction Design and Children. 2019. Presented at: IDC '19; June 12-15, 2019:755-760; Boise, ID. URL: https://dl.acm.org/doi/10.1145/3311927.3326596 [CrossRef]
- Ooi YP, Goh DH, Mekler ED, Tuch AN, Boon J, Ang RP, et al. Understanding player perceptions of RegnaTales, a mobile game for teaching social problem solving skills. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing. 2016. Presented at: SAC '16; April 4-8, 2016:167-172; Pisa, Italy. URL: https://dl.acm.org/doi/10.1145/2851613.2851678 [CrossRef]
- Liegl M, Boden A, Büscher M, Oliphant R, Kerasidou X. Designing for ethical innovation: a case study on ELSI co-design in emergency. Int J Child Comput Interact. Nov 2016;95:80-95. [CrossRef]
- Pinch T. The social construction of technology: a review. In: Fox R, editor. Technological Change Methods and Themes in the History of Technology. New York, NY. Routledge; 1996:17-35.
- Quan-Haase A. Technology and Society: Social Networks, Power, and Inequality. Oxford, UK. Oxford University Press; 2013.
- Russell SJ. Human Compatible: Artificial Intelligence and the Problem of Control. New York, NY. Penguin Publication; 2019.
- Haggerty KD. Ethics creep: governing social science research in the name of ethics. Qual Sociol. 2004;27(4):391-414. [CrossRef]
- de Koning M, Meyer B, Moors A, Pels P. Guidelines for anthropological research: data management, ethics, and integrity. Ethnography. Apr 24, 2019;20(2):170-174. [CrossRef]
- Shaw I. Ethics and the practice of qualitative research. Qual Soc Work. Dec 01, 2008;7(4):400-414. [CrossRef]
- Arora C, Razavian M. Ethics of gamification in health and fitness-tracking. Int J Environ Res Public Health. Oct 21, 2021;18(21):11052. [FREE Full text] [CrossRef] [Medline]
- Nyström T. Exploring the darkness of gamification: you want it darker? In: Proceedings of the 2021 Computing Conference on Intelligent Computing. 2021. Presented at: IC '21; July 15-16, 2021:491-506; Virtual Event. URL: https://link.springer.com/chapter/10.1007/978-3-030-80129-8_35 [CrossRef]
- Kim TW, Werbach K. More than just a game: ethical issues in gamification. Ethics Inf Technol. May 12, 2016;18(2):157-173. [CrossRef]
- Morozov E. To Save Everything, Click Here: The Folly of Technological Solutionism. New York, NY. Penguin Publication; 2014.
- Madonsela S, Ware LJ, Scott M, Watermeyer J. The development and use of adolescent mobile mental health (m-mhealth) interventions in low- and middle-income countries: a scoping review. S Afr J Psychol. Jul 08, 2023;53(4):471-483. [CrossRef]
Abbreviations
RQ: research question |
Edited by T Leung, K Erenli; submitted 19.07.24; peer-reviewed by R Ranisch, M Brown; comments to author 27.09.24; revised version received 04.10.24; accepted 18.10.24; published 28.11.24.
Copyright©Wanda Spahl, Valeria Motta, Kate Woodcock, Giovanni Rubeis. Originally published in JMIR Serious Games (https://games.jmir.org), 28.11.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.