Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 10.06.20 in Vol 8, No 2 (2020): Apr-Jun

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/15647, first published Jul 26, 2019.

This paper is in the following e-collection/theme issue:

    Original Paper

    Gamifying Parenting Education Using an App Developed for Pacific and Other New Zealand Families (Play Kindly): Qualitative Study

    1Department of Psychological Medicine, University of Auckland, Auckland, New Zealand

    2Malatest International, Auckland, New Zealand

    3Department of Pacific Health, University of Auckland, Auckland, New Zealand

    Corresponding Author:

    Marthinus J Bekker, MSc, PGDipClinPsych, PhD

    Department of Psychological Medicine

    University of Auckland

    Private Bag 92019

    Auckland Mail Centre

    Auckland, 1142

    New Zealand

    Phone: 64 9 373 7599 ext 92019

    Fax:64 9 373 7013

    Email: marthinus.bekker@auckland.ac.nz


    ABSTRACT

    Background: Play Kindly is a gamified animated app designed to address common behavioral problems in childhood. The interface is designed to appeal to Pacific people, a population group with a higher risk of developing clinically significant behavioral problems than most other ethnic groups in New Zealand.

    Objective: The aim of this study is to explore the opinions of parents and professionals about the acceptability, usability, and content of Play Kindly.

    Methods: We used qualitative and Pacific and Māori research methodologies. A total of five focus groups with 45 parents and 12 individual interviews with professionals were conducted. The five focus groups consisted of 2 pan-Pacific groups, 1 Māori group, 1 open group, and 1 group of young Pacific adults or prospective parents. The professionals were from a range of disciplines, and the majority had expertise in early childhood, parenting interventions, or research in this field.

    Results: Play Kindly appealed to both parents and professionals. Participants related to the scenarios, which were created in collaboration with a playwright and animator. Although most participants liked the Pacific feel, there was some disagreement about how culturally specific the app should be. A range of issues with usability and gamification techniques were highlighted, likely attributed to the low budget and lack of initial co-design with parents as well as professionals with specific expertise in parenting. A number of parents and professionals felt that the parenting strategies were overly simplified and did not take into account the context in which the behavior occurred. Professionals suggested narrowing the focus of the app to deliver two important parenting messages: playing with your child and positively reinforcing desired behaviors.

    Conclusions: Play Kindly is the first culturally adapted parenting app of its kind designed for Pacific parents and other New Zealanders with children 2-5 years of age. This app has potential in Pacific communities where there are limited culturally specific parenting resources. The results of this study will guide improvements of the app prior to testing it in an open trial.

    JMIR Serious Games 2020;8(2):e15647

    doi:10.2196/15647

    KEYWORDS



    Introduction

    O fanau a manu e fafaga i fuga o laau, a o tama a tagata e fafaga i upu.

    “The young ones of birds are fed with nectar; the children of people are fed with words” [1].

    Behavioral problems are common at some time in a child’s development. The way parents respond to these play a major role in how likely the child is to repeat the behavior. If behaviors start to fall outside the normal range for the child’s age and stage of development, they are referred to as disruptive behavior disorders. These disorders can cause difficulties with peer relationships, school performance, aggression, and eventually substance abuse and criminality [2,3].

    A number of evidence-based interventions have been shown to be effective for the prevention and treatment of disruptive behavior disorders. Early intervention with parent management training has been one of the most successful approaches in early and middle childhood [4]. In this training, facilitators teach parents a range of skills for the management of behavior. Unfortunately, there are often barriers for accessing these programs. For example, participating in parenting programs can mean loss of time spent with children and loss of earnings, which is particularly important for families facing economic hardship [5]. In New Zealand, like many other parts of the world, availability of these programs is limited by underfunding and a lack of expertise in the workforce for their delivery. There are a number of rural communities where access to consistent health care is challenging [6].

    Online parenting programs have shown some positive effects on parenting strategies and skills [7-9] relative to control groups and compared with face-to-face parent seminars and bibliotherapy approaches; however, this evidence is modest. Online, gamified parenting interventions delivered on mobile phones and targeted to vulnerable communities have demonstrated reduced behavioral difficulties in children, an increase in more effective parenting strategies, and decreased parental stress [10]. Digital programs could, therefore, address problems with workforce shortages, availability of parents, and geographical isolation. In fact, consumer preference research shows that vulnerable families prefer online resources as a way of receiving parenting support [11,12].

    In New Zealand, approximately 20% of children have a medium to high likelihood of having disruptive behavior [13]. Although this figure is comparable to international findings [4], the risk is higher for Pacific (24%) and Māori (28%) children [13]. One of the reasons is that a higher proportion of these children live in poverty, and the challenges of economic hardship can lead to difficulties in parenting effectively [6]. There are few parenting programs that cater specifically to Pacific and Māori parents. Despite the fact that these groups are considered to be more at risk and that retention is better in parenting programs that are specific to a culture [14], there are few programs with a focus on targeting these populations.

    Pacific groups are the fourth largest major ethnic group in New Zealand [15], and the number of Pacific children is projected to increase at a higher rate than any other ethnic group in New Zealand [15]. A recent study [16] found that compared to Samoan parents in Samoa, Samoan parents living in New Zealand were more authoritarian, especially fathers, who were more likely to undertake harsh discipline. This may be due to the lifestyle in New Zealand where alcohol, drugs, and other risk factors are more prevalent [16]. New Zealand born Samoan and Pacific parents who were more highly educated and had good levels of support were more likely to discard the harsh discipline practices of their parents [17,18].

    “Play Kindly” is the first app in New Zealand designed for a contemporary Pacific audience that uses gamification to teach parenting strategies for everyday behavior problems. The aim of this study was to carry out a qualitative investigation using Pacific and Māori research methods to assess the acceptability, feasibility, and perceived utility of “Play Kindly” from the perspectives of parents and professionals. These research methods are described in the “Design” section.


    Methods

    Intervention

    Play Kindly is an interactive, cross-platform computer game designed for use on a smartphone. The interface is designed to resonate with Pacific people (Figure 1). The ideas, scenario scripts, narration, and artwork were undertaken by a team consisting of an established Pacific academic, a Pacific playwright, and a Pacific animator working alongside researchers and health professionals. Each scenario is short and lasts a few minutes. Parents can choose to play one scenario at separate times or all of them in one sitting. For each scenario, the participant chooses from a drop-down menu the most appropriate way to manage the behavior. Three “great” (correct) answers are needed to progress to the next scenario. Feedback about “fair” or “try again” answers are delivered by an “educator” avatar, who also gives instructions about how to play the game (Figure 2). Behaviors addressed in the game are fights over belongings, refusing to eat, refusing to be dressed, and temper tantrums. The strategies taught are predominantly focused on effective communication with the child, such as using a calm directive voice and eye contact, using distraction, and offering alternative strategies while not engaging in aggressive or harmful strategies.

    The strategies in Play Kindly build on research with Samoan parents using the interactive CD-ROM tool “Play Nicely” [19]. The authors of the original “Play Nicely” described using content from parenting resources distributed by the American Academy of Pediatrics and American Psychological Association from around the time it was developed in the late 1990s, alongside input from multiple experts in the areas of psychology, pediatrics, and early childhood education [20].

    The gamification and behavioral change techniques employed were the use of rewards such as badges, different levels of play, the use of avatars, the ability to customize some features, and feedback on performance.

    Figure 1. Frame from one of the parenting scenario animations in Play Kindly.
    View this figure
    Figure 2. Play sequence from one of the Play Kindly scenarios.
    View this figure

    Design

    The qualitative method was chosen to get an in-depth understanding about how the app was viewed by parents, particularly those groups underrepresented in health research, and professionals. Pacific parents for whom the app had been designed were the main target group. Our methodologies were, therefore, chosen to engage and work effectively and appropriately with Pacific and Māori communities, include both Pacific [21] and Māori [22] approaches, and take into account Pacific and Māori health research guidelines and qualitative research methods.

    Pacific health research approaches are framed around the Pacific cultural values of communal relationships, reciprocity, holism, and respect from the beginning to the end of the research process [21]. The Pacific team, in partnership with a team from the University of Auckland, collaborated to cocreate an evaluation process that incorporated Pacific values and a rigorous scientific method. The cocreation process prioritized the concept of Teu le Vā, which involves identifying and understanding the “vā,” or spaces, between different stakeholders in Pacific research and development, and sharing knowledge across these spaces.

    To establish the “vā,” engagement was in a face-to face manner with Pacific and Māori researchers, and incorporated a welcome ceremony, sharing of food, introductions, and a meaalofa (gift). This is also consistent with Māori tikanga protocols.

    The Māori ethical framework shares many principles with Pacific guidelines and emphasizes whakapapa (relationships), tika (research design), manaakitanga (cultural and social responsibility), and mana (justice and equity) [22].

    Collaboration across teams and communities, and adherence to cultural guidelines demonstrated our attempt to optimize relationships, enhance Pacific and Māori capacity and capability, and conduct research within a cultural framework.

    Participants

    The five focus groups interviewed consisted of 2 contemporary pan-Pacific groups, 1 Māori group, 1 young Pacific adults or prospective parents group, and 1 open group. Pan-Pacific refers to individuals from the major Pacific ethnic groups in New Zealand. Contemporary refers to Pacific people predominantly fluent in English, who are more likely to have been born in New Zealand and belong to multiple ethnic groups. This subset were chosen because the majority (60%) of the Pacific population in New Zealand are in this category [15]. The open group refers to non-Māori and non-Pacific New Zealanders. Table 1 provides further details about each group.

    Table 1. Type of group, numbers, sex, and ethnicity of participant focus groups.
    View this table

    The 12 professionals interviewed individually were from a range of disciplines and had knowledge of child health and development, parenting interventions, or Pacific health. Some professionals had extensive experience in implementing evidence-based parenting interventions. The largest number of respondents were Samoan or New Zealand European. Table 2 provides further details of the professionals who conducted the interviews.

    Table 2. Profession, ethnicity, and number of interviewees in the professional interviews.
    View this table

    Recruitment

    Pacific research team members recruited parents through snowball sampling. A total of 3 people known to one of the research assistances were contacted by telephone. The research assistant gave them information about the study, asked whether they would like to take part, and asked them to identify other potential participants. These people were contacted in the same way. This process continued until the researcher had all the participants needed.

    Snowball sampling is a technique commonly used when a sample of the study is limited to a small subgroup of the population and starts through known acquaintances that fit criteria. The researchers typically ask for assistance from the participants recruited so far to help identify other people with a similar trait or interest. This method was chosen because of historical difficulties in recruiting Pacific and Māori people to take part in research. These communities have reported feeling overresearched and underinvolved in the design and feedback from research in general. This method meant that on two occasions the interviewee knew one of the research assistants, an almost unavoidable circumstance given the small and often well-connected Pacific community, so this research assistant did not conduct the interviews. A total of 55 individuals were approached; 3 individuals did not respond to the invitation to take part, and 7 did not attend the focus group interview as arranged.

    Professionals were recruited by expert sampling, a form of purposive sampling needed to capture the specific expertise required to answer questions about content and cultural appeal. Expert status was defined as a person, preferably of Pacific decent with extensive knowledge based on research or occupation in the area of child health. Names of individuals were put forward by academic staff familiar with those working in the field across New Zealand. These individuals were contacted by phone or email and asked if they would like to take part. The number of professionals interviewed was determined by the emergence of data saturation. One professional knew one of the app designers and was reminded that their responses would be anonymized and kept confidential. By the end of the study, 20 professionals had been contacted by email; 7 were too busy to take part, and 1 stopped responding to emails.

    Procedure

    All focus groups were conducted in English. The focus groups were run by 1-2 Pacific researchers or 1 Pacific researcher and 1 European or New Zealand European researcher. The researchers held either an MD or PhD, or worked in the field of child mental health (psychiatrist or psychologist). Similarly, the Māori focus group was cofacilitated by a Māori facilitator to ensure that Kaupapa Māori research processes were followed. All interviewers were employed as researchers by the University of Auckland with the exception of the Māori facilitator. None had financial interests in the success of the app. The Pacific facilitators knew the app designers and had an interest in Pacific health initiatives in New Zealand.

    Semistructured interviews were chosen to ensure that the aims of the study were addressed but gave space for new themes and ideas to emerge. In line with Kaupapa Māori and Pacific research methodologies and frameworks, focus groups included a welcome ceremony, the sharing of food, introductions, and setting the scene for the research.

    Prior to the focus group or interview, all participants were asked to complete the app. If parents had not looked at the app before the interviews, the research team allowed time for them to start playing it on provided tablets before they commenced, not necessarily finishing the whole app. The focus groups lasted between 45 minutes and 1 hour, and were all face-to-face. The professional interviews lasted between 30-40 minutes and were conducted at the person’s home or workplace, or over the phone. All professionals had familiarized themselves with the app by the time of the interview. Not everyone had completed all of the scenarios due to usability issues. The interviews were digitally recorded and transcribed verbatim. Script and audio were reviewed by Pacific and Māori researchers to ensure accuracy in interpretation. Transcripts were returned for participants to comment.

    Data Analysis

    All focus groups and individual interviews were recorded, and a general inductive approach was used for data analysis. This approach included collecting and becoming familiar with raw data, generating and revising initial codes, searching for themes, and then reviewing and defining themes and subthemes. Codes and themes were derived from the raw data and coded using NVivo software (QSR International) [23].

    The coding was carried out by 1 Pacific, 1 European, and 1 Māori researcher. An initial meeting took place to discuss ideas about codes relevant to the research question. Following this, each researcher worked on transcripts separately coding everything relevant to the research question. The Māori researcher only coded the Māori focus group manuscript alongside the Pacific and European researcher. This was to ensure that codes and themes were interpreted correctly, taking into account the cultural context. Overall, 40% of the data was independently coded by at least 2 researchers, and any disagreements were resolved by discussion. The codes were then organized into broader themes related to the research question. These were reviewed and modified until it was felt that the data accurately supported the data and captured the entire data set.

    Ethical Approval

    Ethics approval for this research was obtained through The University of Auckland Human Participants Ethics Committee (Ref 018135).


    Results

    Results are summarized in Table 3 across themes that were identified of acceptability, usability, cultural specificity, and content.

    The Pacific theme and real-life nature of scenarios appealed to most regardless of ethnicity. There was some disagreement about how culture specific the app should be, and opinions were likely to be influenced by how strongly the person identified with their own culture. The involvement of an artist and playwright helped to create something that felt real, but the light-hearted approach began to get lost as professionals tried to deliver parenting advice. The main point of contention for some was the virtual coach (avatar) who was referred to as an “educator.”

    The main concerns about content were parenting advice not being tailored for individual families, not taking into account the context in which the behavior occurred, and not providing sufficient instruction to teach strategies effectively. Addressing this could be challenging, as longer explanations would detract from the game, and video demonstrations would use too much data.

    Table 3. Major themes, subthemes, descriptions, and examples from the data.
    View this table

    To progress to the next scenario, parents needed to choose three “great” answers, but this was often not clear to them. Professionals felt that distinguishing between a “great” and a “fair” answer was unhelpful because perfect parenting was idealistic. There was also some disagreement about what should constitute a good or fair answer. Professionals were concerned about the effect on struggling parents who could not progress through the scenarios and how this might impact their view of themselves as parents.

    Finally, professionals recommended that the app should focus on an aspect of parenting rather than general parenting. They suggested the inclusion of what they regarded as the most important strategies: playing with your child and positive reinforcement.


    Discussion

    General Discussion

    This is the first time a parenting app has been designed for Pacific parents and the first time feedback from this important user group and from Māori parents has been sought. Parenting is a sensitive subject and this study highlighted the level of thought needed to deliver advice in a palatable way. Perhaps those searching for a parenting app to upskill would be less likely to object to this method of information delivery than those that participated in the groups who may not have ordinarily sought out such an app. Collaborating with marketers, game designers, and parents in the design process could help to set the correct tone.

    The techniques to “gamify” the app, such as incremental challenges, a scrolling bar of options, and the use of a virtual coach, had the potential to engage with or discourage parents. Our findings support previous research that gamification techniques are only successful if gaming principles like motivational affordances (eg, levels, achievements, feedback) are implemented with specific behavioral outcomes in mind [24,25]. This further highlights that scientific institutions need to work with art industries, game developers, and marketers to create something that is acceptable to the general public and leads to behavioral change.

    Concerns about the app not taking into account the context in which the child’s behavior occurred and not sufficiently explaining the strategies could be mitigated by the fact that the app is aimed at children who have everyday behavioral problems. The level of intervention needed would, therefore, be low. Targeting this cohort, even if the information is brief, could prevent more significant problems from developing or act as a stepping stone for further support. The professionals’ suggestions of narrowing the focus to two important strategies could potentially widen the reach of the app to parents of children with behavioral problems of different severity and could also address the issues with the amount of instructions and text.

    The feedback from the professionals and parents was useful in providing a clear framework for adaptation. Play Kindly was developed on a modest budget, and many of the usability difficulties experienced could be addressed as further funding was secured. There is an increasing recognition of the importance of co-design, and greater use of this with parents and professionals at the start might also have mitigated some of the perceived problems.

    Limitations

    This was a small study with a sample size that is consistent with design research [26], so findings are not intended to be generalized to the population of parents in New Zealand. The diversity of the sample was compromised by snowball sampling. Two people were known to the one of the researchers, so it was ensured that the person who conducted the interview was unfamiliar to them. One participant knew one of the app designers and admitted feeling anxious about expressing their views. This was addressed by reminding them that their opinions would be confidential and anonymized. Without the involvement of a Pacific research team, it is unlikely that a sufficient number of participants would have been recruited to this study, and thus, bias was difficult to avoid. The researchers who conducted the interviews formed their own opinions about the app on the basis of the reviews from parents and professionals. This bias was reduced by asking for other members of the research team, not present at the interviews, to read the transcripts and compare with the overall report.

    Many parents and professionals did not play the entire game because of usability issues and not picking the correct answers as deemed by the app. It is, therefore, possible that a number of themes were missed. The issues raised here will be addressed once the app has been modified and retested by reinterviewing users of the app.

    Future Directions

    This study lays the groundwork for further redevelopment of the app with the feedback obtained through the qualitative paper described here. After redevelopment, the revised app will be trialed in a feasibility trial with further refinement following and then a controlled larger scale trial. Involving stakeholders in the design of electronic interventions is highly recommended for future projects of this nature.

    Conclusions

    Play Kindly is the first culturally adapted parenting app of its kind designed to target Pacific parents and other New Zealanders. Aimed at everyday parenting problems, this app has potential in Pacific communities where there is limited culturally specific parenting resources and could also appeal to other New Zealanders through its visual appeal and relatability.

    Iterative design is a core part of the development of digital technologies. Play Kindly was appealing, and with further development to increase the content as recommended by the professionals and address some of the usability difficulties, it appears to have the potential to be a useful tool for parents of young children.

    Acknowledgments

    The creation of Play Kindly was made possible in the first instance by funding from Quaker Peace and Service-Aotearoa New Zealand, the Loxley award with funding for further development, and the research reported here provided by the Cure Kids foundation. We would also like to acknowledge the parents and professionals who generously gave up their time to help with this study and contribute to research intended to better the lives of Pacific and other New Zealanders.

    Conflicts of Interest

    ETC-M was involved in the design and ongoing evaluation of the app. Due to the small and interconnected nature of Pacific communities, some of the researchers and participants were known to each other.

    References

    1. Vailaau N. A Theology of Children. Wellington: Barnados New Zealand: Royal New Zealand Plunket Society; 2009.
    2. Broidy LM, Nagin DS, Tremblay RE, Bates JE, Brame B, Dodge KA, et al. Developmental trajectories of childhood disruptive behaviors and adolescent delinquency: a six-site, cross-national study. Developmental Psychol 2003;39(2):222-245. [CrossRef]
    3. Tremblay RE. The development of aggressive behaviour during childhood: what have we learned in the past century? Int J Behav Dev 2016 Jun 30;24(2):129-141. [CrossRef]
    4. Piquero AR, Farrington DP, Welsh BC, Tremblay R, Jennings WG. Effects of early family/parent training programs on antisocial behavior and delinquency. J Exp Criminol 2009 Mar 12;5(2):83-120. [CrossRef]
    5. Koerting J, Smith E, Knowles MM, Latter S, Elsey H, McCann DC, et al. Barriers to, and facilitators of, parenting programmes for childhood behaviour problems: a qualitative synthesis of studies of parents' and professionals' perceptions. Eur Child Adolesc Psychiatry 2013 Nov;22(11):653-670 [FREE Full text] [CrossRef] [Medline]
    6. Steele H, Bate J, Steele M, Dube SR, Danskin K, Knafo H, et al. Adverse childhood experiences, poverty, and parenting stress. Can J Behav Sci 2016 Jan;48(1):32-38. [CrossRef]
    7. Breitenstein SM, Gross D, Christophersen R. Digital delivery methods of parenting training interventions: a systematic review. Worldviews Evidence-Based Nurs 2014 May 19;11(3):168-176. [CrossRef]
    8. Hall CM, Bierman KL. Technology-assisted interventions for parents of young children: emerging practices, current research, and future directions. Early Child Res Q 2015;33:21-32 [FREE Full text] [CrossRef] [Medline]
    9. McGoron L, Ondersma SJ. Reviewing the need for technological and other expansions of evidence-based parent training for young children. Child Youth Services Rev 2015 Dec;59:71-83. [CrossRef]
    10. Love SM, Sanders MR, Turner KM, Maurange M, Knott T, Prinz R, et al. Social media and gamification: engaging vulnerable parents in an online evidence-based parenting program. Child Abuse Negl 2016 Mar;53:95-107. [CrossRef] [Medline]
    11. Baker S, Sanders MR, Morawska A. Who uses online parenting support? A cross-sectional survey exploring Australian parents’ internet use for parenting. J Child Fam Stud 2016 Nov 14;26(3):916-927. [CrossRef]
    12. Love SM, Sanders MR, Metzler CW, Prinz RJ, Kast EZ. Enhancing accessibility and engagement in evidence-based parenting programs to reduce maltreatment: conversations with vulnerable parents. J Public Child Welf 2013;7(1):20-38. [CrossRef] [Medline]
    13. Ministry of Health. Social, Emotional and Behavioural Difficulties in New Zealand Children: Summary of Findings. Wellington: Ministry of Health; 2018.
    14. Lau AS. Making the case for selective and directed cultural adaptations of evidence-based treatments: examples from parent training. Clin Psychol Sci Pract 2006 Dec;13(4):295-310. [CrossRef]
    15. Statistics New Zealand. 2013 Census QuickStats about culture and identity. Wellington: Statistics New Zealand; 2014.
    16. Iusitini L, Taylor S, Cowley-Malcolm E, Kerslake M, Paterson J. A comparison of parenting practices between Samoan parents living in New Zealand and Samoa. Pac Health Dialog 2011 Sep;17(2):120-134. [Medline]
    17. Cowley-Malcolm E. Some Samoans' perceptions, values and beliefs on the role of parents and children within the context of aiga/family and the influence of fa'asamoa and the church on Samoan parenting. Auckland: Auckland University of Technology; 2005.
    18. McCallin A, Paterson J, Butler S, Cowley ET. Striving for the best of both worlds: Samoan parenting in New Zealand. Pac Health Dialog 2001 Mar;8(1):6-14. [Medline]
    19. Cowley-Malcolm E. Perceptions of Samoan Parents from a Small Town in New Zealand on Parenting, Childhood Aggression, and the CD-ROM 'Play Nicely'. Wellington: Victoria University of Wellington; 2013.
    20. Scholer SJ, Cherry R, Garrard HG, Gupta AO, Mace R, Greeley N. A multimedia program helps parents manage childhood aggression. Clin Pediatr (Phila) 2006 Nov;45(9):835-840. [CrossRef] [Medline]
    21. Pacific Health Research Guidelines. Auckland: Health Research Council of New Zealand; 2014.
    22. Guidelines for Researchers on Health Research Involving Māori. 2 ed. Auckland: Health Research Council of New Zealand; 2010.
    23. NVivo qualitative data analysis software [program]. Burlington: QSR International; 2012.
    24. Hamari J, Koivisto J, Sarsa H. Does gamification work? A literature review of empirical studies on gamification. Proceedings of the 47th Hawaii International Conference on System Sciences, Hawaii, USA 2014 Jan 6. [CrossRef]
    25. Looyestyn J, Kernot J, Boshoff K, Ryan J, Edney S, Maher C. Does gamification increase engagement with online programs? A systematic review. PLoS One 2017;12(3):e0173403. [CrossRef] [Medline]
    26. Caine K. Local standards for sample size at CHI. Proceedings of 2016 CHI Conference on Human Factors in Computing Systems 2016 May 07. [CrossRef]

    Edited by G Eysenbach; submitted 26.07.19; peer-reviewed by M Cardamone-Breen, J Toelen, A Graham; comments to author 21.10.19; revised version received 17.03.20; accepted 08.04.20; published 10.06.20

    ©Rebecca A Mairs, Marthinus J Bekker, Tony Patolo, Sarah A Hopkins, Esther T Cowley-Malcolm, Lana M Perese, Gerhard B Sundborn, Sally N Merry. Originally published in JMIR Serious Games (http://games.jmir.org), 10.06.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on http://games.jmir.org, as well as this copyright and license information must be included.