This paper is in the following e-collection/theme issue:

Serious Games for Education (139) Training Tools for Medical Students (126) Theoretical Foundations and Frameworks on Games and Gamification (37) Games for Medical Education and Training (90) Serious Games for Health and Medicine (647) Gamification (117)

Published on in Vol 10, No 2 (2022): Apr-Jun

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/30464, first published .
Identifying Player Types to Tailor Game-Based Learning Design to Learners: Cross-sectional Survey using Q Methodology

Identifying Player Types to Tailor Game-Based Learning Design to Learners: Cross-sectional Survey using Q Methodology

Identifying Player Types to Tailor Game-Based Learning Design to Learners: Cross-sectional Survey using Q Methodology

Authors of this article:

A E J Van Gaalen1 Author Orcid Image ;   J Schönrock-Adema2 Author Orcid Image ;   R J Renken3 Author Orcid Image ;   A D C Jaarsma2, 4 Author Orcid Image ;   J R Georgiadis1 Author Orcid Image
Article Authors Cited by (5) Tweetations (2) Metrics

    Original Paper

    1Anatomy & Medical Physiology Section, Department of Biomedical Sciences of Cells and Systems, University Medical Center Groningen, University Groningen, Groningen, Netherlands

    2Wenckebach Institute for Education and Training, University Medical Center Groningen, Groningen, Netherlands

    3Cognitive Neuroscience Center, Department of Biomedical Sciences of Cells and Systems, University Medical Center Groningen, University Groningen, Groningen, Netherlands

    4Faculty of Veterinary Medicine, Utrecht University, Utrecht, Netherlands

    Corresponding Author:

    J R Georgiadis, PhD

    Anatomy & Medical Physiology Section

    Department of Biomedical Sciences of Cells and Systems

    University Medical Center Groningen, University Groningen

    Antonius Deusinglaan 1

    Groningen, 9713AV

    Netherlands

    Phone: 31 648527717

    Email: j.r.georgiadis@umcg.nl


    Background: Game-based learning appears to be a promising instructional method because of its engaging properties and positive effects on motivation and learning. There are numerous options to design game-based learning; however, there is little data-informed knowledge to guide the choice of the most effective game-based learning design for a given educational context. The effectiveness of game-based learning appears to be dependent on the degree to which players like the game. Hence, individual differences in game preferences should be taken into account when selecting a specific game-based learning design.

    Objective: We aimed to identify patterns in students’ perceptions of play and games—player types and their most important characteristics.

    Methods: We used Q methodology to identify patterns in opinions on game preferences. We recruited undergraduate medical and dental students to participate in our study and asked participants to sort and rank 49 statements on game preferences. These statements were derived from a prior focus group study and literature on game preferences. We used by-person factor analysis and varimax rotation to identify common viewpoints. Both factors and participants’ comments were used to interpret and describe patterns in game preferences.

    Results: From participants’ (n=102) responses, we identified 5 distinct patterns in game preferences: the social achiever, the explorer, the socializer, the competitor, and the troll. These patterns revolved around 2 salient themes: sociability and achievement. The 5 patterns differed regarding cheating, playing alone, story-telling, and the complexity of winning.

    Conclusions: The patterns were clearly interpretable, distinct, and showed that medical and dental students ranged widely in how they perceive play. Such patterns may suggest that it is important to take students’ game preferences into account when designing game-based learning and demonstrate that not every game-based learning-strategy fits all students. To the best of our knowledge, this study is the first to use a scientifically sound approach to identify player types. This can help future researchers and educators select effective game-based learning game elements purposefully and in a student-centered way.

    JMIR Serious Games 2022;10(2):e30464

    doi:10.2196/30464

    Keywords

    gamification; serious games; game-based learning; medical education; computers; new technology; focus group; play; qualitative; player types; taxonomy; theory; framework 


    In health professional education, there has been a growing interest in game-based learning because of its engaging properties and positive effects on students’ motivation and learning [1]. Yet, the understanding of how and when to implement game-based learning in educating health professionals remains in its infancy [1] as well as in other educational domains [2]. Although there are myriad ways to design game-based learning strategies [2-4], there is little good-quality evidence to guide the choice of the most effective game-based learning design in a given educational context [1]. This, in turn, may increase the likelihood of choosing suboptimal or even counterproductive game-based learning strategies [5]. Hence, there is a need for empirical research to inform future game-based learning design [1].

    Some scholars have stated that educational games are designed by academics who do not understand the culture, art, and science of games [6-8]. This may result in educational learning tools that can either be a success or a failure with respect to playability and engagement. On the other hand, games developed by game designers with little or no understanding of the theory and practice of game-based learning can be fun to play but are also hit-or-miss with respect to educational goals and outcomes. Indeed, designing an educationally sound game-based learning tool is a challenging task and depends highly on the synergy between pedagogy and engagement [5-8].

    Practical applications of game-based learning have not been substantiated by a significant body of scientific research [1,3,9], which could be interpreted as corroboration for the abovementioned assertions. Researchers in health professional education generally take an educational approach to game-based learning without considering the body of knowledge available in the field of game research. For example, most game-based learning research in health professional education focused on one specific game attribute (ie, the effects of scoring and rewards) [1,2,10], although many other game attributes have also been investigated [3,11]. Moreover, game elements that motivate some learners may actually demotivate others [12-14] indicating that personal preference is a crucial element for motivation to play [15-18]. Game [19] and game-based learning [5,20] research consistently demonstrated that people vary greatly in what they like in play and games. Outside the domain of education for health professionals, individual differences in age, gender, culture, and personality play a role in a person’s preferences for specific types of play, games, and responses to different game-based learning designs [20]. Linking personality traits with game-based learning design solutions that best fit each particular trait has been shown to improve learner experience (eg, perceived playfulness) [12,21-27], motivation [28-31], and performance [28,30]. Hence, preferences should be considered in designing game-based learning strategies to engage and motivate an entire cohort of students (not only a subgroup).

    In the field of game research, the concept of player types is used to characterize users who share preference for a specific type of play, which enables game designers to create an optimal user experience [32]. In an earlier and probably best-known player typology [18], users of a multiplayer role-playing game were classified on the basis of two in-game behaviors—(1) acting versus interacting and (2) world versus player—which resulted in 4 different player types: socializers (users who like to interact with other players, eg, the game is a tool to meet other people), explorers (users who like to interact with the world, eg, discover new areas, and immerse themselves in the game world), achievers (users who like to act on the world, eg, prefer gaining rewards, points, and equipment from the game world), and killers (users who like to act upon other players, eg, thrive on beating other people) (Figure 1). Since then, various player types have been proposed [17,19,33-35]. However, there are major concerns with these player typologies. Many are not supported by empirical evidence [35]. Instead, they are based on researchers’ prior experience in developing games [18,33], on nonscientific literature [36,37], or on combinations of some of the aforementioned player types [38]. Player typologies based on empirical data [17,19,39] tend to be based on research into a specific game genre, which means the typologies may be biased and incomplete. In addition, surveys that were used (eg, Likert-scale surveys [17,19,39]) may have unnecessarily limited respondents’ answers and, thereby, researchers’ interpretations. Hence, important information may have been overlooked [40].

    In this study, we aimed to identify player types among a representative group of education for health professional students, independent of game context. As the first study of its kind, we aimed to explore the widest possible range of preferences for game and play in this group. We formulated the following research question: What patterns in students’ perceptions of play and games (ie, player types) can be identified and what are their most important characteristics?

    ‎
    Figure 1. Typology [18] with 4 player types based on 2 themes: player vs world and acting vs interacting.
    View this figure

    Design

    To investigate students’ perceptions of play, we applied Q-methodology [41], which is a mixed methods research technique that aims to account for all key subjective viewpoints on a certain matter [42]. The qualitative component of Q-methodology allows the expression of subjective opinions to be considered, and the quantitative component uses statistical analysis in order to group participants with shared opinions. Q-methodology is used to cluster individuals based on shared opinions rather than based on latent variables, which is the case in regular factor analysis (or R-methodology). The Q-methodology technique has been used before in medical education, although for different purposes (eg, for identifying different patterns of self-regulating learning behavior [43-45]). Q-methodology is characterized by two main stages: (1) designing a set of statements and let participants sort that set of statements, and (2) by-person correlation and factor analysis of a sample of the included participants.

    Ethics

    We obtained ethical approval for this study from the Netherlands Association for Medical Education (NVMO 2019.1.11).

    Setting and Participants

    This study was conducted in May 2019 at the Faculty of Medical Sciences of the University of Groningen, the Netherlands. The 6-year undergraduate medical and the 6-year undergraduate dental curriculum both consist of a 3-year Bachelor and a 3-year Master’s phase. In both curricula, teachers used face-to-face and web-based teaching methods and sometimes apply game-based learning, but not on a regular or structural basis.

    We invited all medical and dental students (3000 eligible undergraduate students) to participate in our study by posting an announcement on the web-based learning environment (called Nestor) of the university. Participants were informed about the purpose and procedures of the study. Their participation was anonymous, voluntary, and confidential. Participants had the right to withdraw from the study at any time. All participants provided informed consent. In appreciation for their time and effort, each participant received a 5€ (approximately US $5.66) gift certificate.

    Although there is no decisive minimum or maximum number of participants for performing Q-methodology research [43], generally, the number of statements should exceed the number of participants [46], and 40 to 60 participants is considered adequate [47,48]. To achieve a highly diverse sample—which is recommended for Q-sort analysis [46,48]—we purposively selected participants. Therefore, we asked participants to complete a sociodemographic questionnaire (eg, age, gender, and whether or not they considered themselves a gamer) prior to the sorting process that also included a question about the participant’s favorite game. For our purposive sample, we included only participants who had specified a favorite game. We identified the game genre to ensure each game genre was represented evenly in the final sample. In addition, only participants who had performed the sorting task in 12 minutes or more were included. We conducted pilot testing and found that the average sorting time was 25 minutes (range 2-3 minutes) and that reading the statements and swiftly sorting the statements took at least 12 minutes; thus, for less than 12 minutes, the sort was regarded as ill-considered. If there were participants with identical favorite games, only one participant was included. Participants’ preferences for modality (digital or analog) had to be distributed as evenly as possible across game genres; the male-to-female ratio had to be evenly distributed across game genres; and medical and dental student had to be evenly distributed across game genres. If a decision about inclusion or exclusion of a participant could not be made based the preceding criteria, the decision was made by rolling dice.

    Statement Set

    There is no single correct way to compile a set of statements in Q-methodology [41]. In general, the Q sample size is 40 to 80 statements [41,48], and the number of statements should exceed the number of participants [46]. A set containing too many statements can make the sorting process an exhausting and burdensome task, whereas a set containing too few statements may result in inadequate coverage of the topic of game preferences [41]. By sorting and prioritizing each statement from the statement set, individual participants provided us with a model of their view on their own game preferences. Statements should be carefully selected since their nature limits what can be expressed by a participant [49].

    We aimed to develop a set of statements in which each statement was unique and made its own original contribution, and all statements together covered the full range of game preferences. Statements were based on the findings of an earlier focus group study [5] among medical and dental students (n=58) with no experience in game-based learning but widely varying experiences in play and games that had been conducted to obtain perspectives on leisure time and academic education. To make sure that the statement set covered as many aspects of game preferences as possible, we also examined player type studies [17-19,50] that possibly addressed different game preferences. This resulted in an initial set of 136 statements. We grouped the statements into 28 themes, duplicates were removed, and statements were translated into English and reworded to start with the phrase “I like games that….” in order to improve clarity and make sorting more intuitive for participants [41]. The final set (Table 1) consisted of 49 statements and was piloted by 3 medical students. Based on their feedback, we considered the final statement set to meet our abovementioned aims.

    Table 1. Statement set and factor array.
    StatementFactors

    		12345
    1. I like games in which people help each other.10−23−1
    2. I like to see how others learn a new game.−20−1−3−3
    3. I like games with easy wins.−3−3−12−2
    4. I like games which create an atmosphere of sociability.30−311
    5. I like games that let me build relationships.20−310
    6. I like games that let me play in teams.2−1020
    7. I like to play games to maintain relationships.1−3−220
    8. I like games that let me play on my own.−3330−1
    9. I like games in which I can create something.11022
    10. I like games that allow different ways of winning.2312−2
    11. I like games that use luck to enhance my odds of winning.−1−3−1−1−4
    12. I like games with a good storyline.14131
    13. I like games in which I can influence the storyline.0400−1
    14. I like games in which I need to actively participate.31041
    15. I like games in which I know the other players.20−203
    16. I like games in which I can solve a difficult part / puzzle.12343
    17. I like to improve my gameplay by searching for new techniques.020−2−3
    18. I like games in which I learn new things (eg, knowledge/skills)32310
    19. I like games in which I can act differently than I usually do in real life.−21−200
    20. I like games which make you feel immersed in your own world.−23−1−14
    21. I like games that let me apply a strategy.42201
    22. I like games in which I can bluff.−1−1−203
    23. I like games that have trading elements.0−2−112
    24. I like games in which I can negotiate.11−100
    25. I like games that can be played differently than they are intended.−11−3−22
    26. I like games in which I can cheat.−4−2−3−43
    27. I like games in which other players cheat.−4−4−4−4−3
    28. I like games in which I can be fanatic.3−21−11
    29. I like games in which I can play strictly by the rules.0−312−2
    30. I like games to which I can bring modifications.−210−20
    31. I like games in which I can obtain as many points as possible.−10201
    32. I prefer losing with lots of rewards over winning with very few.−3−1−1−1−2
    33. I like games which show me my progression.22210
    34. I like games which let me have items that others don’t manage to collect.−2−20−10
    35. I like games which have a reward at stake.010−1−1
    36. I like games in which I can get my revenge after losing.0−21−11
    37. I like games that show everyone that I’ve won.−1−21−3−3
    38. I like games in which I can prove to the other players that I am the best.−1−12−2−2
    39. I like games that use competition as a way to improve myself.203−1−2
    40. I like games in which I can annoy other players.−1−4−2−32
    41. I like games that use competition to defeat other players.101−31
    42. I like to be the best in a game.1−14−22
    43. I’m a good loser.0−1−40−4
    44. Winning is important to me.−1−14−22
    45. I like games in which I can play alone against a game or computer−3321−1
    46. I like games which let me stay anonymous.−2111−1
    47. I like to get better in a game.42233
    48. I like games that use a lot of different materials (eg, dices, cards, fake money)0001−1
    49. I like games in which losing is okay.0−1−13−1

    Sorting Procedure

    Participants performed the sorting procedure using a web app (Q-sorTouch), in which the 49 statements were randomly presented. Participants were asked to drag and drop each statement into 3 piles: agree, neutral, disagree. After sorting all the statements, they had to refine their 3 piles by ranking the statements into a Q-sort grid ranging from −4, extremely disagree, to +4, extremely agree. In Q-methodology, the number of statements that can be assigned to each scale point are fixed and represent a quasi-normal distribution (Table 2) [41]; thus, participants placed the 2 statements with which they disagreed most under −4 and the 2 with which they agreed most under +4.

    Table 2. Quasi-normal distribution.
    Position−4−3−2−10+1+2+3+4
    Number of items246898642

    The sorting procedure ended when all statements were placed in the fixed distribution and the participants felt that the final sort represented their viewpoint. In the final stage of the data collection, participants provided answers to open-ended questions to elaborate on the rationale behind their sort (eg, why statements were assigned to the extreme ends).

    Statistical Analysis

    To identify groups of participants with shared, but distinct, viewpoints (ie, who subjectively ranked the 49 statements in a similar way), we conducted by-person factor analysis using dedicated software (PQMethod, version 2.35; developer: J Atkinson), which we later verified with formulas [48] in MATLAB (version R2020a; The MathWorks).

    Because each sort was correlated with every other sort, the correlation matrix of the participants’ sorted statement sets (ie, sorts) was used to identify factors (ie, groups of respondents whose Q-sorts were statistically similar) by subjecting the correlation matrix to varimax rotation [41]. Varimax rotation generates a factor solution according to the best mathematical solution (while maintaining an orthogonal basis) [48]. Only factors with eigenvalues >1 and on which at least 2 participants are loaded significantly (P<.01) were accepted [41,48,49], which corresponded to a factor loading >0.37, calculated using 2.58 × (1 / √ (number of items in the Q set) [41,48]. Since our aim was to extract patterns that were unique, participants loading on more than one factor were not used for the construction of a factor. This is in line with the procedures applied in other Q-methodology studies [41,43,44,48].

    A range of factor solutions were generated. To describe patterns of the participants’ game preferences, each factor solution was interpreted in conjunction with qualitative data from participants’ responses in the final stage of the sort. To facilitate factor interpretation, ideal Q-sorts were computed for each factor. These so-called factor arrays are weighted averages of sorts loading on that factor [41,49]. A group of 9 independent researchers individually interpreted all factor solutions and were asked to identify the solution with the highest number of viewpoints while providing distinct and clearly interpretable factors.


    Overview

    A total of 102 students volunteered to participate in our study and completed the sorting procedure. On the basis of their statements about their favorite games, we identified 7 game genres: action games (n=7), adventure games (n=6), party games (n=13), simulations or sports games (n=15), strategy games (n=35), puzzle games (n=14), and role-playing games (n=10). Consequently, we excluded 60 participants: 2 participants did not provide their favorite game; 10 participants performed the sort in less than 12 minutes; 36 participants had duplicate favorite games (eg, 11 participants stated the game Settlers of Catan); 9 participants (4 favorite digital games, 2 females and 3 male students) to ensure a more even distribution of these variables; and 3 participants, by the roll of the dice. The sample consisted of 42 participants (dental students: n=13; medical students: n=29) having 41 different favorite games, of whom 31 were female and 11 were male, with a mean age of 23.3 years (SD 4.0; range 18-42). Of the 42 participants, 15 participants considered themselves to be gamers. Nine sorts were confounded, and 3 sorts did not load significantly on any of the factors (factor loading <0.37; Table 3).

    Table 3. Factor matrix.
    Q sortFactor

    		12345
    10.3830.675a0.2110.1820.170
    20.559a0.0960.0890.2820.166
    3−0.0410.670a0.1090.284−0.019
    4b0.5210.5220.2940.1320.312
    50.578a0.1830.1470.0310.025
    60.2260.753a−0.0570.1880.048
    7−0.1760.1240.584a0.1710.109
    8c0.1680.3640.0870.336−0.094
    9c0.303−0.2960.3160.361−0.255
    100.423a0.288−0.0890.354−0.065
    11b0.2080.1000.5210.414−0.334
    120.501a0.1040.1430.1600.176
    13b0.5310.2530.5350.241−0.045
    140.3440.0540.0140.526a0.060
    150.3680.562a−0.0650.3870.110
    16b0.4020.6450.178−0.0030.106
    17−0.1130.3580.1350.639a−0.131
    180.3570.166−0.137−0.0350.569a
    190.1910.703a0.1340.134−0.392
    20b0.6070.2140.0730.6210.094
    210.0470.686a0.188−0.0110.292
    220.550a0.0970.0380.328−0.293
    23−0.0110.695a0.308−0.1580.055
    240.708a−0.0670.2370.1590.009
    250.3410.175−0.3230.556a−0.092
    260.0680.3800.721a0.2220.131
    27b0.6580.162−0.2020.448−0.175
    28−0.0410.0890.246−0.0250.598a
    290.3200.0190.0520.479a0.257
    300.3910.0460.2760.572a−0.045
    31b−0.3240.5040.4390.1330.057
    320.709a−0.2880.0650.2650.099
    330.3570.1180.658a−0.274−0.137
    340.551a0.058−0.1000.042−0.137
    350.512a0.2260.2230.195−0.064
    360.508a0.128−0.0860.1290.210
    370.1380.0640.625a−0.0300.071
    38c0.1730.0960.1900.294−0.299
    39b0.1990.4350.0430.0730.452
    400.474a0.1080.0550.0260.041
    41b0.4670.3270.580−0.106−0.030
    420.596a0.2720.2720.233−0.070

    aA defining sort for a specific factor.

    bA confounded Qsort (multiple loadings).

    cA Q-sort with a factor loading <0.37.

    Factor Interpretation

    Overview

    Solutions with up to 5 factors were obtained. The 5-factor solution was retained after analysis by 9 independent researchers because it represented 5 clearly distinguishable patterns in students’ perceptions of play and games and had the highest percentage agreement between researchers (88.9%).

    Of the 42 included sorts, 30 loaded significantly (factor loading >0.37; Table 3) on 1 of the 5 factors. These patterns are presented below, with sociodemographic information about the participants and a relevant statement to illustrate each pattern. For example, in pattern 1, statement 21 is in the extremely agree position (21: +4) in that factor array (Table 1). To give a concise (but oversimplified) overview of the patterns, we chose a descriptor for each that reflected its interpretation in a broad sense.

    Social Achiever

    Pattern 1 comprised 12 participants with significant factor loadings (female: 9, male: 3; age: mean 23.7 years, range 18-42 years), of whom 7 were medical students, and 5 were dental students. Of the 12 participants, 5 self-identified as gamers. Favorite game genres were strategy (n=5), action (n=3), party (n=2), and simulation or sport games (n=2). Preferred modality was distributed evenly; 6 participants favored analog games, and 6 participants favored digital games.

    Participants in Pattern 1 shared the opinion that playing is a social act (4: +3; 5: +3), playing alone or in an individual competition with the self was, therefore, generally disliked (8: −3; 45: −3).

    What I really like in games is to collaboratively achieve something meaningful.
    [Student 3]

    The act of social togetherness was not enough for these participants, as they also expressed the need to obtain something meaningful through play (18: +3). Participants loading on this pattern tended to work hard and fanatically toward that goal (28: +3; 3: −3).

    Notably, strategy was liked to a great extent (21: +4), which seemed attributable to the fun of being able to play socially and achieving something together (18: +3). Student 67 mentioned,

    In my opinion, games are way more fun when you play them with friends …. besides, they will give us way longer fun when it is possible to apply a strategy…. This keeps the game interesting and fun for a longer time.
    Explorer

    Pattern 2 comprised 7 participants with significant factor loadings (female: 5, male: 2; age: mean 23.1 years, range 20-31 years), of whom 6 were medical students, and 1 was a dental student. Of the 7 participants, 5 participants self-identified as gamers. Favorite games genres were adventure (n=3), role-playing (n=2), action (n=1), and puzzle games (n=1). The majority (n=5) favored a digital modality over an analog modality.

    Pattern 2 was characterized by a need for immersion (20: +3), which was especially satisfied through story-driven games (12: +4, 13: +4). Student 21 stated,

    A good game must drag me into the story and not let go until I am finished.

    These participants generally liked games that granted them substantial autonomy (10: +3; 29: −3) to explore and alter the game (25: +1; 30: +1). They seemed to be drawn to exploring the potential of the game rather than searching for sociability in play (8: +3; 45: +3; 7: −3). Participant 12 stated,

    For me, gaming is something that I can do primarily on my own.

    These participants played for their own sake or individual pleasure. (6: −1; 7: −3).

    Competitor

    Pattern 3 comprised 4 participants with significant factor loadings (female: 2, male: 1; age: mean 22.2 years, range 21-23 years). Two participants were medical, and 2 participants were dental students. Two participants self-identified as gamers. Favorite game genres in this group were puzzle (n=2) and simulation or sports games (n=2). Of the 4 participants, 3 students favored a digital modality over an analog modality.

    Hunger for competition was the defining aspect of pattern 3 (39: +3)—not only winning or being the best (42: +4; 44: +4), but also parading their supremacy was considered important compared to the other patterns (37: +1; 38: +2). As stated by Student 93,

    I am very competitive, I want to win every game and I want to show that to everyone.

    Losing was therefore greatly disliked (43: −4). These participants shared the opinion with those described by pattern 2 that other game players were not important to them and they would rather play alone (8: +3); however, whereas participants described by pattern 2 had neither a strong preference nor a dislike for social togetherness as a characteristic of play (4: 0; 5: 0), participants described by pattern 3 found sociability in play unnecessary (4: −3; 5: −3; 7: −2; 15: −2). As Student 23 stated,

    I play for myself, not for others.

    Thus, competitors like competition that does not involve collaboration with others but is directed against other players (since they want to prove they are the best (37: +1; 38: +2)) or a nonplayable character. Student 23 stated,

    I like to play independently of other players but with an opponent; so, against a computerized opponent.
    Socializer

    Pattern 4 comprised 5 participants with significant factor loadings (female: 4, male: 1; mean age 26.2 years; range 2-9 years), of whom 4 were medical students, and 1 was a dental student. Of the 5 participants, 2 participants identified themselves as gamers. Favorite game genres in this group were party (n=2), role-playing (n=2), and action games (n=1). The majority favored an analog modality (n=4) over a digital modality (n=1).

    Participants described by Pattern 4 and Pattern 1 had similar characteristics. They valued collaborative play (5: +1; 6: +2); however, whereas being fanatic was important in Pattern 1, in pattern 4, participants did not have the urge to focus on winning (44: −2) or being fanatic (28: −1). They generally disliked competition (41: −3; 42: −2; 44: −2).

    Winning is not important to me, I just enjoy working together with others and having a good time together.
    [Student 68]

    This concept of “having a good time” seemed to be a recurrent characteristic for Pattern 4. Games were seen as a means for social togetherness (7: +2; 1: +3) that should depend on nothing but sociability. Losing should be okay (49: +3) and winning should be easy (3: +2); however, participants felt that active participation would be needed to have a good time (14: +4).

    Troll

    Pattern 5 comprised 2 participants with significant factor loadings (female: 2; age: mean 23.5 years, range 2-5 years), and both were both medical students. One student self-identified as a gamer. One student favored action games, the other student favored simulation or sports games. Both students favored a digital modality (n=2).

    Having the ability to exploit game mechanics to cheat (26: +3), annoy other players (40: +3), and bluff (22: +3) was important for these 2 participants compared with participants described by the other patterns. Such behavior seemed to be the result of boredom or laziness and not really being interested in the game itself. Notably, these participants were not inclined to invest time to learn new techniques (17: −3) but, paradoxically, wanted to get better in a game (47: +3), did not like to see others learn the game (2: −3), and were inclined to play games differently than intended when the game would take too much time (25: +2; 29: −2).

    I like it when a game requires little prior knowledge. It is much simpler and easier to play.
    [Student 51]

    Figure 2 presents a theoretical framework illustrating different player types in relation to sociability and achievement themes.

    ‎
    Figure 2. Theoretical framework illustrating player types in relation to sociability and achievement themes.
    View this figure

    Principal Findings

    We aimed to improve the understanding of game-based learning design, in general, and of game-based learning in health professional education, in particular. We contended that player typology, a concept that has been used to inform game design and game play, may be relevant to game-based learning design. To the best of our knowledge, this study is the first to investigate player types in a student cohort, outside of a game design context, using a methodology deliberately aimed to accommodate the largest variety in game preferences. We found that, in a cohort of medical and dental students with likely similar academic interests and intellectual ability, there was considerable variability in play preferences. We identified 5 distinct and clearly interpretable patterns in game preferences, which can be considered player types: the social achiever, the explorer, the socializer, the competitor, and the troll. Given that only a few game elements are applied in education for health professionals research—predominantly points and rewards [1]—our findings indicate that there is room for improvement within game-based learning design; the current variety of game-based learning designs in education for health professionals seems too limited to be able to tailor game-based learning to students’ game preferences to improve learning through motivation and engagement.

    Each player type has distinct characteristics. Social achievers like to play collaboratively to achieve something meaningful. They like competition and difficult games, preferably in teams. In contrast, explorers are drawn to the game’s story and immersive elements of play rather than winning and team play. Competitors on the other hand, thrive by winning and competition and would rather not depend on others. Socializers (much like social achievers) play for sociability, and interaction with other players is important to them. Yet, whereas competition is important to social achievers, socializers would rather play to find a sense of sociability and togetherness. They look for easy wins just to have a good time. Trolls like games in which they can annoy other players, bluff, and cheat.

    Two themes (Figure 2) are salient in the player types that we identified, and likewise in scientific and grey literature on play and player typologies [17,19,35,39,51-56]: sociability and achievement. Competitors and social achievers like the achievement aspect of play, however, explorers and socializers instead preferred playing for the storyline or to enjoy playing together, respectively. Social achievers and socializers are driven by sociability, collaboration, and interaction; explorers and competitors, however, seem less prone to these traits or only need others to prove their supremacy. The troll is more ambivalent about sociability and achievement aspects of games than other player types and is, therefore, situated at the intersection of achievement and sociability.

    Interestingly, the main themes identified in our theoretical framework bear similarity to the very first and often-cited player typology [18], which was based on a sample with homogeneity in terms of the preferred game, instead of homogeneity in terms of academic interest and which lacked any empirical basis. The fact that our study (which followed a more rigorous scientific approach) resulted in a similar typology may suggest that the existence of player types in a cohort is stable. Our scientific approach led to the identification of the explorer and the socializer, player types that have also previously been described [18]. We identified the social achiever, a player type that seems comparable with that of “achiever [18].” We additionally identified 2 other player type—the competitor and the troll—whereas in [18] only one other player type, namely the “killer [18],” which, upon close inspection, includes troll-like aspects (eg, annoying other players) as a social component (acting on other players). In our study, these characteristics appeared in other player types. We identified the troll and the competitor as separate player types. The achiever [18], with its social component was therefore interpreted as social achiever. The reason for these differences between both typologies may be that we also included games involving teamplay as a play genre in our framework, since we aimed to avoid selection bias from using only one or a few specific game genres to identify player types. The earlier typology [18] did not include teamplay, probably because it was based on a multiuser dungeon game that included role playing, player versus player, and chat functions but rarely team effort. We also found differences in relation to the dimensions on which the player types varied. Whereas the dimensions world versus player and action versus interaction have been previously described [18] our empirical evidence supported achievement and sociability as player type dimensions. As a result, competitors and socializers were opposites in our framework (instead of “killers” and “explorers” [18]).

    The troll as a player type has not been identified in previous studies [20]. Remarkably, however, the troll phenomenon is well known in the field of problematic gaming and internet use [57,58]. Trolling is defined as deliberately trying to create distress or conflict via provocation, for instance, for the purpose of deception or disruption [58]. More than one-third of American millennials said they engaged in the act of trolling [59] and an immensely popular digital game, called Among Us, is based on the concept of trolling (ie, sabotaging and causing chaos [60]). This suggests that the game-related behavior of trolling is not rare or marginal. Although the relevance of this player type to game-based learning design is unclear, this player type might also be pertinent outside the field of education for health professionals.

    Strength and Limitations

    The player types in this study represent a broad spectrum of views on games and play. One of the strengths of this study is that the comprehensive set of statements was derived from prior research among medical and dental students [5] and supplemented with statements taken from existing player type studies. Furthermore, a solid scientific method was used to account for all key subjective viewpoints on game preferences, and we included of a variety of participants (independent from game context) to prevent selection bias on game genre. In addition, we discussed multiple factor solutions, sought advice from expert authors [41], and verified Q-methodology software results. In doing so, we added a new perspective to literature on player types and game-based learning by identifying 5 patterns that were distinct, characteristic, and could be considered player types.

    This study had some limitations: (1) In the interpretation of our patterns, we cannot (and do not) claim to be exhaustive with respect to all viewpoints on game preferences in the entire population. While Q-methodology is a method that aims to capture variety and heterogeneity, our participant group was relatively homogenous (medical and dental students). Therefore, we cannot claim that replication of our study in a different educational context would yield the same outcomes. However, by adding statements from prior (nonmedical) studies on player types in the statement set, and by using stratification to provide profuse and varied participants’ opinions, we feel that the quantitative aspect of the Q-methodology (ie, analyzing participants’ rankings using multivariate data reduction techniques) helped us detect meaningful patterns and connections in game preferences. This, in turn, may provide future researchers with a starting point to investigate the generalizability of our results. (2) In a recent study [5], we showed that game elements are possibly context dependent (ie, aspects that motivate play may not necessarily play a motivating role in game-based learning). For instance, although competition was liked and named trivial in play in leisure time, students considered it stressful and unwanted in play focused on learning. Since we did not ask participants to keep a specific learning environment in mind when they answered the question about their game preferences, their answers may not reflect their game-based learning preferences. (3) We aimed to reduce selection bias by selecting participants independent of game context, however, we do not know whether they had a specific game or context in mind when they performed the sorting procedure. (4) We chose to adopt the 5-factor solution after rigorous discussions and with the help of 3 independent researchers. Although this allowed us to detect a new player type (the troll), few students had significant factor loadings on this player type. Nevertheless, this player type adhered to the widely accepted rules for including a factor in Q-methodology and helped explain the largest variety in play preferences [58].

    By using Q-methodology, we aimed to explain as much variety in existing game preferences as possible; thus, our player types are extreme ends of a spectrum on game preferences. The factor arrays that construct these player types are the combined average of all sort loadings on that player type. Therefore, there is very little chance that a participant’s sort will load 100% on a specific player type and fully match its definition [41]. Indeed, all sorts demonstrated characteristics of all player types, and no sort loaded 100% on one player type. Yet, most sorts loaded clearly on one player type.

    Practical Implications and Future Research

    Systematic reviews indicate that, often, game-based learning strategies are selected based on researchers’ personal opinions rather than theory or a conceptual framework [1,2,61]. Additionally, there is a tendency in game-based learning strategies to use scoring and reward, especially in gamification [1,61]. Our taxonomy provides a novel theoretical framework that may help to tailor game-based learning strategies to student preferences. Future research is needed to investigate whether such tailoring would result in increased effectiveness of applying game-based learning in education.

    Based on our findings, all player types except explorers might need the presence or participation of other players to be optimally motivated to continue playing. To develop game-based learning strategies that optimally engage and motivate the majority of students, multiplayer options appear to be critical. However, this feature is currently overlooked in game-based learning strategies in current practice [1,11,61].

    Our theoretical framework and corresponding factor arrays indicate that preferences for multiplayer modalities can be diverse and are not limited to sociability [62], social media [63], a chat function [34], and message boards [64]. Competitors, for instance, need other players or computerized opponents to triumph over and show their supremacy, social achievers need other players to work with, trolls need other players to annoy, and socializers need other players to have a good time together. By including each player type in a game-based learning-strategy, the complex and dynamic interaction between player types can turn game-based learning into a meaningful strategy for every student. For example, although trolls might only make a small contribution to the overall player population, their actions can have major impact on social play and interaction [65-68], much more than, for example, the actions of social achievers. The inclusion of trolls in game-based learning design can unite socially oriented players by giving them a common foe. Future research should explore how each player type can contribute to multiplayer game-based learning strategies to enhance collaborative learning.

    Future research can focus on investigating whether the range of opinions on play vary significantly across students as a function of the academic level or discipline they are enrolled in, for instance, a medical or a nonmedical group, or medical specialization. Such findings would provide an understanding for future student-specific game-based learning designs. Game preferences might be dependent on context [5] or the players' current needs [31]. For instance, in the playground game called Tag, one player is it and chases the other players in an attempt to tag them by touching them. Then the tagged player becomes it and starts chasing the others to tag someone else. This means that, when being it, a player must adopt the competitor player type (ie, competing and winning from the others), while the others (who are getting chased) can adopt the social achiever or even troll player type to act as a group against the one that is it. Likewise, other digital games (eg, Among Us) perhaps also use changing player types, where one is sometimes a troll and, at other times, needs to take on the role of the social achiever [60]. This raises the question whether player types are in search of a specific game design or does the game design elicit different types of behavioral responses (ie, player types). This might also suggest that game designers should adhere to the entire diversity of player types to ensure inclusion of all participants of the game-based learning strategy.

    As a first step in this direction, we aimed to investigate the prevalence of player types among medical and dental students. This may not only provide more evidence for the existence of the currently identified typology in education for health professional students, it may also shed light on the true diversity of player types within medical and dental education. Furthermore, it may improve our understanding of whether the current educational strategy focusing on the achievement-oriented player type is effective and can be justified or whether it might be better to tailor game-based learning strategies to individual player types.

    Conclusion

    We identified 5 clear and distinct patterns of game preferences. These patterns represent player types that differ in terms of the player type dimensions achievement and sociability. Our taxonomy and accompanying factor arrays can be used to tailor game-based learning design to students’ game preferences to optimize game-based learning effectiveness.

    Acknowledgments

    The authors would like to thank the students for participating in this study. We also thank Tineke Bouwkamp-Timmer for editorial assistance. We thank Kiki Spanjers, Gerben Ruesink, and Anne-Marijke Kosta, for their valuable input in choosing the optimal pattern solution, and Irena Middeljans, for her valuable input during statement selection. Last but certainly not least, we are grateful for the helpful email correspondence with Simon Watts and Paul Stenner.

    Conflicts of Interest

    None declared.

    1. van Gaalen AEJ, Brouwer J, Schönrock-Adema J, Bouwkamp-Timmer T, Jaarsma ADC, Georgiadis JR. Gamification of health professions education: a systematic review. Adv Heal Sci Educ 2021:683-711 [FREE Full text] [CrossRef] [Medline]
    2. Dichev C, Dicheva D. Gamifying education: what is known, what is believed and what remains uncertain: a critical review. Int J Educ Technol High Educ 2017 Feb 20;14(1). [CrossRef]
    3. Bedwell WL, Pavlas D, Heyne K, Lazzara EH, Salas E. Toward a taxonomy linking game attributes to learning: an empirical study. Simul Gaming 2012 May 14;43(6):729-760. [CrossRef]
    4. Marczewski A. 52 gamification mechanics and elements. Gamified UK. 2017.   URL: https://www.gamified.uk/user-types/gamification-mechanics-elements/ [accessed 2022-02-25]
    5. Van Gaalen AEJ, Jaarsma ADC, Georgiadis JR. Medical students' perceptions of play and learning: qualitative study with focus groups and thematic analysis. JMIR Serious Games 2021 Jul 28;9(3):e25637 [FREE Full text] [CrossRef] [Medline]
    6. Papert S. Does easy do it? children, games, and learning. Game Developer 1998;88:1 [FREE Full text]
    7. DiSalvo B. Pink boxes and chocolate-dipped broccoli: bad game design providing justifications for reluctant learners. 2015 Presented at: 11th Games + Learning + Society Conference; July 7-10; Chicago, Illinois, USA p. 11.
    8. Van ECK R. Digital Game-Based Learning: It's Not Just the Digital Natives Who Are Restless. EDUCAUSE Review 2006 Apr:1-16 [FREE Full text]
    9. Landers RN, Bauer KN, Callan RC, Armstrong MB. Psychological theory and the gamification of learning. In: Gamification in Education and Business. New York: Springer; 2015:86.
    10. Böckle M, Novak J, Bick M. Towards adaptive gamification: a synthesis of current developments. 2017 Presented at: 25th European Conference on Information Systems; June 5-10; Guimarães, Portugal.
    11. Dicheva D, Dichev C, Agre G, Angelova G. Gamification in education: A systematic mapping study. Educ Technol Soc 2015:1-14 [FREE Full text]
    12. Monterrat B, Lavoué É, George S. Adaptation of gaming features for motivating learners. Simul Gaming 2017 Jun 30;48(5):625-656. [CrossRef]
    13. Harviainen J. Critical challenges to gamifying education: A review of central concept. 2014 Presented at: Game On! Conference; 03-17-2014; Moscow.
    14. Burgers C, Eden A, van Engelenburg MD, Buningh S. How feedback boosts motivation and play in a brain-training game. Comput Human Behav 2015 Jul;48:94-103. [CrossRef]
    15. Chen C, Chang S. An exploration of the tendency to online game addiction due to users liking of design features. Asian J Heal Inf Sci 2008:38-51 [FREE Full text]
    16. Robinson M, Fischer A, Ahuja A, Lesser E, Maniates H. Roles of "wanting" and "liking" in motivating behavior: gambling, food, and drug addictions. Curr Top Behav Neurosci 2016;27:105-136. [CrossRef] [Medline]
    17. Yee N. Motivations for play in online games. Cyberpsychol Behav 2006 Dec;9(6):772-775. [CrossRef] [Medline]
    18. Bartle R. Hearts, clubs, diamonds, spades: players who suit MUDs. Research Gate. 1996.   URL: https:/​/www.​researchgate.net/​publication/​247190693_Hearts_clubs_diamonds_spades_Players_who_suit_MUDs [accessed 2022-02-25]
    19. Yee N, Ducheneaut N, Nelson L. Online gaming motivations scale: Development and validation. 2012 Presented at: SIGCHI Conference on Human Factors in Computing Systems; 05/12/2012 - 05/10/2012; Texas. [CrossRef]
    20. Klock ACT, Gasparini I, Pimenta MS, Hamari J. Tailored gamification: a review of literature. Int J Hum Comput Stud 2020 Dec;144:102495. [CrossRef]
    21. Codish D, Ravid G. Detecting playfulness in educational gamification through behavior patterns. IBM J Res Dev 2015 Nov;59(6):1-14. [CrossRef]
    22. Codish D, Rabin E, Ravid G. User behavior pattern detection in unstructured processes – a learning management system case study. Interact Learn Env 2019 May 19;27(5-6):699-725. [CrossRef]
    23. Codish D, Ravid G. Personality Based Gamification. Educational Gamification for Extroverts and Introverts. 2014 Presented at: 9th Chais Conference for the Study of Innovation and Learning Technologies: Learning in the Technological Era; 02/11/2014 - 02/12/2014; Israel.
    24. Codish D, Ravid G. Personality based gamification: How different personalities percive gamification. 2014 Presented at: 22nd European Conference on Information Systems; 06/09/2014 - 06/11/2014; Israel.
    25. Codish D, Ravid G. Gender Moderation in Gamification: Does One Size Fit All? 2017 Presented at: 50th Hawaii International Conference on System Sciences; 01/04/2017 - 01/07/2014; Hawaii. [CrossRef]
    26. Denden M, Tlili A, Essalmi F, Jemni M. An investigation of the factors affecting the perception of gamification and game elements. 2017 Presented at: International Conference on Information and Communication Technology and Accessbility, ICTA; Dec 19-21; Muscat. [CrossRef]
    27. Tlili A, Essalmi F, Ayed LB, Jemni M. A smart educational game to model personality using learning analytics. 2017 Presented at: IEEE 17th International Conference on Advanced Learning Technologies; July 3-7; Romania. [CrossRef]
    28. Buckley P, Doyle E. Individualising gamification: an investigation of the impact of learning styles and personality traits on the efficacy of gamification using a prediction market. Comput Educ 2017 Mar;106:43-55. [CrossRef]
    29. Davis K, Sridharan H, Koepke L, Singh S, Boiko R. Learning and engagement in a gamified course: investigating the effects of student characteristics. J Comput Assist Learn 2018 Apr 19;34(5):492-503. [CrossRef]
    30. Pedro L, Lopes A, Prates B, Vassileva J, Isotani S. Does gamification work for boys and girls? An exploratory study with a virtual learning environment. 2015 Presented at: ACM Symposium on Applied Computing; April 13-17; Spain. [CrossRef]
    31. Tu C, Yen C, Sujo-Montes L, Roberts GA. Gaming personality and game dynamics in online discussion instructions. Educ Media Int 2015 Sep 11;52(3):155-172. [CrossRef]
    32. Charles D, Kerr A, McNeill M. Player-centred game design: Player modelling and adaptive digital games. 2005 Presented at: Digital Games Research Conference; 16/06/2005 - 20/06/2005; Vancouver, British Columbia, Canada.
    33. Barata G, Gama S, Jorge J, Goncalves D. Early prediction of student profiles based on performance and gaming preferences. IEEE Trans Learning Technol 2016 Jul 1;9(3):272-284. [CrossRef]
    34. Klock A, da Cunha LF, de Carvalho MF, Rosa B, Anton A, Gasparini I. Gamification in e-learning systems: a conceptual model to engage students and its application in an adaptive e-learning system. In: Zaphiris P P, Ioannou A, editors. Learning and Collaboration Technologies. Cham: Springer; 2015:9192.
    35. Nacke LE, Bateman C, Mandryk RL. BrainHex: a neurobiological gamer typology survey. Entertain Comput 2014 Jan;5(1):55-62. [CrossRef]
    36. Borges S, Mizoguchi R, Durelli V, Bittencourt I, Isotani S. A link between worlds: towards a conceptual framework for bridging player and learner roles in gamified collaborative learning contexts. In: Koch F, Koster A, Primo T, Guttmann C, editors. Advances in Social Computing and Digital Education. Cham: Springer; 2016.
    37. Marczewski A. Even Ninja Monkeys Like to Play: Gamification, Game ThinkingMotivational Desig. In: Gamified UK. San Fransisco: BLURB Incorporated; 2015.
    38. Ferro L, Walz S, Greuter S. Towards personalised, gamified systems: An investigation into game design, personality and player typologies. 2013 Presented at: ACM International Conference Proceeding Series; 10/6/2013 - 10/9/2013; United Kingdom. [CrossRef]
    39. Yee N. The demographics, motivations, and derived experiences of users of massively multiuser online graphical environment. Presence (Camb) 2006 Jun 01;15(3):309-329. [CrossRef]
    40. Danielson S. Q method and surveys: three ways to combine Q and R. Field Methods 2009 Apr 06;21(3):219-237. [CrossRef]
    41. Watts S, Stenner P. Doing Q methodology: theory, method and interpretation. Qual Res Psychol 2005. [CrossRef]
    42. Brown SR, Danielson S, van Exel J. Overly ambitious critics and the Medici effect: a reply to Kampen and Tamás. Qual Quant 2014 Feb 28;49(2):523-537. [CrossRef]
    43. Berkhout JJ, Teunissen PW, Helmich E, van Exel J, van der Vleuten CPM, Jaarsma DADC. Patterns in clinical students' self-regulated learning behavior: a Q-methodology study. Adv Health Sci Educ Theory Pract 2017 Mar 27;22(1):105-121 [FREE Full text] [CrossRef] [Medline]
    44. Fokkema J, Teunissen P, Westerman M, van der Lee N, van der Vleuten CPM, Scherpbier AJJA, et al. Exploration of perceived effects of innovations in postgraduate medical education. Med Educ 2013 Mar;47(3):271-281. [CrossRef] [Medline]
    45. Meade L, Caverzagie K, Swing S, Jones R, O'Malley CW, Yamazaki K, et al. Playing with curricular milestones in the educational sandbox: Q-sort results from an internal medicine educational collaborative. Acad Med 2013 Aug;88(8):1142-1148. [CrossRef] [Medline]
    46. Watts S, Stenner P. Factor interpretation. In: Doing Q Methodological Research: Theory, Method and Interpretation. Los Angeles: SAGE Publications; 2012:147-169.
    47. Solomon H, Stephenson W. The study of behavior: Q-technique and its methodology. J Am Stat Assoc 1955 Dec;50(272):1415. [CrossRef]
    48. Brown SR. Political subjectivity: applications of Q methodology in political science. J Politics 1981 Aug;43(3):912-914. [CrossRef]
    49. Stenner PH, Cooper D, Skevington SM. Putting the Q into quality of life; the identification of subjective constructions of health-related quality of life using Q methodology. Soc Sci Med 2003 Dec;57(11):2161-2172. [CrossRef]
    50. Sherry J, Greenberg B, Lucas K, Lachlan K. Video game uses and gratifications as predictors of use and game preference. In: Playing Video Games: Motives, Responses, and Consequences. New York: Routledge; 2006:213-224.
    51. Hamari J, Tuunanen J. Player types: a meta-synthesis. Trans Digit Games Res Assoc 2014 Mar 24;1(2). [CrossRef]
    52. Tseng F. Segmenting online gamers by motivation. Expert Syst Appl 2011 Jun;38(6):7693-7697. [CrossRef]
    53. Whang L, Chang G. Lifestyles of virtual world residents, living in the on-line game "Lineage". Cyberpsychol Behav 2004:592-600. [CrossRef]
    54. Fullerton T. A playcentric approach to creating innovative games. In: Game Design Workshop. New York: CRC Press; 2008.
    55. Berger BM, Caillois R, Barash M. Man, Play, and Games. Am Sociol Rev 1963 Aug;28(4):651. [CrossRef]
    56. Huizing J. Homo Ludens: A Study of the Play-Element in Culture. New York: Angelico Press; Apr 1951.
    57. Jones D, Paulhus D. Differentiating the dark triad within the interpersonal circumplex. In: Handbook of Interpersonal Psychology: Theory, Research, Assessment, and Therapeutic Interventions. New Jersey: John Wiley & Sons; 2012.
    58. Buckels E, Trapnell P, Paulhus D. Trolls just want to have fun. Personality and Individual Differences 2014 Sep;67:97-102. [CrossRef]
    59. Over a quarter of Americans have made malicious online comments. YouGov.   URL: https:/​/today.​yougov.com/​topics/​politics/​articles-reports/​2014/​10/​20/​over-quarter-americans-admit-malicious-online-comm [accessed 2022-02-25]
    60. Among us. Wikipedia.   URL: https://en.wikipedia.org/wiki/Among_Us [accessed 2022-02-25]
    61. Gentry SV, Gauthier A, L'Estrade Ehrstrom B, Wortley D, Lilienthal A, Tudor Car L, et al. Serious gaming and gamification education in health professions: systematic review. J Med Internet Res 2019 Mar 28;21(3):e12994 [FREE Full text] [CrossRef] [Medline]
    62. Christou G, Lai-Chong Law E, Zaphiris P, Ang CS. Challenges of designing for sociability to enhance player experience in massively multi-player online role-playing Games. Behav Inf Technol 2013 Jul;32(7):724-734. [CrossRef]
    63. Petrucci AM, Kaneva P, Lebedeva E, Feldman LS, Fried GM, Vassiliou MC. You have a message! social networking as a motivator for FLS training. J Surg Educ 2015 May;72(3):542-548. [CrossRef] [Medline]
    64. Wongso O, Rosmansyah Y, Bandung Y. Gamification framework model, based on social engagement in e-learning. 2014 Presented at: 2nd International Conference on Technology, Informatics, Management, Engineering and Environment; December 19-21; Indonesia. [CrossRef]
    65. Bishop J. The psychology of trolling and lurking: the role of defriending and gamification for increasing participation in online communities using seductive narratives. In: Gamification for Human Factors Integration: Social, Education, and Psychological Issues. Pennsylvania: IGI Global; 2015:160-176.
    66. Ruiz C, Domingo D, Micó JL, Díaz-Noci J, Meso K, Masip P. Public sphere 2.0? the democratic qualities of citizen debates in online newspapers. Int J Press Polit 2011 Sep 22;16(4):463-487. [CrossRef]
    67. Shachaf P, Hara N. Beyond vandalism: Wikipedia trolls. J Inf Sci 2010 Apr 13;36(3):357-370. [CrossRef]
    68. Thacker S, Griffiths M. An exploratory study of trolling in online video gaming. Int J Cyber Behav Psychol Learn 2012:17-33. [CrossRef]

    Edited by N Zary; submitted 15.05.21; peer-reviewed by L Roper, S Azer; comments to author 03.08.21; revised version received 15.09.21; accepted 24.09.21; published 04.04.22

    Copyright

    ©A E J Van Gaalen, J Schönrock-Adema, R J Renken, A D C Jaarsma, J R Georgiadis. Originally published in JMIR Serious Games (https://games.jmir.org), 04.04.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.