More Web Proxy on the site http://driver.im/

research-article

Public Access

Teamwork and adaptation in games (TAG): a survey to gauge teamwork

Authors:

Casper Harteveld,

Erica Kleinman,

Dylan Schouten,

Truong Huy Nguyen,

Samuel Liberty,

Wade Kimbrough,

Magy Seif El-NasrAuthors Info & Claims

FDG '19: Proceedings of the 14th International Conference on the Foundations of Digital Games

Article No.: 18, Pages 1 - 12

https://doi.org/10.1145/3337722.3337731

Published: 26 August 2019 Publication History

Abstract

Teamwork is becoming an important element of gameplay. Many games nowadays incorporate teamwork in one form or another. As a result, many game researchers have investigated aspects of teamwork. However, we have yet to develop effective surveys to gauge how people strategize or problem solve together within different games, and how such games enable these activities. In this paper, we propose the Teamwork and Adaptation in Games (TAG) survey. We developed this survey using theories of team adaptation, a process of how teams work together and adapt their strategies to changes in environments. Through three separate studies, the TAG survey was used to gauge team adaptation. Our results show that the TAG survey is an effective instrument allowing us to gauge team adaptation in different game environments. We further found that the instrument can be effectively used to compare games.

References

[1]

Aida Azadegan and Casper Harteveld. 2014. Work for or against players: On the use of collaboration engineering for collaborative games. In Proceedings of the Workshop on Game Design Patterns, co-located with Foundations of Digital Game. ACM.

[2]

Aida Azadegan, Casper Harteveld, and Steven Sutherland. 2015. Design approach for collaborative decision making games. In Proceedings of the Foundations of Digital Games. ACM.

[3]

Shaowen Bardzell, Jeffrey Bardzell, Tyler Pace, and Kayce Reed. 2008. Blissfully productive: Grouping and cooperation in world of warcraft instance runs. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work. ACM, 357--360.

Digital Library

[4]

Fred B Bryant and Albert Satorra. 2013. EXCEL macro file for conducting scaled difference chi-square tests via LISREL 8, LISREL 9, EQS, and Mplus. Available from the authors (2013).

[5]

C Shawn Burke, Kevin C Stagl, Eduardo Salas, Linda Pierce, and Dana Kendall. 2006. Understanding Team Adaptation: A Conceptual Analysis and Model. Journal of Applied Psychology 91, 6 (2006), 1189--1207.

[6]

ER Cadotte. 2014. Marketplace Live. Retrieved from Innovative Learning Solutions (www.marketplace-simulation.com) (2014).

[7]

Nancy J Cooke, Preston A Kiekel, Eduardo Salas, Renée Stout, Clint Bowers, and Janis Cannon-Bowers. 2003. Measuring team knowledge: A window to the cognitive underpinnings of team performance. Group Dynamics: Theory, Research, and Practice 7, 3 (2003), 179.

[8]

Nancy J Cooke, Eduardo Salas, Janis A Cannon-Bowers, and Renee J Stout. 2000. Measuring team knowledge. Human Factors 42, 1 (2000), 151--173.

[9]

Bart A De Jong, Kurt T Dirks, and Nicole Gillespie. 2016. Trust and team performance: A meta-analysis of main effects, moderators, and covariates. Journal of Applied Psychology 101, 8 (2016), 1134.

[10]

Jamie DeCoster. 1998. Overview of factor analysis. (1998). Retrieved June 26th 2019 from http://www.stat-help.com/notes.html.

[11]

Anders Drachen, Matthew Yancey, John Maguire, Derrek Chu, Iris Yuhui Wang, Tobias Mahlmann, Matthias Schubert, and Diego Klabajan. 2014. Skill-based differences in spatio-temporal team behaviour in defence of the ancients 2 (dota 2). In 2014 IEEE Games Media Entertainment. IEEE, 1--8.

[12]

Francis T Durso, Carla A Hackworth, Todd R Truitt, Jerry Crutchfield, Danko Nikolic, and Carol A Manning. 1998. Situation awareness as a predictor of performance for en route air traffic controllers. Air Traffic Control Quarterly 6, 1 (1998), 1--20.

[13]

Mica R Endsley. 1988. Design and evaluation for situation awareness enhancement. In Proceedings of the Human Factors Society annual meeting, Vol. 32. SAGE Publications Sage CA: Los Angeles, CA, 97--101.

[14]

Joel R Evans and Anil Mathur. 2005. The value of online surveys. Internet research 15, 2 (2005), 195--219.

[15]

Claes Fornell and David F Larcker. 1981. Structural equation models with unobservable variables and measurement error: Algebra and statistics.

[16]

David W Gerbing and Janet G Hamilton. 1996. Viability of exploratory factor analysis as a precursor to confirmatory factor analysis. Structural Equation Modeling: A Multidisciplinary Journal 3, 1 (1996), 62--72.

[17]

Ruthanna Gordon. 2015. Alternate Reality Games For Behavioral and Social Science Research. ETC Press.

Digital Library

[18]

Jamie C Gorman, Nancy J Cooke, Jennifer L Winner, Jasmine L Duran, Harry K Pedersen, and Amanda R Taylor. 2007. Knowledge training versus process training: The effects of training protocol on team coordination and performance. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 51. SAGE Publications Sage CA: Los Angeles, CA, 382--386.

[19]

Daire Hooper, Joseph Coughlan, and Michael Mullen. 2008. Structural equation modelling: Guidelines for determining model fit. Articles (2008), 2.

[20]

Zaheer Hussain and Mark D Griffiths. 2009. The attitudes, feelings, and experiences of online gamers: a qualitative analysis. CyberPsychology & Behavior 12, 6 (2009), 747--753.

[21]

Young Ji Kim, David Engel, Anita Williams Woolley, Jeffrey Yu-Ting Lin, Naomi McArthur, and Thomas W Malone. 2017. What Makes a Strong Team? Using Collective Intelligence to Predict Team Performance in League of Legends. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work. 2316--2329.

Digital Library

[22]

Rex B Kline. 2015. Principles and practice of structural equation modeling. Guilford publications.

[23]

Yubo Kou and Xinning Gui. 2014. Playing with strangers: understanding temporary teams in league of legends. In Proceedings of the first ACM SIGCHI annual symposium on Computer-Human Interaction in Play. ACM, 161--169.

Digital Library

[24]

Steve WJ Kozlowski, James A Grand, Samantha K Baard, and Marina Pearce. 2015. Teams, teamwork, and team effectiveness: Implications for human systems integration. (2015).

[25]

Field Day Lab. 2018. ARIS: Create location-based games and stories. https://fielddaylab.org/make/aris/

[26]

Whitney E Lewis. 2018. Design Scaffolding for Computational Making in the Visual Programming Tool ARIS. (2018).

[27]

Timothy C Lisk, Ugur T Kaplancali, and Ronald E Riggio. 2012. Leadership in multiplayer online gaming environments. Simulation & Gaming 43, 1 (2012), 133--149.

Digital Library

[28]

John C Loehlin. 1998. Latent variable models: An introduction to factor, path, and structural analysis. Lawrence Erlbaum Associates Publishers.

[29]

Peter V Marsden and James D Wright. 2010. Handbook of survey research. Emerald Group Publishing.

[30]

John E Mathieu, Tonia S Heffner, Gerald F Goodwin, Eduardo Salas, and Janis A Cannon-Bowers. 2000. The influence of shared mental models on team process and performance. Journal of Applied Psychology 85, 2 (2000), 273.

[31]

John E Mathieu, Scott I Tannenbaum, Jamie S Donsbach, and George M Alliger. 2014. A review and integration of team composition models: Moving toward a dynamic and temporal framework. Journal of Management 40, 1 (2014), 130--160.

[32]

Masaki Matsunaga. 2010. How to factor-analyze your data right: do's, don'ts, and how-to's. International Journal of Psychological Research 3, 1 (2010), 97--110.

[33]

Roger C Mayer, James H Davis, and F David Schoorman. 1995. An integrative model of organizational trust. Academy of management review 20, 3 (1995), 709--734.

[34]

Robert J Mislevy, Andreas Oranje, Malcolm I Bauer, Alina von Davier, Jiangang Hao, Seth Corrigan, and Erin Hoffman. 2014. Psychometric Considerations in Game-based Assessment. GlassLab.

[35]

Bonnie Nardi and Justin Harris. 2006. Strangers and friends: Collaborative play in World of Warcraft. In Proceedings of the 2006 20th anniversary Conference on Computer Supported Cooperative Work. ACM, 149--158.

Digital Library

[36]

Fernando Felix do Nascimento Junior, Allan Sales da Costa Melo, Igor Barbosa da Costa, and Leandro Balby Marinho. 2017. Profiling Successful Team Behaviors in League of Legends. In Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web. ACM, 261--268.

Digital Library

[37]

Robert E Ployhart and Paul D Bliese. 2006. Individual adaptability (I-ADAPT) theory: Conceptualizing the antecedents, consequences, and measurement of individual differences in adaptability. In Understanding adaptability: A prerequisite for effective performance within complex environments. Emerald Group Publishing Limited, 3--39.

[38]

Nataliia Pobiedina, Julia Neidhardt, Maria del Carmen Calatrava Moreno, and Hannes Werthner. 2013. Ranking factors of team success. In Proceedings of the 22nd International Conference on World Wide Web. ACM, 1185--1194.

Digital Library

[39]

Nataliia Pobiedina, Julia Neidhardt, Maria del Carmen Calatrava Moreno, Laszlo Grad-Gyenge, and Hannes Werthner. 2013. On successful team formation: Statistical analysis of a multiplayer online game. In Business Informatics (CBI), 2013 IEEE 15th Conference on. IEEE, 55--62.

Digital Library

[40]

Patrick Prax. 2010. Leadership style in World of Warcraft raid guilds. Proceedings of DiGRA Nordic (2010).

[41]

Elaine D Pulakos, Sharon Arad, Michelle A Donovan, and Kevin E Plamondon. 2000. Adaptability in the workplace: Development of a taxonomy of adaptive performance. Journal of Applied Psychology 85, 4 (2000), 612.

[42]

Daniel Rapaport. 2017. What to expect from the booming esports industry in 2017. Sports Illustrated (2017). https://www.si.com/tech-media/2017/02/09/esports-industry-expectations-billion-dollar

[43]

Michael A Rosen, Wendy L Bedwell, Jessica L Wildman, Barbara A Fritzsche, Eduardo Salas, and C Shawn Burke. 2011. Managing adaptive performance in teams: Guiding principles and behavioral markers for measurement. Human resource management review 21, 2 (2011), 107--122.

[44]

Eduardo Salas, Terry L Dickinson, Sharolyn AConverse, and Scott I Tannenbaum. 1992. Toward an understanding of team performance and training. (1992).

[45]

Eduardo Salas, Carolyn Prince, David P Baker, and Lisa Shrestha. 1995. Situation awareness in team performance: Implications for measurement and training. Human factors 37, 1 (1995), 123--136.

[46]

Matthias Schubert, Anders Drachen, and Tobias Mahlmann. 2016. Esports Analytics Through Encounter Detection Other Sports. (2016).

[47]

Magy Seif El-Nasr, Bardia Aghabeigi, David Milam, Mona Erfani, Beth Lameman, Hamid Maygoli, and Sang Mah. 2010. Understanding and evaluating cooperative games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 253--262.

Digital Library

[48]

Kimberly A Smith-Jentsch, Janis A Cannon-Bowers, Scott I Tannenbaum, and Eduardo Salas. 2008. Guided team self-correction: Impacts on team mental models, processes, and effectiveness. Small Group Research 39, 3 (2008), 303--327.

[49]

Renée J Stout, Janis A Cannon-Bowers, Eduardo Salas, and Dana M Milanovich. 1999. Planning, shared mental models, and coordinated performance: An empirical link is established. Human Factors 41, 1 (1999), 61--71.

[50]

Zachary O Toups, Jessica Hammer, William A Hamilton, Ahmad Jarrah, William Graves, and Oliver Garretson. 2014. A framework for cooperative communication game mechanics from grounded theory. In Proceedings of the first ACM SIGCHI annual symposium on Computer-Human Interaction in Play. ACM, 257--266.

Digital Library

[51]

Harald Warmelink. 2014. Online gaming and playful organization. Routledge.

Digital Library

[52]

David K Woods and Paul G Dempster. 2011. Tales from the bleeding edge: The qualitative analysis of complex video data using Transana. In Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, Vol. 12.

[53]

Jason Wuertz, Scott Bateman, and Anthony Tang. 2017. Why Players Use Pings and Annotations in Dota 2. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1978--2018.

Digital Library

[54]

Pu Yang, Brent E Harrison, and David L Roberts. 2014. Identifying patterns in combat that are predictive of success in MOBA games. In Proceedings of the Foundations of Digital Games.

[55]

Mark C Zorzie. 2012. Individual adaptability: Testing a model of its development and outcomes. Michigan State University. Psychology.

Cited By

Wu YWang MChu WWang G(2023)Organization Preference Knowledge Acquisition of Multi-Platform Aircraft Mission System Utilizing Frequent Closed Itemset MiningAerospace10.3390/aerospace1002016610:2(166)Online publication date: 10-Feb-2023
https://doi.org/10.3390/aerospace10020166
Caserman PBaumgartner KGöbel SKorn O(2023)A best practice for gamification in large companies: An extensive study focusing inter-generational acceptanceMultimedia Tools and Applications10.1007/s11042-023-16877-783:12(35175-35195)Online publication date: 28-Sep-2023
https://doi.org/10.1007/s11042-023-16877-7
Caldwell SSweetser PO’Donnell NKnight MAitchison MGedeon TJohnson DBrereton MGallagher MConroy D(2022)An Agile New Research Framework for Hybrid Human-AI Teaming: Trust, Transparency, and TransferabilityACM Transactions on Interactive Intelligent Systems10.1145/351425712:3(1-36)Online publication date: 26-Jul-2022
https://dl.acm.org/doi/10.1145/3514257

Index Terms

Teamwork and adaptation in games (TAG): a survey to gauge teamwork
1. General and reference
  1. Cross-computing tools and techniques
    1. Measurement
  2. Document types
    1. Surveys and overviews
2. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
      1. Computer supported cooperative work
  2. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Field studies
      2. User studies

Recommendations

The impact of virtual teamwork on real-world collaboration
ACE '09: Proceedings of the International Conference on Advances in Computer Entertainment Technology

With the rapid advance of online gaming and virtual reality technology, virtual teamwork has become increasingly popular. People spend more and more time working with others in 3D virtual environments to accomplish common goals. In this study, we ...
Adaptation in Digital Games: The Effect of Challenge Adjustment on Player Performance and Experience
CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play

Good gaming experiences hinge on players being able to have a balance between challenge and skill. However, achieving that balance is challenging, so dynamic difficulty adjustment offers the opportunity to provide better gaming experiences through ...
Casual games discussion
Future Play '07: Proceedings of the 2007 conference on Future Play

Digital games have become a remarkable cultural phenomenon in the last ten years. The casual games sector especially has been growing rapidly in the last few years. However, there is no clear view on what is "casual" in games cultures and the area has ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

FDG '19: Proceedings of the 14th International Conference on the Foundations of Digital Games

August 2019

822 pages

ISBN:9781450372176

DOI:10.1145/3337722

Conference Chair:
Sebastian Deterding
University of York
,
General Chair:
Foaad Khosmood
California Polytechnic State University
,
Program Chairs:
Johanna Pirker
Graz University of Technology
,
Thomas Apperley
CEGCS Tampere University

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 August 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

DARPA

Conference

FDG '19

FDG '19: The Fourteenth International Conference on the Foundations of Digital Games

August 26 - 30, 2019

California, San Luis Obispo, USA

Acceptance Rates

FDG '19 Paper Acceptance Rate 46 of 124 submissions, 37%;

Overall Acceptance Rate 152 of 415 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
929
Total Downloads

Downloads (Last 12 months)249
Downloads (Last 6 weeks)35

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wu YWang MChu WWang G(2023)Organization Preference Knowledge Acquisition of Multi-Platform Aircraft Mission System Utilizing Frequent Closed Itemset MiningAerospace10.3390/aerospace1002016610:2(166)Online publication date: 10-Feb-2023
https://doi.org/10.3390/aerospace10020166
Caserman PBaumgartner KGöbel SKorn O(2023)A best practice for gamification in large companies: An extensive study focusing inter-generational acceptanceMultimedia Tools and Applications10.1007/s11042-023-16877-783:12(35175-35195)Online publication date: 28-Sep-2023
https://doi.org/10.1007/s11042-023-16877-7
Caldwell SSweetser PO’Donnell NKnight MAitchison MGedeon TJohnson DBrereton MGallagher MConroy D(2022)An Agile New Research Framework for Hybrid Human-AI Teaming: Trust, Transparency, and TransferabilityACM Transactions on Interactive Intelligent Systems10.1145/351425712:3(1-36)Online publication date: 26-Jul-2022
https://dl.acm.org/doi/10.1145/3514257

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents