[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article
Open access

Human-AI Collaboration in Cooperative Games: A Study of Playing Codenames with an LLM Assistant

Published: 15 October 2024 Publication History

Abstract

Playing partial information, restricted communication, cooperative (PIRCC) games with humans have proven challenging for AI, due to our reliance on social dynamics and sophisticated cognitive techniques. Yet, recent advances in generative AI may change this situation through new forms of human-AI collaboration. This paper investigates how teams of players interact with an AI assistant in the PIRCC game Codenames and the impact this has on cognition, social dynamics, and player experience. We observed gameplay and conducted post-game focus groups with 54 participants across ten groups. Each group played three rounds of Codenames, with an AI assistant supporting Cluegivers. We found the AI assistant enhanced players' convergent and divergent thinking, but interfered with formation of team mental models, highlighting a tension in the use of AI in creative team scenarios. The presence of the AI challenged many players' understanding of the 'spirit of the game'. Furthermore, the presence of the AI assistants weakened social connections between human teammates, but strengthened connections across teams. This paper provides an empirical account of an AI assistant's effect on cognition, social dynamics, and player experience in Codenames. We highlight the opportunities and challenges that arise when designing hybrid digital boardgames that include AI assistants.

References

[1]
Safinah Ali, Hae Won Park, and Cynthia Breazeal. 2020. Can Children Emulate a Robotic Non-Player Character's Figural Creativity?. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '20). Association for Computing Machinery, New York, NY, USA, 499--509. https://doi.org/10.1145/3410404.3414251
[2]
Andrew Anderson, Jonathan Dodge, Amrita Sadarangani, Zoe Juozapaitis, Evan Newman, Jed Irvine, Souti Chattopadhyay, Matthew Olson, Alan Fern, and Margaret Burnett. 2020. Mental Models of Mere Mortals with Explanations of Reinforcement Learning. ACM Transactions on Interactive Intelligent Systems, Vol. 10 (5 2020), 1--37. https://doi.org/10.1145/3366485
[3]
Roberts Angel. 1981. Pictionary. Angel Games.
[4]
Michael Argyle and Jean Ann Graham. 1976. The Central Europe Experiment: Looking at Persons and Looking at Objects. Environmental psychology and nonverbal behavior, Vol. 1, 1 (Sept. 1976), 6--16. https://doi.org/10.1007/BF01115461
[5]
Zahra Ashktorab, Q. Vera Liao, Casey Dugan, James Johnson, Qian Pan, Wei Zhang, Sadhana Kumaravel, and Murray Campbell. 2020. Human-AI Collaboration in a Cooperative Game Setting: Measuring Social Perception and Outcomes. Proc. ACM Hum.-Comput. Interact., Vol. 4, CSCW2 (2020), Article 96. https://doi.org/10.1145/3415167
[6]
Eric Azagury and Bruno Poullet. 2018. Just One. Repos Production.
[7]
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter S. Lasecki, Daniel S. Weld, and Eric Horvitz. 2019. Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 7, 1 (Oct. 2019), 2--11.
[8]
Nolan Bard, Jakob N. Foerster, Sarath Chandar, Neil Burch, Marc Lanctot, H. Francis Song, Emilio Parisotto, Vincent Dumoulin, Subhodeep Moitra, Edward Hughes, Iain Dunning, Shibl Mourad, Hugo Larochelle, Marc G. Bellemare, and Michael Bowling. 2020. The Hanabi challenge: A new frontier for AI research. Artificial Intelligence, Vol. 280 (1 3 2020), 103216. https://doi.org/10.1016/j.artint.2019.103216
[9]
Antoine Bauza. 2010. Hanabi. R&R Games.
[10]
Rhyse Bendell, Jessica Williams, Stephen M. Fiore, and Florian Jentsch. 2021. Towards Artificial Social Intelligence: Inherent Features, Individual Differences, Mental Models, and Theory of Mind, Hasan Ayaz, Umer Asgher, and Lucas Paletta (Eds.). Advances in Neuroergonomics and Cognitive Engineering, 20--28. https://doi.org/10.1007/978--3-030--80285--1_3
[11]
Christopher Berner, Greg Brockman, Brooke Chan, Vicki Cheung, Przemysław Dkebiak, Christy Dennison, David Farhi, Quirin Fischer, Shariq Hashme, and Chris Hesse. 2019. Dota 2 with Large Scale Deep Reinforcement Learning. arXiv preprint arXiv:1912.06680 (2019). arxiv: 1912.06680
[12]
Noam Brown and Tuomas Sandholm. 2019. Superhuman AI for Multiplayer Poker. Science, Vol. 365, 6456 (2019), 885--890. https://doi.org/10.1126/science.aay2400
[13]
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, and Amanda Askell. 2020. Language Models Are Few-Shot Learners. Advances in neural information processing systems, Vol. 33 (2020), 1877--1901.
[14]
Murray Campbell, A. Joseph Hoane, and Feng-hsiung Hsu. 2002. Deep Blue. Artificial Intelligence, Vol. 134, 1 (2002), 57--83. https://doi.org/10.1016/S0004--3702(01)00129--1
[15]
Rodrigo Canaan, Christoph Salge, Julian Togelius, and Andy Nealen. 2019. Leveling the playing field: fairness in AI versus human game benchmarks. Proceedings of the 14th international conference on the foundations of digital games. https://doi.org/10.1145/3337722.3337750 Citation Key: 10.1145/3337722.3337750 number-of-pages: 8 publisher-place: San Luis Obispo, California, USA tex.articleno: 37.
[16]
Michal v Certický and David Churchill. 2017. The Current State of StarCraft AI Competitions and Bots. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 13. 2--7.
[17]
Prithvijit Chattopadhyay, Deshraj Yadav, Viraj Prabhu, Arjun Chandrasekaran, Abhishek Das, Stefan Lee, Dhruv Batra, and Devi Parikh. 2017. Evaluating Visual Conversational Agents via Cooperative Human-AI Games. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 5 (Sept. 2017), 2--10. https://doi.org/10.1609/hcomp.v5i1.13312
[18]
Vlaada Chvátil. 2015. Codenames. Czech Games Edition.
[19]
Allan Dafoe, Edward Hughes, Yoram Bachrach, Tantum Collins, Kevin R McKee, Joel Z Leibo, Kate Larson, and Thore Graepel. 2020. Open problems in cooperative AI. arXiv preprint arXiv:2012.08630 (2020).
[20]
Thomas Dagenais-Lesperance. 2018. Decrypto. Scorpion Masque.
[21]
Emile de Maat. 2024. Communication Limits textbar Board Game Mechanic textbar BoardGameGeek. https://boardgamegeek.com/boardgamemechanic/2893/communication-limits/linkeditems/boardgamemechanic?pageid=1&mechanicfilter=2023 Accessed : 2024-05--28.
[22]
Attila Egri-Nagy and Antti Törmänen. 2020. The Game Is Not over YettextemdashGo in the Post-AlphaGo Era. Philosophies, Vol. 5, 4 (2020), 37--0. https://doi.org/10.3390/philosophies5040037
[23]
Katy Ilonka Gero, Zahra Ashktorab, Casey Dugan, Qian Pan, James Johnson, Werner Geyer, Maria Ruiz, Sarah Miller, David R. Millen, Murray Campbell, Sadhana Kumaravel, and Wei Zhang. 2020. Mental Models of AI Agents in a Cooperative Game Setting. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 1--12. https://doi.org/10.1145/3313831.3376316
[24]
Katy Ilonka Gero and Lydia B. Chilton. 2019. Metaphoria: An algorithmic companion for metaphor creation. Proceedings of the 2019 CHI conference on human factors in computing systems, 1--12. https://doi.org/10.1145/3290605.3300526 Citation Key: 10.1145/3290605.3300526 number-of-pages: 12 publisher-place: Glasgow, Scotland Uk.
[25]
Christian Guckelsberger, Christoph Salge, Jeremy Gow, and Paul Cairns. 2017. Predicting player experience without the player.: An exploratory study. Proceedings of the annual symposium on computer-human interaction in play, 305--315. https://doi.org/10.1145/3116595.3116631 Citation Key: 10.1145/3116595.3116631 number-of-pages: 11 publisher-place: Amsterdam, The Netherlands.
[26]
Rotem D Guttman, Jessica Hammer, Erik Harpstead, and Carol J Smith. 2021. Play for Real (ism)-Using Games to Predict Human-AI interactions in the Real World. Proceedings of the ACM on Human-Computer Interaction, Vol. 5, CHI PLAY (2021), 1--17. publisher: ACM New York, NY, USA.
[27]
Carl Gutwin and Saul Greenberg. 2002. A Descriptive Framework of Workspace Awareness for Real-Time Groupware. Computer Supported Cooperative Work (CSCW), Vol. 11, 3 (Sept. 2002), 411--446. https://doi.org/10.1023/A:1021271517844
[28]
Matthew Guzdial, Nicholas Liao, Jonathan Chen, Shao-Yu Chen, Shukan Shah, Vishwa Shah, Joshua Reno, Gillian Smith, and Mark O. Riedl. 2019. Friend, Collaborator, Student, Manager: How Design of an AI-Driven Game Level Editor Affects Creators. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300854
[29]
Brian Hersch. 1989. Taboo. Editions ATLAS.
[30]
Keke Hou, Tingting Hou, and Lili Cai. 2023. Exploring Trust in Human--AI Collaboration in the Context of Multiplayer Online Games. Systems, Vol. 11, 5 (May 2023), 217. https://doi.org/10.3390/systems11050217
[31]
Hengyuan Hu, Adam Lerer, Alex Peysakhovich, and Jakob Foerster. 2020. “Other-Play” for Zero-Shot Coordination. In Proceedings of the 37th International Conference on Machine Learning, Daumé Hal, III and Singh Aarti (Eds.), Vol. 119. PMLR, Proceedings of Machine Learning Research, 4399--4410.
[32]
Angel Hsing-Chi Hwang and Andrea Stevenson Won. 2021. IdeaBot: Investigating Social Facilitation in Human-Machine Team Creativity. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Yokohama, Japan, Article 712. https://doi.org/10.1145/3411764.3445270
[33]
Catalina Jaramillo, Megan Charity, Rodrigo Canaan, and Julian Togelius. 2020. Word Autobots: Using Transformers for Word Association in the Game Codenames. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 16. 231--237.
[34]
Ville Kankainen and Janne Paavilainen. 2019. Hybrid Board Game Design Guidelines.
[35]
Markelle Kelly, Aakriti Kumar, Padhraic Smyth, and Mark Steyvers. 2023. Capturing Humans? Mental Models of AI: An Item Response Theory Approach. Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, 1723--1734. https://doi.org/10.1145/3593013.3594111 event-place: Chicago, IL, USA.
[36]
Andrew Kim, Maxim Ruzmaykin, Aaron Truong, and Adam Summerville. 2019. Cooperation and Codenames: Understanding Natural Language Processing via Codenames. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 15, 1 (8 10 2019), 160--166. section: Poster Papers.
[37]
Michal Kosinski. 2023. Theory of mind may have spontaneously emerged in large language models. arXiv preprint arXiv:2302.02083 (2023).
[38]
Adam Lerer, Hengyuan Hu, Jakob Foerster, and Noam Brown. 2020. Search in Cooperative Partially-Observable Games. In AAAI Conference on Artificial Intelligence.
[39]
Bernhard Maurer and Verena Fuchsberger. 2019. Dislocated boardgames: Design potentials for remote tangible play. Multimodal technologies and interaction, Vol. 3, 4 (2019), 72. publisher: MDPI.
[40]
Chelsea Mills, Denise Y. Geiskkovitch, Carman Neustaedter, William Odom, and Benett Axtell. 2023. Remote wavelength: Design and evaluation of a system for social connectedness through distributed tabletop gameplay. Proceedings of the 2023 CHI conference on human factors in computing systems. https://doi.org/10.1145/3544548.3581142 Citation Key: 10.1145/3544548.3581142 number-of-pages: 19 publisher-place:Hamburg, Germany tex.articleno: 680.
[41]
Chelsea Mills, Carman Neustaedter, and William Odom. 2021. Distributed letter jam: Designing distributed board game play for social connection. Companion publication of the 2021 conference on computer supported cooperative work and social computing, 135--139. https://doi.org/10.1145/3462204.3481753 Citation Key: 10.1145/3462204.3481753 number-of-pages: 5 publisher-place: Virtual Event, USA.
[42]
Edi Mukardin, Martin Tappler, Bernhard K Aichernig, and Ingo Pill. 2023. Reinforcement Learning under Partial Observability Guided by Learned Environment Models. In International Conference on Integrated Formal Methods. Springer, 257--276.
[43]
Donald A Norman. 1992. Design Principles for Cognitive Artifacts. Research in Engineering Design, Vol. 4, 1 (1992), 43--50.
[44]
OpenAI, :, Christopher Berner, Greg Brockman, Brooke Chan, Vicki Cheung, Przemys law Dbiak, Christy Dennison, David Farhi, Quirin Fischer, Shariq Hashme, Chris Hesse, Rafal Józefowicz, Scott Gray, Catherine Olsson, Jakub Pachocki, Michael Petrov, Henrique P. d. O. Pinto, Jonathan Raiman, Tim Salimans, Jeremy Schlatter, Jonas Schneider, Szymon Sidor, Ilya Sutskever, Jie Tang, Filip Wolski, and Susan Zhang. 2019. Dota 2 with Large Scale Deep Reinforcement Learning. arXiv e-prints (12 2019), arXiv:1912.06680. eprint: 1912.06680.
[45]
OpenAI. 2022. ChatGPT: Optimizing Language Models for Dialogue.
[46]
OpenAI. 2023. OpenAI API.
[47]
Melissa J Rogerson, Martin R Gibbs, and Wally Smith. 2018. Cooperating to Compete: The Mutuality of Cooperation and Competition in Boardgame Play. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--13.
[48]
Melissa J. Rogerson, Lucy A. Sparrow, and Martin R. Gibbs. 2021. More than a gimmick - digital tools for boardgame play. Proc. ACM Hum.-Comput. Interact., Vol. 5, CHI PLAY (10 2021). https://doi.org/10.1145/3474688 Citation Key: 10.1145/3474688 number-of-pages: 23 publisher-place: New York, NY, USA publisher: Association for Computing Machinery.
[49]
Melissa J. Rogerson, Lucy A. Sparrow, and Martin R. Gibbs. 2021. Unpacking 'Boardgames with apps': The hybrid digital boardgame model. Proceedings of the 2021 CHI conference on human factors in computing systems. https://doi.org/10.1145/3411764.3445077 Citation Key: 10.1145/3411764.3445077 number-of-pages: 17 publisher-place: Yokohama, Japan tex.articleno: 111.
[50]
Shaghayegh Roohi, Asko Relas, Jari Takatalo, Henri Heiskanen, and Perttu Hämäläinen. 2020. Predicting game difficulty and churn without players. Proceedings of the annual symposium on computer-human interaction in play, 585--593. https://doi.org/10.1145/3410404.3414235 Citation Key: 10.1145/3410404.3414235 number-of-pages: 9 publisher-place: Virtual Event, Canada.
[51]
William B Rouse, Janis A Cannon-Bowers, and Eduardo Salas. 1992. The role of mental models in team performance in complex systems. IEEE transactions on systems, man, and cybernetics, Vol. 22, 6 (1992), 1296--1308. publisher: IEEE.
[52]
Kjeld Schmidt and Carla Simonee. 1996. Coordination Mechanisms: Towards a Conceptual Foundation of CSCW Systems Design. Computer Supported Cooperative Work (CSCW), Vol. 5, 2 (1996), 155--200.
[53]
Julian Schrittwieser, Ioannis Antonoglou, Thomas Hubert, Karen Simonyan, Laurent Sifre, Simon Schmitt, Arthur Guez, Edward Lockhart, Demis Hassabis, Thore Graepel, Timothy Lillicrap, and David Silver. 2020. Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model. Nature, Vol. 588, 7839 (Dec. 2020), 604--609. https://doi.org/10.1038/s41586-020-03051--4
[54]
Matthew Sidji, Wally Smith, and Melissa J. Rogerson. 2023. The Hidden Rules of Hanabi: How Humans Outperform AI Agents. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3544548.3581550
[55]
David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, and Adrian Bolton. 2017. Mastering the game of go without human knowledge. nature, Vol. 550, 7676 (2017), 354--359.
[56]
Thomas Sing. 2019. The Crew: The Quest for Planet Nine. Kosmos.
[57]
Ho Chit Siu, Jaime Peña, Edenna Chen, Yutai Zhou, Victor Lopez, Kyle Palko, Kimberlee Chang, and Ross Allen. 2021. Evaluation of Human-AI Teams for Learned and Rule-Based Agents in Hanabi. Advances in Neural Information Processing Systems, Vol. 34 (2021).
[58]
Sherman Siu. 2022. Towards automating Codenames spymasters with deep reinforcement learning. arXiv preprint arXiv:2212.14104 (2022).
[59]
Ondra Skoupy. 2019. Letter Jam. Czech Games Edition.
[60]
Brad Spendlove and Dan Ventura. 2022. Competitive Language Games as Creative Tasks with Well-Defined Goals.In ICCC. 291--299.
[61]
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R Brown, Adam Santoro, Aditya Gupta, and Adrià Garriga-Alonso. 2022. Beyond the Imitation Game: Quantifying and Extrapolating the Capabilities of Language Models. arXiv preprint arXiv:2206.04615 (2022). arxiv: 2206.04615
[62]
Minhyang (Mia) Suh, Emily Youngblom, Michael Terry, and Carrie J Cai. 2021. AI as Social Glue: Uncovering the Roles of Deep Generative AI during Social Music Composition. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3411764.3445219 event-place: Yokohama, Japan.
[63]
Gerald Tesauro. 1995. Temporal difference learning and TD-Gammon. Commun. ACM, Vol. 38, 3 (1995), 58--68.
[64]
Mike Treanor, Alexander Zook, Mirjam P Eladhari, Julian Togelius, Gillian Smith, Michael Cook, Tommy Thompson, Brian Magerko, John Levine, and Adam Smith. 2015. AI-based Game Design Patterns. In Proceedings of the 10th International Conference on the Foundations of Digital Games 2015 (FDG 2015).
[65]
Jennifer Villareale, Casper Harteveld, and Jichen Zhu. 2022. "I Want To See How Smart This AI Really Is": Player mental model development of an adversarial AI player. Proc. ACM Hum. Comput. Interact., Vol. 6, CHI PLAY (10 2022). https://doi.org/10.1145/3549482 Citation Key: 10.1145/3549482 number-of-pages: 26 publisher-place: New York, NY, USA publisher: Association for Computing Machinery tex.articleno: 219 tex.issue date: October 2022.
[66]
Jennifer Villareale and Jichen Zhu. 2021. Understanding Mental Models of AI through Player-AI Interaction. arXiv preprint arXiv:2103.16168 (2021).
[67]
Samangi Wadinambiarachchi, Ryan M. Kelly, Saumya Pareek, Qiushi Zhou, and Eduardo Velloso. 2024. The Effects of Generative AI on Design Fixation and Divergent Thinking. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--18. https://doi.org/10.1145/3613904.3642919
[68]
James R. Wallace, Joseph Pape, Yu-Ling Betty Chang, Phillip J. McClelland, T.C. Nicholas Graham, Stacey D. Scott, and Mark Hancock. 2012. Exploring automation in digital tabletop board game. Proceedings of the ACM 2012 conference on computer supported cooperative work companion, 231--234. https://doi.org/10.1145/2141512.2141585 Citation Key: 10.1145/2141512.2141585 number-of-pages: 4 publisher-place: Seattle, Washington, USA.
[69]
Qian Wan, Siying Hu, Yu Zhang, Piaohong Wang, Bo Wen, and Zhicong Lu. 2023. " It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language Models. arXiv preprint arXiv:2307.10811 (2023).
[70]
Dakuo Wang, Elizabeth Churchill, Pattie Maes, Xiangmin Fan, Ben Shneiderman, Yuanchun Shi, and Qianying Wang. 2020. From human-human collaboration to Human-AI collaboration: Designing AI systems that can work together with people. 1--6.
[71]
Wolfgang Warsch. 2018. The Mind. Nürnberger-Spielkarten-Verlag.
[72]
Rina R. Wehbe, Edward Lank, and Lennart E. Nacke. 2017. Left Them 4 Dead: Perception of Humans versus Non-Player Character Teammates in Cooperative Gameplay. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). Association for Computing Machinery, New York, NY, USA, 403--415. https://doi.org/10.1145/3064663.3064712
[73]
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Ed Chi, Quoc Le, and Denny Zhou. 2022. Chain of Thought Prompting Elicits Reasoning in Large Language Models. arXiv preprint arXiv:2201.11903 (2022). arxiv: 2201.11903
[74]
Margaret Wilson. 2002. Six Views of Embodied Cognition. Psychonomic bulletin & review, Vol. 9 (2002), 625--636.
[75]
Maximilian Wittmann and Benedikt Morschheuser. 2022. What do games teach us about designing effective human-AI cooperation?-A systematic literature review and thematic synthesis on design patterns of non-player characters. Player Characters (2022), 95--104.
[76]
Yan Xu, Evan Barba, Iulian Radu, Maribeth Gandy, and Blair MacIntyre. 2011. Chores Are Fun: Understanding Social Play in Board Games for Digital Tabletop Game Design.In Digra Conference.
[77]
Qiao Zhang. 2023. Understanding human-AI teaming dynamics through gaming environments, Vol. 19. 440--443. issue: 1.
[78]
Rui Zhang, Nathan J McNeese, Guo Freeman, and Geoff Musick. 2021. " An Ideal Human" Expectations of AI Teammates in Human-AI Teaming. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW3 (2021), 1--25. publisher: ACM New York, NY, USA.
[79]
Jichen Zhu, Jennifer Villareale, Nithesh Javvaji, Sebastian Risi, Mathias Löwe, Rush Weigelt, and Casper Harteveld. 2021. Player-AI Interaction: What Neural Network Games Reveal About AI as Play. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Yokohama, Japan, Article 77. https://doi.org/10.1145/3411764.3445307
[80]
Faheem Hassan Zunjani and Ana-Maria Olteteanu. 2019. Towards Reframing Codenames for Computational Modelling and Creativity Support Using Associative Creativity Principles. Proceedings of the 2019 on Creativity and Cognition, 407--413. https://doi.org/10.1145/3325480.3325510 event-place: San Diego, CA, USA.

Cited By

View all
  • (2025)Interacting Large Language Model Agents Bayesian Social Learning Based Interpretable ModelsIEEE Access10.1109/ACCESS.2025.353859913(25465-25504)Online publication date: 2025

Index Terms

  1. Human-AI Collaboration in Cooperative Games: A Study of Playing Codenames with an LLM Assistant

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Human-Computer Interaction
    Proceedings of the ACM on Human-Computer Interaction  Volume 8, Issue CHI PLAY
    CHI PLAY
    October 2024
    1726 pages
    EISSN:2573-0142
    DOI:10.1145/3700823
    Issue’s Table of Contents
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 October 2024
    Published in PACMHCI Volume 8, Issue CHI PLAY

    Check for updates

    Author Tags

    1. codenames
    2. human-ai collaboration
    3. human-ai interaction
    4. hybrid games
    5. large language models
    6. theory of mind

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)882
    • Downloads (Last 6 weeks)275
    Reflects downloads up to 07 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Interacting Large Language Model Agents Bayesian Social Learning Based Interpretable ModelsIEEE Access10.1109/ACCESS.2025.353859913(25465-25504)Online publication date: 2025

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Full Access

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media