More Web Proxy on the site http://driver.im/

research-article

Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems

Authors:

Mary Lou MaherAuthors Info & Claims

ACM Transactions on Computer-Human Interaction, Volume 30, Issue 5

Article No.: 67, Pages 1 - 28

https://doi.org/10.1145/3519026

Published: 23 September 2023 Publication History

Abstract

Human-AI co-creativity involves both humans and AI collaborating on a shared creative product as partners. In a creative collaboration, interaction dynamics, such as turn-taking, contribution type, and communication, are the driving forces of the co-creative process. Therefore the interaction model is a critical and essential component for effective co-creative systems. There is relatively little research about interaction design in the co-creativity field, which is reflected in a lack of focus on interaction design in many existing co-creative systems. The primary focus of co-creativity research has been on the abilities of the AI. This article focuses on the importance of interaction design in co-creative systems with the development of the Co-Creative Framework for Interaction design (COFI) that describes the broad scope of possibilities for interaction design in co-creative systems. Researchers can use COFI for modeling interaction in co-creative systems by exploring alternatives in this design space of interaction. COFI can also be beneficial while investigating and interpreting the interaction design of existing co-creative systems. We coded a dataset of existing 92 co-creative systems using COFI and analyzed the data to show how COFI provides a basis to categorize the interaction models of existing co-creative systems. We identify opportunities to shift the focus of interaction models in co-creativity to enable more communication between the user and AI leading to human-AI partnerships.

References

[1]

[n.d.]. Dictionary, Encyclopedia and Thesaurus. Retrieved 16 April, 2022 from https://www.thefreedictionary.com/.

[2]

[n.d.]. Library of Mixed-Initiative Creative Interfaces. Retrieved from http://mici.codingconduct.cc/. (Accessed on 05/31/2020).

[3]

2015. Style Machine Lite. Retrieved 21 Feb., 2022 from https://metacreativetech.com/products/stylemachine-lite/.

[4]

Margareta Ackerman, James Morgan, and Christopher Cassion. 2018. Co-creative conceptual art. In Proceedings of the 9th International Conference on Computational Creativity. 1–8.

[5]

Aftab Alam, Sehat Ullah, Shah Khalid, Fakhrud Din, and Ihsan Rabbi. 2013. Computer supported collaborative work (CSCW) and network issues: A survey. International Information Institute (Tokyo). Information 16, 11 (2013), 7995.

[6]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Robert Kovacs, Anna Seufert, Ludwig Wall, Hsiang-Ting Chen, Florian Meinel, Willi Müller, Sijing You, Maximilian 990 Brehm, Jonathan Striebel, Yannis Kommana, et al. 2017. Trussfab: Fabricating sturdy large-scale structures on desktop 991 3d printers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz (Eds.). 2606–2616. Guidelines for human-AI interaction.

[7]

Ines Arous, Jie Yang, Mourad Khayati, and Philippe Cudré-Mauroux. 2020. Opencrowd: A human-ai collaborative approach for finding social influencers via open-ended answers aggregation. In Proceedings of the Web Conference 2020. 1851–1862.

Digital Library

[8]

Zahra Ashktorab, Q. Vera Liao, Casey Dugan, James Johnson, Qian Pan, Wei Zhang, Sadhana Kumaravel, and Murray Campbell. 2020. Human-ai collaboration in a cooperative game setting: Measuring social perception and outcomes. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 1–20.

Digital Library

[9]

Ronald M. Baecker. 1993. Readings in Groupware and Computer-supported Cooperative Work: Assisting Human-human Collaboration. Elsevier.

[10]

Chris L. Baker, Julian Jara-Ettinger, Rebecca Saxe, and Joshua B. Tenenbaum. 2017. Rational quantitative attribution of beliefs, desires and percepts in human mentalizing. Nature Human Behaviour 1, 4 (2017), 1–10.

[11]

Kevin Baker, Saul Greenberg, and Carl Gutwin. 2001. Heuristic evaluation of groupware based on the mechanics of collaboration. In Proceedings of the IFIP International Conference on Engineering for Human-Computer Interaction. Springer, 123–139.

Digital Library

[12]

Kim A. Bard. 1992. Intentional behavior and intentional communication in young free-ranging orangutans. Child Development 63, 5 (1992), 1186–1197.

[13]

Min Basadur and Peter A. Hausdorf. 1996. Measuring divergent thinking attitudes related to creative problem solving and innovation management. Creativity Research Journal 9, 1 (1996), 21–32.

[14]

Steve R. Bergen. 2009. Evolving stylized images using a user-interactive genetic algorithm. In Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers. 2745–2752.

Digital Library

[15]

Margaret A. Boden. 1998. Creativity and artificial intelligence. Artificial Intelligence 103, 1–2 (1998), 347–356.

Digital Library

[16]

Oliver Bown. 2014. Empirically grounding the evaluation of creative systems: Incorporating interaction design. In Proceedings of the ICCC. 112–119.

[17]

Oliver Bown. 2015. Player responses to a live algorithm: Conceptualising computational creativity without recourse to human comparisons?. In Proceedings of the ICCC. 126–133.

[18]

Oliver Bown and Andrew R. Brown. 2018. Interaction design for metacreative systems. In Proceedings of the New Directions in 3rd Wave Human-Computer Interaction: Volume 1-Technologies. Springer, 67–87.

[19]

Oliver Bown, Kazjon Grace, Liam Bray, and Dan Ventura. 2020. A speculative exploration of the role of dialogue in human-computerco-creation. In Proceedings of the ICCC. 25–32.

[20]

Ingar Brinck. 2008. The role of intersubjectivity in the development of intentional communication. The Shared Mind: Perspectives on Intersubjectivity (2008), 115–140.

[21]

Andrew R. Brown, Toby Gifford, and Rene Wooller. 2010. Generative music systems for live performance. In Proceedings of the 1st International Conference on Computational Intelligence. 290.

[22]

Diletta Cacciagrano and Flavio Corradini. 2001. On synchronous and asynchronous communication paradigms. In Proceedings of the Italian Conference on Theoretical Computer Science. Springer, 256–268.

Digital Library

[23]

Sara Helms Cahan and Jennifer H. Fewell. 2004. Division of labor and the evolution of task sharing in queen associations of the harvester ant Pogonomyrmex californicus. Behavioral Ecology and Sociobiology 56, 1 (2004), 9–17.

[24]

Carrie J. Cai, Samantha Winter, David Steiner, Lauren Wilcox, and Michael Terry. 2019. “ Hello AI”: Uncovering the onboarding needs of medical practitioners for human-AI collaborative decision-making. Proceedings of the ACM on Human-computer Interaction 3, CSCW (2019), 1–24.

Digital Library

[25]

Fuyuan Cao, Jiye Liang, Deyu Li, Liang Bai, and Chuangyin Dang. 2012. A dissimilarity measure for the k-modes clustering algorithm. Knowledge-Based Systems 26 (2012), 120–127.

Digital Library

[26]

Luigi Cardamone, Daniele Loiacono, and Pier Luca Lanzi. 2011. Interactive evolution for the procedural generation of tracks in a high-end racing game. In Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation. 395–402.

Digital Library

[27]

Kristin Carlson, Philippe Pasquier, Herbert H. Tsang, Jordon Phillips, Thecla Schiphorst, and Tom Calvert. 2016. Cochoreo: A generative feature in idanceforms for creating novel keyframe animation for choreography. In Proceedings of the 7th International Conference on Computational Creativity. 380–387.

[28]

O. Castaño Pérez, B. A. Kybartas, and Rafael Bidarra. 2016. TaleBox: A mobile game for mixed-initiative story creation. In Proceedings of the 1st Joint International Conference of DIGRA and FDG, 2016.

[29]

Lee Cheatley, Margareta Ackerman, Alison Pease, and Wendy Moncur. 2020. Co-creative songwriting for bereavement support. In Proceedings of the 11th International Conference on Computational Creativity: ICCC’20. Association for Computational Creativity, 33–41.

[30]

Angelo E. M. Ciarlini, Cesar T. Pozzer, Antonio L. Furtado, and Bruno Feijó. 2005. A logic-based tool for interactive generation and dramatization of stories. In Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology. 133–140.

Digital Library

[31]

Simon Colton, Michael Cook, and Azalea Raad. 2011. Ludic considerations of tablet-based evo-art. In Proceedings of the European Conference on the Applications of Evolutionary Computation. Springer, 223–233.

[32]

Simon Colton, Jeremy Gow, Pedro Torres, and Paul A. Cairns. 2010. Experiments in objet trouvé browsing. In Proceedings of the ICCC. 238–247.

[33]

Simon Colton and Geraint A. Wiggins. 2012. Computational creativity: The final frontier? In Proceedings of the Ecai. 874, 21–26.

[34]

Kate Compton and Michael Mateas. 2015. Casual creators. In Proceedings of the ICCC. 228–235.

[35]

Michael Cook, Jeremy Gow, and Simon Colton. 2016. Danesh: Helping bridge the gap between procedural generators and their output. In Proceedings of the7th Workshop on Procedural Content Generation.

[36]

Luka Crnkovic-Friis and Louise Crnkovic-Friis. 2016. Generative Choreography using Deep Learning. In Proceedings of the Seventh International Conference on Computational Creativity.

[37]

Allan Dafoe, Yoram Bachrach, Gillian Hadfield, Eric Horvitz, Kate Larson, and Thore Graepel. 2021. Cooperative AI: Machines Must Learn to Find Common Ground. Nature Publishing Group.

[38]

Palle Dahlstedt. 2001. A mutasynth in parameter space: Interactive composition through evolution. Organised Sound 6, 2 (2001), 121–124.

Digital Library

[39]

Nicholas Davis, Chih-Pin Hsiao, Yanna Popova, and Brian Magerko. 2015. An enactive model of creativity for computational collaboration and co-creation. In Proceedings of the Creativity in the Digital Age. Springer, 109–133.

[40]

Nicholas Davis, Chih-PIn Hsiao, Kunwar Yashraj Singh, Lisa Li, Sanat Moningi, and Brian Magerko. 2015. Drawing apprentice: An enactive co-creative agent for artistic collaboration. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition. 185–186.

Digital Library

[41]

Nicholas Davis, Chih-PIn Hsiao, Kunwar Yashraj Singh, Lisa Li, and Brian Magerko. 2016. Empirically studying participatory sense-making in abstract drawing with a co-creative cognitive agent. In Proceedings of the 21st International Conference on Intelligent User Interfaces. 196–207.

Digital Library

[42]

Nicholas Mark Davis. 2013. Human-computer co-creativity: Blending human and computational creativity. In Proceedings of the 9th Artificial Intelligence and Interactive Digital Entertainment Conference.

[43]

Hanne De Jaegher. 2013. Embodiment and sense-making in autism. Frontiers in Integrative Neuroscience 7 (2013), 15.

[44]

Hanne De Jaegher and Ezequiel Di Paolo. 2007. Participatory sense-making. Phenomenology and the Cognitive Sciences 6, 4 (2007), 485–507.

[45]

Manoj Deshpande. 2020. Towards Co-build: An Architecture Machine for Co-creative Form-making. Ph.D. Dissertation. The University of North Carolina at Charlotte.

[46]

Sebastian Deterding, Jonathan Hook, Rebecca Fiebrink, Marco Gillies, Jeremy Gow, Memo Akten, Gillian Smith, Antonios Liapis, and Kate Compton. 2017. Mixed-initiative creative interfaces. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 628–635.

Digital Library

[47]

Arne Dietrich. 2004. The cognitive neuroscience of creativity. Psychonomic Bulletin & Review 11, 6 (2004), 1011–1026.

[48]

Steve DiPaola, Graeme McCaig, Kristin Carlson, Sara Salevati, and Nathan Sorenson. 2013. Adaptation of an autonomous creative evolutionary system for real-world design application based on creative cognition. In Proceedings of the ICCC. 40–47.

[49]

Malin Eiband, Daniel Buschek, and Heinrich Hussmann. 2021. How to support users in understanding intelligent systems? Structuring the discussion. In Proceedings of the 26th International Conference on Intelligent User Interfaces. 120–132.

Digital Library

[50]

Arne Eigenfeldt and Philippe Pasquier. 2010. Realtime generation of harmonic progressions using controlled markov selection. In Proceedings of the ICCC-X-Computational Creativity Conference. 16–25.

[51]

Jonathan Eisenmann, Benjamin Schroeder, Matthew Lewis, and Rick Parent. 2011. Creating choreography with interactive evolutionary algorithms. In Proceedings of the European Conference on the Applications of Evolutionary Computation. Springer, 293–302.

[52]

Paul Ekman and Wallace V. Friesen. 1969. Nonverbal leakage and clues to deception. Psychiatry 32, 1 (1969), 88–106.

[53]

Daniel Fallman. 2008. The interaction design research triangle of design practice, design studies, and design exploration. Design Issues 24, 3 (2008), 4–18.

[54]

Judith E. Fan, Monica Dinculescu, and David Ha. 2019. Collabdraw: An environment for collaborative sketching with an artificial agent. In Proceedings of the 2019 on Creativity and Cognition. 556–561.

Digital Library

[55]

Valentina Fantasia, Hanne De Jaegher, and Alessandra Fasulo. 2014. We can work it out: An enactive look at cooperation. Frontiers in Psychology 5 (2014), 874.

[56]

Frank Fischer and Heinz Mandl. 2003. Being there or being where? Videoconferencing and cooperative learning. PhilPapers.

[57]

James Gain, Patrick Marais, and Wolfgang Straßer. 2009. Terrain sketching. In Proceedings of the 2009 Symposium on Interactive 3D Graphics and Games. 31–38.

Digital Library

[58]

Katy Ilonka Gero and Lydia B. Chilton. 2019. Metaphoria: An algorithmic companion for metaphor creation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[59]

Stephen Gilroy, Julie Porteous, Fred Charles, and Marc Cavazza. 2012. Exploring passive user interaction for adaptive narratives. In Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces. 119–128.

Digital Library

[60]

Ashok K. Goel and Spencer Rugaber. 2017. GAIA: A CAD-like environment for designing game-playing agents. IEEE Intelligent Systems 32, 3 (2017), 60–67.

Digital Library

[61]

Carl Gutwin, Saul Greenberg, and Mark Roseman. 1996. Workspace awareness in real-time distributed groupware: Framework, widgets, and evaluation. In Proceedings of the People and Computers XI. Springer, 281–298.

Digital Library

[62]

Matthew Guzdial and Mark Riedl. 2019. An interaction framework for studying co-creative ai. arXiv:1903.09709. Retrieved from https://arxiv.org/abs/1903.09709.

[63]

Rania Hodhod and Brian Magerko. 2016. Closing the cognitive gap between humans and interactive narrative agents using shared mental models. In Proceedings of the 21st International Conference on Intelligent User Interfaces. 135–146.

Digital Library

[64]

Guy Hoffman and Gil Weinberg. 2011. Interactive improvisation with a robotic marimba player. Autonomous Robots 31, 2–3 (2011), 133–153.

Digital Library

[65]

Zhexue Huang. 1997. Clustering large data sets with mixed numeric and categorical values. In Proceedings of the 1st Pacific-asia Conference on Knowledge Discovery and Data Mining. 21–34.

[66]

Steffan Ianigro and Oliver Bown. 2016. Plecto: A low-level interactive genetic algorithm for the evolution of audio. In Proceedings of the International Conference on Computational Intelligence in Music, Sound, Art, and Design. Springer, 63–78.

Digital Library

[67]

I. Infantino, A. Augello, A. Manfré, G. Pilato, and F. Vella. 2016. Robodanza: Live performances of a creative dancing humanoid. In Proceedings of the 7th International Conference on Computational Creativity. 388–395.

[68]

Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. 2017. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1125–1134.

[69]

Mikhail Jacob, Alexander Zook, and Brian Magerko. 2013. Viewpoints AI: Procedurally representing and reasoning about gestures. In Proceedings of the DiGRA Conference.

[70]

Kyle E. Jennings, Dean Keith Simonton, and Stephen E. Palmer. 2011. Understanding exploratory creativity in a visual domain. In Proceedings of the 8th ACM Conference on Creativity and Cognition. 223–232.

Digital Library

[71]

Youngseung Jeon, Seungwan Jin, Patrick C. Shih, and Kyungsik Han. 2021. FashionQ: An AI-driven creativity support tool for facilitating ideation in fashion design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–18.

Digital Library

[72]

Rex Eugene Jung, Brittany S. Mead, Jessica Carrasco, and Ranee A. Flores. 2013. The structure of creative cognition in the human brain. Frontiers in Human Neuroscience 7 (2013), 330.

[73]

Peter H. Kahn, Takayuki Kanda, Hiroshi Ishiguro, Brian T. Gill, Solace Shen, Jolina H. Ruckert, and Heather E. Gary. 2016. Human creativity can be facilitated through interacting with a social robot. In Proceedings of the 2016 11th ACM/IEEE International Conference on Human-Robot Interaction. IEEE, 173–180.

[74]

Maximos Kaliakatsos-Papakostas, Roberto Confalonieri, Joe Corneli, Asterios Zacharakis, and Emilios Cambouropoulos. 2016. An Argument-based Creative Assistant for Harmonic Blending. In Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016, 27 June-1 July. Sony Computer Science Laboratory, 330–337.

[75]

Nabil N. Kamel and Robert M. Davison. 1998. Applying CSCW technology to overcome traditional barriers in group interactions. Information & Management 34, 4 (1998), 209–219.

Digital Library

[76]

Anna Kantosalo and Anna Jordanous. 2020. Role-based perceptions of computer participants in human-computer co-creativity. In Proceedings of the 7th Computational Creativity Symposium at AISB 2020.

[77]

Anna Kantosalo, Prashanth Thattai Ravikumar, Kazjon Grace, and Tapio Takala. 2020. Modalities, styles and strategies: An interaction framework for human-computer co-creativity. In Proceedings of the ICCC. 57–64.

[78]

Anna Kantosalo, Jukka M. Toivanen, Ping Xiao, and Hannu Toivonen. 2014. From isolation to involvement: Adapting machine creativity software to support human-computer co-creation. In Proceedings of the ICCC. 1–7.

[79]

Anna Kantosalo and Hannu Toivonen. 2016. Modes for creative human-computer collaboration: Alternating and task-divided co-creativity. In Proceedings of the 7th International Conference on Computational Creativity. 77–84.

[80]

Pegah Karimi, Jeba Rezwana, Safat Siddiqui, Mary Lou Maher, and Nasrin Dehbozorgi. 2020. Creative sketching partner: An analysis of human-AI co-creativity. In Proceedings of the 25th International Conference on Intelligent User Interfaces. 221–230.

Digital Library

[81]

Jody Koenig Kellas and April R. Trees. 2014. Rating interactional sense-making in the process of joint storytelling. In the Sourcebook of Nonverbal Measures: Going Beyond Words. Taylor and Francis, 281–294.

[82]

Robert M. Keller. 2012. Continuous improvisation and trading with impro-visor. (2012), 222.

[83]

Andruid Kerne, Eunyee Koh, Steven M. Smith, Andrew Webb, and Blake Dworaczyk. 2008. combinFormation: Mixed-initiative composition of image and text surrogates promotes information discovery. ACM Transactions on Information Systems 27, 1 (2008), 1–45.

Digital Library

[84]

Ahmed Khalifa, Gabriella A. B. Barros, and Julian Togelius. 2017. Deeptingle. In 8th International Conference on Computational Creativity, ICCC.

[85]

Jeeeun Kim, Haruki Takahashi, Homei Miyashita, Michelle Annett, and Tom Yeh. 2017. Machines as co-designers: A fiction on the future of human-fabrication machine interaction. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 790–805.

Digital Library

[86]

Gary Klein, Brian Moon, and Robert R. Hoffman. 2006. Making sense of sensemaking 1: Alternative perspectives. IEEE Intelligent Systems 21, 4 (2006), 70–73.

Digital Library

[87]

Jon Kolko. 2010. Thoughts on Interaction Design. Morgan Kaufmann.

[88]

Robert Kovacs, Anna Seufert, Ludwig Wall, Hsiang-Ting Chen, Florian Meinel, Willi Müller, Sijing You, Maximilian Brehm, Jonathan Striebel, Yannis Kommana, Alexander Popiak, Thomas Bläsius, and Patrick Baudisch. 2017. Trussfab: Fabricating sturdy large-scale structures on desktop 3d printers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2606–2616.

[89]

Iván M. Laclaustra, José Ledesma, Gonzalo Méndez, and Pablo Gervás. 2014. Kill the dragon and rescue the princess: Designing a plan-based multi-agent story generator. In Proceedings of the ICCC. 347–350.

[90]

Carlos León. 2011. Stella-a story generation system for generic scenarios. In Proceedings of the 2nd International Conference on Computational Creativity.

[91]

Aaron Levisohn and Philippe Pasquier. 2008. BeatBender: subsumption architecture for autonomous rhythm generation. In Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology. 51–58.

Digital Library

[92]

Zhuying Li, Yan Wang, Wei Wang, Stefan Greuter, and Florian’Floyd’ Mueller. 2020. Empowering a creative city: Engage citizens in creating street art through human-AI collaboration. In Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8.

Digital Library

[93]

Antonios Liapis, Georgios N. Yannakakis, and Julian Togelius. 2012. Co-creating game content using an adaptive model of user taste. In Proceedings of the 3rd International Conference on Computational Creativity.

[94]

Antonios Liapis, Georgios N. Yannakakis, and Julian Togelius. 2013. Sentient world: Human-based procedural cartography. In Proceedings of the International Conference on Evolutionary and Biologically Inspired Music and Art. Springer, 180–191.

Digital Library

[95]

Antonios Liapis, Georgios N. Yannakakis, and Julian Togelius. 2014. Computational Game Creativity. ICCC.

[96]

Yuyu Lin, Jiahao Guo, Yang Chen, Cheng Yao, and Fangtian Ying. 2020. It is your turn: collaborative ideation with a co-creative robot through sketch. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[97]

Tao Liu, Hirofumi Saito, and Misato Oi. 2015. Role of the right inferior frontal gyrus in turn-based cooperation and competition: A near-infrared spectroscopy study. Brain and Cognition 99 (2015), 17–23.

[98]

Duri Long, Mikhail Jacob, Nicholas Davis, and Brian Magerko. 2017. Designing for socially interactive systems. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. 39–50.

Digital Library

[99]

Alex Rodriguez Lopez, Antonio Pedro Oliveira, and Amílcar Cardoso. 2010. Real-time emotion-driven music engine. In Proceedings of the ICCC. 150–154.

[100]

Ryan Louie, Andy Coenen, Cheng Zhi Huang, Michael Terry, and Carrie J. Cai. 2020. Novice-AI music co-creation via AI-steering tools for deep generative models. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[101]

Todd I. Lubart. 2001. Models of the creative process: Past, present and future. Creativity Research Journal 13, 3–4 (2001), 295–308.

[102]

Pedro Lucas and Carlos Martinho. 2017. Stay awhile and listen to 3buddy, a co-creative level design support tool. In Proceedings of the ICCC. 205–212.

[103]

Penousal Machado and Amílcar Cardoso. 2000. NEvAr–the assessment of an evolutionary art tool. In Proceedings of the AISB00 Symposium on Creative & Cultural Aspects and Applications of AI & Cognitive Science.

[104]

Tiago Machado, Ivan Bravi, Zhu Wang, Andy Nealen, and Julian Togelius. 2016. Shopping for game mechanics. In Proceedings of 1st International Joint Conference of DiGRA and FDG.

[105]

Brian Magerko, Christopher DeLeon, and Peter Dohogne. 2011. Digital improvisational theatre: Party quirks. In Proceedings of the International Workshop on Intelligent Virtual Agents. Springer, 42–47.

[106]

Mary Lou Maher. 2012. Computational and collective creativity: Who’s being creative?. In Proceedings of the ICCC. Citeseer, 67–71.

[107]

Lena Mamykina, Linda Candy, and Ernest Edmonds. 2002. Collaborative creativity. Communications of the ACM 45, 10 (2002), 96–99.

Digital Library

[108]

Charles Martin, Henry Gardner, Ben Swift, and Michael Martin. 2016. Intelligent agents and networked buttons improve free-improvised ensemble music-making on touch-screens. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2295–2306.

Digital Library

[109]

Michael Mateas and Andrew Stern. 2003. Façade: An experiment in building a fully-realized interactive drama. In Proceedings of the Game Developers Conference. 4–8.

[110]

Jon McCormack, Toby Gifford, Patrick Hutchings, Maria Teresa Llano Rodriguez, Matthew Yee-King, and Mark d’Inverno. 2019. In a silent way: Communication between ai and improvising musicians beyond sound. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–11.

Digital Library

[111]

Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019. Model cards for model reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency. 220–229.

Digital Library

[112]

Asako Miura and Misao Hida. 2004. Synergy between diversity and similarity in group-idea generation. Small Group Research 35, 5 (2004), 540–564.

[113]

Fabio Morreale and Raul Masu. 2017. Renegotiating responsibilities in human-computer ensembles.

[114]

Bilge Mutlu, Fumitaka Yamaoka, Takayuki Kanda, Hiroshi Ishiguro, and Norihiro Hagita. 2009. Nonverbal leakage in robots: Communication of intentions through seemingly unintentional behavior. In Proceedings of the 4th ACM/IEEE International Conference on Human Robot Interaction. 69–76.

Digital Library

[115]

Santiago Negrete-Yankelevich and Nora Morales Zaragoza. 2014. The apprentice framework: Planning and assessing creativity. In Proceedings of the ICCC. 280–283.

[116]

Mark Nelson, Swen Gaudl, Simon Colton, Edward Powley, Blanca Perez Ferrer, Rob Saunders, Peter Ivey, and Michael Cook. 2017. Fluidic games in cultural contexts. In Proceedings of theInternational Conference on Computational Creativity.

[117]

Laurence Nigay. 2004. Design space for multimodal interaction. In Proceedings of the Building the Information Society. Springer, 403–408.

[118]

Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[119]

Hugo Gonçalo Oliveira, Raquel Hervás, Alberto Díaz, and Pablo Gervás. 2014. Adapting a generic platform for poetry generation to produce spanish poems. In Proceedings of the ICCC. 63–71.

[120]

Brian O’Neill and Mark Riedl. 2011. Simulating the everyday creativity of readers. In Proceedings of the ICCC. 153–158.

[121]

Hiroyuki Osone, Jun-Li Lu, and Yoichi Ochiai. 2021. BunCho: AI supported story co-creation via unsupervised multitask learning to increase writers’ creativity in japanese. In Proceedings of the Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1–10.

Digital Library

[122]

Francois Pachet. 2003. The continuator: Musical interaction with style. Journal of New Music Research 32, 3 (2003), 333–341.

[123]

Jéssica Parente, Tiago Martins, Joao Bicker, and Penousal Machado. 2020. Which type is your type?. In Proceedings of the ICCC. 476–483.

[124]

Victor M. Ruiz Penichet, Ismael Marin, Jose A. Gallud, María Dolores Lozano, and Ricardo Tesoriero. 2007. A classification method for CSCW systems. Electronic Notes in Theoretical Computer Science 168 (2007), 237–247.

Digital Library

[125]

Ken Perlin and Athomas Goldberg. 1996. Improv: A system for scripting interactive actors in virtual worlds. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques. 205–216.

Digital Library

[126]

Florian Pinel and Lav R. Varshney. 2014. Computational creativity for culinary recipes. In Proceedings of the CHI’14 Extended Abstracts on Human Factors in Computing Systems. 439–442.

Digital Library

[127]

David Premack and Guy Woodruff. 1978. Does the chimpanzee have a theory of mind?. Behavioral and Brain Sciences 1, 4 (1978), 515–526.

[128]

Walter Reinhard, Jean Schweitzer, Gerd Volksen, and Michael Weber. 1994. CSCW tools: Concepts and architectures. Computer 27, 5 (1994), 28–36.

Digital Library

[129]

Jeba Rezwana, Mary Lou Maher, and Nicholas Davis. 2021. Creative PenPal: A virtual embodied conversational AI agent to improve user engagement and collaborative experience in human-AI co-creative design ideation. In IUI Workshops.

[130]

Mel Rhodes. 1961. An analysis of creativity. The Phi Delta Kappan 42, 7 (1961), 305–310.

[131]

Mark Riedl, Jonathan Rowe, and David K. Elson. 2008. Toward intelligent support of authoring machinima media content: Story and visualization. In Proceedings of the 2nd International Conference on Intelligent Technologies for Interactive Entertainment.

[132]

Tom Rodden and Gordon Blair. 1991. CSCW and distributed systems: The problem of control. In Proceedings of the 2nd European Conference on Computer-Supported Cooperative Work ECSCW’91. Springer, 49–64.

[133]

Daniel M. Russell, Mark J. Stefik, Peter Pirolli, and Stuart K. Card. 1993. The cost structure of sensemaking. In Proceedings of the INTERACT’93 and CHI’93 Conference on Human Factors in Computing Systems. 269–276.

Digital Library

[134]

Tony Salvador, Jean Scholtz, and James Larson. 1996. The denver model for groupware design. ACM SIGCHI Bulletin 28, 1 (1996), 52–58.

Digital Library

[135]

Ben Samuel, Michael Mateas, and Noah Wardrip-Fruin. 2016. The design of writing buddy: A mixed-initiative approach towards computational story collaboration. In Proceedings of the International Conference on Interactive Digital Storytelling. Springer, 388–396.

Digital Library

[136]

Richard Savery, Lisa Zahray, and Gil Weinberg. 2020. Shimon the Rapper: a real-time system for human-robot interactive rap battles. In International Conference on Computational Creativity. 212–219.

[137]

R. Keith Sawyer and Stacy DeZutter. 2009. Distributed creativity: How collective creations emerge from collaboration. Psychology of Aesthetics, Creativity, and the Arts 3, 2 (2009), 81.

[138]

Andreas Scheibenpflug, Johannes Karder, Susanne Schaller, Stefan Wagner, and Michael Affenzeller. 2016. Evolutionary procedural 2D map generation using novelty search. In Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion. 39–40.

Digital Library

[139]

Kjeld Schmidt. 2008. Cooperative work and coordinative practices. In Proceedings of the Cooperative Work and Coordinative Practices. Springer, 3–27.

[140]

Oliver Schmitt and Daniel Buschek. 2021. Characterchat: Supporting the creation of fictional characters through conversation and progressive manifestation with a chatbot. In Creativity and Cognition. 1–10.

[141]

Noor Shaker, Mohammad Shaker, and Julian Togelius. 2013. Ropossum: An authoring tool for designing, optimizing, and solving cut the rope levels. In Proceedings of the 9th Artificial Intelligence and Interactive Digital Entertainment Conference.

[142]

Ruben Michaël Smelik, Tim Tutenel, Klaas Jan de Kraker, and Rafael Bidarra. 2010. Interactive creation of virtual worlds using procedural sketching. In Proceedings of the Eurographics (Short Papers). 29–32.

[143]

Gillian Smith, Jim Whitehead, and Michael Mateas. 2010. Tanagra: A mixed-initiative level design tool. In Proceedings of the 5th International Conference on the Foundations of Digital Games. 209–216.

Digital Library

[144]

Michael R. Smith, Ryan S. Hintze, and Dan Ventura. 2014. Nehovah: A neologism creator nomen ipsum. In Proceedings of the ICCC. 173–181.

[145]

Frank K. Sonnenberg. 1991. Strategies for creativity. Journal of Business Strategy 12, 1 (1991). 50–53.

[146]

Jannick Kirk Sørensen. 2016. Silent game as model for examining student online creativity-preliminary results from an experiment. Think CROSS. Magdeburg: Change MEDIA 10 (2016).

[147]

Jannick Kirk Sørensen. 2017. Exploring constrained creative communication: The silent game as model for studying online collaboration. International Journal of E-Services and Mobile Applications 9, 4 (2017), 1–23.

Digital Library

[148]

Paul A. Szerlip, Amy Hoover, and Kenneth O. Stanley. 2012. MaestroGenesis: Computer-assisted musical accompaniment generation. In 3rd International Conference on Computational Creativity.

[149]

Kurt Thywissen. 1999. GeNotator: An environment for exploring the application of evolutionary techniques in computer-assisted composition. Organised Sound 4, 2 (1999), 127–133.

Digital Library

[150]

Ha Trinh, Darren Edge, Lazlo Ring, and Timothy Bickmore. 2016. Thinking outside the box: Co-planning scientific presentations with virtual agents. In Proceedings of the International Conference on Intelligent Virtual Agents. Springer, 306–316.

[151]

Dakuo Wang, Justin D. Weisz, Michael Muller, Parikshit Ram, Werner Geyer, Casey Dugan, Yla Tausczik, Horst Samulowitz, and Alexander Gray. 2019. Human-ai collaboration in data science: Exploring data scientists’ perceptions of automated ai. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–24.

Digital Library

[152]

Peter Wegner. 1997. Why interaction is more powerful than algorithms. Communications of the ACM 40, 5 (1997), 80–91.

Digital Library

[153]

Miaomiao Wen, Nancy Baym, Omer Tamuz, Jaime Teevan, Susan T. Dumais, and Adam Kalai. 2015. OMG UR funny! computer-aided humor with an application to chat. In Proceedings of the ICCC. 86–93.

[154]

Tom White and Ian Loh. 2017. Generating animations by sketching in conceptual space. In Proceedings of the ICCC. 261–268.

[155]

Alena Widows and Harriet Sandilands. 2009. The Poetry Machine. Retrieved from www.thepoetrymachine.net.

[156]

Geraint A. Wiggins. 2006. A preliminary framework for description, analysis and comparison of creative systems. Knowledge-Based Systems 19, 7 (2006), 449–458.

Digital Library

[157]

Blake Williford, Abhay Doke, Michel Pahud, Ken Hinckley, and Tracy Hammond. 2019. DrawMyPhoto: Assisting novices in drawing from photographs. In Proceedings of the 2019 on Creativity and Cognition. 198–209.

Digital Library

[158]

Lauren Winston and Brian Magerko. 2017. Turn-taking with improvisational co-creative agents. In Proceedings of the 13th Artificial Intelligence and Interactive Digital Entertainment Conference.

[159]

Jun Xiao, Xuemei Zhang, Phil Cheatle, Yuli Gao, and C. Brian Atkins. 2008. Mixed-initiative photo collage authoring. In Proceedings of the 16th ACM International Conference on Multimedia. 509–518.

Digital Library

[160]

Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. 2020. Re-examining whether, why, and how human-AI interaction is uniquely difficult to design. In Proceedings of the 2020 Chi Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[161]

Georgios N. Yannakakis, Antonios Liapis, and Constantine Alexopoulos. 2014. Mixed-initiative co-creativity. In Proceedings of the 9th International Conference on the Foundations of Digital Games.

[162]

Matthew Yee-King and Mark d’Inverno. 2016. Experience driven design of creative systems. In Proceedings of the 7th International Conference on Computational Creativity.

[163]

Wako Yoshida, Ray J. Dolan, and Karl J. Friston. 2008. Game theory of mind. PLoS Computational Biology 4, 12 (2008), e1000254.

[164]

Michael W. Young and Oliver Bown. 2010. Clap-along: A negotiation strategy for creative musical interaction with computational systems. In Proceedings of the International Conference on Computational Creativity 2010. 215–222.

[165]

Chao Zhang, Cheng Yao, Jianhui Liu, Zili Zhou, Weilin Zhang, Lijuan Liu, Fangtian Ying, Yijun Zhao, and Guanyun Wang. 2021. StoryDrawer: A co-creative agent supporting children’s storytelling through collaborative drawing. In Proceedings of the Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1–6.

Digital Library

[166]

Viktor Zoric and Björn Gambäck. 2018. The image artist: Computer generated art based on musical input. In Proceedings of the ICCC. 296–303.

Cited By

McIntosh TSusnjak TLiu TWatters PXu DLiu DHalgamuge M(2025)From Google Gemini to OpenAI Q* (Q-Star): A Survey on Reshaping the Generative Artificial Intelligence (AI) Research LandscapeTechnologies10.3390/technologies1302005113:2(51)Online publication date: 30-Jan-2025
https://doi.org/10.3390/technologies13020051
Wilchek MLuther KBatarseh F(2025)Ajna: A Wearable Shared Perception System for Extreme SensemakingACM Transactions on Interactive Intelligent Systems10.1145/369082915:1(1-29)Online publication date: 16-Jan-2025
https://dl.acm.org/doi/10.1145/3690829
Yao JChen PLi ZCai YWu YYou WSun L(2025)StepIdeator: Utilizing Mixed Representations to Support Step-By-Step Design With Generative Artificial IntelligenceJournal of Mechanical Design10.1115/1.4067426147:7Online publication date: 30-Jan-2025
https://doi.org/10.1115/1.4067426
Show More Cited By

Index Terms

Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Collaborative interaction
  2. Interaction design
    1. Interaction design process and methods

Recommendations

Understanding User Perceptions, Collaborative Experience and User Engagement in Different Human-AI Interaction Designs for Co-Creative Systems
C&C '22: Proceedings of the 14th Conference on Creativity and Cognition

Human-AI co-creativity involves humans and AI collaborating on a shared creative product as partners. In a creative collaboration, communication is an essential component among collaborators. In many existing co-creative systems, users can communicate ...
Environments for creative interaction design processes
DIS Companion '14: Proceedings of the 2014 companion publication on Designing interactive systems

The theme of the workshop is to examine the nature of creative processes as part of designing interactive systems. In particular, the workshop will focus on how to organize design sessions to improve creative processes, for instance by setting up ...
Speculative data and the creative imaginary: shared innovative visions between art and technology
C&C '07: Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition

The exhibition Speculative Data and the Creative Imaginary: shared innovative visions between art and technology will bring together examples of best practices in creative digital media art and design that foster strong ties to current research trends ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 30, Issue 5

October 2023

593 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/3623487

Editors:
Kristina Höök
KTH Royal Institute of Technology, Sweden
,
Kasper Hornbæk
University of Copenhagen, Denmark

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 September 2023

Online AM: 24 February 2022

Accepted: 14 February 2022

Revised: 04 February 2022

Received: 02 July 2021

Published in TOCHI Volume 30, Issue 5

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

45
Total Citations
View Citations
8,197
Total Downloads

Downloads (Last 12 months)3,926
Downloads (Last 6 weeks)552

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

McIntosh TSusnjak TLiu TWatters PXu DLiu DHalgamuge M(2025)From Google Gemini to OpenAI Q* (Q-Star): A Survey on Reshaping the Generative Artificial Intelligence (AI) Research LandscapeTechnologies10.3390/technologies1302005113:2(51)Online publication date: 30-Jan-2025
https://doi.org/10.3390/technologies13020051
Wilchek MLuther KBatarseh F(2025)Ajna: A Wearable Shared Perception System for Extreme SensemakingACM Transactions on Interactive Intelligent Systems10.1145/369082915:1(1-29)Online publication date: 16-Jan-2025
https://dl.acm.org/doi/10.1145/3690829
Yao JChen PLi ZCai YWu YYou WSun L(2025)StepIdeator: Utilizing Mixed Representations to Support Step-By-Step Design With Generative Artificial IntelligenceJournal of Mechanical Design10.1115/1.4067426147:7Online publication date: 30-Jan-2025
https://doi.org/10.1115/1.4067426
Taylor RChmura CHinson JSteinhart BSangal RVenkatesh AXu HCohen IFaustino ILevin S(2025)Impact of Artificial Intelligence–Based Triage Decision Support on Emergency Department CareNEJM AI10.1056/AIoa24002962:3Online publication date: 27-Feb-2025
https://doi.org/10.1056/AIoa2400296
Boers JEtty TBaars Mvan Boekhoven K(2025)Exploring cognitive strategies in human-AI interaction: ChatGPT's role in creative tasksJournal of Creativity10.1016/j.yjoc.2025.10009535:1(100095)Online publication date: Apr-2025
https://doi.org/10.1016/j.yjoc.2025.100095
Sabbaghan SEaton S(2025)Navigating the Ethical Frontier: Graduate Students’ Experiences with Generative AI-Mediated ScholarshipInternational Journal of Artificial Intelligence in Education10.1007/s40593-024-00454-6Online publication date: 22-Jan-2025
https://doi.org/10.1007/s40593-024-00454-6
Liu BLiao Y(2025)Integrating IBM Watson BEAT generative AI software into flute music learning: the impact of advanced AI tools on students’ learning strategiesEducation and Information Technologies10.1007/s10639-025-13394-yOnline publication date: 31-Jan-2025
https://doi.org/10.1007/s10639-025-13394-y
Chung KLee M(2024)Exploring AI for Creative Fashion Image Generation through HAICJournal of the Korean Society of Costume10.7233/jksc.2024.74.1.06174:1(61-87)Online publication date: 29-Feb-2024
https://doi.org/10.7233/jksc.2024.74.1.061
Glebova E(2024)Research Duos: Unveiling the Collaborative Essence of ResearchSocieties10.3390/soc1409017514:9(175)Online publication date: 6-Sep-2024
https://doi.org/10.3390/soc14090175
Mao YRafner JWang YSherson J(2024)HI-TAM, a hybrid intelligence framework for training and adoption of generative design assistantsFrontiers in Computer Science10.3389/fcomp.2024.14603816Online publication date: 29-Nov-2024
https://doi.org/10.3389/fcomp.2024.1460381
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

Figures

Tables

Media

View full text|Download PDF

View Issue’s Table of Contents