More Web Proxy on the site http://driver.im/

survey

Understanding and Creating Art with AI: Review and Outlook

Authors:

James SheAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 18, Issue 2

Article No.: 66, Pages 1 - 22

https://doi.org/10.1145/3475799

Published: 16 February 2022 Publication History

Abstract

Technologies related to artificial intelligence (AI) have a strong impact on the changes of research and creative practices in visual arts. The growing number of research initiatives and creative applications that emerge in the intersection of AI and art motivates us to examine and discuss the creative and explorative potentials of AI technologies in the context of art. This article provides an integrated review of two facets of AI and art: (1) AI is used for art analysis and employed on digitized artwork collections, or (2) AI is used for creative purposes and generating novel artworks. In the context of AI-related research for art understanding, we present a comprehensive overview of artwork datasets and recent works that address a variety of tasks such as classification, object detection, similarity retrieval, multimodal representations, and computational aesthetics, among others. In relation to the role of AI in creating art, we address various practical and theoretical aspects of AI Art and consolidate related works that deal with those topics in detail. Finally, we provide a concise outlook on the future progression and potential impact of AI technologies on our understanding and creation of art.

References

[1]

G. Goh A. Ramesh, M. Pavlov, and S. Gray. 2021. DALL\(\cdot\)E: Creating Images from Text. Retrieved January 25, 2021 from https://openai.com/blog/dall-e/.

[2]

Patrice Abry, Herwig Wendt, and Stéphane Jaffard. 2013. When Van Gogh meets Mandelbrot: Multifractal classification of painting’s texture. Signal Processing 93, 3 (2013), 554–572.

Digital Library

[3]

Panos Achlioptas, Maks Ovsjanikov, Kilichbek Haydarov, Mohamed Elhoseiny, and Leonidas Guibas. 2021. ArtEmis: Affective language for visual art. arXiv preprint arXiv:2101.07396 (2021).

[4]

Siddharth Agarwal, Harish Karnick, Nirmal Pant, and Urvesh Patel. 2015. Genre and style based painting classification. In Proceedings of the 2015 IEEE Winter Conference on Applications of Computer Vision (WACV’15). IEEE, Los Alamitos, CA, 588–594. https://doi.org/10.1109/WACV.2015.84

Digital Library

[5]

Xavier Alameda-Pineda, Elisa Ricci, Yan Yan, and Nicu Sebe. 2016. Recognizing emotions from abstract paintings using non-linear matrix completion. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5240–5248.

[6]

Seyed Ali Amirshahi, Gregor Uwe Hayn-Leichsenring, Joachim Denzler, and Christoph Redies. 2014. Jenaesthetics subjective dataset: Analyzing paintings by subjective scores. In Proceedings of the European Conference on Computer Vision. 3–19.

[7]

Yaniv Bar, Noga Levy, and Lior Wolf. 2014. Classification of artistic styles using binarized features derived from a deep neural network. In Computer Vision—ECCV 2014 Workshops. Lecture Notes in Computer Science, Vol. 8925. Springer, 71–84. https://doi.org/10.1007/978-3-319-16178-5_5

[8]

Lorenzo Baraldi, Marcella Cornia, Costantino Grana, and Rita Cucchiara. 2018. Aligning text and document illustrations: Towards visually explainable digital humanities. In Proceedings of the 24th International Conference on Pattern Recognition (ICPR’18). IEEE, Los Alamitos, CA, 1097–1102.

[9]

Peter Bell and Leonardo Impett. 2019. Ikonographie und interaktion. Computergestützte analyse von posen in bildern der heilsgeschichte. Das Mittelalter 24, 1 (2019), 31–53.

[10]

Simone Bianco, Davide Mazzini, Paolo Napoletano, and Raimondo Schettini. 2019. Multitask painting categorization by deep multibranch neural network. Expert Systems with Applications 135 (2019), 90–101.

Digital Library

[11]

Margaret A. Boden. 2010. Creativity and Art: Three Roads to Surprise. Oxford University Press.

[12]

Margaret A. Boden and Ernest A. Edmonds. 2009. What is generative art?Digital Creativity 20, 1–2 (2009), 21–46.

[13]

Pietro Bongini, Federico Becattini, Andrew D. Bagdanov, and Alberto Del Bimbo. 2020. Visual question answering for cultural heritage. arXiv preprint arXiv:2003.09853 (2020).

[14]

Andrew Brock, Jeff Donahue, and Karen Simonyan. 2018. Large scale GAN training for high fidelity natural image synthesis. arXiv preprint arXiv:1809.11096 (2018).

[15]

Sheila Bsteh and Filip Vermeylen. 2021. From Painting to Pixel: Understanding NFT Artworks. Retrieved June 15, 2021 from https://www.researchgate.net/publication/351346278_From_Painting_to_Pixel_Understanding_NFT_artworks.

[16]

Gustavo Carneiro, Nuno Pinho Da Silva, Alessio Del Bue, and João Paulo Costeira. 2012. Artistic image classification: An analysis on the PRINTART database. In Computer Vision—ECCV 2012. Lecture Notes in Computer Science, Vol. 7575. Springer, 143–157.

Digital Library

[17]

Giovanna Castellano, Eufemia Lella, and Gennaro Vessio. 2021. Visual link retrieval and knowledge discovery in painting datasets. Multimedia Tools and Applications 80, 5 (2021), 6599–6616.

Digital Library

[18]

Giovanna Castellano and Gennaro Vessio. 2020. Towards a tool for visual link retrieval and knowledge discovery in painting datasets. In Digital Libraries: The Era of Big Data and Data Science. Communications in Computer and Information Science, Vol. 1177. Springer, 105–110.

[19]

Eva Cetinic. 2020. Iconographic image captioning for artworks. In Pattern Recognition. ICPR International Workshops and Challenges. Lecture Notes in Computer Science, Vol. 12663. Springer, 502–516.

[20]

Eva Cetinic and Sonja Grgic. 2013. Automated painter recognition based on image feature extraction. In Proceedings of the 2013 55th International Symposium (ELMAR’13). IEEE, Los Alamitos, CA, 19–22.

[21]

Eva Cetinic and Sonja Grgic. 2016. Genre classification of paintings. In Proceedings of the 2016 International Symposium (ELMAR’16). IEEE, Los Alamitos, CA, 201–204.

[22]

Eva Cetinic, Tomislav Lipic, and Sonja Grgic. 2018. Fine-tuning convolutional neural networks for fine art classification. Expert Systems with Applications 114 (2018), 107–118.

[23]

Eva Cetinic, Tomislav Lipic, and Sonja Grgic. 2019. A deep learning perspective on beauty, sentiment, and remembrance of art. IEEE Access 7 (2019), 73694–73710.

[24]

Eva Cetinic, Tomislav Lipic, and Sonja Grgic. 2020. Learning the principles of art history with convolutional neural networks. Pattern Recognition Letters 129 (2020), 56–62.

[25]

Rebecca Chamberlain, Caitlin Mullin, Bram Scheerlinck, and Johan Wagemans. 2018. Putting the art in artificial: Aesthetic responses to computer-generated art. Psychology of Aesthetics, Creativity, and the Arts 12, 2 (2018), 177.

[26]

Eugene Ch’ng. 2019. Art by computing machinery: Is machine art acceptable in the artworld?ACM Transactions on Multimedia Computing, Communications, and Applications 15, 2s (2019), 1–17.

Digital Library

[27]

Christie’s. 2018. Is Artificial Intelligence Set to Become Art’s Next Medium? Retrieved December 2, 2020 from https://www.christies.com/features/A-collaboration-between-two-artists-one-human-one-a-machine-9332-1.aspx.

[28]

Christie’s. 2021. Monumental Collage by Beeple Is First Purely Digital Artwork NFT to Come to Auction. Retrieved June 15, 2021 from https://www.christies.com/features/Monumental-collage-by-Beeple-is-first-purely-digital-artwork-NFT-to-come-to-auction-11510-7.aspx.

[29]

Mark Coeckelbergh. 2017. Can machines create art?Philosophy & Technology 30, 3 (2017), 285–303.

[30]

Simon Colton. 2012. The painting fool: Stories from building an automated painter. In Computers and Creativity. Springer, 3–38.

Digital Library

[31]

Simon Colton, Alison Pease, and Rob Saunders. 2018. Issues of authenticity in autonomously creative systems. In Proceedings of the 9th International Conference on Computational Creativity.

[32]

Elliot J. Crowley, Omkar M. Parkhi, and Andrew Zisserman. 2015. Face painting: Querying art with photos. In Proceedings of the 2015 British Machine Vision Conference (BMVC’15). 65.1–65.13.

[33]

Elliot J. Crowley and Andrew Zisserman. 2014. In search of art. In Computer Vision—ECCV 2014 Workshops. Lecture Notes in Computer Science, Vol. 8925. Springer, 54–70.

[34]

Elliot J. Crowley and Andrew Zisserman. 2014. The state of the art: Object retrieval in paintings using discriminative regions. In Proceedings of the 2014 British Machine Vision Conference (BMVC’14).

[35]

Elliot J. Crowley and Andrew Zisserman. 2016. The art of detection. In Computer Vision—ECCV 2016 Workshops. Lecture Notes in Computer Science, Vol. 9913. Springer, 721–737.

[36]

Antonio Daniele and Yi-Zhe Song. 2019. AI + art = human. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (AIES’19). ACM, New York, NY, 155–161.

Digital Library

[37]

Omid E. David and Nathan S. Netanyahu. 2016. DeepPainter: Painter classification using deep convolutional autoencoders. In Artificial Neural Networks and Machine Learning. Lecture Notes in Computer Science, Vol. 9887. Springer, 20–28.

[38]

Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. ImageNet: A large-scale hierarchical image database. In Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09). IEEE, Los Alamitos, CA, 248–255.

[39]

Yingying Deng, Fan Tang, Weiming Dong, Chongyang Ma, Feiyue Huang, Oliver Deussen, and Changsheng Xu. 2020. Exploring the representativity of art paintings. IEEE Transactions on Multimedia 23 (2020), 2794–2805.

[40]

Alan Dorin. 2013. Chance and complexity: Stochastic and generative processes in art and creativity. In Proceedings of the 2013 International Virtual Reality Conference. ACM, New York, NY, Article 19, 8 pages.

Digital Library

[41]

Alan Dorin, Jonathan McCabe, Jon McCormack, Gordon Monro, and Mitchell Whitelaw. 2012. A framework for understanding generative art. Digital Creativity 23, 3–4 (2012), 239–259.

[42]

Alexei A. Efros and William T. Freeman. 2001. Image quilting for texture synthesis and transfer. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’01). ACM, New York, NY, 341–346.

[43]

Athanasios Efthymiou, Stevan Rudinac, Monika Kackovic, Marcel Worring, and Nachoem Wijnberg. 2021. Graph neural networks for knowledge enhanced visual representation of paintings. arXiv preprint arXiv:2105.08190 (2021).

Digital Library

[44]

Ahmed Elgammal. 2019. AI is blurring the definition of artist: Advanced algorithms are using machine learning to create art autonomously. American Scientist 107, 1 (2019), 18–22.

[45]

Ahmed Elgammal, Bingchen Liu, Mohamed Elhoseiny, and Marian Mazzone. 2017. CAN: Creative adversarial networks, generating “art” by learning about styles and deviating from style norms. arXiv preprint arXiv:1706.07068 (2017).

[46]

Ahmed Elgammal, Bingchen Liu, Diana Kim, Mohamed Elhoseiny, and Marian Mazzone. 2018. The shape of art history in the eyes of the machine. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI’18). 2183–2191.

Digital Library

[47]

Ziv Epstein, Sydney Levine, David G. Rand, and Iyad Rahwan. 2020. Who gets credit for AI-generated art?iScience 23, 9 (2020), 101515.

[48]

Jason K. Eshraghian. 2020. Human ownership of artificial creativity. Nature Machine Intelligence 2, 3 (2020), 157–160.

[49]

Corneliu Florea, Răzvan Condorovici, Constantin Vertan, Raluca Butnaru, Laura Florea, and Ruxandra Vrânceanu. 2016. Pandora: Description of a painting database for art movement recognition with baselines and perspectives. In Proceedings of the 24th European Signal Processing Conference (EUSIPCO’16). IEEE, Los Alamitos, CA, 918–922.

[50]

Massimo Franceschet, Giovanni Colavizza, T’ai Smith, Blake Finucane, Martin Lukas Ostachowski, Sergio Scalet, Jonathan Perkins, James Morgan, and Sebástian Hernández. 2020. Crypto art: A decentralized view. Leonardo 54, 4 (2020), 1–8.

[51]

Philip Galanter. 2003. What is generative art? Complexity theory as a context for art theory. In Proceedings of the 2003 6th Generative Art Conference (GA’03).

[52]

Noa Garcia and George Vogiatzis. 2018. How to read paintings: Semantic art understanding with multi-modal retrieval. In Computer Vision—ECCV 2018 Workshops. Lecture Notes in Computer Science, Vol. 11130. Springer, 676–691.

[53]

Noa Garcia, Chentao Ye, Zihua Liu, Qingtao Hu, Mayu Otani, Chenhui Chu, Yuta Nakashima, and Teruko Mitamura. 2020. A dataset and baselines for visual question answering on art. In Computer Vision—ECCV 2020 Workshops. Lecture Notes in Computer Science, Vol. 12536. Springer, 92–108.

[54]

Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. 2016. Image style transfer using convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2414–2423.

[55]

Jessica L. Gillotte. 2019. Copyright infringement in AI-generated artworks. UC Davis Law Review 53 (2019), 2655.

[56]

Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. 2014. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’14). IEEE, Los Alamitos, CA, 580–587.

Digital Library

[57]

Nicolas Gonthier, Yann Gousseau, and Saïd Ladjal. 2020. An analysis of the transfer learning of convolutional neural networks for artistic images. In Pattern Recognition. Lecture Notes in Computer Science, Vol. 12663. Springer, 546–561.

[58]

Nicolas Gonthier, Yann Gousseau, Said Ladjal, and Olivier Bonfait. 2018. Weakly supervised object detection in artworks. In Computer Vision—ECCV 2018 Workshops. Lecture Notes in Computer Science, Vol. 11130. Springer, 692–709.

[59]

Bruce Gooch and Amy Gooch. 2001. Non-Photorealistic Rendering. CRC Press, Boca Raton, FL.

[60]

Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. Advances in Neural Information Processing Systems 27 (2014), 2672–2680.

Digital Library

[61]

Daniel J. Graham, James M. Hughes, Helmut Leder, and Daniel N. Rockmore. 2012. Statistics, vision, and the analysis of artistic style. Wiley Interdisciplinary Reviews: Computational Statistics 4, 2 (2012), 115–123.

Digital Library

[62]

Andres Guadamuz. 2017. Do Androids dream of electric copyright? Comparative analysis of originality in artificial intelligence generated works. Intellectual Property Quarterly. Open access, April 1, 2017.

[63]

Gregor U. Hayn-Leichsenring, Thomas Lehmann, and Christoph Redies. 2017. Subjective ratings of beauty and aesthetics: Correlations with statistical image properties in western oil paintings. i-Perception 8, 3 (2017), 2041669517715474.

[64]

Aaron Hertzmann. 1998. Painterly rendering with curved brush strokes of multiple sizes. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’98). ACM, New York, NY, 453–460.

Digital Library

[65]

Aaron Hertzmann. 2018. Can computers create art? In Arts, Vol. 7. Multidisciplinary Digital Publishing Institute, 18.

[66]

Aaron Hertzmann. 2020. Computers do not make art, people do. Communications of the ACM 63, 5 (2020), 45–48.

Digital Library

[67]

Aaron Hertzmann. 2020. Visual indeterminacy in GAN art. Leonardo 53, 4 (2020), 424–428.

Digital Library

[68]

Aaron Hertzmann, Charles E. Jacobs, Nuria Oliver, Brian Curless, and David H. Salesin. 2001. Image analogies. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’01). ACM, New York, NY, 327–340.

Digital Library

[69]

Joo-Wha Hong. 2018. Bias in perception of art produced by artificial intelligence. In Human-Computer Interaction. Lecture Notes in Computer Science, Vol. 10902. Springer, 290–303.

[70]

Joo-Wha Hong and Nathaniel Ming Curran. 2019. Artificial intelligence, artists, and art: Attitudes toward artwork produced by humans vs. artificial intelligence. ACM Transactions on Multimedia Computing, Communications, and Applications 15, 2s (2019), 1–16.

Digital Library

[71]

C. Robert Jacobsen and Morten Nielsen. 2013. Stylometry of paintings using hidden Markov modelling of contourlet transforms. Signal Processing 93, 3 (2013), 579–591.

Digital Library

[72]

Tomas Jenicek and Ondřej Chum. 2019. Linking art through human poses. In Proceedings of the 2019 International Conference on Document Analysis and Recognition (ICDAR’19). IEEE, Los Alamitos, CA, 1338–1345.

[73]

Yongcheng Jing, Yezhou Yang, Zunlei Feng, Jingwen Ye, Yizhou Yu, and Mingli Song. 2019. Neural style transfer: A review. IEEE Transactions on Visualization and Computer Graphics 26 (2019), 3365–3385.

[74]

Colin G. Johnson, Jon McCormack, Iria Santos, and Juan Romero. 2019. Understanding aesthetics and fitness measures in evolutionary art systems. Complexity 2019 (2019), 3495962.

Digital Library

[75]

Sergey Karayev, Matthew Trentacoste, Helen Han, Aseem Agarwala, Trevor Darrell, Aaron Hertzmann, and Holger Winnemoeller. 2014. Recognizing image style. In Proceedings of the 2014 British Machine Vision Conference (BMVC’14).

[76]

Tero Karras, Samuli Laine, and Timo Aila. 2019. A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’19). IEEE, Los Alamitos, CA, 4401–4410.

[77]

Daniel Keren. 2002. Painter identification using local features and naive Bayes. In Proceedings of the 16th International Conference on Pattern Recognition (ICPR’02). IEEE, Los Alamitos, CA, 474–477.

[78]

Abdullah Khalili and Hamid Bouchachia. 2021. An information theory approach to aesthetic assessment of visual patterns. Entropy 23, 2 (2021), 153.

[79]

Fahad Shahbaz Khan, Shida Beigpour, Joost Van de Weijer, and Michael Felsberg. 2014. Painting-91: A large scale database for computational painting categorization. Machine Vision and Applications 25, 6 (2014), 1385–1397.

Digital Library

[80]

Diana Kim, Bingchen Liu, Ahmed Elgammal, and Marian Mazzone. 2018. Finding principal semantics of style in art. In Proceedings of the 12th IEEE International Conference on Semantic Computing (ICSC’18). IEEE, Los Alamitos, CA, 156–163.

[81]

Daniel Kim, Seung-Woo Son, and Hawoong Jeong. 2014. Large-scale quantitative analysis of painting arts. Scientific Reports 4 (2014), 7370.

[82]

Diana Kim, Jason Xu, Ahmed Elgammal, and Marian Mazzone. 2019. Computational analysis of content in fine art paintings. In Proceedings of the 10th International Conference on Computational Creativity (ICCC’19). 33–40.

[83]

Harald Klinke. 2020. The digital transformation of art history. In The Routledge Companion to Digital Humanities and Art History. Routledge, 32–42.

[84]

Sabine Lang and Björn Ommer. 2018. Attesting similarity: Supporting the organization and study of art image collections with computer vision. Digital Scholarship in the Humanities 33, 4 (2018), 845–856.

[85]

Sabine Lang and Bjorn Ommer. 2018. Reflecting on how artworks are processed and analyzed by computer vision. In Computer Vision—ECCV 2018 Workshops. Lecture Notes in Computer Science, Vol. 11130. Springer, 647–652.

[86]

Adrian Lecoutre, Benjamin Négrevergne, and Florian Yger. 2017. Recognizing art style automatically in painting with deep learning. In Proceedings of the 9th Asian Conference on Machine Learning (ACML’17).327–342.

[87]

Byunghwee Lee, Min Kyung Seo, Daniel Kim, In-Seob Shin, Maximilian Schich, Hawoong Jeong, and Seung Kee Han. 2020. Dissecting landscape art history with information theory. Proceedings of the National Academy of Sciences 117, 43 (2020), 26580–26590.

[88]

Hubert Lin, Mitchell Van Zuijlen, Maarten W. A. Wijntjes, Sylvia C. Pont, and Kavita Bala. 2020. Insights from a large-scale database of material depictions in paintings. In Pattern Recognition. Lecture Notes in Computer Science, Vol. 12663. Springer, 531–545.

[89]

Maria Teresa Llano, Mark d’Inverno, Matthew Yee-King, Jon McCormack, Alon Ilsar, Alison Pease, and Simon Colton. 2020. Explainable computational creativity. In Proceedings of the 11th International Conference on Computational Creativity (ICCC’20). 334–341.

[90]

Prathmesh Madhu, Ronak Kosti, Lara Mührenberg, Peter Bell, Andreas Maier, and Vincent Christlein. 2019. Recognizing characters in art history using deep learning. In Proceedings of the 1st Workshop on Structuring and Understanding of Multimedia Heritage Contents (SUMAC@ACM Multmedia’19). ACM, New York, NY, 15–22.

Digital Library

[91]

Prathmesh Madhu, Tilman Marquart, Ronak Kosti, Peter Bell, Andreas Maier, and Vincent Christlein. 2020. Understanding compositional structures in art historical images using pose and gaze priors. In Computer Vision—ECCV 2020 Workshops. Lecture Notes in Computer Science, Vol. 12536. Springer, 109–125.

[92]

Hui Mao, Ming Cheung, and James She. 2017. DeepArt: Learning joint representations of visual arts. In Proceedings of the 2017 ACM on Multimedia Conference (MM’17). ACM, New York, NY, 1183–1191.

Digital Library

[93]

George Mather. 2018. Visual image statistics in the history of western art. Art & Perception 6, 2–3 (2018), 97–115.

[94]

Marian Mazzone and Ahmed Elgammal. 2019. Art, creativity, and the potential of artificial intelligence. In Arts, Vol. 8. Multidisciplinary Digital Publishing Institute, 26.

[95]

Jon McCormack, Oliver Bown, Alan Dorin, Jonathan McCabe, Gordon Monro, and Mitchell Whitelaw. 2014. Ten questions concerning generative computer art. Leonardo 47, 2 (2014), 135–141.

[96]

Jon McCormack, Toby Gifford, and Patrick Hutchings. 2019. Autonomy, authenticity, authorship and intention in computer generated art. In Computational Intelligence in Music, Sound, Art and Design. Lecture Notes in Computer Science, Vol. 11453. Springer, 35–50.

[97]

Joanie Lemercier Addie Wagenknecht Mat Dryhurst Memo Akten, Primavera De Filippi. 2021. A Guide to Ecofriendly CryptoArt (NFTs). Retrieved June 15, 2021 from https://github.com/memo/eco-nft.

[98]

Orfeas Menis-Mastromichalakis, Natasa Sofou, and Giorgos Stamou. 2020. Deep ensemble art style recognition. In Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN’20). IEEE, Los Alamitos, CA, 1–8.

[99]

Thomas Mensink and Jan Van Gemert. 2014. The Rijksmuseum Challenge: Museum-centered visual recognition. In International Conference on Multimedia Retrieval (ICMR’14). ACM, New York, NY, 451.

Digital Library

[100]

Alexis Mermet, Asanobu Kitamoto, Chikahiko Suzuki, and Akira Takagishi. 2020. Face detection on pre-modern Japanese artworks using R-CNN and image patching for semi-automatic annotation. In Proceedings of the 2nd Workshop on Structuring and Understanding of Multimedia Heritage Contents (SUMAC’20). ACM, New York, NY, 23–31.

Digital Library

[101]

Federico Milani and Piero Fraternali. 2020. A data set and a convolutional model for iconography classification in paintings. arXiv preprint arXiv:2010.11697 (2020).

Digital Library

[102]

Saif Mohammad and Svetlana Kiritchenko. 2018. Wikiart emotions: An annotated dataset of emotions evoked by art. In Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC’18).

[103]

Alexander Mordvintsev, Christopher Olah, and Mike Tyka. 2015. Inceptionism: Going Deeper into Neural Networks. Retrieved 15 June 2021 from http://googleresearch.blogspot.com/2015/06/inceptionism-going-deeper-into-neural.html.

[104]

Olfa Mzoughi, André Bigand, and Christophe Renaud. 2018. Face detection in painting using deep convolutional neural networks. In Advanced Concepts for Intelligent Vision Systems. Lecture Notes in Computer Science, Vol. 11182. Springer, 333–341.

[105]

Anna Notaro. 2020. State-of-the-art: AI through the (artificial) artist’s eye. In Proceedings of the 2020 Conference on Electronic Visualization and the Arts (EVA’20). 322–328.

[106]

Etienne Posthumus. 2020. Brill Iconclass AI Test Set. Retrieved 1 February 2021 from https://labs.brill.com/ictestset/.

[107]

Hanchao Qi and Shannon Hughes. 2011. A new method for visual stylometry on impressionist paintings. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’11). IEEE, Los Alamitos, CA, 2036–2039.

[108]

Alec Radford, J. W. Kim, Chris Hallacy, A. Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, J. Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning transferable visual models from natural language supervision. ArXiv abs/2103.00020 (2021).

[109]

Martin Ragot, Nicolas Martin, and Salomé Cojean. 2020. AI-generated vs. human artworks. A perception bias towards artificial intelligence? In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI’20). ACM, New York, NY, 1–10.

Digital Library

[110]

N. Rea. 2018. Has Artificial Intelligence Brought Us the Next Great Art Movement? Here Are 9 Pioneering Artists Who Are Exploring AI’s Creative Potential. Retrieved December 3, 2020 from https://news.artnet.com/market/9-artists-artificial-intelligence-1384207.

[111]

Christoph Redies and Anselm Brachmann. 2017. Statistical image properties in large subsets of traditional art, bad art, and abstract art. Frontiers in Neuroscience 11 (2017), 593.

[112]

Scott Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, and Honglak Lee. 2016. Generative adversarial text to image synthesis. In Proceedings of the 33rd International Conference on Machine Learning (ICML’16), Vol. 48. 1060–1069.

Digital Library

[113]

J. C. Risset. 1982. Stochastic processes in music and art. In Stochastic Processes in Quantum Theory and Statistical Physics. Springer, 281–288.

[114]

Matthia Sabatelli, Mike Kestemont, Walter Daelemans, and Pierre Geurts. 2018. Deep transfer learning for art classification problems. In Computer Vision—ECCV 2018 Workshops. Lecture Notes in Computer Science, Vol. 11130. Springer, 631–646.

[115]

Catherine Sandoval, Elena Pirogova, and Margaret Lech. 2019. Two-stage deep learning approach to the classification of fine-art paintings. IEEE Access 7 (2019), 41770–41781.

[116]

G. Sargentis, Panayiotis Dimitriadis, and Demetris Koutsoyiannis. 2020. Aesthetical issues of Leonardo da Vinci’s and Pablo Picasso’s paintings with stochastic evaluation. Heritage 3, 2 (2020), 283–305.

[117]

Benoit Seguin, Carlotta Striolo, and Frederic Kaplan. 2016. Visual link retrieval in a database of paintings. In Proceedings of the European Conference on Computer Vision. 753–767.

[118]

Lior Shamir, Tomasz Macura, Nikita Orlov, D. Mark Eckley, and Ilya G. Goldberg. 2010. Impressionism, expressionism, surrealism: Automated recognition of painters and schools of art. ACM Transactions on Applied Perception 7, 2 (2010), 8.

Digital Library

[119]

Lior Shamir and Jane A. Tarakhovsky. 2012. Computer analysis of art. ACM Journal on Computing and Cultural Heritage 5, 2 (2012), Article 7, 11 pages.

Digital Library

[120]

Xi Shen, Alexei A. Efros, and Mathieu Aubry. 2019. Discovering visual patterns in art collections with spatially-consistent feature learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’19). IEEE, Los Alamitos, CA, 9278–9287.

[121]

Shurong Sheng and Marie-Francine Moens. 2019. Generating captions for images of ancient artworks. In Proceedings of the 27th ACM International Conference on Multimedia (MM’19). ACM, New York, NY, 2478–2486.

Digital Library

[122]

Elena Sidorova. 2019. The cyber turn of the contemporary art market. In Arts, Vol. 8. Multidisciplinary Digital Publishing Institute, 84.

[123]

Higor Y. D. Sigaki, Matjaž Perc, and Haroldo V. Ribeiro. 2018. History of art paintings through the lens of entropy and complexity. Proceedings of the National Academy of Sciences 115, 37 (2018), E8585–E8594.

[124]

Ramya Srinivasan and Kanji Uchino. 2021. Biases in generative art: A causal look from the lens of art history. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT’21). 41–51.

Digital Library

[125]

Matteo Stefanini, Marcella Cornia, Lorenzo Baraldi, Massimiliano Corsini, and Rita Cucchiara. 2019. Artpedia: A new visual-semantic dataset with visual and contextual sentences in the artistic domain. In Image Analysis and Processing. Lecture Notes in Computer Science, Vol. 11752. Springer, 729–740.

[126]

Jan Løhmann Stephensen. 2019. Towards a philosophy of post-creative practices? Reading obvious’ “Portrait of Edmond de Belamy.”Politics of the Machine Beirut 2019 2 (2019), 21–30.

[127]

Gjorgji Strezoski and Marcel Worring. 2018. OmniArt: A large-scale artistic benchmark. ACM Transactions on Multimedia Computing, Communications, and Applications 14, 4 (2018), 1–21.

Digital Library

[128]

Paul Todorov. 2019. A game of dice: Machine learning and the question concerning art. arXiv preprint arXiv:1904.01957 (2019).

[129]

Nanne Van Noord and Eric Postma. 2017. Learning scale-variant and scale-invariant features for deep image classification. Pattern Recognition 61 (2017), 583–592.

[130]

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. arXiv preprint arXiv:1706.03762 (2017).

Digital Library

[131]

Qin Wang, Rujia Li, Qi Wang, and Shiping Chen. 2021. Non-fungible token (NFT): Overview, evaluation, opportunities and challenges. arXiv preprint arXiv:2105.07447 (2021).

[132]

Harry Wechsler and Andeep S. Toor. 2019. Modern art challenges face detection. Pattern Recognition Letters 126 (2019), 3–10.

[133]

Nicholas Westlake, Hongping Cai, and Peter Hall. 2016. Detecting people in artwork with CNNs. In Computer Vision—ECCV 2016 Workshops. Lecture Notes in Computer Science, Vol. 9931. Springer, 825–841.

[134]

Yuheng Wu, Yi Mou, Zhipeng Li, and Kun Xu. 2020. Investigating American and Chinese subjects’ explicit and implicit perceptions of AI-generated artistic work. Computers in Human Behavior 104 (2020), 106186.

[135]

Tao Xu, Pengchuan Zhang, Qiuyuan Huang, Han Zhang, Zhe Gan, Xiaolei Huang, and Xiaodong He. 2018. AttnGAN: Fine-grained text to image generation with attentional generative adversarial networks. In Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’18). IEEE, Los Alamitos, CA, 1316–1324.

[136]

Heekyung Yang and Kyungha Min. 2020. Classification of basic artistic media based on a deep convolutional approach. Visual Computer 36, 3 (2020), 559–578.

Digital Library

[137]

Shlomit Yanisky-Ravid and Luis Antonio Velez-Hernandez. 2018. Copyrightability of artworks produced by creative robots and originality: The formality-objective model. Minnesota Journal of Law, Science & Technology 19 (2018), 1.

[138]

Victoria Yanulevskaya, Jasper Uijlings, Elia Bruni, Andreza Sartori, Elisa Zamboni, Francesca Bacci, David Melcher, and Nicu Sebe. 2012. In the eye of the beholder: Employing statistical analysis and eye tracking for analyzing abstract paintings. In Proceedings of the 20th ACM Multimedia Conference (MM’12). ACM, Los Alamitos, CA, 349–358.

Digital Library

[139]

Jiajing Zhang, Yongwei Miao, and Jinhui Yu. 2021. A comprehensive survey on computational aesthetic evaluation of visual art images: Metrics and challenges. IEEE Access 9 (2021), 77164–77187.

Digital Library

[140]

Lin Zhao, Meimei Shang, Fei Gao, Rongsheng Li, Fei Huang, and Jun Yu. 2020. Representation learning of image composition for aesthetic prediction. Computer Vision and Image Understanding 199 (2020), 103024.

[141]

Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei A. Efros. 2017. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE International Conference on Computer Vision (ICCV’17). IEEE, Los Alamitos, CA, 2242–2251.

Cited By

Pente PAdams C(2024)AI in the posthuman art classroomThe Canadian Art Teacher10.7202/1113141ar19:2(20-25)Online publication date: 21-Aug-2024
https://doi.org/10.7202/1113141ar
Deng Z(2024)Proposed strategies to appreciate visual arts among local productsInternational Journal of Research Studies in Education10.5861/ijrse.2024.2475213:17Online publication date: 20-Oct-2024
https://doi.org/10.5861/ijrse.2024.24752
Kurnia Putri RAthoillah M(2024)Artificial Intelligence and Machine Learning in Digital Transformation: Exploring the Role of AI and ML in Reshaping Businesses and Information SystemsAdvances in Digital Transformation - Rise of Ultra-Smart Fully Automated Cyberspace10.5772/intechopen.1004406Online publication date: 17-Jul-2024
https://doi.org/10.5772/intechopen.1004406
Show More Cited By

Index Terms

Understanding and Creating Art with AI: Review and Outlook
1. Applied computing
  1. Arts and humanities
    1. Fine arts
  2. Computers in other domains
    1. Digital libraries and archives
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
    2. Philosophical/theoretical foundations of artificial intelligence

Recommendations

AI + Art = Human
AIES '19: Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society

Over the past few years, specialised online and offline press blossomed with articles about art made "with" Artificial Intelligence (AI) but the narrative is rapidly changing. In fact, in October 2018, the auction house Christie's sold an art piece ...
Artificial Intelligence in Art Generation: An Open Issue
Image Analysis and Processing - ICIAP 2023 Workshops
Abstract
This paper aims to give a contribution to one of the most discussed issues in recent times, in both scientific and art communities: the use of Artificial Intelligence (AI) based tools for creating artworks. As the issue is strongly ...
AI-Generated Imagery: A New Era for the `Readymade'
SA '23: SIGGRAPH Asia 2023 Art Papers

This paper examines the classification of digital images created by generative AI systems and their emergence as art. The term ‘art’ defies precise definition, but there is a growing tendency to label AI-generated images as such. The current discourse ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 18, Issue 2

May 2022

494 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/3505207

Editor:
Alberto Del Bimbo
University of Firenze, Italy

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 February 2022

Accepted: 01 July 2021

Revised: 01 June 2021

Received: 01 February 2021

Published in TOMM Volume 18, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Survey
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

175
Total Citations
View Citations
32,780
Total Downloads

Downloads (Last 12 months)13,135
Downloads (Last 6 weeks)1,849

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pente PAdams C(2024)AI in the posthuman art classroomThe Canadian Art Teacher10.7202/1113141ar19:2(20-25)Online publication date: 21-Aug-2024
https://doi.org/10.7202/1113141ar
Deng Z(2024)Proposed strategies to appreciate visual arts among local productsInternational Journal of Research Studies in Education10.5861/ijrse.2024.2475213:17Online publication date: 20-Oct-2024
https://doi.org/10.5861/ijrse.2024.24752
Kurnia Putri RAthoillah M(2024)Artificial Intelligence and Machine Learning in Digital Transformation: Exploring the Role of AI and ML in Reshaping Businesses and Information SystemsAdvances in Digital Transformation - Rise of Ultra-Smart Fully Automated Cyberspace10.5772/intechopen.1004406Online publication date: 17-Jul-2024
https://doi.org/10.5772/intechopen.1004406
Wu JDOS SANTOS L(2024)Role Transformation of Teachers in Higher Vocational Colleges under Artificial Intelligence Assisted Art Creation: A Qualitative Study of Art Design TeachersJournal of Social Science and Humanities10.53469/jssh.2024.6(09).156:9(87-93)Online publication date: 26-Sep-2024
https://doi.org/10.53469/jssh.2024.6(09).15
Navas Guzman LMeier C(2024)Experiencia en el aula basada en la (re)creación de imágenes mediante inteligencia artificialClassroom experience based on the (re)creation of images through artificial intelligenceRevista Ecos de la Academia10.53358/ecosacademia.v10i19.107610:19(e1076)Online publication date: 31-May-2024
https://doi.org/10.53358/ecosacademia.v10i19.1076
Ms. Nayana Ghuikar Mr. Tejas Moon Mr. Prasad Bhagat Mr. Sushant Chafale Mr. Gaurav Sabe (2024)VidMagic: Prompt to Image ClipsInternational Journal of Advanced Research in Science, Communication and Technology10.48175/IJARSCT-17473(426-430)Online publication date: 19-Apr-2024
https://doi.org/10.48175/IJARSCT-17473
Todorović M(2024)AI and Heritage: A Discussion on Rethinking Heritage in a Digital WorldUluslararası Kültürel ve Sosyal Araştırmalar Dergisi (UKSAD)10.46442/intjcss.1397403Online publication date: 5-Feb-2024
https://doi.org/10.46442/intjcss.1397403
Chaudhary MTiwari SGangele AGaur L(2024)From Code to ConscienceResponsible Implementations of Generative AI for Multidisciplinary Use10.4018/979-8-3693-9173-0.ch006(165-188)Online publication date: 20-Sep-2024
https://doi.org/10.4018/979-8-3693-9173-0.ch006
Yadav MKumar MSahoo ARathnasiri M(2024)AI and the Evolution of Artistic ExpressionTransforming Cinema with Artificial Intelligence10.4018/979-8-3693-3916-9.ch002(15-36)Online publication date: 27-Dec-2024
https://doi.org/10.4018/979-8-3693-3916-9.ch002
Hutson J(2024)Multimodal GAI in Arts-Based MultiliteraciesArts-Based Multiliteracies for Teaching and Learning10.4018/979-8-3693-3184-2.ch008(209-244)Online publication date: 9-Aug-2024
https://doi.org/10.4018/979-8-3693-3184-2.ch008
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents