More Web Proxy on the site http://driver.im/

course

Intelligent tools for creative graphics

Authors:

Niloy J. Mitra,

Nobuyuki Umetani,

Yuki KoyamaAuthors Info & Claims

SIGGRAPH 2020: ACM SIGGRAPH 2020 Courses

Article No.: 15, Pages 1 - 11

https://doi.org/10.1145/3388769.3407498

Published: 17 August 2020 Publication History

Abstract

In recent years, much research has been dedicated to the development of "intelligent tools" that can assist both professionals as well as novices in the process of creation. Using the computational power of the machine, and involving advanced techniques, the tools handle complex and tedious tasks that were difficult or even impossible for humans, thereby freeing the human creator of many constraints and allowing her to concentrate on the creative process, while ensuring high-quality and valid design. This course is aimed at presenting some of the key technologies used to assist interactive creative processes. The course allows researchers and practitioners to understand these techniques more deeply, and possibly inspire them to research this subject and create intelligent tools themselves. More specifically, the course will concentrate on four main enabling technologies: geometric reasoning, physical constraints, data-driven techniques and machine learning, and crowdsourcing. In each of these areas the course will survey several recent papers and works and provide examples of using these in the creation of a variety of outputs: 3D models, animations, images, videos and more.

References

[1]

Siddhartha Chaudhuri, Evangelos Kalogerakis, Stephen Giguere, and Thomas Funkhouser. Attribit: Content creation with semantic attributes. In Proc. UIST '13, pages 193--202, 2013.

Digital Library

[2]

Shu-Yu Chen, Wanchao Su, Lin Gao, Shihong Xia, and Hongbo Fu. DeepFaceDrawing: Deep generation of face images from sketches. ACM Trans. Graph., 39(4):72:1--72:16, July 2020.

Digital Library

[3]

Tao Chen, Ming-Ming Cheng, Ping Tan, Ariel Shamir, and Shi-Min Hu. Sketch2photo: Internet image montage. ACM Trans. Graph., 28(5):1--10, December 2009.

Digital Library

[4]

Tao Chen, Zhe Zhu, Shi-Min Hu, Daniel Cohen-Or, and Ariel Shamir. Extracting 3d objects from photographs using 3-sweep. Commun. ACM, 59(12):121--129, December 2016.

Digital Library

[5]

Ruta Desai, Fraser Anderson, Justin Matejka, Stelian Coros, James McCann, George Fitzmaurice, and Tovi Grossman. Geppetto: Enabling semantic design of expressive robot behaviors. In Proc. CHI '19, pages 369:1--369:14, 2019.

Digital Library

[6]

Ohad Fried, Ayush Tewari, Michael Zollhöfer, Adam Finkelstein, Eli Shechtman, Dan B Goldman, Kyle Genova, ZeyuJin, Christian Theobalt, andManeesh Agrawala. Text-based editing of talking-head video. ACM Trans. Graph., 38(4):68:1--68:14, July 2019.

Digital Library

[7]

Elena Garces, Aseem Agarwala, Diego Gutierrez, and Aaron Hertzmann. A similarity measure for illustration style. ACM Trans. Graph., 33(4):93:1--93:9, July 2014.

Digital Library

[8]

Yotam Gingold, Ariel Shamir, and Daniel Cohen-Or. Micro perceptual human computation for visual tasks. ACM Trans. Graph., 31(5):119:1--119:12, September 2012.

Digital Library

[9]

Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. In Proc. NIPS '14, pages 2672--2680, 2014. URL: http://papers.nips.cc/paper/5423-generative-adversarial-nets.pdf.

[10]

Jeff Howe. The rise of crowdsourcing. https://www.wired.com/2006/06/crowds/, 2006. Last checked: October 23, 2016.

[11]

Jeff Howe. Crowdsourcing: A definition. http://crowdsourcing.typepad.com/cs/2006/06/crowdsourcing_a.html, 2006. Last checked: October 23, 2016.

[12]

Yuki Koyama and Takeo Igarashi. Computational design with crowds. In Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, and Andrew Howes (Eds.), Computational Interaction, chapter 6, pages 153--184. Oxford University Press, 2018.

[13]

Yuki Koyama, Daisuke Sakamoto, and Takeo Igarashi. Crowd-powered parameter analysis for visual design exploration. In Proc. UIST '14, pages 65--74, 2014.

Digital Library

[14]

Yuki Koyama, Shinjiro Sueda, Emma Steinhardt, Takeo Igarashi, Ariel Shamir, and Wojciech Matusik. AutoConnect: Computational design of 3d-printable connectors. ACM Trans. Graph., 34(6):231:1--231:11, October 2015.

Digital Library

[15]

Yuki Koyama, Issei Sato, Daisuke Sakamoto, and Takeo Igarashi. Sequential line search for efficient visual design optimization by crowds. ACM Trans. Graph., 36(4):48:1--48:11, July 2017.

Digital Library

[16]

Yuki Koyama, Issei Sato, and Takeo Igarashi. Sequential gallery for interactive visual design optimization. ACM Trans. Graph., 38(4):88:1--88:12, July 2020.

Digital Library

[17]

Lasse Farnung Laursen, Yuki Koyama, Hsiang-Ting Chen, Elena Garces, Diego Gutierrez, Richard Harper, and Takeo Igarashi. Icon set selection via human computation. In Pacific Graphics Short Papers, 2016.

[18]

Tianqiang Liu, Aaron Hertzmann, Wilmot Li, and Thomas Funkhouser. Style compatibility for 3d furniture models. ACM Trans. Graph., 34(4):85:1--85:9, July 2015.

Digital Library

[19]

Zhaoliang Lun, Evangelos Kalogerakis, and Alla Sheffer. Elements of style: Learning perceptual shape style similarity. ACM Trans. Graph., 34(4):84:1--84:14, July 2015.

Digital Library

[20]

Kaichun Mo, Paul Guerrero, Li Yi, Hao Su, Peter Wonka, Niloy J. Mitra, and Leonidas J. Guibas. StructureNet: Hierarchical graph networks for 3D shape generation. ACM Trans. Graph., 38(6): 242:1--242:19, November 2019.

Digital Library

[21]

Peter O'Donovan, Jănis Lībeks, Aseem Agarwala, and Aaron Hertzmann. Exploratory font selection using crowdsourced attributes. ACM Trans. Graph., 33(4):92:1--92:9, July 2014.

Digital Library

[22]

T. Park, M. Liu, T. Wang, and J. Zhu. Semantic image synthesis with spatially-adaptive normalization. In Proc. CVPR '19, pages 2332--2341, 2019.

[23]

Alexander J. Quinn and Benjamin B. Bederson. Human computation: A survey and taxonomy of a growing field. In Proc. CHI '11, pages 1403--1412, 2011.

Digital Library

[24]

Adriana Schulz, Ariel Shamir, David I. W. Levin, Pitchaya Sitthi-amorn, and Wojciech Matusik. Design and fabrication by example. ACM Trans. Graph., 33(4):62:1--62:11, July 2014.

Digital Library

[25]

Adrian Secord, Jingwan Lu, Adam Finkelstein, Manish Singh, and Andrew Nealen. Perceptual models of viewpoint preference. ACM Trans. Graph., 30(5):109:1--109:12, October 2011.

Digital Library

[26]

Ana Serrano, Diego Gutierrez, Karol Myszkowski, Hans-Peter Seidel, and Belen Masia. An intuitive control space for material appearance. ACM Trans. Graph., 35(6), November 2016.

Digital Library

[27]

Leonid Sigal, Moshe Mahler, Spencer Diaz, Kyna McIntosh, Elizabeth Carter, Timothy Richards, and Jessica Hodgins. A perceptual control space for garment simulation. ACM Trans. Graph., 34(4), July 2015. URL: https://doi.org/10.1145/2766971.

Digital Library

[28]

Stephan Streuber, M. Alejandra Qiros-Ramirez, Matthew Q. Hill, Carina A. Hahn, Silvia Zuffi, Alice O'Toole, and Michael J. Black. Body Talk: Crowdshaping realistic 3d avatars with words. ACM Trans. Graph., 35(4):54:1--54:14, July 2016.

Digital Library

[29]

Nobuyuki Umetani, Danny M. Kaufman, Takeo Igarashi, and Eitan Grinspun. Sensitive couture for interactive garment modeling and editing. ACM Trans. Graph., 30(4):90:1--90:12, July 2011.

Digital Library

[30]

Nobuyuki Umetani, Takeo Igarashi, and Niloy J. Mitra. Guided exploration of physically valid shapes for furniture design. ACM Trans. Graph., 31(4):86:1--86:11, July 2012.

Digital Library

[31]

Nobuyuki Umetani, Yuki Koyama, Ryan Schmidt, and Takeo Igarashi. Pteromys: Interactive design and optimization of free-formed free-flight model airplanes. ACM Trans. Graph., 33(4):65:1--65:10, July 2014.

Digital Library

[32]

Nobuyuki Umetani, Athina Panotopoulou, Ryan Schmidt, and Emily Whiting. Printone: Interactive resonance simulation for free-form print-wind instrument design. ACM Trans. Graph., 35(6):184:1--184:14, November 2016.

Digital Library

[33]

Luis von Ahn. Human Computation. PhD thesis, Carnegie Mellon University, Pittsburgh, PA, USA, 2005. URL: http://reports-archive.adm.cs.cmu.edu/anon/2005/CMU-CS-05-193.pdf. CMU-CS-05-193.

Digital Library

[34]

Miao Wang, Guo-Wei Yang, Shi-Min Hu, Shing-Tung Yau, and Ariel Shamir. Write-a-video: Computational video montage from themed text. ACM Trans. Graph., 38(6):177:1--177:13, November 2019.

Digital Library

[35]

Tuanfeng Y. Wang, Duygu Ceylan, Jovan Popović, and Niloy J. Mitra. Learning a shared shape space for multimodal garment design. ACM Trans. Graph., 37(6):203:1--203:13, December 2018.

Digital Library

[36]

Mehmet Ersin Yumer, Siddhartha Chaudhuri, Jessica K. Hodgins, and Levent Burak Kara. Semantic shape editing using deformation handles. ACM Trans. Graph., 34(4):86:1--86:12, July 2015.

Digital Library

[37]

Jun-Yan Zhu, Aseem Agarwala, Alexei A. Efros, Eli Shechtman, and Jue Wang. Mirror mirror: Crowdsourcing better portraits. ACM Trans. Graph., 33(6):234:1--234:12, November 2014.

Digital Library

Cited By

Yue YKoyama YSato IIgarashi T(2021)User interfaces for high-dimensional design problemsACM SIGGRAPH 2021 Courses10.1145/3450508.3464551(1-34)Online publication date: 9-Aug-2021
https://dl.acm.org/doi/10.1145/3450508.3464551
Visschers JBudker DBougas L(2021)Rapid parameter estimation of discrete decaying signals using autoencoder networksMachine Learning: Science and Technology10.1088/2632-2153/ac1eea2:4(045024)Online publication date: 21-Sep-2021
https://doi.org/10.1088/2632-2153/ac1eea

Intelligent tools for creative graphics
1. Computing methodologies

Recommendations

Intelligent Tools: The Cornerstone of a New Civilization

The following article briefly describes the developments of tools and knowledge in human history and states that these two phenomena co‐exist only in intelligent tools. It focusses on the productive merits of the past intelligent tools and discusses the ...
Research on Intelligent Design Tools to Stimulate Creative Thinking
Cross-Cultural Design. User Experience of Products, Services, and Intelligent Environments
Abstract
With the development of artificial intelligence technology, AI has been more and more employed in the process of design, providing unlimited possibilities for future design tools. In order to promote AI technology to better assist design and meet ...
Cinder Creative Coding Cookbook

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '20: ACM SIGGRAPH 2020 Courses

August 2020

3010 pages

ISBN:9781450379724

DOI:10.1145/3388769

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 August 2020

Check for updates

Qualifiers

Course

Conference

SIGGRAPH '20

Sponsor:

SIGGRAPH

SIGGRAPH '20: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 17, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
397
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)3

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yue YKoyama YSato IIgarashi T(2021)User interfaces for high-dimensional design problemsACM SIGGRAPH 2021 Courses10.1145/3450508.3464551(1-34)Online publication date: 9-Aug-2021
https://dl.acm.org/doi/10.1145/3450508.3464551
Visschers JBudker DBougas L(2021)Rapid parameter estimation of discrete decaying signals using autoencoder networksMachine Learning: Science and Technology10.1088/2632-2153/ac1eea2:4(045024)Online publication date: 21-Sep-2021
https://doi.org/10.1088/2632-2153/ac1eea

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents