Procedurally-Generated Audio for Soft-Body Animations
Authors: 
Feng Su, Chris JoslinAuthors Info & Claims
Article No.: 16, Pages 1 - 8
Abstract
Procedurally-generated audio is an important method for the automatic synthesis of realistic sounds for computer animations and virtual environments. While synthesis techniques for rigid bodies have been well studied, few publications have tackled the challenges of synthesizing sounds for soft bodies. In this paper, we propose a data-driven synthesis approach to simultaneously generate audio based on certain given soft-body animations. Our method uses granular synthesis to extract a database of sound from real-world recordings and then retarget these grains of sounds based on the motion of any input animations. We demonstrate the effectiveness of this method on a variety of soft-body animations including a basketball bouncing, apple slicing, hand clapping and a jelly simulation.
References
[1]
Steven S. An, Doug L. James, and Steve Marschner. 2012. Motion-driven concatenative synthesis of cloth sounds. ACM Transactions on Graphics 31, 4: 1--10.
[2]
M Cardle, S Brooks, Z Bar-Joseph, and P Robinson. 2003. Sound-by-numbers: motion-driven sound synthesis. Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation: 349--356.
[3]
Jeffrey N. Chadwick, Steven S. An, and Doug L. James. 2009. Harmonic Shells: A Practical Nonlinear Sound Model for Near-Rigid Thin Shells. ACM SIGGRAPH Asia 2009 papers on - SIGGRAPH Asia '09 28, 5: 1.
[4]
Jeffrey N. Chadwick and Doug L. James. 2011. Animating fire with sound. ACM Transactions on Graphics 30, 4: 1.
[5]
Jeffrey N. Chadwick, Changxi Zheng, and Doug L. James. 2012. Precomputed acceleration noise for improved rigid-body sound. ACM Transactions on Graphics 31, 4: 1--9.
[6]
Gabriel Cirio, Dingzeyu Li, Eitan Grinsprun, Miguel A. Otaduy, and Changxi Zheng. 2016. Crumpling Sound Synthesis. ACM Transactions on Graphics 35, 6: 1--11.
[7]
Perry R. Cook. 2002. Real Sound Synthesis for Interactive Applications. A K Peters.
[8]
Yoshinori Dobashi, Tsuyoshi Yamamoto, and Tomoyuki Nishita. 2003. Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics. ACM Transactions on Graphics 22: 732.
[9]
Yoshinori Dobashi, Tsuyoshi Yamamoto, and Tomoyuki Nishita. 2004. Synthesizing sound from turbulent field using sound textures for interactive fluid simulation. Computer Graphics Forum 23, 3 SPEC. ISS.: 539--545.
[10]
K Doel. 2005. Physically Based Models for Liquid Sounds. ACM Transactions on Applied Perception 2, 4: 534--546.
[11]
K Van Den Doel and Dk Pai. 2003. Modal synthesis for vibrating objects. Audio Anectodes. AK Peter, Natick, MA: 1--8. Retrieved from http://www.cs.ubc.ca/~kvdoel/publications/modalpaper.pdf
[12]
Kees van den Doel, Paul G. Kry, and Dinesh K. Pai. 2001. FoleyAutomatic. Proceedings of the 28th annual conference on Computer graphics and interactive techniques - SIGGRAPH '01: 537--544.
[13]
Kees van den Doel and Dinesh K. Pai. 1996. Synthesis of shape dependent sounds with physical modeling. Proceedings of the International Conference on Auditory Display (ICAD). Retrieved from http://dev.icad.org/Proceedings/1996/vandenDoelPai1996.pdf
[14]
Dl James, J Barbic, and Dk Pai. 2006. Precomputed acoustic transfer: outputsensitive, accurate sound generation for geometrically complex vibration sources. ACM Transactions on Graphics (TOG) 1, 212: 9.
[15]
Dingzeyu Li, Yun Fei, and Changxi Zheng. 2015. Interactive Acoustic Transfer Approximation for Modal Sound. ACM Transactions on Graphics 35, 1: 1--16.
[16]
William Moss, Hengchin Yeh, Jeong-Mo Hong, Ming C. Lin, and Dinesh Manocha. 2010. Sounding liquids. ACM Transactions on Graphics 29, 3: 1--13.
[17]
James F. O'Brien, Perry R. Cook, and Georg Essl. 2001. Synthesizing sounds from physically based motion. Computer graphics and interactive techniques: 529--536.
[18]
James F. O'Brien, Chen Shen, and Christine M. Gatchalian. 2002. Synthesizing sounds from rigid-body simulations. Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation: 175.
[19]
C Picard, Nicolas Tsingos, and F Faure. 2009. Retargetting example sounds to interactive physics-driven animations. Audio Engineering Society Conference: 1--8. Retrieved from http://www.aes.org/elib/browse.cfm?elib=15179
[20]
N Raghuvanshi and MC Lin. 2006. Interactive sound synthesis for large scale environments. Proceedings of the 2006 symposium on Interactive 3D graphics and games 1, March: 14-17. Retrieved from http://portal.acm.org/citation.cfm?id=1111411.1111429
[21]
Zhimin Ren, Hengchin Yeh, and Ming C. Lin. 2013. Example-guided physically based modal sound synthesis. ACM Transactions on Graphics 32, 1: 1--16.
[22]
Bruno H. Repp. 1987. The sound of two hands clapping: An exploratory study. The Journal of the Acoustical Society of America 81, 4: 1100--1109.
[23]
Curtis Roads. 2004. Microsound. The MIT Press.
[24]
Camille Schreck, Damien Rohmer, Doug James, Stefanie Hahmann, and Marie-Paule Cani. 2016. Real-time sound synthesis for paper material based on geometric analysis. Eurographics/ACM SIGGRAPH Symposium on Computer Animation (2016).
[25]
Diemo Schwarz. 2000. A System for Data-Driven Concatenative Sound Synthesis. Digital Audio Effects (DAFx): 97--102.
[26]
Eston Schweickart, Doug L James, and Steve Marschner. 2017. Animating Elastic Rods with Sound. ACM Transactions on Graphics (TOG) 36, 4: 115.
[27]
Changxi Zheng and Doug L. James. 2009. Harmonic fluids. ACM Transactions on Graphics 28, 3: 1.
[28]
Changxi Zheng and Doug L. James. 2010. Rigid-body fracture sound with precomputed soundbanks. ACM Transactions on Graphics 29, 4: 1.
[29]
Changxi Zheng and Doug L. James. 2011. Toward high-quality modal contact sound. ACM Transactions on Graphics 30, 4: 1.
Index Terms
- Procedurally-Generated Audio for Soft-Body Animations
Recommendations
Toward Generating Realistic Sounds for Soft Bodies: A Review
AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in SoundGenerating realistic sounds for soft bodies is a challenging task due to the complexity of the interactions. Therefore, automatic audio generation based on procedural approach has become an attractive method for digital synthesis of soft-body sounds. In ...
Procedural Sound Generation for Soft Bodies in Video Games
MIG '19: Proceedings of the 12th ACM SIGGRAPH Conference on Motion, Interaction and GamesWe propose a real-time, data-driven method to synthesize the sound of typical soft bodies (such as cloth and rope) in video games. For a given soft body, we perform a geometric analysis of its shape at each frame. These data are used to calculate a ...
Motion-driven concatenative synthesis of cloth sounds
We present a practical data-driven method for automatically synthesizing plausible soundtracks for physics-based cloth animations running at graphics rates. Given a cloth animation, we analyze the deformations and use motion events to drive crumpling ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2018
252 pages
ISBN:9781450366090
DOI:10.1145/3243274
- Conference Chair:
- Stuart Cunningham,
- Program Chair:
- Richard Picking
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 September 2018
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
AM'18
Acceptance Rates
Overall Acceptance Rate 177 of 275 submissions, 64%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 149Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)1
Reflects downloads up to 11 Dec 2024
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in