A Study of Material Sonification in Touchscreen Devices
Pages 305 - 310
Abstract
Even in the digital age, designers largely rely on physical material samples to illustrate their products, as existing visual representations fail to sufficiently reproduce the look and feel of real world materials. Here, we investigate the use of interactive material sonification as an additional sensory modality for communicating well-established material qualities like softness, pleasantness or value. We developed a custom application for touchscreen devices that receives tactile input and translate it into material rubbing sound using granular synthesis. We used this system to perform a psychophysical study, in which the ability of the user to rate subjective material qualities is evaluated, with the actual material samples serving as reference stimulus.
References
[1]
D. Atkinson, P. Orzechowski, B. Petreca, N. Bianchi-Berthouze, P. Watkins, S. Baurley, S. Padilla, and M. Chantler. 2013. Tactile Perceptions of Digital Textiles: A Design Research Approach. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (CHI'13). ACM, 1669--1678.
[2]
P. Brinkmann. 2012. Making Musical Apps. O'Reilly Media, Inc.
[3]
A. Citrin, D. Stem Jr., E. Spangenberg, and M. Clark. 2003. Consumer need for tactile input: An internet retailing challenge. Journal of Business Research 56, 11 (2003), 915 -- 922.
[4]
C. Ho, R. Jones, S. King, L. Murray, and C. Spence. 2013. Multisensory augmented reality in the context of a retail clothing application. In Audio Branding Academy yearbook 2012/2013. Nomos Publishers, Germany, 167--174.
[5]
R. Martín, J Iseringhausen, M. Weinmann, and M.B. Hullin. 2015. Multimodal Perception of Material Properties. In ACM Symposium on Applied Perception (SAP '15). ACM, 33--40.
[6]
A. Misra and P. Cook. 2009. Toward Synthesized Environments: A Survey of Analisis and Synthesis Methods for Sound Designers and Composers. In Proc. of the International Computer Music Conf. (ICMC). Int. Computer Music Association, 155--162.
[7]
C. Spence and M. Zampini. 2006. Auditory contributions to multisensory product perception. Acta Acustica united with Acustica 92, 6 (2006), 1009--1025.
[8]
A. Tajadura-Jiménez, B. Liu, N. Bianchi-Berthouze, and F. Bevilacqua. 2014. Using Sound in Multi-touch Interfaces to Change Materiality and Touch Behavior. In Proc. of the 8th Nordic Conf. on Human-Computer Interaction (NordiCHI '14). ACM, 199--202.
Index Terms
- A Study of Material Sonification in Touchscreen Devices
Recommendations
Evaluation of psychoacoustic sound parameters for sonification
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal InteractionSonification designers have little theory or experimental evidence to guide the design of data-to-sound mappings. Many mappings use acoustic representations of data values which do not correspond with the listener's perception of how that data value ...
Aesthetic strategies in sonification
Sound can be listened to in various ways and with different intentions. Multiple factors influence how and what we perceive when listening to sound. Sonification, the acoustic representation of data, is in essence just sound. It functions as ...
Sonification of Probabilistic Feedback through Granular Synthesis
We describe a method to improve user feedback, specifically the display of time varying probabilistic information, through asynchronous granular synthesis. We have applied these techniques to challenging control problems as well as to the sonification ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2018
499 pages
ISBN:9781450356947
DOI:10.1145/3279778
- General Chairs:
- Hideki Koike,
- Carlo Ratti,
- Yuichiro Takeuchi,
- Program Chairs:
- Kentaro Fukuchi,
- Stacey Scott,
- Diego Martinez Plasencia
Copyright © 2018 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 November 2018
Check for updates
Badges
Best Poster
Author Tags
Qualifiers
- Poster
Funding Sources
- X-Rite Chair and Graduate School for Digital Material Appearance
Conference
ISS '18
Sponsor:
ISS '18: 2018 ACM International Conference on Interactive Surfaces and Spaces
November 25 - 28, 2018
Tokyo, Japan
Acceptance Rates
ISS '18 Paper Acceptance Rate 28 of 105 submissions, 27%;
Overall Acceptance Rate 147 of 533 submissions, 28%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 155Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)1
Reflects downloads up to 13 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in