Cited By
View all- Lee BKaye JDruin ALampe CMorris DHourcade J(2016)A Falling LineProceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2891096(3863-3866)Online publication date: 7-May-2016
MelodicBrush: a cross-modal link between ancient and digital art forms
Authors: 
Michael Xuelin Huang, Will Tang, Kenneth W.K. Lo, C.K. Lau, 
Grace Ngai, Stephen ChanAuthors Info & Claims
Pages 995 - 998
Abstract
MelodicBrush is a novel cross-modal musical system that connects two ancient art forms: Chinese ink-brush calligraphy and Chinese music. Our system endows the process of calligraphy writing with a novel auditory representation in a natural and intuitive manner to create a novel artistic experience. The writing effect is simulated as though the user were writing on an infinitely large piece of paper viewed through a viewport. The real-time musical generation effects are motivated by principles of metaphoric congruence and statistical music modeling.
Supplementary Material
References
[1]
HyperScore. http://www.hyperscore.com/
[2]
Izadi S., Kim D., Hilliges O., Molyneaux D., Newcombe R., Kohli P., Shotton J., Hodges S., Freeman D., Davison A., and Fitzgibbon A. KinectFusion: realtime 3D reconstruction and interaction using a moving depth camera. In Proc. UIST 2011, ACM Press (2011), 559--568.
[3]
Jordà, S., Geiger, G., Alonso, M. and Kaltenbrunner, M. The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In Proc. TEI 2007, ACM Press (2007), 139--146.
[4]
Jo, K. DrawSound: a drawing instrument for sound performance. In TEI 2008, ACM Press (2008), 59--62.
[5]
Kang L. and Chien H. Y. Hé: Calligraphy as a Musical Interface. In Proc. NIME 2010.
[6]
Nichols, E., Morris, D., and Basu, S. Data-driven exploration of musical chord sequences. In Proc. IUI 2009, ACM Press (2009), 227--236.
[7]
Obrenovic, Z. A flexible system for creating music while interacting with the computer. In Proc. MM 2005, ACM Press (2005), 996--1004.
[8]
Sonic wire sculptors. http://sws.cc/index.html
[9]
Simon, I., Morris, D. and Basu, S. MySong: automatic accompaniment generation for vocal melodies. In Procs. CHI 2008, ACM Press (2008), 725--734.
[10]
Vandoren, P., Claesen, L., Laerhoven, T. V., Taelman, J., Raymaekers, C., Flerackers, E., and Reeth, F. V. FluidPaint: an interactive digital painting system using real wet brushes. In Proc. ITS 2009, ACM Press (2009), 53--56.
[11]
Wilson, A. D. Using a depth camera as a touch sensor. In Proc. ITS 2010, ACM Press (2010). 69--72.
Index Terms
- MelodicBrush: a cross-modal link between ancient and digital art forms
Recommendations
Feature-oriented writing process reproduction of Chinese calligraphic artwork
SA '14: SIGGRAPH Asia 2014 Technical BriefsReproducing the writing process of ancient handwritten artworks is a popular way to appreciating and learning the expert skills of Chinese calligraphy. This paper presents a system for reappearing the writing processes of calligraphic characters in ...
MelodicBrush: a novel system for cross-modal digital art creation linking calligraphy and music
DIS '12: Proceedings of the Designing Interactive Systems ConferenceMelodicBrush is a novel system that connects two ancient art forms: Chinese ink-brush calligraphy and Chinese music. Our system uses vision-based techniques to create a digitized ink-brush calligraphic writing surface with enhanced interaction ...
Chinese Calligraphy Character Image Recognition and Its Applications in Web and Wechat Applet Platform
JCDL '20: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020Calligraphy is an important part of traditional Chinese culture. Authentic calligraphy works are usually preserved on paper, bamboo slips and stone tablets, which are easy to be destroyed and not easily appreciated by most calligraphy lovers anytime and ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
May 2012
2864 pages
ISBN:9781450310161
DOI:10.1145/2212776
- General Chair:
- Joseph A. Konstan,
- Program Chairs:
- Ed H. Chi,
- Kristina Höök
Copyright © 2012 Authors.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 May 2012
Check for updates
Author Tags
Qualifiers
- Extended-abstract
Conference
CHI '12
Sponsor:
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 300Total Downloads
- Downloads (Last 12 months)9
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Mar 2025
Other Metrics
Citations
Cited By
View all- Lee BKaye JDruin ALampe CMorris DHourcade J(2016)A Falling LineProceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2891096(3863-3866)Online publication date: 7-May-2016
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in