More Web Proxy on the site http://driver.im/

Article

An intelligent virtual piano tutor

Authors:

Damon Shing-Min LiuAuthors Info & Claims

VRCIA '06: Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications

Pages 353 - 356

https://doi.org/10.1145/1128923.1128986

Published: 14 June 2006 Publication History

Abstract

Aiming to instruct the novice in good playing of musical instruments, tutors need to teach the students how to practice certain fingering for certain notes sequence, which typically is the most difficult skill for a beginner to learn. In this paper, we illustrate a virtual piano tutoring system. The system takes a MIDI event sequence as input and displays the suggested result by a 3D virtual pianist, demonstrating the automatically generated "good" fingering for the learner to imitate.Most previous fingering solving algorithms have drawbacks. First, all them solve the fingering piece by piece off-line. Second, the goodness evaluation function is hard to model. Third, no polyphonic algorithm is ever presented. This paper describes a new framework which remedies the first two drawbacks and is of potnetial to solve polyphonic sequence using a novel fingering generation mechanism SFG(Slicing Fingering Generation). Our system gets the fingering solving in real-time, and provides an ergonomics-based pose evaluation.

References

[1]

Albrecht, I., Haber, J., and Seidel, H.-P. 2003. Construction and animation of anatomically based human hand models. Eurographics/SIGGRAPH Symposium on Computer Animation (July), 98--109.

Digital Library

[2]

Buss, S. R. 2004. Introduction to inverse kinematics with jacobian transpose, pseudoinverse and damped least squares methods. Unpublished survey article.

[3]

Elkoura, G., and Singh, K. 2003. Handrix: Animating the human hand. Proceeding of the ACM SIGGRAPH/Eurogaphics Symposium on Computer Animation, 110--119.

Digital Library

[4]

Gliecher, M., Shin, H. J., Kovar, L., and Jepsen, A. 2003. Snap-together motion: Assembling run-time animations. In Symposium on Interactive 3D Graphics, 181--188.

Digital Library

[5]

Hart, M., Bosch, R., and Tsai, E. 2000. Finding optimal piano fingerings. The UMAP Journal 21, 2, 167--177.

[6]

Kim, J., Cordier, F., and Magnenat-Thalmann, N. 2000. Neural network-based violinist's hand animation. Computer Graphics International (CGI) (July), 37--41.

Digital Library

[7]

Lee, K.-H., and Kroemer, K. 1993. A finger model with constant tendon moment arms. Proc. Human Factors and Ergonomics Society 37th Annual Meeting, 710--714.

[8]

Lee, J., Chai, J., Reitsma, P., Hodgins, J. K., and Pollard, N. 2002. Interactive control of avatars animated with human motion data. ACM SIGGRAPH 2002 21, 3 (July), 491--500.

Digital Library

[9]

Parncutt, R., Sloboda, J. A., Eric F. Clarke, M. R., and Desain, P. 1997. An ergonomic model of keyboard fingering for melodic fragments. Music Perception 14, 4, 341--382.

[10]

Pollard, N., and Zordan, V. B. 2005. Physically based grasping control from example. In In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation.

Digital Library

[11]

Roads, C. 1985. Research in music and artificial intelligence. Computing Surveys 17, 2.

Digital Library

[12]

Sayegh, S. 1989. Fingering for string instruments with the optimum path paradigm. Computer Music Journal 13, 3, 76--84.

[13]

Vexo, F. 2001. Virtual Human Music Performers Simulation Based on Musical Input and Knowledge on Emotional Content and Behaviour. PhD thesis, Instituto Superior Tecnico, Portugal de Nationalite.

[14]

Viana, A. B. 2003. Technological improvements in the siedp. IX Brazilian Symposium on Computer Music (August). Held in Campinas, SP.

[15]

Yasumuro, Y., Chen, Q., and Chihara, K. 1999. Three-dimensional modeling of the human hand with motion constraints. Image and Vision Computing 17, 2, 149--156.

Cited By

Mandanici MSpagnol SLudovico LBaratè AAvanzini FMandanici MSpagnol SLudovico LBaratè AAvanzini F(2023)Learning Theories and Technology-Based Learning ApproachesDigital Music Learning Resources10.1007/978-981-99-4206-0_2(19-37)Online publication date: 27-Jul-2023
https://doi.org/10.1007/978-981-99-4206-0_2
Guan XZhao HLi Q(2022)Estimation of playable piano fingering by pitch-difference fingering match modelEURASIP Journal on Audio, Speech, and Music Processing10.1186/s13636-022-00237-82022:1Online publication date: 11-Apr-2022
https://doi.org/10.1186/s13636-022-00237-8
Shi WLi YGuan YChen XYang SMo S(2022)Optimized Fingering Planning for Automatic Piano Playing Using Dual-arm Robot System2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)10.1109/ROBIO55434.2022.10011881(933-938)Online publication date: 5-Dec-2022
https://doi.org/10.1109/ROBIO55434.2022.10011881
Show More Cited By

Index Terms

An intelligent virtual piano tutor

Recommendations

piARno - An Augmented Reality Piano Tutor
OzCHI '20: Proceedings of the 32nd Australian Conference on Human-Computer Interaction

Music is an important way for humans to express themselves, unite, relate, and gain enjoyment. While many people desire for themselves, or their loved ones, to achieve some form of musical prowess, the discipline remains encumbered by low motivation ...
P.I.A.N.O.: Faster Piano Learning with Interactive Projection
ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces

Learning to play the piano is a prolonged challenge for novices. It requires them to learn sheet music notation and its mapping to respective piano keys, together with articulation details. Smooth playing further requires correct finger postures. The ...
Piano&Dancer: Interaction Between a Dancer and an Acoustic Instrument
MOCO '17: Proceedings of the 4th International Conference on Movement Computing

Piano&Dancer is an interactive piece for a dancer and an electromechanical acoustic piano. The piece presents the dancer and the piano as two performers on stage whose bodily movements are mutually interdependent. This interdependence reveals a close ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCIA '06: Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications

June 2006

410 pages

ISBN:1595933247

DOI:10.1145/1128923

Conference Chair:
Hanqiu Sun
Hong Kong

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

VRCIA06

Sponsor:

SIGGRAPH

VRCIA06: ACM International Conference on Virtual Reality Continuum and Its Applications 2006

June 14 - April 17, 2006

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
1,160
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)5

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mandanici MSpagnol SLudovico LBaratè AAvanzini FMandanici MSpagnol SLudovico LBaratè AAvanzini F(2023)Learning Theories and Technology-Based Learning ApproachesDigital Music Learning Resources10.1007/978-981-99-4206-0_2(19-37)Online publication date: 27-Jul-2023
https://doi.org/10.1007/978-981-99-4206-0_2
Guan XZhao HLi Q(2022)Estimation of playable piano fingering by pitch-difference fingering match modelEURASIP Journal on Audio, Speech, and Music Processing10.1186/s13636-022-00237-82022:1Online publication date: 11-Apr-2022
https://doi.org/10.1186/s13636-022-00237-8
Shi WLi YGuan YChen XYang SMo S(2022)Optimized Fingering Planning for Automatic Piano Playing Using Dual-arm Robot System2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)10.1109/ROBIO55434.2022.10011881(933-938)Online publication date: 5-Dec-2022
https://doi.org/10.1109/ROBIO55434.2022.10011881
Herremans DChuan CChew E(2017)A Functional Taxonomy of Music Generation SystemsACM Computing Surveys10.1145/310824250:5(1-30)Online publication date: 26-Sep-2017
https://dl.acm.org/doi/10.1145/3108242
Xiao XIshii HKaye JDruin ALampe CMorris DHourcade J(2016)Inspect, Embody, InventProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858577(5397-5408)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858577
Liang HWang JSun QLiu YYuan JLuo JHe YWyman CYuksel C(2016)Barehanded musicProceedings of the 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games10.1145/2856400.2856411(87-94)Online publication date: 27-Feb-2016
https://dl.acm.org/doi/10.1145/2856400.2856411
Balliauw MHerremans DPalhazi Cuervo DSörensen K(2015)A variable neighborhood search algorithm to generate piano fingerings for polyphonic sheet musicInternational Transactions in Operational Research10.1111/itor.1221124:3(509-535)Online publication date: 2-Oct-2015
https://doi.org/10.1111/itor.12211
Balliauw MHerremans DCuervo DSörensen K(2015)Generating Fingerings for Polyphonic Piano Music with a Tabu Search AlgorithmMathematics and Computation in Music10.1007/978-3-319-20603-5_15(149-160)Online publication date: 16-Jun-2015
https://doi.org/10.1007/978-3-319-20603-5_15
Goodwin AGreen R(2013)Key detection for a virtual piano teacher2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013)10.1109/IVCNZ.2013.6727030(282-287)Online publication date: Nov-2013
https://doi.org/10.1109/IVCNZ.2013.6727030
Sebastien VConruyt NSebastien O(2012)Score Analyzer: Extracting performance information for instrumental e-learning2012 15th International Conference on Interactive Collaborative Learning (ICL)10.1109/ICL.2012.6402061(1-7)Online publication date: Sep-2012
https://doi.org/10.1109/ICL.2012.6402061
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents