More Web Proxy on the site http://driver.im/

research-article

Mobile music touch: mobile tactile stimulation for passive learning

Authors:

Daniel Kohlsdorf,

Claas Ahlrichs,

Ruediger LeibrandtAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 791 - 800

https://doi.org/10.1145/1753326.1753443

Published: 10 April 2010 Publication History

Abstract

Mobile Music Touch (MMT) helps teach users to play piano melodies while they perform other tasks. MMT is a lightweight, wireless haptic music instruction system consisting of fingerless gloves and a mobile Bluetooth enabled computing device, such as a mobile phone. Passages to be learned are loaded into the mobile phone and are played repeatedly while the user performs other tasks. As each note of the music plays, vibrators on each finger in the gloves activate, indicating which finger is used to play each note. We present two studies on the efficacy of MMT. The first measures 16 subjects' ability to play a passage after using MMT for 30 minutes while performing a reading comprehension test. The MMT system was significantly more effective than a control condition where the passage was played repeatedly but the subjects' fingers were not vibrated. The second study compares the amount of time required for 10 subjects to replay short, randomly generated passages using passive training versus active training. Participants with no piano experience could repeat the passages after passive training while subjects with piano experience often could not.

References

[1]

R.J. Adams, D. Klowden, and B. Hannaford. Virtual training for a manual assembly task. Haptics-e, 2(2), 2001.

[2]

D. Coon. Psychology: A Modular Approach to Mind and Behavior. Thomson Wadsworth, 2005.

[3]

M.M. Dimitrijevic, N. Soroker, and F.E. Pollo. Mesh glove electrical stimulation. Science & Medicine, 3 (3), 1996.

[4]

N. Doidge. The Brain that Changes itself. Viking, New York, March 2007.

[5]

D. Feygin, M. Keehner, and F. Tendick. Haptic guidance: Experimental evaluation of a haptic training. In IEEE Haptics Symposium, pages 40--47, 2002.

Digital Library

[6]

G. Grindlay. Haptic guidance benefits musical motor learning. In HAPTICS '08: Proceedings of the 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pages 397--404, Washington, DC, USA, 2008.

Digital Library

[7]

G. Grindlay. The impact of haptic guidance on musical motor learning. Master's thesis, Massachusetts Institute of Technology, 2007.

[8]

D. Jack, R. Boian, A. Merians, S.V. Adamovich, M. Tremaine, M. Recce, G.C. Burdea, and H. Poizner. A virtual reality-based exercise program for stroke rehabilitation. In ASSETS '00: Proceedings of the fourth international ACM conference on Assistive technologies, pages 56--63, New York, NY, USA, 2000.

Digital Library

[9]

M. Jones, A. Bokinsky, T. Tretter, and A. Negishi. A comparison of learning with haptic and visual modalities. Haptics-e, 3(6), May 2005.

[10]

H.E. Krugman and E.L. Hartley. Passive learning from television. The Public Opinion Quarterly, Oxford University Press, 34(2): pp. 184--190, 1970.

[11]

C.E. Lewiston. MaGKeyS: A haptic guidance keyboard system for facilitating sensorimotor training and rehabilitation. PhD thesis, MIT, February 2009.

[12]

D. Morris, H. Tan, F. Barbagli, T. Chang, and K. Salisbury. Haptic feedback enhances force skill learning. In WHC '07: Proceedings of the Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pages 21--26, Washington, DC, USA, 2007. IEEE Computer Society.

Digital Library

[13]

J. Patton and F. Mussa-Ivaldi. Robot-assisted adaptive training: Custom force fields for teaching movement patterns. IEEE Transactions on Biomedical Engineering, 51(4):636--646, 2004.

[14]

G. Srimathveeravalli and K. Thenkurussi. Motor skill training assistance using haptic attributes. In 05: Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pages 452--457, Washington, DC, USA, 2005. IEEE Computer Society.

Digital Library

[15]

X.-D. Yang, W.F. Bischof, and P. Boulanger. Validating the performance of haptic motor skill training. In HAPTICS '08: Proceedings of the 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pages 129--135, Washington, DC, USA, 2006. IEEE Computer Society.

Digital Library

[16]

C.M. Zelazny. Therapeutic instrumental music playing in hand rehabilitation for older adults with osteoarthritis: Four case studies. Journal of Music Therapy, pages pp.97--113, 2001.

[17]

C. Zukin and R. Snyder. Passive learning: When the media environment is the message. The Public Opinion Quarterly, Oxford University Press, 48(3): pp. 629--638, 1984.

Cited By

Gemicioglu THopper EDwivedi BKulkarni RBhandarkar ARajan PEng NRamanujam ARamey CGilliland SMason CSeim CStarner T(2024)Passive Haptic Rehearsal for Augmented Piano Learning in the WildProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997488:4(1-26)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699748
Choi YJeon JLee CNoh YHong J(2024)A Way for Deaf and Hard of Hearing People to Enjoy Music by Exploring and Customizing Cross-modal Music ConceptsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642665(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642665
Tan FXu PRam ASuen WZhao SHuang YHurter C(2024)AudioXtend: Assisted Reality Visual Accompaniments for Audiobook Storytelling During Everyday Routine TasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642514(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642514
Show More Cited By

Index Terms

Mobile music touch: mobile tactile stimulation for passive learning
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Investigating Retention in Passive Haptic Learning of Piano Songs

Passive haptic learning (PHL) is a phenomenon where one is able to acquire new motor skills through repeated haptic stimuli applied to the body without paying active attention to learning. In the following work, we investigated the retention of passively ...
Learning Piano Songs with Passive Haptic Training: an Interactive Lesson
UbiComp/ISWC '22 Adjunct: Adjunct Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable Computers

Passive haptic learning (PHL) is a method for learning piano pieces through repetition of haptic stimuli while a user is focused on other daily tasks. In combination with active practice techniques, this method is a powerful tool for users to learn ...
Passive Haptic Rehearsal for Augmented Piano Learning in the Wild

Passive haptic learning (PHL) is a method for training motor skills via intensive repetition of haptic stimuli while a user is focused on other tasks. For the practical application of PHL to music education, we propose passive haptic rehearsal (PHR) ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

68
Total Citations
View Citations
1,833
Total Downloads

Downloads (Last 12 months)74
Downloads (Last 6 weeks)4

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gemicioglu THopper EDwivedi BKulkarni RBhandarkar ARajan PEng NRamanujam ARamey CGilliland SMason CSeim CStarner T(2024)Passive Haptic Rehearsal for Augmented Piano Learning in the WildProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997488:4(1-26)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699748
Choi YJeon JLee CNoh YHong J(2024)A Way for Deaf and Hard of Hearing People to Enjoy Music by Exploring and Customizing Cross-modal Music ConceptsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642665(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642665
Tan FXu PRam ASuen WZhao SHuang YHurter C(2024)AudioXtend: Assisted Reality Visual Accompaniments for Audiobook Storytelling During Everyday Routine TasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642514(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642514
Wang XXu BZhang WWang JDeng LPing JHu CLi H(2023)Recognizing emotions induced by wearable haptic vibration using noninvasive electroencephalogramFrontiers in Neuroscience10.3389/fnins.2023.121955317Online publication date: 6-Jul-2023
https://doi.org/10.3389/fnins.2023.1219553
Jiang WWang CSarsenbayeva ZIrlitti AWei JKnibbe JDingler TGoncalves JKostakos V(2023)InfoPrintProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109337:3(1-29)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610933
Janaka NGao JZhu LZhao SLyu LXu PNabokow MWang SOng Y(2023)GlassMessagingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109317:3(1-32)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610931
Fang LMüller TPescara EFischer NHuang YBeigl M(2023)Investigating Passive Haptic Learning of Piano Songs Using Three Tactile Sensations of Vibration, Stroking and TappingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108997:3(1-19)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610899
Ehtesham-Ul-Haque MBillah S(2023)Abacus GesturesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108987:3(1-30)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610898
Fang LPescara EReiter PBeigl M(2023)How Could I Learn Rhythm Better? Investigating Three Learning Signals for Passive Haptic Learning in Different ContextProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3594807(279-283)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3594807
Liu RWu ELiao CNishioka HFuruya SKoike H(2023)PianoHandSync: An Alignment-based Hand Pose Discrepancy Visualization System for Piano LearningExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585705(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585705
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents