Training Support Method with Loudness Changes in Music
Pages 384 - 395
Abstract
Many methods using music to support training have been proposed. Most of these methods achieve the effects of improving poses and supporting training by changing the melody according to the postural state during training. In this study, we propose a training support method using changes in sound loudness, based on the idea that elements of music and sound other than melody (tempo, pinch, and loudness) may also be applicable to training support. Specifically, by changing the loudness of each part of pop music commonly heard in daily life in conjunction with body movements, the accuracy of movements is presented as feedback in real time. In this paper, we describe a prototype that supports training by linking hand or foot movements to changes in the loudness of the singing vocals and an experiment that investigated whether the proposed method positively affects postural accuracy and the training experience using the prototype.
References
[1]
Apple: Airpods3 (2021). https://www.apple.com/jp/airpods-3rd-generation/
[2]
Clarke, C., Cavdir, D., Chiu, P., Denoue, L., Kimber, D.: Reactive Video: adaptive video playback based on user motion for supporting physical activity. In: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, pp. 196–208 (2020)
[3]
Elvitigala, D.S., Matthies, D.J., David, L., Weerasinghe, C., Nanayakkara, S.: Gymsoles: improving squats and dead-lifts by visualizing the user’s center of pressure. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–12 (2019)
[4]
Ghai S, Schmitz G, Hwang TH, and Effenberg AO Auditory proprioceptive integration: effects of real-time kinematic auditory feedback on knee proprioception Front. Neurosci. 2018 12 142
[5]
Keesing, A., Ooi, M., Wu, O., Ye, X., Shaw, L., Wünsche, B.C.: HIIT with hits: using music and gameplay to induce HIIT in exergames. In: Proceedings of the Australasian Computer Science Week Multiconference, pp. 1–10 (2019)
[6]
Khan, R.A., Jeon, M., Yoon, T.: “Musical Exercise” for people with visual impairments: a preliminary study with the blindfolded. In: International Conference on Auditory Display, 2018 (2018)
[7]
Microsoft: Azure kinect (2021). https://azure.microsoft.com/ja-jp/services/kinect-dk/
[8]
Newbold, J.W., Bianchi-Berthouze, N., Gold, N.E.: Musical expectancy in squat sonification for people who struggle with physical activity. Georgia Institute of Technology (2017)
[9]
Newbold, J.W., Bianchi-Berthouze, N., Gold, N.E., Tajadura-Jiménez, A., Williams, A.C.: Musically informed sonification for chronic pain rehabilitation: facilitating progress & avoiding over-doing. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5698–5703 (2016)
[10]
Nintendo: Fit boxinge (2018). https://fitboxing.net/
[11]
Nintendo: Ringfit adventure (2020). https://www.nintendo.co.jp/ring/index.html
[12]
Rector, K., Bennett, C.L., Kientz, J.A.: Eyes-free yoga: an exergame using depth cameras for blind & low vision exercise. In: Proceedings of the 15th International ACM Sigaccess Conference on Computers and Accessibility, pp. 1–8 (2013)
[13]
Ren X, Yu B, Lu Y, Chen Y, and Pu P Healthsit: designing posture-based interaction to promote exercise during fitness breaks Int. J. Hum.-Comput. Interact. 2019 35 10 870-885
[14]
Sousa, M., Vieira, J., Medeiros, D., Arsenio, A., Jorge, J.: Sleevear: augmented reality for rehabilitation using realtime feedback. In: Proceedings of the 21st International Conference on Intelligent User Interfaces, pp. 175–185 (2016)
[15]
Tang, R., Yang, X.D., Bateman, S., Jorge, J., Tang, A.: Physio@Home: exploring visual guidance and feedback techniques for physiotherapy exercises. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 4123–4132 (2015)
[16]
Turmo Vidal, L., Zhu, H., Riego-Delgado, A.: Bodylights: open-ended augmented feedback to support training towards a correct exercise execution. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–14 (2020)
[17]
Yin, B., Bailey, S., Hu, E., Jayarekera, M., Shaw, A., Wünsche, B.C.: Tour de tune 2-auditory-game-motor synchronisation with music tempo in an immersive virtual reality exergame. In: Proceedings of the 2021 Australasian Computer Science Week Multiconference, pp. 1–10 (2021)
[18]
Zhang, X., Huang, M.C., Ren, F., Xu, W., Guan, N., Yi, W.: Proper running posture guide: a wearable biomechanics capture system. In: Proceedings of the 8th International Conference on Body Area Networks, pp. 83–89 (2013)
Recommendations
Music/lyrics composition system considering user's image and music genre
SMC'09: Proceedings of the 2009 IEEE international conference on Systems, Man and CyberneticsThis paper proposes a music/lyrics composition system consisting of two sections, a lyric composing section and a music composing section, which considers user's image of a song and music genre. First of all, a user has an image of music/lyrics to ...
Ancient Chinese zither (guqin) music recovery with support vector machine
The Chinese zither, called guqin, has existed for over 3,000 years and always played an important role in Chinese social history. An interesting but unfortunate fact is that the traditional notation of guqin music does not provide the duration ...
Automatic Guitar Music Transcription
ACSAT '12: Proceedings of the 2012 International Conference on Advanced Computer Science Applications and TechnologiesThis paper presents a system that helps in automatically generating guitar tablatures and musical scores based on musical audio data. Information gathered from the audio consists of pitch, onsets and durations, chords, and beat and tempo. Major issues ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 29 June 2024
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 06 Jan 2025