research-article

Enhanced motion interaction for multimedia applications

Authors:

Dennis Majoe,

Lars Widmer,

Juerg GutknechtAuthors Info & Claims

MoMM '09: Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia

Pages 13 - 19

https://doi.org/10.1145/1821748.1821760

Published: 14 December 2009 Publication History

Get Access

Abstract

In this paper, we consider how low cost wearable sensors may be used to enhance mobile interactions with learning and games multimedia. Unlike camera and single accelerometer based systems, the sensors developed provide measurements for all of the user's limb movements and this data can then be used to recognize what the user is doing anytime anywhere. The movements may then drive a game or may be used in an educative or artistic experience. The aim here is to report on work done using the Hidden Markov Model method for gesture recognition applied as a component within an exemplary Tai Chi training system. The intention is to demonstrate a practical result which could form the basis for other researchers involved in future mobile applications such as dance training, martial arts and sports. We also look at an extension of this work in the field of interactive dance multimedia.

References

[1]

http://en.wikipedia.org/wiki/Wii_MotionPlus/.

Google Scholar

[2]

http://en.wikipedia.org/wiki/Project_Natal/.

Google Scholar

[3]

K. Kunze, M. Barry, E. Heinz, P. Lukowicz, D. Majoe, J. Gutknecht, "Towards Recognizing Tai Chi - An Initial Experiment UsingWearable Sensors", 3rd International Forum on Applied Wearable Computing, Mobile Research Center, Universität Bremen, Bremen, Germany, 2006.

Google Scholar

[4]

D. Majoe, I. Kulka, and J. Gutknecht, "Qi energy flow visualisation using wearable computing," Pervasive Computing and Applications, 2007. ICPCA 2007. 2nd International Conference on, pp. 285--290, 26--27 July 2007.

Google Scholar

[5]

D. Majoe, M. Estermann, N. Ranieri, J. Gutknecht, "Ergonomic Low Cost Motion Capture for every day health exercise" Pervasive Computing and Applications, 2008. ICPCA 2008. Third International Conference Volume: 2, On page(s): 627-6326-8 Oct. 2008.

Google Scholar

[6]

Wikipedia, "Forward kinematic animation", http://en.wikipedia.org/wiki/Forward_kinematic_animation

Google Scholar

[7]

Kanav Kahol, Priyamvada Tripathi, Sethuraman Panchanathan, "Computational Analysis of Mannerism Gestures." Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Pages: 946--949, 2004.

Digital Library

Google Scholar

[8]

L. R. Rabiner. "A tutorial on HMM and selected applications in speech recognition". In Proc. IEEE, Vol. 77, No. 2, pp. 257--286, Feb. 1989.

Crossref

Google Scholar

[9]

AF Bobick, AD. Wilson, "A state based technique for the summarization and recognition of gesture.", Proceedings 5th international conference on Computer Vision 1995.

Digital Library

Google Scholar

[10]

M. Brand, N. Oliver, A. Pentland, "Coupled hidden Markov models for complex action recognition." Proceedings IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1997.

Digital Library

Google Scholar

[11]

HongLi Zhu, Peng Ying Du, Jian Xiang. "3D Motion Recognition based on Ensemble Learning", Proceedings of the Eighth International Workshop on Image Analysis for Multimedia Interactive Services, 2007.

Digital Library

Google Scholar

Cited By

View all

Zhao HRu XDu PLiu SLiu NWang XWu Z(2024)Achieving view-distance and -angle invariance in motion prediction using a simple networkVisual Computing for Industry, Biomedicine, and Art10.1186/s42492-024-00176-57:1Online publication date: 28-Oct-2024
https://doi.org/10.1186/s42492-024-00176-5
Zou QYuan SDu SWang YLiu CXu YChen JJi X(2024)ParCo: Part-Coordinating Text-to-Motion SynthesisComputer Vision – ECCV 202410.1007/978-3-031-72992-8_8(126-143)Online publication date: 30-Oct-2024
https://doi.org/10.1007/978-3-031-72992-8_8
Zhang SLiu SGao F(2023)3D Human Motion Prediction via Activity-Driven Attention-MLP Association2023 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP49359.2023.10222273(960-964)Online publication date: 8-Oct-2023
https://doi.org/10.1109/ICIP49359.2023.10222273
Show More Cited By

Recommendations

Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch
HotMobile '15: Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications

Smartwatch is becoming one of the most popular wearable device with many major smartphone manufacturers such as Samsung and Apple releasing their smartwatches recently. Apart from the fitness applications, the smartwatch provides a rich user interface ...
Gesture interaction for small handheld devices to support multimedia applications

Accelerometer-based gesture control is proposed as a complementary interaction modality for small handheld devices to enable a variety of multimedia applications. The motivation for experimenting with gesture interaction is justified by the personal and ...
FingOrbits: interaction with wearables using synchronized thumb movements
ISWC '17: Proceedings of the 2017 ACM International Symposium on Wearable Computers

We present FingOrbits, a wearable interaction technique using synchronized thumb movements. A thumb-mounted ring with an inertial measurement unit and a contact microphone are used to capture thumb movements when rubbing against the other fingers. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MoMM '09: Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia

December 2009

663 pages

ISBN:9781605586595

DOI:10.1145/1821748

General Chair:
Gabriele Kotsis
Johannes Kepler University Linz, Austria
,
Program Chairs:
David Taniar
Monash University, Australia
,
Eric Pardede
La Trobe University, Australia

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MoMM '09

Sponsor:

MoMM '09: 7th International Conference on Mobile Computing and Multimedia

December 14 - 16, 2009

Kuala Lumpur, Malaysia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
211
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhao HRu XDu PLiu SLiu NWang XWu Z(2024)Achieving view-distance and -angle invariance in motion prediction using a simple networkVisual Computing for Industry, Biomedicine, and Art10.1186/s42492-024-00176-57:1Online publication date: 28-Oct-2024
https://doi.org/10.1186/s42492-024-00176-5
Zou QYuan SDu SWang YLiu CXu YChen JJi X(2024)ParCo: Part-Coordinating Text-to-Motion SynthesisComputer Vision – ECCV 202410.1007/978-3-031-72992-8_8(126-143)Online publication date: 30-Oct-2024
https://doi.org/10.1007/978-3-031-72992-8_8
Zhang SLiu SGao F(2023)3D Human Motion Prediction via Activity-Driven Attention-MLP Association2023 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP49359.2023.10222273(960-964)Online publication date: 8-Oct-2023
https://doi.org/10.1109/ICIP49359.2023.10222273
Zhang SLiu SGao FChen S(2022)Augmented Graph Attention with Temporal Gradation and Reorganization for Human Motion PredictionIntelligent Robotics and Applications10.1007/978-3-031-13841-6_28(294-306)Online publication date: 10-Aug-2022
https://doi.org/10.1007/978-3-031-13841-6_28
Ovalle JStawarz KMarzo A(2019)Exploring the Addition of Audio Input to Wearable Punch RecognitionProceedings of the XX International Conference on Human Computer Interaction10.1145/3335595.3335641(1-4)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3335595.3335641
Wan Idris WRafi ABidin AJamal AFadzli S(2019)A systematic survey of martial art using motion capture technologiesMultimedia Tools and Applications10.1007/s11042-018-6624-y78:8(10113-10140)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1007/s11042-018-6624-y
Kano STakashima RAsakura YShiraishi RMistry PMaes PSeigneur JNanayakkara SParadiso J(2017)5th limbProceedings of the 8th Augmented Human International Conference10.1145/3041164.3041208(1-2)Online publication date: 16-Mar-2017
https://dl.acm.org/doi/10.1145/3041164.3041208
Noor NHashim WWan Adnan WSaman F(2014)Mapping Graceful Interaction Design from Dance PerformanceHuman-Computer Interaction. Applications and Services10.1007/978-3-319-07227-2_29(301-311)Online publication date: 2014
https://doi.org/10.1007/978-3-319-07227-2_29
de Morais WWickstrom N(2011)A serious computer game to assist Tai Chi training for the elderlyProceedings of the 2011 IEEE 1st International Conference on Serious Games and Applications for Health10.1109/SeGAH.2011.6165450(1-8)Online publication date: 16-Nov-2011
https://dl.acm.org/doi/10.1109/SeGAH.2011.6165450

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch

Gesture interaction for small handheld devices to support multimedia applications

FingOrbits: interaction with wearables using synchronized thumb movements