More Web Proxy on the site http://driver.im/

research-article

Takes Tutu to Ballet: Designing Visual and Verbal Feedback for Augmented Mirrors

Authors:

Milka Trajkova,

Francesco CafaroAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 2, Issue 1

Article No.: 38, Pages 1 - 30

https://doi.org/10.1145/3191770

Published: 26 March 2018 Publication History

Abstract

Mirrors have been a core feature in ballet studios for over five hundred years. While physical mirrors provide real-time feedback, they do not inform dancers of their errors. Thus, technologies such as motion tracking have been used to augment what a physical mirror can provide. Current augmented mirrors, however, only implement one mode of communication, usually visual, and do not provide a holistic feedback to dancers that includes all the feedback elements commonly used in ballet classes. We conducted a mixed-method study with 16 novices and 16 expert dancers in which we compared two different modes of communication (visual and verbal), two different types of feedback (value and corrective) and two levels of guidance (mirror, or no mirror). Participants' ballet technique scores were evaluated by a remote teacher on eight ballet combinations (tendue, adagio, pirouette, saute, plié, degage, frappe and battement tendue). We report quantitative and qualitative results that show how the level of guidance, mode of communication, and type of feedback, needs to be tuned in different ways for novices and experts.

References

[1]

Nick Allen, Alan Nevill, John Brooks, Yiannis Koutedakis, and Matthew Wyon. 2012. Ballet injuries: injury incidence and severity over 1 year. journal of orthopaedic 8 sports physical therapy 42, 9: 781-A1.

[2]

Fraser Anderson, Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2013. YouMove: enhancing movement training with an augmented reality mirror. In Proceedings of the 26th annual ACM symposium on User interface software and technology, 311--320.

Digital Library

[3]

Richard C Anderson, Ralph E Reynolds, Diane L Schallert, and Ernest T Goetz. 1977. Frameworks for comprehending discourse. American educational research journal 14, 4: 367--381.

[4]

Reuben M Baron and David A Kenny. 1986. The Moderator-Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations. 6: 1173--1182.

[5]

Ludovic Baudry, David Leroy, Ràgis Thouvarecq, and Didier Chollet. 2006. Auditory concurrent feedback benefits on the circle performed in gymnastics. Journal of Sports Sciences 24, 2: 149--156.

[6]

James H Bray and Scott E Maxwell. 1985. Multivariate analysis of variance. Sage.

[7]

Julie A. Brodie and Elm E. Lobel. 2008. More than just a mirror image: The visual system and other modes of learning and performing dance. Journal of Dance Education 8: 23--31.

[8]

John Seely Brown, Allan Collins, and Paul Duguid. 1989. Situated cognition and the culture of learning. Educational researcher 18, 1: 32--42.

[9]

Maxine D Brown and Stephen W Smoliar. 1976. A Graphics Editor for Labanotation. SIGGRAPH Comput. Graph. 10, 2: 60--65.

Digital Library

[10]

J C P Chan, H Leung, J K T Tang, and T Komura. 2011. A Virtual Reality Dance Training System Using Motion Capture Technology. IEEE Transactions on Learning Technologies 4, 2: 187--195.

Digital Library

[11]

Winyu Chinthammit, Troy Merritt, Scott Pedersen, et al. 2014. Ghostman: Augmented reality application for Telerehabilitation and remote instruction of a novel motor skill. BioMed Research International 2014.

[12]

Karen Dearborn, Kathleen Harring, Christina Young, and Emily O'Rourke. 2006. Mirror and phrase difficulty influence dancer attention and body satisfaction. Journal of Dance Education 6, 4: 116--123.

[13]

Karen Dearborn, Kathleen Harring, Christina Young, and Emily O'Rourke. 2006. Mirror and Phrase Difficulty Influence Dancer Attention and Body Satisfaction. Journal of Dance Education 6, 4: 116--123.

[14]

Karen Dearborn and Rachael Ross. 2006. Dance learning and the mirror: comparison study of dance phrase learning with and without mirrors. Journal of Dance Education 6, 4: 109--115.

[15]

E L Deci, W F Cascio, and J Krusell. 1973. Sex differences, verbal reinforcement, and intrinsic motivation. In Meeting of the Eastern Psychological Association, Washington, DC.

[16]

Edward L Deci and Richard M Ryan. 1980. Self-determination Theory: When Mind Mediates Behavior. The Journal of Mind and Behavior. 33--43.

[17]

Edward L Deci and Richard M Ryan. 1985. Cognitive evaluation theory. In Intrinsic motivation and self-determination in human behavior. Springer, 43--85.

[18]

Edward L Deci and Maarten Vansteenkiste. 2004. Self-determination theory and basic need satisfaction: Understanding human development in positive psychology. Ricerche di psicologia.

[19]

Jane Desmond. 1997. Meaning in motion: New cultural studies of dance. Duke University Press.

[20]

Daniel L Eaves, Gavin Breslin, Paul Van Schaik, Emma Robinson, and Iain R Spears. 2011. The Short-Term Effects of Real- Time Virtual Reality Feedback on Motor Learning in Dance. 20, 1: 62--77.

[21]

Hermann Ebbinghaus. 1913. Memory (HA Ruger 8 CE Bussenius, Trans.). New York: Teachers College.(Original work published 1885) 39.

[22]

J Ehara and H Saito. 2006. Texture overlay for virtual clothing based on PCA of silhouettes. In 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality 139--142.

Digital Library

[23]

Shantel Ehrenberg. 2010. Reflections on reflections: mirror use in a university dance training environment. Theatre, Dance and Performance Training 1, 2: 172--184.

[24]

P Eisert, P Fechteler, and J Rurainsky. 2008. 3-D Tracking of shoes for Virtual Mirror applications. In 2008 IEEE Conference on Computer Vision and Pattern Recognition, 1--6.

[25]

Paul Morris Fitts and Michael I Posner. 1967. Human performance.

[26]

Rory Foster. 2010. Ballet pedagogy. University press of Florida.

[27]

Elizabeth Gibbons. 2007. Teaching dance: The spectrum of styles. AuthorHouse.

[28]

Michael Goldberger, Sara Ashworth, and Mark Byra. 2012. Spectrum of teaching styles retrospective 2012. Quest 64, 4: 268--282.

[29]

Jennifer Goldstein. 2007. Easy to dance to: Solving the problems of teacher evaluation with peer assistance and review. American Journal of Education 113, 3: 479--508.

[30]

Judith A Gray. 1984. A catalog of dance teacher behaviors. Journal of Teaching in Physical Education 3, 2: 71--80.

[31]

Judith A Gray. 1989. Dance Technology. Current Applications and Future Trends. ERIC.

[32]

Jill Green. 1999. Somatic authority and the myth of the ideal body in dance education. Dance Research Journal 31, 2: 80--100.

[33]

K Hachimura, H. Kato, and H. Tamura. 2004. A prototype dance training support system with motion capture and mixed reality technologies. RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759): 217--222.

[34]

Linda H Hamilton. 1997. The person behind the mask: A guide to performing arts psychology. Greenwood Publishing Group.

[35]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52: 139--183.

[36]

Justin Howse and Moira McCormack. 2009. Anatomy, dance technique and injury prevention. A8C Black.

[37]

Jeff Blagdon. 2013. How Emoji Conquered the World. Verge. Retrieved from http://www.theverge.com/2013/3/4/3966140/how-emoji-conquered-the-world

[38]

Gayle Kassing and Lynn Mortensen. 1981. Critiquing Student Performance in Ballet. 2: 43--46.

[39]

Matthew Kyan, Guoyu Sun, Haiyan Li, et al. 2015. An Approach to Ballet Dance Training through MS Kinect and Visualization in a CAVE Virtual Reality Environment. ACM Transactions on Intelligent Systems and Technology 6, 2: 1--37.

Digital Library

[40]

Ed Lantz. 1996. The Future of Virtual Reality: Head Mounted Displays Versus Spatially Immersive Displays (Panel). In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '96), 485--486.

Digital Library

[41]

Ronald F Lunsford. 1997. When less is more: principles for responding in the disciplines. New directions for teaching and learning 1997,69: 91--104.

[42]

Richard A. Magill. 1994. The influence of augmented feedback on skill learning depends on characteristics of the skill and the learner. Quest 46, 3: 314--327.

[43]

Zoe Marquardt, João Beira, Natalia Em, Isabel Paiva, and Sebastian Kox. 2012. Super Mirror: a kinect interface for ballet dancers. In CHI'12 Extended Abstracts on Human Factors in Computing Systems, 1619--1624.

Digital Library

[44]

Richard E Mayer. 2002. Multimedia learning. Psychology of learning and motivation 41: 85--139.

[45]

Mary L McHugh. 2012. Interrater reliability: the kappa statistic. Biochemia Medica 22, 3: 276--282. Retrieved from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3900052/

[46]

Alma S Merians, David Jack, Rares Boian, et al. 2002. Virtual Reality--Augmented Rehabilitation for Patients Following Stroke. Physical therapy 82, 9.

[47]

Barbara Montero. 2006. Proprioception as an aesthetic sense. The Journal of Aesthetics and Art Criticism 64, 2: 231--242.

[48]

Muska Mosston. 1966. Teaching physical education. From command to discovery. Columbus, Ohio: Charles E.

[49]

S Mottura, L Greci, E Travaini, G Viganò, and M Sacco. 2007. MagicMirror 8 FootGlove: A New System for the Customized Shoe Try-on. In The Future of Product Development, 441--450.

[50]

Akio Nakamura, Sou Tabata, Tomoya Ueda, Shinichiro Kiyofuji, and Yoshinori Kuno. 2005. Multimodal presentation method for a dance training system. CHI 05 extended abstracts on Human factors in computing systems CHI 05: 1685.

Digital Library

[51]

Kia C Ng, Tillman Weyde, Oliver Larkin, Kerstin Neubarth, Thijs Koerselman, and Bee Ong. 2007. 3D augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support. In Proceedings of the 9th international conference on Multimodal interfaces, 339--345.

Digital Library

[52]

Wendy Oliver. 2008. Body image in the dance class. Journal of Physical Education, Recreation 8 Dance 79, 5: 18--41.

[53]

Allan Paivio. 1986. Mental representations: A dual coding approach. Oxford University Press.

[54]

Sally A Radell. 2013. Mirrors in dance class: help or hindrance. International Association for Dance Medicine and Science.

[55]

Sally A. Radell. 2012. Body Image and Mirror Use in the Ballet Class. International Association for Dance Medicine 8 Science 4, 1.

[56]

Sally A Radell, Daniel D Adame, and Stephen P Cole. 2003. Effect of teaching with mirrors on ballet dance performance. Perceptual and motor skills 91, 3: 960--964.

[57]

Sally A Radell, Daniel D Adame, and Steven P Cole. 2002. Effect of teaching with mirrors on body image and locus of control in women college ballet dancers. Perceptual and motor skills 95, 3_suppl: 1239--1247.

[58]

Sally A Radell, Daniel D Adame, and Steven P Cole. 2004. The impact of mirrors on body image and classroom performance in female college ballet dancers. Journal of Dance Medicine 8 Science 8, 2: 47--52.

[59]

Sally A Radell, Daniel D Adame, Steven P Cole, and Nicole J Blumenkehl. 2011. The impact of mirrors on body image and performance in high and low performing female ballet students. Journal of Dance Medicine 8 Science 15, 3: 108--115.

[60]

Jacques H A Van Rossum. 2004. The dance teacher: The ideal case and daily reality. Journal for the Education of the Gifted 28, 1: 36--55.

[61]

Richard A Schmidt and Craig A Wrisberg. 2008. Motor learning and performance: A situation-based learning approach. Human Kinetics.

[62]

Matthias Seuter, Lucien Opitz, Gernot Bauer, and David Hochmann. 2016. Live-Feedback from the IMUs: Animated 3D Visualization for. 904--907.

Digital Library

[63]

Roland Sigrist, Georg Rauter, Robert Riener, and Peter Wolf. 2013. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychonomic bulletin 8 review 20, 1: 21--53.

[64]

Roland Sigrist, Georg Rauter, Robert Riener, and Peter Wolf. 2013. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review. 21--53.

[65]

M. Trajkova and M. Ferati. 2015. Usability evaluation of Kinect-Based system for ballet movements.

Digital Library

[66]

Milka Trajkova and Francesco Cafaro. 2016. E-ballet: designing for remote ballet learning. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, 213--216.

Digital Library

[67]

Lucía Vera, Jesús Gimeno, Inmaculada Coma, and Marcos Fernandez. 2011. Augmented mirror: interactive augmented reality system based on kinect. In IEIP Conference on Human-Computer Interaction, 483--486.

Digital Library

[68]

Victoria Looseleaf. 2008. Something Happening Underfoot. Los Angeles Times.

[69]

Qiao Wang, Pavan Turaga, Grisha Coleman, and Todd Ingalls. 2014. Somatech: an exploratory interface for altering movement habits. In Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems, 1765--1770.

Digital Library

[70]

Edward C Warburton. 2008. Beyond steps: The need for pedagogical knowledge in dance. Journal of Dance Education 8, 1: 7--12.

[71]

Gretchen Ward Warren. 1989. Classical ballet technique. University of South Florida Press.

[72]

Kevin P Weinfurt. 1995. Multivariate analysis of variance. In L. G. Grimm 8 P. R. Yarnold (Eds.), Reading and understanding multivariate statistics (pp. 245--276). Washington, DC, US: American Psychological Association.

[73]

V Wilmerding and D Krasnow. 2009. Motor learning and teaching dance. Resource paper for International Association for Dance Science and Medicine.

[74]

Gabriele Wulf and Charles H Shea. 2002. Principles derived from the study of simple skills do not generalize to complex skill learning. Psychonomic bulletin 8 review 9, 2: 185--211.

[75]

Gabriele Wulf, Charles H Shea, and Sabine Matschiner. 1998. Frequent feedback enhances complex motor skill learning. Journal of motor behavior 30, 2: 180--192.

[76]

Gabriele Wulf, Charles Shea, and Rebecca Lewthwaite. 2010. Motor skill learning and performance: A review of influential factors. Medical Education 44, 1: 75--84.

[77]

Gabriele Wulf, Charles Shea, and Rebecca Lewthwaite. 2010. Motor skill learning and performance: a review of influential factors. Medical education 44, 1: 75--84.

[78]

Helena Wulff. 1998. Ballet across borders: Career and culture in the world of dancers. Berg Publishers, Oxford, UK.

[79]

Shuo Yan, Gangyi Ding, Zheng Guan, Ningxiao Sun, Hongsong Li, and Longfei Zhang. 2015. OutsideMe: Augmenting Dancer's External Self-image by Using A Mixed Reality System. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, 965--970.

Digital Library

Cited By

Diller FHenkel NScheuermann GWiebel A(2025)SkillAR: omnipresent in-situ feedback for motor skill training using ARVirtual Reality10.1007/s10055-025-01108-129:1Online publication date: 14-Feb-2025
https://dl.acm.org/doi/10.1007/s10055-025-01108-1
Salim FPostma DHaider FLuz SBeijnum BReidsma D(2024)Enhancing volleyball training: empowering athletes and coaches through advanced sensing and analysisFrontiers in Sports and Active Living10.3389/fspor.2024.13268076Online publication date: 16-Apr-2024
https://doi.org/10.3389/fspor.2024.1326807
Keppel JStrauss MGruenefeld USchneegass S(2024)Magic Mirror: Designing a Weight Change Visualization for Domestic UseProceedings of the ACM on Human-Computer Interaction10.1145/36981498:ISS(569-596)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698149
Show More Cited By

Index Terms

Takes Tutu to Ballet: Designing Visual and Verbal Feedback for Augmented Mirrors
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Empirical studies in ubiquitous and mobile computing

Recommendations

E-ballet: designing for remote ballet learning
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct

Since its genesis in the 16th century, ballet training has largely been unchanged: it relies on the word of mouth expertise of ballet teachers passed down generation to generation. Top-tier training is only found in few locations around the world, and ...
An Approach to Ballet Dance Training through MS Kinect and Visualization in a CAVE Virtual Reality Environment
Special Section on Visual Understanding with RGB-D Sensors

This article proposes a novel framework for the real-time capture, assessment, and visualization of ballet dance movements as performed by a student in an instructional, virtual reality (VR) setting. The acquisition of human movement data is facilitated ...
Here and Now: Creating Improvisational Dance Movements with a Mixed Reality Mirror
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

This paper explores using mixed reality (MR) mirrors for supporting improvisational dance making. Motivated by the prevalence of mirrors in dance studios and inspired by Forsythe’s Improvisation Technologies, we conducted workshops with 13 dancers and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 2, Issue 1

March 2018

1370 pages

EISSN:2474-9567

DOI:10.1145/3200905

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2018

Accepted: 01 January 2018

Revised: 01 November 2017

Received: 01 May 2017

Published in IMWUT Volume 2, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
670
Total Downloads

Downloads (Last 12 months)94
Downloads (Last 6 weeks)15

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Diller FHenkel NScheuermann GWiebel A(2025)SkillAR: omnipresent in-situ feedback for motor skill training using ARVirtual Reality10.1007/s10055-025-01108-129:1Online publication date: 14-Feb-2025
https://dl.acm.org/doi/10.1007/s10055-025-01108-1
Salim FPostma DHaider FLuz SBeijnum BReidsma D(2024)Enhancing volleyball training: empowering athletes and coaches through advanced sensing and analysisFrontiers in Sports and Active Living10.3389/fspor.2024.13268076Online publication date: 16-Apr-2024
https://doi.org/10.3389/fspor.2024.1326807
Keppel JStrauss MGruenefeld USchneegass S(2024)Magic Mirror: Designing a Weight Change Visualization for Domestic UseProceedings of the ACM on Human-Computer Interaction10.1145/36981498:ISS(569-596)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698149
Mizukami HNiijima APark COgawa T(2024)Exploring the Impact of Size and Position on Visual Feedback Efficacy for Ballet DancersCompanion Proceedings of the 2024 Conference on Interactive Surfaces and Spaces10.1145/3696762.3698052(54-57)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3696762.3698052
Xia CMin TSugiura Y(2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676489
Lee SHwang SOakley ILee K(2024)Expanding the Design Space of Vision-based Interactive Systems for Group Dance PracticeProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661568(2768-2787)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661568
Zhang CCocking CTrajkova MMock ZTate GMonden CMagerko B(2024)Fostering AI Literacy with LuminAI through Embodiment and Creativity in Informal Learning SpacesProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3664255(476-481)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3664255
Zhou QSyiem BLi BGoncalves JVelloso E(2024)Reflected RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314317:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631431
Turmo Vidal LTajadura-Jiménez AVega-Cebrián JLey-Flores JDíaz-Durán JMárquez Segura ECiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Body Transformation: An Experiential Quality of Sensory Feedback Wearables for Altering Body PerceptionProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633373(1-19)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633373
Trajkova MLong DDeshpande MKnowlton AMagerko B(2024)Exploring Collaborative Movement Improvisation Towards the Design of LuminAI—a Co-Creative AI Dance PartnerProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642677(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642677
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents