More Web Proxy on the site http://driver.im/

short-paper

Open access

A multimodal serious-game to teach fractions in primary school

Authors:

Gualtiero VolpeAuthors Info & Claims

MIE 2017: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education

Pages 67 - 70

https://doi.org/10.1145/3139513.3139524

Published: 13 November 2017 Publication History

Abstract

Multisensory learning is considered a relevant pedagogical framework for education since a very long time and several authors support the use of a multisensory and kinesthetic approach in children learning. Moreover, results from psychophysics and developmental psychology show that children have a preferential sensory channel to learn specific concepts (spatial and/or temporal), hence a further evidence for the need of a multisensory approach. In this work, we present an example of serious game for learning a particularly complicated mathematical concept: fractions. The main novelty of our proposal comes from the role covered by the communication between sensory modalities in particular, movement, vision, and sound. The game has been developed in the context of the EU-ICT-H2020 weDRAW Project aiming at developing new multimodal technologies for multisensory serious-games on mathematical concepts for primary school children.

References

[1]

1998. The Rhythm of Mathematics. Classroom Compass - Eisenhowever Southwest Consortium for the Improvement of Mathematics and Science Teaching 4, 2 (1998).

[2]

Camurri A., Mazzarino B., and Volpe G. 2004. Expressive Interfaces. Cognition Technology and Work 6, 1 (2004), 15-22.

Digital Library

[3]

Camurri A., Mazzarino B., Ricchetti M., Timmers R., and Volpe G. 2004. Multimodal analysis of expressive gesture in music and dance performance. In Gesture-Based Communication in Human-Computer Interaction, Springer Berlin Heidelberg (Ed.). 20-39.

[4]

Camurri A., Hashimoto S., Richetti M., Ricci A., Suzuki K., Trocca R., and Volpe G. 2000. EyesWeb: Toward Gesture and Affect Recognition in Interactive Dance and Music Systems. Computer Music Journal (2000), 57-69.

Digital Library

[5]

Graziano A. B., Peterson M., and Shaw G. L. 1999. Enhanced learning of proportional math through music training and spatial-temporal training. Neurological research 21, 2 (1999), 139-152.

[6]

Dubus G. and Bresin R. 2013. A Systematic Review of Mapping Strategies for the Sonification of Physical Quantities. PLoS ONE 8, 12 (2013).

[7]

Fernald G. 1921. The effect of kinesthetic factors in development of word recognition in the case of non-readers. Journal of Educational Research 4 (1921).

[8]

Varni G. and Dubus G. et al. 2012. Interactive sonification of synchronisation of motor behaviour in social active listening to music with mobile devices. Journal on Multimodal User Interfaces 5 (2012), 157-173.

[9]

Rauscher F. H., Shaw G. L., Levine L. J., Wright E. L., Dennis W. R., and Newcomb R. L. 1997. Music training causes long-term enhancement of preschool children’s spatial-temporal reasoning. Neurological Research 19 (1997), 2-8.

[10]

Cheek J.M. and L.R. Smith. 1999. Music training and Mathematics achievement. Adolescence 34, 136 (1999), 759-761.

[11]

Barrett M. and Newell F. 2015. Task-Specific, Age Related Effects in the Cross-Modal Identification and Localisation of Objects. Multisensory research 28, 1-2 (2015), 111-151.

[12]

Forgeard M., Gottfried S., Andrea N., Camilla R., Udita I., and Ellen W. 2008. The relation between music and phonological processing in normal-reading children and children with dyslexia. Music Perception: An Interdisciplinary Journal 25, 4 (2008), 383-390.

[13]

Gori M., Del Viva M., Sandini G., and Burr D. C. 2008. Young children do not integrate visual and haptic form information. Current Biology 18, 9 (2008), 694-8.

[14]

Habib M., Lardy C., Desiles T., Commeiras C., Chobert J., and Besson Mireille. 2016. Music and Dyslexia: A New Musical Training Method to Improve Reading and Related Disorders. Frontiers in Psychology 7, 26 (2016).

[15]

MIE’17, November 13, 2017, Glasgow, UK S.Ghisio et al.

[16]

Piro J. M. and Ortiz C. 2009. The effect of piano lessons on the vocabulary and verbal sequencing skills of primary grade students. Psychology of Music 37, 3 (2009), 325-347.

[17]

Claudia S. Salcedo. 2010. The Effects Of Songs In The Foreign Language Classroom On Text Recall, Delayed Text Recall And Involuntary Mental Rehearsal. Journal of College Teaching and Learning 7, 6 (2010), 19-30.

[18]

A. Strauss and L. E. Lehtinen. 1947. Psychopathology and Education of the Brain-Injured Child. Grune and Stratton.

[19]

Orton S. T. 1928. Specific reading disability - strephosymbolia. Journal of American Medical Association 90 (1928), 1095-1099.

[20]

Abstract 1 Introduction 1.1 Background 2 Understanding Fractions Through the Body 2.1 Design and Architecture 2.2 Game Session 3 Conclusion and Future work Acknowledgments References

Cited By

Pantidos PFragkiadaki GKaliampos GRavanis K(2022)Inscriptions in Science Teaching: From Realism to AbstractionFrontiers in Education10.3389/feduc.2022.9052727Online publication date: 7-Jul-2022
https://doi.org/10.3389/feduc.2022.905272
D'Amato VOneto LCamurri AAnguita D(2021)Keep it Simple: Handcrafting Feature and Tuning Random Forests and XGBoost to face the Affective Movement Recognition Challenge 20212021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)10.1109/ACIIW52867.2021.9666428(1-7)Online publication date: 28-Sep-2021
https://doi.org/10.1109/ACIIW52867.2021.9666428
Padial-Ruz RGarcía-Molina RPuga-González E(2019)Effectiveness of a Motor Intervention Program on Motivation and Learning of English Vocabulary in Preschoolers: A Pilot StudyBehavioral Sciences10.3390/bs90800849:8(84)Online publication date: 5-Aug-2019
https://doi.org/10.3390/bs9080084
Show More Cited By

Index Terms

A multimodal serious-game to teach fractions in primary school
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. HCI design and evaluation methods
      1. Laboratory experiments

Recommendations

Exploiting multimodal integration in adaptive interactive systems and game-based learning interfaces
MOCO '18: Proceedings of the 5th International Conference on Movement and Computing

The main purpose of my work is to investigate multisensory and multimodal integration in the design and development of adaptive systems and interfaces for game-based learning applications in the areas of education and rehabilitation. To this aim, I ...
An open platform for full-body multisensory serious-games to teach geometry in primary school
MIE 2017: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education

Recent results from psychophysics and developmental psychology show that children have a preferential sensory channel to learn specific concepts. In this work, we explore the possibility of developing and evaluating novel multisensory technologies for ...
Enhancing children understanding of mathematics with multisensory technology
MOCO '18: Proceedings of the 5th International Conference on Movement and Computing

Recent results from psychophysics and developmental psychology show that children do not integrate and use the same sensory modalities in the same way, but they rather have a preferential sensory channel to learn specific concepts. In schools, however, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MIE 2017: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education

November 2017

75 pages

ISBN:9781450355575

DOI:10.1145/3139513

Copyright © 2017 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

H2020-EU.2.1.1. - INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Conference

ICMI '17

Sponsor:

SIGCHI

ICMI '17: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 13, 2017

Glasgow, UK

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
871
Total Downloads

Downloads (Last 12 months)97
Downloads (Last 6 weeks)6

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pantidos PFragkiadaki GKaliampos GRavanis K(2022)Inscriptions in Science Teaching: From Realism to AbstractionFrontiers in Education10.3389/feduc.2022.9052727Online publication date: 7-Jul-2022
https://doi.org/10.3389/feduc.2022.905272
D'Amato VOneto LCamurri AAnguita D(2021)Keep it Simple: Handcrafting Feature and Tuning Random Forests and XGBoost to face the Affective Movement Recognition Challenge 20212021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)10.1109/ACIIW52867.2021.9666428(1-7)Online publication date: 28-Sep-2021
https://doi.org/10.1109/ACIIW52867.2021.9666428
Padial-Ruz RGarcía-Molina RPuga-González E(2019)Effectiveness of a Motor Intervention Program on Motivation and Learning of English Vocabulary in Preschoolers: A Pilot StudyBehavioral Sciences10.3390/bs90800849:8(84)Online publication date: 5-Aug-2019
https://doi.org/10.3390/bs9080084
Wang SYang WLin Y(2018)Multimodal Smart TV Interface for Multisensory Learning: Scenarios and Performance Evaluation2018 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW)10.1109/ICCE-China.2018.8448662(1-2)Online publication date: May-2018
https://doi.org/10.1109/ICCE-China.2018.8448662
Niewiadomski RMancini MCera APiana SCanepa CCamurri A(2018)Does embodied training improve the recognition of mid-level expressive movement qualities sonification?Journal on Multimodal User Interfaces10.1007/s12193-018-0284-0Online publication date: 4-Dec-2018
https://doi.org/10.1007/s12193-018-0284-0

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents