More Web Proxy on the site http://driver.im/

research-article

2015 Multimodal Learning and Analytics Grand Challenge

Authors:

Marcelo Worsley,

Katherine Chiluiza,

Joseph F. Grafsgaard,

Xavier OchoaAuthors Info & Claims

ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Pages 525 - 529

https://doi.org/10.1145/2818346.2829995

Published: 09 November 2015 Publication History

Abstract

Multimodality is an integral part of teaching and learning. Over the past few decades researchers have been designing, creating and analyzing novel environments that enable students to experience and demonstrate learning through a variety of modalities. The recent availability of low cost multimodal sensors, advances in artificial intelligence and improved techniques for large scale data analysis have enabled researchers and practitioners to push the boundaries on multimodal learning and multimodal learning analytics. In an effort to continue these developments, the 2015 Multimodal Learning and Analytics Grand Challenge includes a combined focus on new techniques to capture multimodal learning data, as well as the development of rich, multimodal learning applications.

References

[1]

D Atkins, J Bennett, J S Brown, et al. 2010. Transforming American education: Learning powered by technology (National Educational Technology Plan 2010). Washington, DC: US Department of Education, Office of Educational Technology.

[2]

Ryan S J D Baker and Kalina Yacef. 2009. The state of educational data mining in 2009: A review and future visions. JEDM-Journal of Educational Data Mining 1, 1, 3--17.

[3]

Marie Bienkowski, Mingyu Feng, and Barbara Means. 2012. Enhancing teaching and learning through educational data mining and learning analytics: An issue brief. US Department of Education, Office of Educational Technology, 1--57.

[4]

Paulo Blikstein, Marcelo Worsley, Chris Piech, Mehran Sahami, Steve Cooper, and Daphne Koller. 2014. Programming pluralism: Using learning analytics to detect patterns in the learning of computer programming. Journal of Learning Sciences.

[5]

Paulo Blikstein and Marcelo Worsley. (in press) Multimodal Learning Analytics: a methodological framework for research in constructivist learning. Journal of Learning Analytics.

[6]

Lei Chen, Chee Wee Leong, Gary Feng, and Chong Min Lee. 2014. Using Multimodal Cues to Analyze MLA'14 Oral Presentation Quality Corpus: Presentation Delivery and Slides Quality. Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge, ACM, 45--52. http://doi.org/10.1145/2666633.2666640 527

Digital Library

[7]

Vanessa Echeverría, Allan Avendaño, Katherine Chiluiza, Aníbal Vásquez, and Xavier Ochoa. 2014. Presentation Skills Estimation Based on Video and Kinect Data Analysis. Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge, ACM, 53--60. http://doi.org/10.1145/2666633.2666641

Digital Library

[8]

JS Gorin and RJ Mislevy. 2013. Inherent Measurement Challenges in the Next Generation Science Standards for Both Formative and Summative Assessment. September. Retrieved March 17, 2014 from http://www.k12center.org/rsc/pdf/gorin-mislevy.pdf

[9]

Joseph F Grafsgaard, Joseph B Wiggins, Kristy Elizabeth Boyer, Eric N Wiebe, and James C Lester. 2014. Predicting Learning and Affect from Multimodal Data Streams in Task-Oriented Tutorial Dialogue. 7th International Conference on Educational Data Mining, 122--129.

[10]

Joseph F Grafsgaard. 2014. Multimodal Analysis and Modeling of Nonverbal Behaviors During Tutoring. Proceedings of the 16th International Conference on Multimodal Interaction, ACM, 404--408. http://doi.org/10.1145/2663204.2667611

Digital Library

[11]

Arno Hartholt, David Traum, Stacy C Marsella, et al. 2013. All together now. Intelligent Virtual Agents, 368--381.

[12]

Larry Johnson, Samantha Adams, Malcolm Cummins, Victoria Estrada, Alex Freeman, and Holly Ludgate. 2013. The NMC horizon report: 2013 higher education edition.

[13]

Linda Katehi, Greg Pearson, and Michael Feder. 2009. The status and nature of K-12 engineering education in the United States. The Bridge 39, 3, 5--10.

[14]

Gonzalo Luzardo, Bruno Guamán, Katherine Chiluiza, Jaime Castells, and Xavier Ochoa. 2014. Estimation of Presentations Skills Based on Slides and Audio Features. Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge, ACM, 37--44. http://doi.org/10.1145/2666633.2666639

Digital Library

[15]

Marwa Mahmoud, Louis-Philippe Morency, and Peter Robinson. 2013. Automatic multimodal descriptors of rhythmic body movement. Proceedings of the 15th ACM on International conference on multimodal interaction - ICMI '13, 429--436. http://doi.org/10.1145/2522848.2522895

Digital Library

[16]

Taylor Martin and Bruce Sherin. 2013. Learning analytics and computational techniques for detecting and evaluating patterns in learning: An introduction to the special issue. Journal of the Learning Sciences 22, 4, 511--520.

[17]

National Research Council. 2012. A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas. National Academies Press.

[18]

Jiquan Ngiam, Aditya Khosla, Mingyu Kim, Juhan Nam, Honglak Lee, and Andrew Y Ng. 2011. Multimodal deep learning. Proceedings of the 28th International Conference on Machine Learning (ICML-11), 689--696.

Digital Library

[19]

Xavier Ochoa, Katherine Chiluiza, Gonzalo Méndez, Gonzalo Luzardo, Bruno Guamán, and James Castells. 2013. Expertise estimation based on simple multimodal features. Proceedings of the 15th ACM on International conference on multimodal interaction - ICMI '13, 583--590. http://doi.org/10.1145/2522848.2533789

Digital Library

[20]

S Oviatt and A Cohen. 2013. Written and multimodal representations as predictors of expertise and problem-solving success in mathematics. Proceedings of the 15th ACM International Conference on Multimodal Interaction -- ICMI '13, ACM, 599--606. http://dx.doi.org/10.1145/2522848.2533793

Digital Library

[21]

Roy Pea. 2014. THE LEARNING ANALYTICS Workgroup A Report on Building the Field of Learning Analytics.

[22]

Jean Piaget. 1973. To understand is to invent: the future of education (G. Roberts, Trans.). NY: Grossman Publishers.

[23]

Stefan Scherer, Michael Glodek, Georg Layher, et al. 2012. A generic framework for the inference of user states in human computer interaction. Journal on Multimodal User Interfaces 6, 3--4, 117--141.

[24]

Stefan Scherer, Marcelo Worsley, and Louis-Philippe Morency. 2012. 1st international workshop on multimodal learning analytics. ICMI, 609--610.

Digital Library

[25]

Bertrand Schneider and Paulo Blikstein. Unraveling Students' Interaction Around a Tangible Interface using Multimodal Learning Analytics. Journal of Educational Data Mining.

[26]

Bertrand Schneider, Jenelle Wallace, Paulo Blikstein, and Roy Pea. 2013. Preparing for future learning with a tangible user interface: the case of neuroscience. Learning Technologies, IEEE Transactions on 6, 2, 117--129.

Digital Library

[27]

Daniel L Schwartz. 1992. Constructivism in an age of non-constructivist assessments.

[28]

Yale Song, Louis-Philippe Morency, and Randall Davis. 2012. Multimodal human behavior analysis: learning correlation and interaction across modalities. Proceedings of the 14th ACM international conference on Multimodal interaction, 27--30. 528

Digital Library

[29]

Robert A Sottilare, Keith W Brawner, Benjamin S Goldberg, and Heather K Holden. 2012. The generalized intelligent framework for tutoring (GIFT).

[30]

Marcelo Worsley and Paulo Blikstein. 2013. Towards the Development of Multimodal Action Based Assessment. Proceedings of the Third International Conference on Learning Analytics and Knowledge, ACM, 94--101. http://doi.org/10.1145/2460296.2460315

Digital Library

[31]

Marcelo Worsley and Paulo Blikstein. 2015. Leveraging Multimodal Learning Analytics to Differentiate Student Learning Strategies. Proceedings of the Fifth International Conference on Learning Analytics And Knowledge, ACM, 360--367. http://doi.org/10.1145/2723576.2723624

Digital Library

[32]

Marcelo Worsley. 2012. Multimodal learning analytics: enabling the future of learning through multimodal data analysis and interfaces. Proceedings of the 14th ACM international conference on Multimodal interaction, 353--356.

Digital Library

[33]

Jianlong Zhou, Kevin Hang, Sharon Oviatt, Kun Yu, and Fang Chen. 2014. Combining Empirical and Machine Learning Techniques to Predict Math Expertise Using Pen Signal Features. Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge, ACM, 29--36. http://doi.org/10.1145/2666633.2666638

Digital Library

[34]

2013. Next Generation Science Standards: For States, By States.

Cited By

Romano GSchneider JDrachsler H(2019)Dancing Salsa with Machines—Filling the Gap of Dancing Learning SolutionsSensors10.3390/s1917366119:17(3661)Online publication date: 23-Aug-2019
https://doi.org/10.3390/s19173661
Schneider JRomano GDrachsler H(2019)Beyond Reality—Extending a Presentation Trainer with an Immersive VR ModuleSensors10.3390/s1916345719:16(3457)Online publication date: 7-Aug-2019
https://doi.org/10.3390/s19163457
Spikol DPrieto LRodríguez-Triana MWorsley MOchoa XCukurova MVogel BRuffaldi ERingtved UWise AWinne PLynch GOchoa XMolenaar IDawson SHatala M(2017)Current and future multimodal learning analytics data challengesProceedings of the Seventh International Learning Analytics & Knowledge Conference10.1145/3027385.3029437(518-519)Online publication date: 13-Mar-2017
https://dl.acm.org/doi/10.1145/3027385.3029437

Index Terms

2015 Multimodal Learning and Analytics Grand Challenge
1. Applied computing
  1. Law, social and behavioral sciences
2. Human-centered computing

Recommendations

Current and future multimodal learning analytics data challenges
LAK '17: Proceedings of the Seventh International Learning Analytics & Knowledge Conference

Multimodal Learning Analytics (MMLA) captures, integrates and analyzes learning traces from different sources in order to obtain a more holistic understanding of the learning process, wherever it happens. MMLA leverages the increasingly widespread ...
Multimodal learning analytics
LAK '13: Proceedings of the Third International Conference on Learning Analytics and Knowledge

New high-frequency data collection technologies and machine learning analysis techniques could offer new insights into learning, especially in tasks in which students have ample space to generate unique, personalized artifacts, such as a computer ...
MLA '14: Proceedings of the 2014 ACM workshop on Multimodal Learning Analytics Workshop and Grand Challenge

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

November 2015

678 pages

ISBN:9781450339124

DOI:10.1145/2818346

General Chairs:
Zhengyou Zhang
Microsoft Research, USA
,
Phil Cohen
VoiceBox Technologies, USA
,
Program Chairs:
Dan Bohus
Microsoft Research, USA
,
Radu Horaud
INRIA Grenoble Rhone-Alpes, France
,
Helen Meng
Chinese University of Hong Kong, China

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI '15

Sponsor:

SIGCHI

ICMI '15: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 9 - 13, 2015

Washington, Seattle, USA

Acceptance Rates

ICMI '15 Paper Acceptance Rate 52 of 127 submissions, 41%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
281
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Romano GSchneider JDrachsler H(2019)Dancing Salsa with Machines—Filling the Gap of Dancing Learning SolutionsSensors10.3390/s1917366119:17(3661)Online publication date: 23-Aug-2019
https://doi.org/10.3390/s19173661
Schneider JRomano GDrachsler H(2019)Beyond Reality—Extending a Presentation Trainer with an Immersive VR ModuleSensors10.3390/s1916345719:16(3457)Online publication date: 7-Aug-2019
https://doi.org/10.3390/s19163457
Spikol DPrieto LRodríguez-Triana MWorsley MOchoa XCukurova MVogel BRuffaldi ERingtved UWise AWinne PLynch GOchoa XMolenaar IDawson SHatala M(2017)Current and future multimodal learning analytics data challengesProceedings of the Seventh International Learning Analytics & Knowledge Conference10.1145/3027385.3029437(518-519)Online publication date: 13-Mar-2017
https://dl.acm.org/doi/10.1145/3027385.3029437

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents