More Web Proxy on the site http://driver.im/

research-article

The Machine Learning Machine: A Tangible User Interface for Teaching Machine Learning

Authors:

Magnus Høholt Kaspersen,

Karl-Emil Kjær Bilstrup,

Marianne Graves PetersenAuthors Info & Claims

TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction

Article No.: 19, Pages 1 - 12

https://doi.org/10.1145/3430524.3440638

Published: 14 February 2021 Publication History

Abstract

Machine Learning (ML) is often used invisibly in everyday applications with little opportunity for consumers to investigate how it works. In this paper, we expand recent efforts to unfold what students should know about ML and how to design tools and activities allowing them to engage with ML. To do so, we explore how to make processes and aspects of ML tangible through the design of the Machine Learning Machine (MLM); a tangible user interface which enables students to create their own data-sets using pen and paper and to iteratively build and test ML models using this data. Based on insights from the design process and a preliminary pilot study with the MLM, we discuss how a tangible approach to engaging with ML can spur curiosity in students and how the iterative process of improving ML models can encourage students to reflect on the relation between data, model and predictions.

References

[1]

Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, New York, New York, USA, 1–18. https://doi.org/10.1145/3173574.3174156

Digital Library

[2]

Anne Louise Bang, Peter Gall Krogh, Martin Ludvigsen, and Thomas Markussen. 2012. The Role of Hypothesis in Constructive Design Research. In The Art of Research 2012: Making, Reflecting and understanding. Helsinki, 1–11.

[3]

Karl-Emil Kjær Bilstrup, Magnus H. Kaspersen, and Marianne Graves Petersen. 2020. Staging Reflections on Ethical Dilemmas in Machine Learning : A Card-Based Design Workshop for High School Students. In DIS ’20: Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, United States, Eindhoven, Netherlands, 1211–1222. https://doi.org/10.1145/3357236.3395558

Digital Library

[4]

Thomas Binder and Johan Redström. 2006. Exemplary Design Research. In Design Research Society Wonderground International Conference 2006.

[5]

Susanne Bødker and Morten Kyng. 2018. Participatory Design that Matters—Facing the Big Issues. ACM Transactions on Computer-Human Interaction 25, 1 (2 2018), 1–31. https://doi.org/10.1145/3152421

Digital Library

[6]

Xiaozhou Deng, Danli Wang, Qiao Jin, and Fang Sun. 2019. ARCat: A tangible programming tool for DFS algorithm teaching. In Proceedings of the 18th ACM International Conference on Interaction Design and Children, IDC 2019, Vol. 19. Association for Computing Machinery, Inc, New York, New York, USA, 533–537. https://doi.org/10.1145/3311927.3325308

Digital Library

[7]

Christian Dindler, Rachel Smith, and Ole Sejer Iversen. 2020. Computational empowerment: participatory design in education. CoDesign 16, 1 (1 2020), 66–80. https://doi.org/10.1080/15710882.2020.1722173

[8]

Stefania Druga. 2018. Growing up with AI - Cognimates: from coding to teaching machines., 204 pages. http://hdl.handle.net/1721.1/120691

[9]

Eva Eriksson, Ole Sejer Iversen, Gökçe Elif Baykal, Maarten Van Mechelen, Rachel Smith, Marie-louise Wagner, Bjarke Vognstrup Fog, Clemens Klokmose, Bronwyn Cumbo, Arthur Hjorth, Line Have Musaeus, Marianne Graves Petersen, and Niels Olof Bouvin. 2019. Widening the scope of FabLearn Research : Integrating Computational Thinking, Design and Making. In FabLearn Europe ’19. https://doi.org/10.1145/3335055.3335070

Digital Library

[10]

Jerry Alan Fails, Allison Druin, Mona Leigh Guha, Gene Chipman, Sante Simms, and Wayne Churaman. 2005. Child’s Play: A Comparison of Desktop and Physical Interactive Environments. Technical Report.

[11]

Gerald Futschek and Julia Moschitz. 2011. Learning algorithmic thinking with tangible objects eases transition to computer programming. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 7013 LNCS. Springer, Berlin, Heidelberg, 155–164. https://doi.org/10.1007/978-3-642-24722-4_14

Digital Library

[12]

Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark patterns in proxemic interactions: A critical perspective. Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, DIS(2014), 523–532. https://doi.org/10.1145/2598510.2598541

Digital Library

[13]

Lars Hallnäs and Johan Redström. 2001. Slow technology - Designing for reflection. Personal and Ubiquitous Computing 5, 3 (2001), 201–212. https://doi.org/10.1007/PL00000019

Digital Library

[14]

Martin Heidegger. 1996. Being and time. State University of New York Press.

[15]

Tom Hitron, Yoav Orlev, Iddo Wald, Ariel Shamir, Hadas Erel, and Oren Zuckerman. 2019. Can children understand machine learning concepts? The effect of uncovering black boxes. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, New York, New York, USA. https://doi.org/10.1145/3290605.3300645

Digital Library

[16]

Michael S. Horn, Erin T. Solovey, R. Jordan Crouser, and Robert J.K. Jacob. 2009. Comparing the use of tangible and graphical programming languages for informal science education. In Conference on Human Factors in Computing Systems - Proceedings. ACM Press, New York, New York, USA, 975–984. https://doi.org/10.1145/1518701.1518851

Digital Library

[17]

Felix Hu, Ariel Zekelman, Michael Horn, and Frances Judd. 2015. Strawbies: Explorations in tangible programming. In Proceedings of IDC 2015: The 14th International Conference on Interaction Design and Children. Association for Computing Machinery, Inc, New York, New York, USA, 410–413. https://doi.org/10.1145/2771839.2771866

Digital Library

[18]

Ole Sejer Iversen, Rachel Charlotte Smith, and Christian Dindler. 2018. From computational thinking to computational empowerment. In PDC ’18 Proceedings of the 15th Participatory Design Conference: Full Papers - Volume 1. ACM Press, Hasselt and Genk, Belgium, 1–11. https://doi.org/10.1145/3210586.3210592

Digital Library

[19]

Yasmin Kafai, Chris Proctor, and Debora Lui. 2019. From theory bias to theory dialogue: Embracing cognitive, situated, and critical framings of computational thinking in K-12 Cs education. In ICER 2019 - Proceedings of the 2019 ACM Conference on International Computing Education Research. 101–109. https://doi.org/10.1145/3291279.3339400

Digital Library

[20]

Ken Kahn and Niall Winters. 2018. AI Programming by Children. In Proceedings of the Constructionism 2018 Conference, Valentina Dagienèand Eglè Jasutè (Eds.). Vilnius, Lithuania, 315–324.

[21]

Irni Eliana Khairuddin, Corina Sas, and Chris Speed. 2019. BlocKit: A physical kit for materializing and designing for blockchain infrastructure. In DIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference. Association for Computing Machinery, Inc, New York, NY, USA, 1449–1462. https://doi.org/10.1145/3322276.3322370

Digital Library

[22]

Ilpo Koskinen and Peter Gall Krogh. 2015. Design Accountability: When Design Research Entangles Theory and Practice. http://www.ijdesign.org/index.php/IJDesign/article/view/1799

[23]

Ilpo Koskinen, John Zimmerman, Thomas Binder, Johan Redstrom, and Stephan Wensveen. 2011. Design Research Through Practice: From the Lab, Field, and Showroom. Elsevier.

Digital Library

[24]

Peter Gall Krogh and Ilpo Koskinen. 2020. Drifting by Intention: Four Epistemic Traditions from within Constructive Design Research (1ed.). Springer International Publishing. 162 pages.

[25]

Paul Marshall. 2007. Do tangible interfaces enhance learning?. In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction. https://doi.org/10.1145/1226969.1227004

Digital Library

[26]

Paul Marshall, Sara Price, and Yvonne Rogers. 2003. Conceptualising tangibles to support learning. In Proceedings of the 2003 Conference on Interaction Design and Children, IDC 2003. Association for Computing Machinery, Inc, New York, New York, USA, 101–109. https://doi.org/10.1145/953536.953551

Digital Library

[27]

Anna Mavroudi, Monica Divitini, Francesco Gianni, Simone Mora, and Dag R. Kvittem. 2018. Designing IoT applications in lower secondary schools. IEEE Global Engineering Education Conference, EDUCON 2018-April (2018), 1120–1126. https://doi.org/10.1109/EDUCON.2018.8363355

[28]

Keith O’Hara, Douglas Blank, and James Marshall. 2015. Computational Notebooks for AI Education. The Twenty-Eighth International Flairs Conference (4 2015). http://doi.org/10.13140/2.1.2434.5928

[29]

Cathy O’Neil. 2017. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Vol. 52. Penguin Books.

[30]

Seymour Papert. 1980. Mindstorms : children, computers, and powerful ideas. Basic Books. 230 pages. https://dl.acm.org/citation.cfm?id=1095592

Digital Library

[31]

Seymour Papert and Idit Harel. 1991. Situating Constructionism. Constructionism 36, 2 (1991), 1–11.

[32]

Frank Pasquale. 2015. The Black Box Society: The Secret Algorithms That Control Money and Information. Harvard University Press. http://www.jstor.org/stable/j.ctt13x0hch

[33]

Fernando Perez and Brian E. Granger. 2015. Project Jupyter: Computational Narratives as the Engine of Collaborative Data Science. Technical Report. UC Berkeley & Cal Poly.

[34]

Jean Piaget. 1976. Piaget’s theory. In Piaget and His school - A Reader in Developmental Psychology, B. Inhelder, H.H. Chipman, and C. Zwingmann (Eds.). Springer, New York, New York, USA, 11–23.

[35]

Alexander Scheidt and Tim Pulver. 2019. Any-cubes: A children’s toy for learning AI. In ACM International Conference Proceeding Series. Association for Computing Machinery, New York, New York, USA, 893–895. https://doi.org/10.1145/3340764.3345375

Digital Library

[36]

Shourya Pratap Singh, Ankit Kumar Panda, Susobhit Panigrahi, Ajaya Kumar Dash, and Debi Prosad Dogra. 2018. PlutoAR: An Inexpensive, Interactive And Portable Augmented Reality Based Interpreter For K-10 Curriculum. arXiv:1809.00375 [cs.HC](2018). https://doi.org/arXiv:1809.00375v2

[37]

Pieter Jan Stappers and Elisa Giaccardi. 2017. Research through Design. In The Encyclopedia of Human-Computer Interaction, 2nd edition, M. Soegaardand R. Friis-Dam (Eds.).

[38]

Simone Stumpf, Vidya Rajaram, Lida Li, Weng Keen Wong, Margaret Burnett, Thomas Dietterich, Erin Sullivan, and Jonathan Herlocker. 2009. Interacting meaningfully with machine learning systems: Three experiments. International Journal of Human Computer Studies 67, 8 (2009), 639–662. https://doi.org/10.1016/j.ijhcs.2009.03.004

Digital Library

[39]

David Touretzky, Christina Gardner-McCune, Fred Martin, and Deborah Seehorn. 2019. Envisioning AI for K-12 : What should every child know about AI ?. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 9795–9799. https://doi.org/10.1609/aaai.v33i01.33019795

Digital Library

[40]

Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. A is for Artificial Intelligence. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, New York, New York, USA, 1–11. https://doi.org/10.1145/3290605.3300677

Digital Library

[41]

Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. A is for artificial intelligence the impact of artificial intelligence activities on young children’s perceptions of robots. In Conference on Human Factors in Computing Systems - Proceedings, Vol. 4. Association for Computing Machinery, New York, New York, USA, 1–11. https://doi.org/10.1145/3290605.3300677

Digital Library

[42]

Jeannette M. Wing. 2006. Computational thinking. Commun. ACM 49, 3 (2006). https://doi.org/10.1145/1118178.1118215

Digital Library

[43]

Karen Yeung. 2017. ‘Hypernudge’: Big Data as a mode of regulation by design. Information Communication and Society 20, 1 (2017), 118–136. https://doi.org/10.1080/1369118X.2016.1186713

[44]

Abigail Zimmermann-Niefield, Makenna Turner, Bridget Murphy, Shaun K Kane, and R Benjamin Shapiro. 2019. Youth Learning Machine Learning through Building Models of Athletic Moves. In IDC ’19 Proceedings of the 18th ACM International Conference on Interaction Design and Children. ACM Press, New York, New York, USA, 121–132. https://doi.org/10.1145/3311927.3323139

Digital Library

Cited By

Kim KKwon K(2024)Designing an Inclusive Artificial Intelligence (AI) Curriculum for Elementary Students to Address Gender Differences With Collaborative and Tangible ApproachesJournal of Educational Computing Research10.1177/0735633124127105962:7(1837-1864)Online publication date: 28-Aug-2024
https://doi.org/10.1177/07356331241271059
Morales-Navarro LKafai Y(2024)Unpacking Approaches to Learning and Teaching Machine Learning in K-12 Education: Transparency, Ethics, and Design ActivitiesProceedings of the 19th WiPSCE Conference on Primary and Secondary Computing Education Research10.1145/3677619.3678117(1-10)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3677619.3678117
Darabipourshiraz HAmbani DLong D(2024)DataBites: An embodied and co-creative museum exhibit to foster children's understanding of supervised machine learningProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3664247(550-555)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3664247
Show More Cited By

Index Terms

The Machine Learning Machine: A Tangible User Interface for Teaching Machine Learning
1. Applied computing
  1. Education
2. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Machine Learning: The State of the Art

The two fundamental problems in machine learning (ML) are statistical analysis and algorithm design. The former tells us the principles of the mathematical models that we establish from the observation data. The latter defines the conditions on which ...
Lifelong Machine Learning
Machine Learning: A Technical Approach To Machine Learning For Beginners

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2021

908 pages

ISBN:9781450382137

DOI:10.1145/3430524

Editor:
Raphael Wimmer
University of Regensburg, Germany
,
General Chairs:
Martin Kaltenbrunner
University of Art and Design Linz, Austria
,
Martin Murer
University of Salzburg, Austria
,
Program Chairs:
Katrin Wolf
Beuth University of Applied Sciences, Berlin, Germany
,
Ian Oakley
UNIST, Ulsan, Republic of Korea

Copyright © 2021 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 February 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Villum Fonden

Conference

TEI '21

TEI '21: Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 14 - 17, 2021

Salzburg, Austria

Acceptance Rates

TEI '21 Paper Acceptance Rate 40 of 136 submissions, 29%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
1,478
Total Downloads

Downloads (Last 12 months)348
Downloads (Last 6 weeks)32

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kim KKwon K(2024)Designing an Inclusive Artificial Intelligence (AI) Curriculum for Elementary Students to Address Gender Differences With Collaborative and Tangible ApproachesJournal of Educational Computing Research10.1177/0735633124127105962:7(1837-1864)Online publication date: 28-Aug-2024
https://doi.org/10.1177/07356331241271059
Morales-Navarro LKafai Y(2024)Unpacking Approaches to Learning and Teaching Machine Learning in K-12 Education: Transparency, Ethics, and Design ActivitiesProceedings of the 19th WiPSCE Conference on Primary and Secondary Computing Education Research10.1145/3677619.3678117(1-10)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3677619.3678117
Darabipourshiraz HAmbani DLong D(2024)DataBites: An embodied and co-creative museum exhibit to foster children's understanding of supervised machine learningProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3664247(550-555)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3664247
Zhou XZhou YGong YCai ZQiu AXiao QAntle ABai Z(2024)"Bee and I need diversity!" Break Filter Bubbles in Recommendation Systems through Embodied AI LearningProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655802(44-61)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655802
Bakogeorge AImtiaz SAbu Hantash NManshaei RMazalek ACiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Embodied Machine LearningProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633370(1-12)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633370
Bilstrup KKaspersen MBouvin NPetersen M(2024)ml-machine.org: Infrastructuring a Research Product to Disseminate AI Literacy in EducationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642539(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642539
Williams RAli SAlcantara RBurghleh TAlghowinem SBreazeal CGrollman DBroadbent EJu WSoh HWilliams T(2024)Doodlebot: An Educational Robot for Creativity and AI LiteracyProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634950(772-780)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634950
Kim KKwon K(2024)A systematic review of the evaluation in K-12 artificial intelligence education from 2013 to 2022Interactive Learning Environments10.1080/10494820.2024.2335499(1-29)Online publication date: 31-Mar-2024
https://doi.org/10.1080/10494820.2024.2335499
Smith RSchaper MTamashiro MVan Mechelen MPetersen MIversen O(2024)A research agenda for computational empowerment for emerging technology educationInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10061638:COnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100616
Kim KKwon K(2024)Tangible computing tools in AI education: Approach to improve elementary students' knowledge, perception, and behavioral intention towards AIEducation and Information Technologies10.1007/s10639-024-12497-229:13(16125-16156)Online publication date: 7-Feb-2024
https://dl.acm.org/doi/10.1007/s10639-024-12497-2
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents