[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2930674.2930710acmconferencesArticle/Chapter ViewAbstractPublication PagesidcConference Proceedingsconference-collections
research-article
Public Access

SharedPhys: Live Physiological Sensing, Whole-Body Interaction, and Large-Screen Visualizations to Support Shared Inquiry Experiences

Published: 21 June 2016 Publication History

Abstract

We present and evaluate a new mixed-reality tool called SharedPhys, which tightly integrates real-time physiological sensing, whole-body interaction, and responsive large-screen visualizations to support new forms of embodied interaction and collaborative learning. While our primary content area is the human body, we use the body and physical activity as a pathway to other STEM areas such as biology, health, and mathematics. We describe our participatory design process with 20 elementary school teachers, the development of three contrasting SharedPhys prototypes, and results from six exploratory evaluations in two after-school programs. Our findings suggest that the tight coupling between physical interaction, sensing, and visualization in a multi-user environment helps promote engagement, allows children to easily explore cause-and-effect relationships, supports and shapes social interactions, and promotes playful experiences.

References

[1]
Adachi, T., Goseki, M., Muratsu, K., Mizoguchi, H., Namatame, M., Sugimoto, M., Kusunoki, F., Yamaguchi, E., Inagaki, S. and Takeda, Y. 2013. Human SUGOROKU: Full-body Interaction System for Students to Learn Vegetation Succession. Proceedings of the 12th International Conference on Interaction Design and Children (New York, NY, USA, 2013), 364--367.
[2]
An Animated Guide to Breathing: http://tabletopwhale.com/2014/10/24/3-different-ways-to-breathe.html. Accessed: 2014-10-24.
[3]
Begel, A., Garcia, D.D. and Wolfman, S.A. 2004. Kinesthetic learning in the classroom. ACM SIGCSE Bulletin. 36, 1 (Mar. 2004), 183.
[4]
Birchfield, D., Thornburg, H., Megowan-Romanowicz, M.C., Hatton, S., Mechtley, B., Dolgov, I. and Burleson, W. 2008. Embodiment, multimodality, and composition: convergent themes across HCI and education for mixed-reality learning environments. Advances in Human-Computer Interaction. 2008, (2008), 1--20.
[5]
Blum, T., Kleeberger, V., Bichlmeier, C. and Navab, N. 2012. mirracle: An augmented reality magic mirror system for anatomy education. 2012 IEEE Virtual Reality (VR) (Mar. 2012), 115--116.
[6]
Boeije, H. 2002. A Purposeful Approach to the Constant Comparative Method in the Analysis of Qualitative Interviews. Quality and Quantity. 36, 4 (2002), 391--409.
[7]
Bonafide, C.P., Brady, P.W., Keren, R.C., H., P., Marsolo, K. and Daymont, C. 2013. Development of heart and respiratory rate percentile curves for hospitalized children. Pediatrics. 4, 131 (2013), 1150--1157.
[8]
Bonsignore, E., Hansen, D., Kraus, K., Ahn, J., Visconti, A., Fraistat, A. and Druin, A. 2012. Alternate Reality Games: platforms for collaborative learning. Proceedings of the 10th International Conference of the Learning Sciences (ICLS) (2012), 251--258.
[9]
Carini, R.M., Kuh, G.D. and Klein, S.P. 2006. Student engagement and student learning: Testing the linkages. Research in Higher Education. 47, 1 (2006), 1--32.
[10]
Chi, M.T.H. 1997. Quantifying Qualitative Analyses of Verbal Data: A Practical Guide. Journal of the Learning Sciences. 6, 3 (Jul. 1997), 271--315.
[11]
Colella, V. 2000. Participatory Simulations: Building Collaborative Understanding Through Immersive Dynamic Modeling. Journal of the Learning Sciences. 9, 4 (Oct. 2000), 471--500.
[12]
Danish, J.A., Enyedy, N., Saleh, A., Lee, C. and Andrade, A. 2015. Science Through Technology Enhanced Play: Designing to Support Reflection Through Play and Embodiment. Proceedings of the 11th International Conference on Computer Supported Collaborative Learning (CSCL2015) (2015), 332--339.
[13]
Deniz, H. and Dulger, M.F. 2012. Supporting Fourth Graders' Ability to Interpret Graphs Through Real-Time Graphing Technology: A Preliminary Study. Journal of Science Education and Technology. 21, 6 (Dec. 2012), 652--660.
[14]
Dourish, P. 2001. Where the Action Is: The Foundations of Embodied Interaction. The MIT Press.
[15]
Enyedy, N., Danish, J.A., Delacruz, G. and Kumar, M. 2012. Learning physics through play in an augmented reality environment. International Journal of Computer-Supported Collaborative Learning. 7, 3 (Jul. 2012), 347--378.
[16]
Ganong, W.F. and Barrett, K.E. 2005. Review of medical physiology. New York: McGraw-Hill Medical.
[17]
Garcia-Barros, S., Martínez-Losada, C. and Garrido, M. 2011. What do Children Aged Four to Seven Know about the Digestive System and the Respiratory System of the Human Being and of Other Animals? International Journal of Science Education. 33, 15 (Oct. 2011), 2095-- 2122.
[18]
Gardner, C.M., Clegg, T.L., Williams, O.J. and Kolodner, J.L. 2006. Messy Learning Environments: Busy Hands and Less Engaged Minds. Proceedings of the 7th International Conference on Learning Sciences (2006), 926--927.
[19]
Gulinson, S. and Harrison, J. 1996. Control of resting ventilation rate in grasshoppers. The Journal of experimental biology. 199, 2 (1996), 379--389.
[20]
Hailstone, J. and Kilding, A.E. 2011. Reliability and Validity of the Zephyr™ BioHarness™ to Measure Respiratory Responses to Exercise. Measurement in Physical Education and Exercise Science. 15, 4 (Oct. 2011), 293--300.
[21]
Hamza-Lup, F.G., Santhanam, A.P., Imielinska, C., Meeks, S.L. and Rolland, J.P. 2007. Distributed Augmented Reality With 3-D Lung Dynamics---A Planning Tool Concept. IEEE Transactions on Information Technology in Biomedicine. 11, 1 (Jan. 2007), 40--46.
[22]
Harcourt Inc. 2007. Harcourt Health and Fitness: Grade 4. Harcourt School Publishers.
[23]
Inside the brains of Xbox One Kinect (Kinect v2): https://youtu.be/ziXflemQr3A?t=1m47s. Accessed: 2015-03-01.
[24]
Ioannidou, A., Repenning, A., Webb, D., Keyser, D., Luhn, L. and Daetwyler, C. 2010. Mr. Vetro: A Collective Simulation for teaching health science. International Journal of Computer-Supported Collaborative Learning. 5, 2 (Mar. 2010), 141--166.
[25]
Jacob, J. and Pescatore, T. 2013. Avian Respiratory System.
[26]
Johnson-Glenberg, M.C., Birchfield, D.A., Tolentino, L. and Koziupa, T. 2014. Collaborative embodied learning in mixed reality motion-capture environments: Two science studies. Journal of Educational Psychology. 106, 1 (2014), 86--104.
[27]
Kim, J.-H., Roberge, R., Powell B., J., Shafer B., A. and Jon Williams, W. 2013. Measurement Accuracy of Heart Rate and Respiratory Rate during Graded Exercise and Sustained Exercise in the Heat Using the Zephyr BioHarness™. International Journal of Sports Medicine. 34, 06 (2013), 497--501.
[28]
Klemmer, S.R., Hartmann, B. and Takayama, L. 2006. How bodies matter: five themes for interaction design. Proceedings of the 6th ACM conference on Designing Interactive systems - DIS '06 (New York, New York, USA, Jun. 2006), 140--149.
[29]
Kreitmayer, S., Rogers, Y., Laney, R. and Peake, S. 2012. From Participatory to Contributory Simulations: Changing the Game in the Classroom. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12 (New York, New York, USA, May 2012), 49--58.
[30]
Landry, P., Minsky, J., Castañer, M., Camerino, O., Rodriguez-Arregui, R., Ormo, E. and Pares, N. 2013. Design Strategy to Stimulate a Diversity of Motor Skills for an Exergame Addressed to Children. Proceedings of the 12th International Conference on Interaction Design and Children (New York, NY, USA, 2013), 84--91.
[31]
Laura Malinverni, N.P. 2014. Learning of Abstract Concepts through Full-Body Interaction: A Systematic Review. Journal of Educational Technology & Society. 17, 4 (2014), 100--116.
[32]
Lee, V.R. 2014. Combining High-Speed Cameras and Stop-Motion Animation Software to Support Students' Modeling of Human Body Movement. Journal of Science Education and Technology. 24, 2-3 (Oct. 2014), 178--191.
[33]
Lee, V.R. 2014. Introduction: Technology Meets Body, Body Meets Technology. Learning technologies and the body: integration and implementation in formal and informal learning environments. V.R. Lee, ed. 1--20.
[34]
Lee, V.R. 2015. Learning Technologies and the Body: Integration and Implementation In Formal and Informal Learning Environments. Taylor and Francis.
[35]
Lee, V.R. 2013. The Quantified Self (QS) movement and some emerging opportunities for the educational technology field. Educational Technology. 53, 6 (2013), 39--42.
[36]
Lee, V.R. and Drake, J. 2013. Quantified Recess: Design of an Activity for Elementary Students Involving Analyses of Their Own Movement Data. Proceedings of the 12th International Conference on Interaction Design and Children (New York, NY, USA, 2013), 273--276.
[37]
Lee, V.R., Drake, J.R., Cain, R. and Thayne, J. 2015. Opportunistic Uses of the Traditional School Day Through Student Examination of Fitbit Activity Tracker Data. Proceedings of the 14th International Conference on Interaction Design and Children (New York, NY, USA, 2015), 209--218.
[38]
Lee, V.R. and DuMont, M. 2010. An Exploration into How Physical Activity Data-Recording Devices Could be Used in Computer-Supported Data Investigations. International Journal of Computers for Mathematical Learning. 15, 3 (Dec. 2010), 167--189.
[39]
Lee, V.R. and Thomas, J.M. 2011. Integrating physical activity data technologies into elementary school classrooms. Educational Technology Research and Development. 59, 6 (Aug. 2011), 865--884.
[40]
Lindgren, R. and Johnson-Glenberg, M. 2013. Emboldened by Embodiment: Six Precepts for Research on Embodied Learning and Mixed Reality. Educational Researcher. 42, 8 (Nov. 2013), 445--452.
[41]
Lindwall, O. and Ivarsson, J. 2004. What makes the subject matter matter? Contrasting probeware with Graphs & Tracks. Renderings & reasoning: Studying artifacts in human knowing. J. Ivarsson, ed. Universitatis Gothoburgensis. 115--143.
[42]
Lui, M., Kuhn, A.C., Acosta, A., Quintana, C. and Slotta, J.D. 2014. Supporting Learners in Collecting and Exploring Data from Immersive Simulations in Collective Inquiry. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2014), 2103--2112.
[43]
Meng, M., Fallavollita, P., Blum, T., Eck, U., Sandor, C., Weidert, S., Waschke, J. and Navab, N. 2013. Kinect for interactive AR anatomy learning. 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (Oct. 2013), 277--278.
[44]
Miles, M.B., Huberman, A.M. and Saldaña, J. 2013. Qualitative Data Analysis: A Methods Sourcebook. Sage Publications, Inc.
[45]
Milgram, P. and Kishino, F. 1994. A Taxonomy of Mixed Reality Visual Displays. IEICE TRANSACTIONS on Information and Systems. The Institute of Electronics, Information and Communication Engineers.
[46]
Miller, R.E. and Fowler, M.E. 2014. Fowler's Zoo and Wild Animal Medicine, Volume 8. Elsevier Health Sciences.
[47]
Moher, T., Uphoff, B., Bhatt, D., Silva, B.L. and Malcom, P. 2008. WallCology: Designing interaction affordances for learner engagement in authentic science inquiry. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2008), 163--172.
[48]
Monkman, H. and Kushniruk, A.W. 2015. A see through future: augmented reality and health information systems. Studies in health technology and informatics. 208, (Jan. 2015), 281--5.
[49]
My Incredible Body - Guide to Learn About the Human Body for Children - Educational Science App with Anatomy for Kids: https://itunes.apple.com/us/app/my-incredible-body-guide-to/id853953105. Accessed: 2015-08-05.
[50]
Myers, M.J. and Burgess, A.B. 2003. Inquiry-based Laboratory Course Improves Students' Ability to Design Experiments and Interpret Data. AJP: Advances in Physiology Education. 27, 1 (Mar. 2003), 26--33.
[51]
National Research Council 2012. A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas. The National Academies Press.
[52]
Next Generation Science Standards (NGSS) Lead States. 2013. NGSS: For States, By States. Washington, DC: The National Academies Press.
[53]
Nicolaou, C.T., Nicolaidou, I., Zacharia, Z. and Constantinou, C.P. 2007. Enhancing Fourth Graders' Ability to Interpret Graphical Representations Through the Use of Microcomputer-Based Labs Implemented Within an Inquiry-Based Activity Sequence. Journal of Computers in Mathematics and Science Teaching. 26, 1 (2007), 75--99.
[54]
Norooz, L. and Froehlich, J. 2013. Exploring early designs for teaching anatomy and physiology to children using wearable e-textiles. Proceedings of the 12th International Conference on Interaction Design and Children (IDC '13) (New York, New York, USA, Jun. 2013), 577--580.
[55]
Norooz, L., Mauriello, M.L., Jorgensen, A., McNally, B. and Froehlich, J.E. 2015. BodyVis: A New Approach to Body Learning Through Wearable Sensing and Visualization. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015), 1025--1034.
[56]
Pecher, D. and Zwaan, R.A. 2005. Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thinking. Cambridge University Press.
[57]
Poh, M.-Z., McDuff, D.J. and Picard, R.W. 2010. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express. 18, 10 (May 2010), 10762--10774.
[58]
Price, S. and Rogers, Y. 2004. Let's get physical: The learning benefits of interacting in digitally augmented physical spaces. Computers & Education. 43, 1-2 (Aug. 2004), 137--151.
[59]
Price, S., Sakr, M. and Jewitt, C. 2015. Exploring Whole-Body Interaction and Design for Museums. Interacting with Computers. (Sep. 2015), iwv032.
[60]
R., J., Jablon and Wilkinson, M. 2006. Using Engagement Strategies to Facilitate Children's Learning and Success. YC Young Children. (2006), 12--16.
[61]
Reiss, M.J. et al. 2002. An international study of young peoples' drawings of what is inside themselves. Journal of Biological Education. 36, 2 (Mar. 2002), 58--64.
[62]
Revelle, G. 2013. Applying developmental theory and research to the creation of educational games. New directions for child and adolescent development. 2013, 139 (Jan. 2013), 31--40.
[63]
Ross, P.M., Tronson, D.A. and Ritchie, R.J. 2008. Increasing Conceptual Understanding of Glycolysis & the Krebs Cycle Using Role-Play. The American Biology Teacher. 70, 3 (Mar. 2008), 163--168.
[64]
Royuk, B. and Brooks, D.W. 2003. Cookbook Procedures in MBL Physics Exercises. Journal of Scienzwace Education and Technology. 12, 3 (Sep. 2003), 317--324.
[65]
Russell, D.W., Lucas, K.B. and McRobbie, C.J. 2004. Role of the microcomputer-based laboratory display in supporting the construction of new understandings in thermal physics. Journal of Research in Science Teaching. 41, 2 (Feb. 2004), 165--185.
[66]
Saarelainen, M., Laaksonen, A. and Hirvonen, P.E. 2007. Students' initial knowledge of electric and magnetic fields---more profound explanations and reasoning models for undesired conceptions. European J. of Physics. 28, 1 (Jan. 2007), 51--60.
[67]
Saldaña, J. 2012. The Coding Manual for Qualitative Researchers. SAGE Publications Ltd.
[68]
Singh, V. 2010. The Electron Runaround: Understanding Electric Circuit Basics Through a Classroom Activity. The Physics Teacher. 48, 5 (Apr. 2010), 309.
[69]
Snibbe, S.S. and Raffle, H.S. 2009. Social Immersive Media: Pursuing Best Practices for Multi-user Interactive Camera/Projector Exhibits. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2009), 1447--1456.
[70]
Stage Goal 23: Understand human body systems and factors that influence growth and development: http://www.isbe.net/ils/pdh/pdf/goal23.pdf. Accessed: 2015-05-01.
[71]
Struck, W. and Yerrick, R. 2009. The Effect of Data Acquisition-Probeware and Digital Video Analysis on Accurate Graphical Representation of Kinetics in a High School Physics Class. Journal of Science Education and Technology. 19, 2 (Oct. 2009), 199--211.
[72]
The Human Body: https://itunes.apple.com/us/app/the-human-body-by-tinybop/id682046579. Accessed: 2015-08-04.
[73]
Tinker, R. 2000. History of Probeware. http://makingsens.stanford.edu/pubs/AHistoryOfProbeware.pdf. Accessed: 2015-08-04.
[74]
Tzaneva, V. and Perry, S.F. 2010. The control of breathing in goldfish (Carassius auratus) experiencing thermally induced gill remodelling. The Journal of experimental biology. 213, 21 (2010), 3666--3675.
[75]
Vessey, J.A., Braithwaite, K.B. and Widemann, M. 1990. Teaching Children About Their Internal Bodies. Pediatric Nursing. 16, 1 (1990), 29--33.
[76]
Zephyr BioHarness 3: Model BH3: 2014. http://www.zephyranywhere.com/products/bioharness-3/. Accessed: 2015-08-04.
[77]
Zucker, A.A., Tinker, R., Staudt, C., Mansfield, A. and Metcalf, S. 2007. Learning Science in Grades 3-8 Using Probeware and Computers: Findings from the TEEMSS II Project. Journal of Science Education and Technology. 17, 1 (Nov. 2007), 42--48.

Cited By

View all
  • (2024)Leveraging Physical Activities to Support Learning for Young People via Technologies: An Examination of Educational Practices Across the FieldReview of Educational Research10.3102/00346543241248464Online publication date: 18-May-2024
  • (2024)SonifyAR: Context-Aware Sound Generation in Augmented RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676406(1-13)Online publication date: 13-Oct-2024
  • (2024)A systematic exploration of collaborative immersive systems for sense-making in STEMBehaviour & Information Technology10.1080/0144929X.2024.2441963(1-30)Online publication date: 18-Dec-2024
  • Show More Cited By

Index Terms

  1. SharedPhys: Live Physiological Sensing, Whole-Body Interaction, and Large-Screen Visualizations to Support Shared Inquiry Experiences

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IDC '16: Proceedings of the The 15th International Conference on Interaction Design and Children
    June 2016
    774 pages
    ISBN:9781450343138
    DOI:10.1145/2930674
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 June 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Physiological sensing
    2. STEM
    3. collaborative learning
    4. large-screen displays
    5. mixed-reality
    6. scientific inquiry
    7. wearables

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    IDC '16
    Sponsor:
    IDC '16: Interaction Design and Children
    June 21 - 24, 2016
    Manchester, United Kingdom

    Acceptance Rates

    IDC '16 Paper Acceptance Rate 36 of 77 submissions, 47%;
    Overall Acceptance Rate 172 of 578 submissions, 30%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)146
    • Downloads (Last 6 weeks)21
    Reflects downloads up to 05 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Leveraging Physical Activities to Support Learning for Young People via Technologies: An Examination of Educational Practices Across the FieldReview of Educational Research10.3102/00346543241248464Online publication date: 18-May-2024
    • (2024)SonifyAR: Context-Aware Sound Generation in Augmented RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676406(1-13)Online publication date: 13-Oct-2024
    • (2024)A systematic exploration of collaborative immersive systems for sense-making in STEMBehaviour & Information Technology10.1080/0144929X.2024.2441963(1-30)Online publication date: 18-Dec-2024
    • (2023)Constructionist approaches to critical data literacy: A reviewProceedings of the 22nd Annual ACM Interaction Design and Children Conference10.1145/3585088.3589367(112-123)Online publication date: 19-Jun-2023
    • (2023)A comprehensive survey on AR-enabled local collaborationVirtual Reality10.1007/s10055-023-00848-227:4(2941-2966)Online publication date: 20-Aug-2023
    • (2022)RealityTalk: Real-Time Speech-Driven Augmented Presentation for AR Live StorytellingProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545702(1-12)Online publication date: 29-Oct-2022
    • (2022)Taking data feminism to school: A synthesis and review of pre‐collegiate data science education projectsBritish Journal of Educational Technology10.1111/bjet.1325153:5(1096-1113)Online publication date: 24-Jun-2022
    • (2022)A systematic survey on embodied cognitionInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2022.10047833:COnline publication date: 1-Sep-2022
    • (2022)Effects of Wearable Hybrid AR/VR Learning Material on High School Students’ Situational Interest, Engagement, and Learning Performance: the Case of a Physics Laboratory Learning EnvironmentJournal of Science Education and Technology10.1007/s10956-022-10001-432:1(1-12)Online publication date: 6-Oct-2022
    • (2021)Multi-User Virtual Environments for Physical Education and Sport TrainingResearch Anthology on Business Strategies, Health Factors, and Ethical Implications in Sports and eSports10.4018/978-1-7998-7707-3.ch041(734-755)Online publication date: 2021
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media