More Web Proxy on the site http://driver.im/

research-article

Tangible paper interfaces: interpreting pupils' manipulations

Authors:

Quentin Bonnard,

Patrick Jermann,

Frédéric Kaplan,

Pierre DillenbourgAuthors Info & Claims

ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

Pages 133 - 142

https://doi.org/10.1145/2396636.2396658

Published: 11 November 2012 Publication History

Abstract

Paper interfaces merge the advantages of the digital and physical world. They can be created using normal paper augmented by a camera+projector system. They are particularly promising for applications in education, because paper is already fully integrated in the classroom, and computers can augment them with a dynamic display. However, people mostly use paper as a document, and rarely for its characteristics as a physical body. In this article, we show how the tangible nature of paper can be used to extract information about the learning activity. We present an augmented reality activity for pupils in primary schools to explore the classification of quadrilaterals based on sheets, cards, and cardboard shapes. We present a preliminary study and an in-situ, controlled study, making use of this activity. From the detected positions of the various interface elements, we show how to extract indicators about problem solving, hesitation, difficulty levels of the exercises, and the division of labor among the groups of pupils. Finally, we discuss how such indicators can be used, and how other interfaces can be designed to extract different indicators.

Supplementary Material

suppl.mov (its0215-file3.mp4)

Supplemental video

Download
23.30 MB

References

[1]

Bonnard, Q., Verma, H., Kaplan, F., and Dillenbourg, P. Paper interfaces for learning geometry. In 7th European Conference on Technology Enhanced Learning (2012).

Digital Library

[2]

Costanza, E., Giaccone, M., Kueng, O., Shelley, S., and Huang, J. Tangible interfaces for download: initial observations from users' everyday environments. In CHI '10 (2010).

Digital Library

[3]

Cuendet, S., Bonnard, Q., Kaplan, F., and Dillenbourg, P. Paper interface design for classroom orchestration. In CHI '11 (2011).

Digital Library

[4]

Cuendet, S., Jermann, P., and Dillenbourg, P. Tangible interfaces: when physical-virtual coupling may be detrimental to learning. In BCS '12 Proc. of the 25th BCS Interaction Specialist Group Conference (2012).

Digital Library

[5]

Dillenbourg, P., and Jermann, P. Technology for classroom orchestration. New Science of Learning: Cognition, Computers and Collaboration in Education (2010).

[6]

Dimitrakopoulou, A., Bollen, L., Dimitriadis, Y., Harrer, A., Jermann, P., Kollias, V., Marcos, J. A., Martínez, A., and Petrou, A. State of the art of interaction analysis for metacognitive support & diagnosis, 2006.

[7]

Do-Lenh, S., Kaplan, F., and Dillenbourg, P. Paper-based concept map: the effects of tabletop on an expressive collaborative learning task. BCS-HCI '09 (2009).

Digital Library

[8]

Fishkin, K. P. A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing 8, 5 (2004).

Digital Library

[9]

García, R. R., Quirós, J. S., Santos, R. G., González, S. M., and Fernanz, S. M. Interactive multimedia animation with macromedia flash in descriptive geometry teaching. Computers & Education 49, 3 (2007).

Digital Library

[10]

Hornecker, E., and Buur, J. Getting a grip on tangible interaction: a framework on physical space and social interaction. In CHI '06 (2006).

Digital Library

[11]

Jermann, P., Zufferey, G., Schneider, B., Lucci, A., Lépine, S., and Dillenbourg, P. Physical space and division of labor around a tabletop tangible simulation. In CSCL '09 (2009).

Digital Library

[12]

Kortenkamp, U., and Dohrmann, C. User interface design for dynamic geometry software. Acta Didactica Napocensia 3 (2010).

[13]

Laborde, C., Keitel, and Ruthven, K. The computer as part of the learning environment: the case of geometry. In Learning from computers:Mathematics education and technology. Springer-Verlag, 1993.

[14]

Martin-Gutiérrez, J., Luis Saorin, J., Contero, M., A., M., Pérez-López, D. C., and Ortega, M. Design and validation of an augmented book for spatial abilities development in engineering students. Computers & Graphics 34, 1 (2010).

Digital Library

[15]

Oviatt, S., Arthur, A., and Cohen, J. Quiet interfaces that help students think. In UIST '06 (2006).

Digital Library

[16]

Perlman, R. Using computer technology to provide a creative learning environment for preschool children. Tech. rep., M.I.T., 1976.

[17]

Pietrzak, T., Malacria, S., Tabard, A., and Lecolinet, E. What do u-note? an augmented note taking system for the classroom. In PaperComp 2010: 1st International Workshop on Paper Computing. Workshop at Ubicomp 2010 (2010).

[18]

Sellen, A. J., and Harper, R. The Myth of the Paperless Office. MIT Press, Cambridge, MA, USA, 2003.

Digital Library

[19]

Soller, A., Martínez, A., Jermann, P., and Muehlenbrock, M. From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. International Journal of Artificial Intelligence in Education 15, 4 (2005).

Digital Library

[20]

Song, H., Guimbretière, F., Ambrose, M., and Lostritto, C. CubeExplorer: an evaluation of interaction techniques in architectural education. In INTERACT '07 (2007).

Digital Library

[21]

Steimle, J., Brdiczka, O., and Muhlhauser, M. CoScribe: integrating paper and digital documents for collaborative knowledge work. IEEE Transactions on Learning Technologies 2 (2009).

Digital Library

[22]

Straesser, R. Cabri-géomètre: Does dynamic geometry software (DGS) change geometry and its teaching and learning? International Journal of Computers for Mathematical Learning 6, 3 (2002).

[23]

Wellner, P. Interacting with paper on the DigitalDesk. Communications of the ACM 36, 7 (1993).

Digital Library

[24]

Zufferey, G. The Complementarity of Tangible and Paper Interfaces in Tabletop Environments for Collaborative Learning. PhD thesis, 2010.

Cited By

Pasqualotto AFilosofi F(2023)Tangible digital storytelling and phygital reality: benefits for inclusion and cooperation in young childrenResearch on Education and Media10.2478/rem-2023-002315:2(41-50)Online publication date: 14-Dec-2023
https://doi.org/10.2478/rem-2023-0023
Li YLiang MPreissing JBachl NDutoit MWeber TMayer SHussmann H(2022)A Meta-Analysis of Tangible Learning Studies from the TEI ConferenceProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501313(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501313
Soysa AAl Mahmud A(2019)How Do Typically Developing Children and Children with ASD Play a Tangible Game?Human-Computer Interaction – INTERACT 201910.1007/978-3-030-29384-0_8(135-155)Online publication date: 25-Aug-2019
https://doi.org/10.1007/978-3-030-29384-0_8
Show More Cited By

Index Terms

Tangible paper interfaces: interpreting pupils' manipulations
1. Human-centered computing

Recommendations

Designing pen-and-paper user interfaces for interaction with documents
TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction

Despite numerous predictions of the paperless office, knowledge work is still characterized by the combined use of paper and digital documents. Digital pen-and-paper user interfaces bridge the gap between both worlds by electronically capturing the ...
Tangible Interfaces: An Analysis of User Experience Using the AR Sandbox Project
IHC '17: Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems

The desire to make the human-computer interaction more natural, and the limitation between real and virtual became practically imperceptible, resulted in the development of Tangible Interfaces (TUI). In TUI physical objects are interpreted by the system ...
The hold-and-move gesture for multi-touch interfaces
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services

We present the two-finger gesture hold-and-move as an alternative to the disruptive long-tap which utilizes dwell times for switching from panning to object dragging mode in touch interfaces. We make use of a second finger for object selection and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

November 2012

430 pages

ISBN:9781450312097

DOI:10.1145/2396636

General Chairs:
Orit Shaer
Wellesley College, USA
,
Chia Shen
Harvard University, USA
,
Program Chairs:
Meredith Ringel Morris
Microsoft Research, USA
,
Michael Horn
Northwestern University, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITS'12

Sponsor:

SIGCHI

ITS'12: Interactive Tabletops and Surfaces

November 11 - 14, 2012

Massachusetts, Cambridge, USA

Acceptance Rates

ITS '12 Paper Acceptance Rate 24 of 63 submissions, 38%;

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
419
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pasqualotto AFilosofi F(2023)Tangible digital storytelling and phygital reality: benefits for inclusion and cooperation in young childrenResearch on Education and Media10.2478/rem-2023-002315:2(41-50)Online publication date: 14-Dec-2023
https://doi.org/10.2478/rem-2023-0023
Li YLiang MPreissing JBachl NDutoit MWeber TMayer SHussmann H(2022)A Meta-Analysis of Tangible Learning Studies from the TEI ConferenceProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501313(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501313
Soysa AAl Mahmud A(2019)How Do Typically Developing Children and Children with ASD Play a Tangible Game?Human-Computer Interaction – INTERACT 201910.1007/978-3-030-29384-0_8(135-155)Online publication date: 25-Aug-2019
https://doi.org/10.1007/978-3-030-29384-0_8
Yanikoglu BGogus AInal E(2017)Use of handwriting recognition technologies in tablet-based learning modules for first grade educationEducational Technology Research and Development10.1007/s11423-017-9532-365:5(1369-1388)Online publication date: 12-Jul-2017
https://doi.org/10.1007/s11423-017-9532-3
Agarwal BTripathi RMaver TDo E(2015)Sketch-Play-Learn - An Augmented Paper Based Environment for Learning the Concepts of OpticsProceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition10.1145/2757226.2764558(213-216)Online publication date: 22-Jun-2015
https://dl.acm.org/doi/10.1145/2757226.2764558
Kubicki SWolff MLepreux SKolski C(2015)RFID interactive tabletop application with tangible objectsPersonal and Ubiquitous Computing10.1007/s00779-015-0891-719:8(1259-1274)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1007/s00779-015-0891-7
Mann AHinrichs UQuigley A(2015)Digital Pen Technology’s Suitability to Support Handwriting LearningThe Impact of Pen and Touch Technology on Education10.1007/978-3-319-15594-4_2(7-22)Online publication date: 10-Jul-2015
https://doi.org/10.1007/978-3-319-15594-4_2
Mann AHinrichs UQuigley AChisik YGeiger CHasegawa S(2014)Children's Creativity LabProceedings of the 2014 Workshops on Advances in Computer Entertainment Conference10.1145/2693787.2693805(1-9)Online publication date: 11-Nov-2014
https://dl.acm.org/doi/10.1145/2693787.2693805
Zhao YQin YLiu YLiu SZhang TShi YButz AGreenberg SBakker SLoke LDe Luca A(2014)QOOKProceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction10.1145/2540930.2540977(125-132)Online publication date: 16-Feb-2014
https://dl.acm.org/doi/10.1145/2540930.2540977
Heinrich PKilic MAschoff FSchwabe GFussell SLutters WMorris MReddy M(2014)Enabling relationship building in tabletop-supported advisory settingsProceedings of the 17th ACM conference on Computer supported cooperative work & social computing10.1145/2531602.2531697(171-183)Online publication date: 15-Feb-2014
https://dl.acm.org/doi/10.1145/2531602.2531697
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents