More Web Proxy on the site http://driver.im/

research-article

Supporting an integrated paper-digital workflow for observational research

Authors:

Edwin Hutchins,

James D. HollanAuthors Info & Claims

IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

Pages 257 - 266

https://doi.org/10.1145/1943403.1943443

Published: 13 February 2011 Publication History

Abstract

The intertwining of everyday life and computation, along with a new generation of inexpensive digital recording devices and storage facilities, is revolutionizing our ability to collect and analyze human activity data. Such ubiquitous data collection has an exciting potential to augment human cognition and radically improve information-intensive work. In this paper we introduce a system to aid the process of data collection and analysis during observational research by providing non-intrusive automatic capture of paper-based annotations. The system exploits current note-taking practices and incorporates digital pen technology. We describe the development, deployment and use of the system for interactive visualization and annotation of multiple stream of video and other types of time-based data.

Supplementary Material

JPG File (fp034i.jpg)

Download
20.75 KB

MOV File (fp034i.mov)

Download
34.76 MB

References

[1]

E. Auramak, M. Robinson, A. Aaltonen, M. Kovalainen, A. Liinamaa, and T. Tuuna-Vaiska. Paperwork at 78kph. In Proc. CSCW '96, pages 370--379.

Digital Library

[2]

M. Bernstein, M. Van Kleek, D. Karger, and M. Schraefel. Information Scraps: How and Why Information Eludes our Personal Information Management Tools. ACM Transactions on Information Systems (TOIS), 26(4):1--46, 2008.

Digital Library

[3]

K. Conroy, D. Levin, and F. Guimbretière. ProofRite: A Paper-Augmented Word Processor. Technical Report HCIL-2004-22, CS-TR-4652, Human-Computer Interaction Lab, University of Maryland, USA, 2004.

[4]

A. Fouse and J. D. Hollan. DataPrism: A Tool for Visualizing Multimodal Data. In Proc. Measuring Behavior 2010, pages 181--184.

Digital Library

[5]

C. Goodwin. Professional vision. American anthropologist, 96(3):606--633, 1994.

[6]

F. Guimbretière. Paper Augmented Digital Documents. In Proc. UIST '03, pages 51--60.

Digital Library

[7]

J. Hagedorn, J. Hailpern, and K. Karahalios. VCode and VData: Illustrating a New Framework for Supporting the Video Annotation Workflow. In Proc. AVI 2008, pages 317--321.

Digital Library

[8]

C. Hofmann, N. Hollender, and D. Fellner. Task-and Process-related Design of Video Annotation Systems. In Proc. Mensch & Computer '09, pages 173--182.

[9]

E. Hutchins. Cognition in the wild. MIT Press, 1995.

[10]

Z. Liu and D. Stork. Is Paperless Really More? Communications of the ACM, 43(11):94--97, 2000.

Digital Library

[11]

W. Mackay, A. Fayard, L. Frobert, and L. Médini. Reinventing the Familiar: Exploring an Augmented Reality Design Space for Air Traffic Control. In Proc. CHI '98, pages 558--565.

Digital Library

[12]

W. E. Mackay, G. Pothier, C. Letondal, K. Bøegh, and H. E. Sørensen. The Missing Link: Augmenting Biology Laboratory Notebooks. In Proc. UIST '02, pages 41--50, Paris, France.

Digital Library

[13]

G. Moore and J. O'Hare. Paper's future role. Paper 360, pages 16--18, Apr 2008.

[14]

M. C. Norrie, B. Signer, and N. Weibel. General Framework for the Rapid Development of Interactive Paper Applications. In Proc. CoPADD '06, pages 9--12.

[15]

K. O'Hara and A. Sellen. A Comparison of Reading Paper and Online Documents. In Proc. CHI '97, pages 335--342.

Digital Library

[16]

R. Pea and E. Hoffert. Video Workflow in the Learning Sciences: Prospects of Emerging Technologies for Augmenting Work Practices. In R. Goldman, R. Pea, B. Barron, and S. Derry, editors, Video Research in the Learning Sciences, pages 427--460. 2007.

[17]

R. Pea and J. Lemke. Sharing and Reporting Video Work. In S. Derry, editor, Guidelines for Video Research in Education: Recommendations from an Expert Panel. Data Research and Development Center, 2007.

[18]

A. M. Piper, N. Weibel, and J. D. Hollan. Introducing Multimodal Paper-Digital Interfaces for Speech-Language Therapy. In Proc. ASSETS '10, pages 203--210.

Digital Library

[19]

D. Schön. The reflective practitioner: How professionals think in action. Basic Books, 1983.

[20]

A. Sellen and R. Harper. The Myth of the Paperless Office. MIT Press, 2003.

Digital Library

[21]

B. Signer, U. Kurmann, and M. C. Norrie. iGesture: A General Gesture Recognition Framework. In Proc. ICDAR '07, pages 954--958.

Digital Library

[22]

L. Stifelman, B. Arons, and C. Schmandt. The Audio Notebook: Paper and Pen Interaction with Structured Speech. In Proc. CHI '01, pages 182--189.

Digital Library

[23]

A. Tabard. Supporting Lightweight reflection on personal information. PhD thesis, Université Paris-Sud & INRIA, 2009.

[24]

A. Tabard, W. Mackay, and E. Eastmond. From Individual to Collaborative: The evolution of Prism, a Hybrid Laboratory Notebook. In Proc. CSCW '08, pages 569--578.

Digital Library

[25]

N. Weibel, A. Ispas, B. Signer, and M. C. Norrie. PaperProof: A Paper-Digital Proof-Editing System. In Proc. CHI '08, pages 2349--2354.

Digital Library

[26]

P. Wellner. Interacting with Paper on the DigitalDesk. Communications of the ACM, 36(7):87--96, Jul 1993.

Digital Library

[27]

R. B. Yeh, C. Liao, S. R. Klemmer, F. Guimbretière, B. Lee, B. Kakaradov, J. Stamberger, and A. Paepcke. ButterflyNet: A Mobile Capture and Access System for Field Biology Research. In Proc. CHI '06, pages 571--580.

Digital Library

[28]

R. B. Yeh, A. Paepcke, and S. R. Klemmer. Iterative Design and Evaluation of an Event Architecture for Pen and Paper Interfaces. In Proc. UIST '08, pages 111--120.

Digital Library

Cited By

Han FCheng YStrachan MMa X(2021)Hybrid Paper-Digital Interfaces: A Systematic Literature ReviewProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462059(1087-1100)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462059
Theureau J(2020)Cognição distribuída e curso de açãoLaboreal10.4000/laboreal.1650216:2Online publication date: 10-Nov-2020
https://doi.org/10.4000/laboreal.16502
Theureau J(2020)Distributed cognition and “Course of action”Cognition distribuée et Cours d’actionActivites10.4000/activites.536817:2Online publication date: 15-Oct-2020
https://doi.org/10.4000/activites.5368
Show More Cited By

Index Terms

Supporting an integrated paper-digital workflow for observational research
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing design and evaluation methods
  2. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Let's look at the cockpit: exploring mobile eye-tracking for observational research on the flight deck
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

As part of our research on multimodal analysis and visualization of activity dynamics, we are exploring the integration of data produced by a variety of sensor technologies within ChronoViz, a tool aimed at supporting the simultaneous visualization of ...
Digital pen and paper practices in observational research
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Researchers from many disciplines are taking advantage of increasingly inexpensive digital video to capture extensive records of human activity in real-world settings. The ability to record and share such data has created a critical moment in the ...
Supporting Large-scale Geographical Visualization in a Multi-granularity Way
WSDM '18: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining

Urban data (e.g., real estate data, crime data) often have multiple attributes which are highly geography-related. With the scale of data increases, directly visualizing millions of individual data points on top of a map would overwhelm users' ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

February 2011

504 pages

ISBN:9781450304191

DOI:10.1145/1943403

General Chairs:
Pearl Pu
EPFL, Switzerland
,
Michael Pazzani
Rutgers University, USA
,
Program Chairs:
Elisabeth André
Augsburg University, Germany
,
Doug Riecken
CCLS Columbia University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 February 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IUI '11

Sponsor:

IUI '11: 16th International Conference on Intelligent User Interfaces

February 13 - 16, 2011

CA, Palo Alto, USA

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
487
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Han FCheng YStrachan MMa X(2021)Hybrid Paper-Digital Interfaces: A Systematic Literature ReviewProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462059(1087-1100)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462059
Theureau J(2020)Cognição distribuída e curso de açãoLaboreal10.4000/laboreal.1650216:2Online publication date: 10-Nov-2020
https://doi.org/10.4000/laboreal.16502
Theureau J(2020)Distributed cognition and “Course of action”Cognition distribuée et Cours d’actionActivites10.4000/activites.536817:2Online publication date: 15-Oct-2020
https://doi.org/10.4000/activites.5368
Theureau J(2020)Cognition distribuée et Cours d’actionDistributed cognition and “Course of action”Activites10.4000/activites.530817:2Online publication date: 15-Oct-2020
https://doi.org/10.4000/activites.5308
Martinez-Maldonado RGoodyear PKay JThompson KCarvalho LKaye JDruin ALampe CMorris DHourcade J(2016)An Actionable Approach to Understand Group Experience in Complex, Multi-surface SpacesProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858213(2062-2074)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858213
Mosleh MBaba MMalek SAlhussein M(2015)Challenges of Digital Note TakingAdvanced Computer and Communication Engineering Technology10.1007/978-3-319-24584-3_19(211-231)Online publication date: 29-Dec-2015
https://doi.org/10.1007/978-3-319-24584-3_19
Marquardt NSchardong FTang A(2015)EXCITE: EXploring Collaborative Interaction in Tracked EnvironmentsHuman-Computer Interaction – INTERACT 201510.1007/978-3-319-22668-2_8(89-97)Online publication date: 30-Aug-2015
https://doi.org/10.1007/978-3-319-22668-2_8
Hutchins EWeibel NEmmenegger CFouse AHolder B(2013)An Integrative Approach to Understanding Flight Crew ActivityJournal of Cognitive Engineering and Decision Making10.1177/15553434134955477:4(353-376)Online publication date: 5-Jul-2013
https://doi.org/10.1177/1555343413495547
Schmidt DSas CGellersen HMackay WBrewster SBødker S(2013)Personal clipboards for individual copy-and-paste on shared multi-user surfacesProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2470654.2466457(3335-3344)Online publication date: 27-Apr-2013
https://dl.acm.org/doi/10.1145/2470654.2466457
Seifert JSimeone ASchmidt DHolleis PReinartz CWagner MGellersen HRukzio EShaer OShen CMorris MHorn M(2012)MobiSurfProceedings of the 2012 ACM international conference on Interactive tabletops and surfaces10.1145/2396636.2396644(51-60)Online publication date: 11-Nov-2012
https://dl.acm.org/doi/10.1145/2396636.2396644
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents