More Web Proxy on the site http://driver.im/

research-article

PenLight: combining a mobile projector and a digital pen for dynamic visual overlay

Authors:

Hyunyoung Song,

George Fitzmaurice,

François Guimbretiere,

Gordon KurtenbachAuthors Info & Claims

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 143 - 152

https://doi.org/10.1145/1518701.1518726

Published: 04 April 2009 Publication History

Abstract

Digital pen systems, originally designed to digitize annotations made on physical paper, are evolving to permit a wider variety of applications. Although the type and quality of pen feedback (e.g., haptic, audio, and visual) have a huge impact on advancing the digital pen technology, dynamic visual feedback has yet to be fully investigated. In parallel, miniature projectors are an emerging technology with the potential to enhance visual feedback for small mobile computing devices. In this paper we present the PenLight system, which is a testbed to explore the interaction design space and its accompanying interaction techniques in a digital pen embedded with a spatially-aware miniature projector. Using our prototype, that simulates a miniature projection (via a standard video projector), we visually augment paper documents, giving the user immediate access to additional information and computational tools. We also show how virtual ink can be managed in single and multi-user environments to aid collaboration and data management. User evaluation with professional architects indicated promise of our proposed techniques and their potential utility in the paper-intensive domain of architecture.

Supplementary Material

JPG File (3.jpg)

Download
16.43 KB

JPG File (p143.jpg)

Download
14.98 KB

FLV File (3.flv)

Download
22.89 MB

WMV File (p143.wmv)

Download
28.54 MB

References

[1]

Anoto, Development Guide for Service Enabled by Anoto Functionality. 2002, Anoto.

[2]

Apitz, G. and F. Guimbretiere. CrossY: A Crossing-Based Drawing Application. Proceedings of UIST'04, pp. 3 -- 12.

Digital Library

[3]

Arai, T., D. Aust, and S.E. Hudson. PaperLink: a technique for hyperlinking from real paper to electronic content. Proceedings of CHI'97, pp. 327 -- 334.

Digital Library

[4]

Arvo, J. and K. Novins. Fluid sketches: continuous recognition and morphing of simple hand-drawn shapes. Proceedings of UIST'00, pp. 73--80.

Digital Library

[5]

Baudisch, P. and R. Rosenholtz, Halo: a technique for visualizing off-screen objects, in Proceedings of the SIGCHI conference on Human factors in computing systems. 2003, ACM: Ft. Lauderdale, Florida, USA.

Digital Library

[6]

Bier, E.A., M.C. Stone, K. Pier, W. Buxton, and T.D. DeRose. Toolglass and magic lenses: the see-through interface. Proceedings of SigGraph'93, pp. 73 -- 80.

Digital Library

[7]

Cao, X. and R. Balakrishnan. Interacting with dynamically defined information spaces using a handheld projector and a pen. Proceedings of UIST '06, pp. 225--234.

Digital Library

[8]

Cao, X., C. Forlines, and R. Balakrishnan, Multi-user interaction using handheld projectors, in Proceedings of UIST'07, ACM: Newport, Rhode Island, USA. p. 43--52.

Digital Library

[9]

Eastman, C., P. Teicholz, R. Sacks, and K. Liston, BIM Handbook: A Guide to Building Information Modeling for Owners, Managers, Designers, Engineers and Contractors. 2008: Wiley.

Digital Library

[10]

Erwin, D.E., Further Evidence for Two Components in Visual Persistence. Journal of Experimental Psychology: Human Perception and Performance, 2, 2, 191--209, 1976.

[11]

Fitzmaurice, G.W., Situated information spaces and spatially aware palmtop computers. Communications of the ACM, 1993. 36(7): p. 39 -- 49.

Digital Library

[12]

Flagg, M. and J.M. Rehg, Projector-guided painting, in Proceedings of UIST'06, ACM: Montreux, Switzerland. p. 235--244.

Digital Library

[13]

Flypentop, Flypentop Computer http://www.flypentop.com/.

[14]

Forlines, C., R. Balakrishnan, P. Beardsley, J.v. Baar, and R. Raskar, Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors, in Proceedings of the UIST'05, ACM: Seattle, WA, USA. p. 73--82.

Digital Library

[15]

Grossman, T., K. Hinckley, P. Baudisch, M. Agrawala, and R. Balakrishnan, Hover widgets: using the tracking state to extend the capabilities of pen-operated devices, in Proceedings of the SIGCHI '06, ACM: Montreal, Quebec, Canada. p. 861--870.

Digital Library

[16]

Guimbretiere, F. Paper Augmented Digital Documents. Proceedings of UIST'03, pp. 51 -- 60.

Digital Library

[17]

Heikkila, J. and O. Silven. A Four-step Camera Calibration Procedure with Implicit Image Correction. Proceedings of CVPR'97, pp.

Digital Library

[18]

Heiner, J.M., S.E. Hudson, and K. Tanaka. Linking and messaging from real paper in the Paper PDA. Proceedings of UIST'99, pp. 179 -- 186.

Digital Library

[19]

Hinckley, K., R. Pausch, J.C. Goble, and N.F. Kassell, A survey of design issues in spatial input, in Proceedings of the 7th annual ACM symposium on User interface software and technology. 1994, ACM: Marina del Rey, California, United States.

Digital Library

[20]

Holman, D., R. Vertegaal, M. Altosaar, N. Troje, and D. Johns, Paper windows: interaction techniques for digital paper, in Proceedings of the SIGCHI conference on Human factors in computing systems. 2005, ACM: Portland, Oregon, USA.

Digital Library

[21]

Keisuke, T., K. Itaru, and O. Yuichi, A nested marker for augmented reality, in ACM SIGGRAPH 2006 Sketches. 2006, ACM: Boston, Massachusetts.

Digital Library

[22]

Lee, C.J., H.P. Dietz, D. Leigh, S.W. Yerazunis, and E.S. Hudson. Haptic pen: a tactile feedback stylus for touch screens. Proceedings of UIST'04, pp. 291--294.

Digital Library

[23]

Liao, C., F. Guimbretière, and C.E. Loeckenhoff. Pen-top feedback for paper-based interfaces. Proceedings of UIST '06, pp. 201--210.

Digital Library

[24]

Liao, C., F. Guimbretière, K. Hinckley, and J. Hollan, Papiercraft: A gesture-based command system for interactive paper. ACM Trans. Comput.-Hum. Interact., 2008. 14(4): p. 1--27.

Digital Library

[25]

LiveScribe, http://www.livescribe.com/

[26]

Light Blue Optics http://www.lightblueoptics.com/

[27]

Mackay, W.E., D.S. Pagani, L. Faber, B. Inwood, P. Launiainen, L. Brenta, and V. Pouzol. Ariel: augmenting paper engineering drawings. Proceedings of CHI'95, pp. 421 -- 422.

Digital Library

[28]

Mackay, W.E., G. Pothier, C. Letondal, K. Bøegh, and H.E. Sørensen. The missing link: augmenting biology laboratory notebooks. Proceedings of UIST'02, pp. 41 -- 50.

Digital Library

[29]

Norman, D., Psychology of everyday things. 1988: Basic Books.

[30]

Perlin, K. and J. Meyer, Nested user interface components, in Proceedings of the 12th annual ACM symposium on User interface software and technology. 1999, ACM: Asheville, North Carolina, United States. p. 11--18.

Digital Library

[31]

Phelps, T.A. and R. Wilensky. Multivalent Annotations. Proceedings of ECDL'97, pp. 287 -- 303.

Digital Library

[32]

Signer, B. and M.C. Norrie. PaperPoint: a paper-based presentation and interactive paper prototyping tool. Proceedings of TEI'07, pp. 57--64.

Digital Library

[33]

Subramanian, S., D. Aliakseyeu, and A. Lucero, Multi-layer interaction for digital tables, in Proceedings of UIST06, ACM: Montreux, Switzerland. p. 269--272.

Digital Library

[34]

Tsang, M., G. Fitzmaurice, G. Kurtenbach, A. Khan, and B. Buxton. Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. Proceedings of UIST '02, pp. 111 -- 120.

Digital Library

[35]

MicroVision http://www.microvision.com/

[36]

Wellner, P., Interacting with paper on the DigitalDesk. Communications of the ACM, 1993. 36(7): p. 87 -- 96.

Digital Library

[37]

Yee, K. Peephole displays: pen interaction on spatially aware handheld computers. Proceedings of SIGCHI '03, pp. 1--8.

Digital Library

[38]

Yeh, R.B., C. Liao, S.R. Klemmer, F. Guimbretière, B. Lee, B. Kakaradov, J. Stamberger, and A. Paepcke. ButterflyNet: A Mobile Capture and Access System for Field Biology Research. Proceedings of CHI'06, pp.

Digital Library

[39]

Zhai, S., S. Conversy, M. Beaudouin-Lafon, and Y. Guiard, Human on-line response to target expansion, in Proceedings of the SIGCHI '03, ACM: Ft. Lauderdale, Florida, USA.

Digital Library

Cited By

Chen YCasiez GMalacria SVogel D(2024)LuxAR: A Direct Manipulation Projected Display to Extend and Augment Desktop ComputingProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670981(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670981
Maierhöfer VSchmid AWimmer RCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)TipTrack: Precise, Low-Latency, Robust Optical Pen Tracking on Arbitrary Surfaces Using an IR-Emitting Pen TipProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633366(1-13)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633366
Fang CHuang LKuang QLieberman ZMaes PIshii H(2024)An Accessible, Three-Axis Plotter for Enhancing Calligraphy Learning through Generated MotionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642792(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642792
Show More Cited By

Index Terms

PenLight: combining a mobile projector and a digital pen for dynamic visual overlay
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

MouseLight is a spatially-aware standalone mobile projector with the form factor of a mouse that can be used in combination with digital pens on paper. By interacting with the projector and the pen bimanually, users can visualize and modify the ...
On-mouse projector: extended workspace using a mouse with a projector
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

In this paper, we propose On-mouse projector, an interface that combines a mouse and a mobile projector. This system satisfies both portability and large information space and enables stable operation. The mobile projector is placed on the mouse and ...
On-mouse projector: peephole interaction using a mouse with a projector
MUM '17: Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia

In this paper, we propose a system that combines a mouse with a projector and that allows users to perform peephole interaction, which enables stable operation in a wide workspace. In our prototype system, a mobile projector is attached above a mouse ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2009

2426 pages

ISBN:9781605582467

DOI:10.1145/1518701

General Chairs:
Dan R. Olsen
Brigham Young University
,
Richard B. Arthur
Brigham Young University
,
Program Chairs:
Ken Hinckley
Microsoft Research
,
Meredith Ringel Morris
Microsoft Research
,
Scott Hudson
Carnegie Mellon University
,
Saul Greenberg
University of Calgary

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '09

Sponsor:

CHI '09: CHI Conference on Human Factors in Computing Systems

April 4 - 9, 2009

MA, Boston, USA

Acceptance Rates

CHI '09 Paper Acceptance Rate 277 of 1,130 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

74
Total Citations
View Citations
2,752
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)4

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen YCasiez GMalacria SVogel D(2024)LuxAR: A Direct Manipulation Projected Display to Extend and Augment Desktop ComputingProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670981(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670981
Maierhöfer VSchmid AWimmer RCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)TipTrack: Precise, Low-Latency, Robust Optical Pen Tracking on Arbitrary Surfaces Using an IR-Emitting Pen TipProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633366(1-13)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633366
Fang CHuang LKuang QLieberman ZMaes PIshii H(2024)An Accessible, Three-Axis Plotter for Enhancing Calligraphy Learning through Generated MotionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642792(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642792
Dogan MSiu AHealey JWigington CXiao CSun T(2023)StandARone: Infrared-Watermarked Documents as Portable Containers of AR Interaction and PersonalizationExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585905(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585905
Fender ARoberts TLuong THolz C(2023)InfinitePaint: Painting in Virtual Reality with Passive Haptics Using Wet Brushes and a Physical Proxy CanvasProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580927(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580927
Pourjafarian NMjaku FKoelle MSchmitz MBorchers JSteimle J(2023)Handheld Tools Unleashed: Mixed-Initiative Physical Sketching with a Robotic PrinterProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580691(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580691
Campos CKljun MSandak JČopič Pucihar K(2022)LightMeUp: Back-print Illumination Paper Display with Multi-stable VisualsProceedings of the ACM on Human-Computer Interaction10.1145/35703336:ISS(407-429)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3570333
Campos CKljun MČopič Pucihar K(2022)Dynamic Pinhole Paper: Interacting with Horizontal Displays through Perforated PaperProceedings of the ACM on Human-Computer Interaction10.1145/35677206:ISS(254-276)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567720
Lüthi GFender AHolz C(2022)DeltaPen: A Device with Integrated High-Precision Translation and Rotation Sensing on Passive SurfacesProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545655(1-12)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545655
Rajaram SNebeling M(2022)Paper Trail: An Immersive Authoring System for Augmented Reality Instructional ExperiencesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517486(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517486
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents