More Web Proxy on the site http://driver.im/

research-article

Knotty gestures: subtle traces to support interactive use of paper

Authors:

Theophanis Tsandilas,

Wendy E. MackayAuthors Info & Claims

AVI '10: Proceedings of the International Conference on Advanced Visual Interfaces

Pages 147 - 154

https://doi.org/10.1145/1842993.1843020

Published: 26 May 2010 Publication History

Abstract

We introduce the knotty gesture, a simple yet powerful technique for interacting with paper. Knots are tiny circles that can be added to any gesture. Users can leave subtle marks that permit both immediate interaction in the flow of writing and create rich opportunities for future interaction. We identify diverse applications of knotty gestures and explore alternative techniques for interacting with their traces. We conducted two experiments to evaluate the design and recognition heuristics and demonstrated that people can successfully execute knotty gestures, even without feedback. Knotty gestures provide users with a subtle, in-the-flow-of-writing technique for tagging information and subsequently interacting with the paper.

References

[1]

Avrahami, D., Hudson, S., Hudson, S., Moran, T., & Williams, B. (2001) Guided gesture support in the paper PDA. In Proc. UIST'01 ACM, pp. 197--198.

Digital Library

[2]

Bau, O. & Mackay, W. (2008) Octopocus: a dynamic guide for learning gesture-based command sets. In Proc. UIST'08, 37--46. ACM, pp. 173--182.

Digital Library

[3]

Cao, X. & Zhai, S. (2007) Modeling human performance of pen stroke gestures. In Proc. CHI'07 ACM. pp. 495--1504.

Digital Library

[4]

Hinckley, K., P. Baudisch, G. Ramos, & F. Guimbretièère. Design and analysis of delimiters for selection-action pen gesture phrases in Scriboli. In Proc. CHI 2005, ACM (2005), 451--460.

Digital Library

[5]

Hinckley, K., S. Zhao, R. Sarin, P. Baudisch, and E. Cutrell (2007). InkSeine: In Situ Search for Active Note Taking. In Proc. CHI 2007, pp. 251--260.

Digital Library

[6]

Huber, R. & A. M. Headrick, Handwriting identification: facts and fundamentals. 1999: CRC Press.

[7]

Kurtenbach, G. & Buxton, W. (1993) The limits of expert performance using hierarchic marking menus. In Proc. CHI '93 ACM. p. 482--487.

Digital Library

[8]

Liao, C., F. Guimbretière & K. Hinckley. PapierCraft: a command system for interactive paper. In Proc. UIST 2005, ACM Press (2005), 241--244.

Digital Library

[9]

Liao, C., F. Guimbretière, & C. Loeckenhoff. Pen-top Feedback for Paper-based Interfaces. In Proc. UIST 2006, ACM Press (2006), 201--210.

Digital Library

[10]

Mackay, W. E., Pothier, G., Letondal, C., Bøegh, K., & Søørensen, H. E. (2002). The missing link: augmenting biology laboratory notebooks. In Proc UIST 2002, ACM, pp. 41--50.

Digital Library

[11]

Mankoff, J., Hudson, S., & Abowd, G. (2000) Interaction techniques for ambiguity resolution in recognition-based interfaces. In Proc. UIST '00 ACM. pp. 11--20.

Digital Library

[12]

Moscovich, T. and Hughes, J. F. (2004). Navigating documents with the virtual scroll ring. In Proc. UIST '04. ACM Press, pp. 57--60.

Digital Library

[13]

Smith, G. M. and m. c. schraefel (2004). The radial scroll tool: scrolling support for stylus- or touch-based document navigation. In Proc. UIST '04, ACM Press, 53--56.

Digital Library

[14]

Song, H., Grossman, T., Fitzmaurice, G., Guimbretiere, F., Khan, A., Attar, R., and Kurtenbach, G. (2009) PenLight: combining a mobile projector and a digital pen for dynamic visual overlay. In Proc. CHI '09. ACM, pp. 143--152.

Digital Library

[15]

Song, H., F. Guimbretière, C. Hu and H. Lipson. Model-Craft: capturing freehand annotations and edits on physical 3D models. In Proc. UIST 2006, ACM Press (2006), 13--22.

Digital Library

[16]

Tabard, A., Eastmond, E. & Mackay, W. From Individual to Collaborative: The Evolution of Prism, a Hybrid Laboratory Notebook. In Proc. CSCW '08, ACM Press (2008), 569--578.

Digital Library

[17]

Tsandilas, T., C. Letondal & W. E. Mackay. Musink: composing music through augmented drawing. In Proc. CHI 2009, ACM Press (2009), 819--828.

Digital Library

[18]

Weibel, N., Ispas, A., Signer, B., and Norrie, M. C. 2008. Paperproof: a paper-digital proof-editing system. In Extended Abstracts CHI '08. ACM, pp. 2349--2354.

Digital Library

[19]

Wellner P. Interacting with the DigitalDesk. Communications of the ACM, 1993. 36(7), p. 87--96.

Digital Library

[20]

Wobbrock, J. O., A. D. Wilson & Y. Li. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proc. UIST 2007, ACM Press (2007), 159--168.

Digital Library

[21]

Yeh, R., C. Liao, S. Klemmer, F. Guimbretière, B. Lee, B. Kakaradov, J. Stamberger, & A. Paepcke. ButterflyNet: A Mobile Capture and Access System for Field Biology Research. In Proc. CHI 2006, ACM Press (2006), 571--580.

Digital Library

[22]

Zeleznik, R., Miller, T., Holden, L., LaViola, J., Fluid Inking: Using Punctuation to Allow Modeless Combination of Marking and Gesturing. 2004, Brown University, TR CS-04-11.

[23]

Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., and Baudisch, P. 2007. EarPod: eyes-free menu selection using touch input and reactive audio feedback. In Proc. CHI '07. ACM, pp. 1395--140.

Digital Library

Cited By

Hsueh SCiolfi Felice MAlaoui SMackay W(2024)What Counts as ‘Creative’ Work? Articulating Four Epistemic Positions in Creativity-Oriented HCI ResearchProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642854(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642854
Beaudouin-Lafon MBødker SMackay W(2021)Generative Theories of InteractionACM Transactions on Computer-Human Interaction10.1145/346850528:6(1-54)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1145/3468505
Pohl HMuresan AHornbæk KBrewster SFitzpatrick GCox AKostakos V(2019)Charting Subtle Interaction in the HCI LiteratureProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300648(1-15)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300648
Show More Cited By

Index Terms

Knotty gestures: subtle traces to support interactive use of paper
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

A comparative evaluation of finger and pen stroke gestures
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This paper reports an empirical investigation in which participants produced a set of stroke gestures with varying degrees of complexity and in different target sizes using both the finger and the pen. The recorded gestures were then analyzed according ...
Differences and Similarities between Finger and Pen Stroke Gestures on Stationary and Mobile devices

This study investigated differences and similarities between finger and pen gestures on stationary devices (sitting posture) and mobile devices (sitting and walking postures). The recorded gestures were analyzed according to multiple gesture features. We ...
Visual similarity of pen gestures
CHI '00: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

Pen-based user interfaces are becoming ever more popular. Gestures (i.e., marks made with a pen to invoke a command) are a valuable aspect of pen-based UIs, but they also have drawbacks. The challenge in designing good gestures is to make them easy for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

AVI '10: Proceedings of the International Conference on Advanced Visual Interfaces

May 2010

427 pages

ISBN:9781450300766

DOI:10.1145/1842993

Editor:
Giuseppe Santucci
Dipartimento di Informatica e Sistemistica, Sapienza Universita di Roma, Italy

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Consulta Umbria SRL

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 May 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AVI '10

Sponsor:

AVI '10: The International Conference on Advanced Visual Interfaces

May 26 - 28, 2010

Roma, Italy

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
351
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)3

Reflects downloads up to 17 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hsueh SCiolfi Felice MAlaoui SMackay W(2024)What Counts as ‘Creative’ Work? Articulating Four Epistemic Positions in Creativity-Oriented HCI ResearchProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642854(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642854
Beaudouin-Lafon MBødker SMackay W(2021)Generative Theories of InteractionACM Transactions on Computer-Human Interaction10.1145/346850528:6(1-54)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1145/3468505
Pohl HMuresan AHornbæk KBrewster SFitzpatrick GCox AKostakos V(2019)Charting Subtle Interaction in the HCI LiteratureProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300648(1-15)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300648
Wanderley MMackay W(2019)HCI, Music and Art: An Interview with Wendy MackayNew Directions in Music and Human-Computer Interaction10.1007/978-3-319-92069-6_7(115-120)Online publication date: 7-Feb-2019
https://doi.org/10.1007/978-3-319-92069-6_7
Ciolfi Felice MFdili Alaoui SMackay WMandryk RHancock MPerry MCox A(2018)KnotationProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174022(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174022
Tsandilas TGrammatikou MHuot SNunes NCostanza EOlivier PSchöning J(2015)BricoSketchProceedings of the 2015 International Conference on Interactive Tabletops & Surfaces10.1145/2817721.2817729(127-136)Online publication date: 15-Nov-2015
https://dl.acm.org/doi/10.1145/2817721.2817729
Signer BNorrie MWeibel NIspas A(2014)Advanced authoring of paper-digital systemsMultimedia Tools and Applications10.1007/s11042-012-1217-770:2(1309-1332)Online publication date: 1-May-2014
https://dl.acm.org/doi/10.1007/s11042-012-1217-7
Leitner JPerteneder FLiu CRendl CHaller MMackay WBrewster SBødker S(2013)KolibriProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2470654.2466236(1789-1798)Online publication date: 27-Apr-2013
https://dl.acm.org/doi/10.1145/2470654.2466236
Tsandilas TMiller RBenko HLatulipe C(2012)Interpreting strokes on paper with a mobile assistantProceedings of the 25th annual ACM symposium on User interface software and technology10.1145/2380116.2380155(299-308)Online publication date: 7-Oct-2012
https://dl.acm.org/doi/10.1145/2380116.2380155
Pietrzak TMalacria SLecolinet É(2012)S-NotebookProceedings of the International Working Conference on Advanced Visual Interfaces10.1145/2254556.2254696(733-736)Online publication date: 21-May-2012
https://dl.acm.org/doi/10.1145/2254556.2254696
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents