More Web Proxy on the site http://driver.im/

Article

Diagram editing on interactive displays using multi-touch and pen gestures

Authors:

Mathias Frisch,

Jens Heydekorn,

Raimund DachseltAuthors Info & Claims

Diagrams'10: Proceedings of the 6th international conference on Diagrammatic representation and inference

Pages 182 - 196

Published: 09 August 2010 Publication History

Abstract

Creating and editing graphs and node-link diagrams by means of digital tools are crucial activities in domains such as software or business process modeling. However, these tools have several drawbacks with regard to interaction techniques and usability. In order to address these issues, we investigate the promising combination of pen and multi-touch input on interactive displays. In this work, we contribute a gesture set to make the interaction with diagrams more efficient and effective by means of pen and hand gestures. Thereby, two prevalent mental models are supported: structural editing and sketching. The gesture set is based on the results of a previous pilot study asking users for suggestions to accomplish diagram editing tasks on tabletops. In this paper, we provide a careful analysis of the resulting user-elicited gestures. We propose solutions to resolve ambiguities within this gesture collection and discuss design decisions for a comprehensible diagram editor. We also present the multi-touch and pen gesture set as a fully implemented prototype for diagram editing on interactive surfaces.

References

[1]

Anoto Group AB, http://www.anoto.com/

[2]

Brandl, P., Forlines, C., Wigdor, D., Haller, M., Shen, C.: Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces. In: Proc. of AVI 2008, pp. 154-161. ACM, New York (2008)

Digital Library

[3]

Brandl, P., Haller, M., Hurnaus, M., Lugmayr, V., Oberngruber, J., Oster, C., Schafleitner, C., Billinghurst, M.: An Adaptable Rear-Projection Screen Using Digital Pens And Hand Gestures. In: Proc. of ICAT 2007, pp. 49-54. IEEE Computer Society, Los Alamitos (2007)

Digital Library

[4]

Cao, X., Wilson, A.D., Balakrishnan, R., Hinckley, K., Hudson, S.E.: ShapeTouch: Leveraging Contact Shape on Interactive Surfaces. In: Proc. of TABLETOP 2008, pp. 139-146 (2008)

[5]

Chen, Q., Grundy, J., Hosking, J.: An e-whiteboard application to support early designstage sketching of UML diagrams. In: Proc. of HCC 2003, pp. 219-226. IEEE, Los Alamitos (2003)

Digital Library

[6]

Cherubini, M., Venolia, G., DeLine, R., Ko, A.J.: Let's go to the whiteboard: how and why software developers use drawings. In: Proc. of CHI 2007, pp. 557-566. ACM, New York (2007)

Digital Library

[7]

Community Core Vision, NUI Group, http://ccv.nuigroup.com/

[8]

Damm, C.H., Hansen, K.M., Thomsen, M.: Tool support for cooperative object-oriented design: gesture based modeling on an electronic whiteboard. In: Proc. of CHI 2000, pp. 518-525. ACM, New York (2000)

Digital Library

[9]

Dekel, U.: Supporting distributed software design meetings: what can we learn from colocated meetings? In: Proc. of HSSE 2005, pp. 1-7. ACM, New York (2005)

Digital Library

[10]

Dietz, P., Leigh, D.: DiamondTouch: a multi-user touch technology. In: Proc. of UIST 2001, pp. 219-226. ACM, New York (2001)

Digital Library

[11]

Dwyer, T., Lee, B., Fisher, D., Quinn, K.I., Isenberg, P., Robertson, G., North, C.: A Comparison of User-Generated and Automatic Graph Layouts. IEEE Trans. on Visualization and Computer Graphics 15(6), 961-968 (2009)

Digital Library

[12]

Epps, J., Lichman, S., Wu, M.: A study of hand shape use in tabletop gesture interaction. In: CHI 2006 Ext. Abstracts, pp. 748-753. ACM, New York (2006)

Digital Library

[13]

Freeman, D., Benko, H., Morris, M.R., Wigdor, D.: ShadowGuides: Visualizations for In-Situ Learning of Multi-Touch and Whole-Hand Gestures. In: Proc. ACM ITS 2009, pp. 183-190. ACM, New York (2009)

Digital Library

[14]

Frisch, M., Heydekorn, J., Dachselt, R.: Investigating Multi-Touch and Pen Gestures for Diagram Editing on Interactive Surfaces. In: Proc. of ACM IST 2009, pp. 167-174. ACM, New York (2009)

[15]

Grundy, J., Hosking, J.: Supporting Generic Sketching-Based Input of Diagrams in a Domain-Specific Visual Language Meta-Tool. In: Pro. of ICSE 2007, pp. 282-291 (2007)

Digital Library

[16]

Guiard, Y.: Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model. The Journal of Motor Behavior 19(4), 486-517 (1987)

[17]

Hammond, T., Davis, R.: Tahuti: a geometrical sketch recognition system for UML class diagrams. In: ACM SIGGRAPH 2006 Courses. ACM, New York (2006)

Digital Library

[18]

Han, J.Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In: Proc. of UIST 2005, pp. 115-118. ACM, New York (2005)

Digital Library

[19]

Leitner, J., Powell, J., Brandl, P., Seifried, T., Haller, M., Dorray, B., To, P.: Flux: a tilting multi-touch and pen based surface. In: CHI 2009 Ext. Abstracts, pp. 3211-3216. ACM, New York (2009)

Digital Library

[20]

Malik, S., Ranjan, A., Balakrishnan, R.: Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In: Proc. UIST 2005, pp. 43-52. ACM, New York (2005)

Digital Library

[21]

Micire, M., Desai, M., Courtemanche, A., Tsui, K., Yanco, H.: Analysis of Natural Gestures for Controlling Robot Teams on Multi-touch Tabletop Surfaces. In: Proc. ACM IST 2009. ACM, New York (2009)

Digital Library

[22]

Microsoft Surface, http://www.microsoft.com/surface/

[23]

Moran, T.P., Chiu, P., van Melle, W.: Pen-based interaction techniques for organizing material on an electronic whiteboard. In: Proc. UIST 1997, pp. 45-54. ACM, New York (1997)

Digital Library

[24]

Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 409-420. Springer, Heidelberg (2004)

[25]

Rekimoto, J.: SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In: Proc. CHI 2002, pp. 113-120. ACM, New York (2002)

Digital Library

[26]

Ringel, M., Ryall, K., Shen, C., Forlines, C., Vernier, F.: Release, relocate, reorient, resize: fluid techniques for document sharing on multi-user interactive tables. In: Ext. Abstracts CHI 2004, pp. 1441-1444. ACM, New York (2004)

Digital Library

[27]

TUIO Protocol, http://www.tuio.org/

[28]

Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proc. of CHI 2009, pp. 1083-1092. ACM, New York (2009)

Digital Library

[29]

Wu, M., Balakrishnan, R.: Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In: Proc. of UIST 2003, pp. 193-202. ACM, New York (2003)

Digital Library

[30]

Wu, M., Shen, C., Ryall, K., Forlines, C., Balakrishnan, R.: Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces. In: Proc. TABLETOP 2006, pp. 185-192. IEEE, Los Alamitos (2006)

Digital Library

[31]

Yee, K.: Two-handed interaction on a tablet display. In: Ext. Abs. CHI 2004, pp. 1493- 1496. ACM, New York (2004)

Digital Library

Cited By

Kister UKlamka KTominski CDachselt R(2017)GraSpComputer Graphics Forum10.1111/cgf.1320636:3(503-514)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1111/cgf.13206
Kister UReipschläger PDachselt RHancock MMarquardt NSchöning JTory M(2016)MultiLensProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2992168(139-148)Online publication date: 6-Nov-2016
https://dl.acm.org/doi/10.1145/2992154.2992168
Wong-Villacres MBarzola VGranda RGarcia K(2016)Portable TabletopsProceedings, Part II, of the 18th International Conference on Human-Computer Interaction. Interaction Platforms and Techniques - Volume 973210.1007/978-3-319-39516-6_23(241-252)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1007/978-3-319-39516-6_23
Show More Cited By

Diagram editing on interactive displays using multi-touch and pen gestures
1. Human-centered computing

Recommendations

Investigating multi-touch and pen gestures for diagram editing on interactive surfaces
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

Creating and editing large graphs and node-link diagrams are crucial activities in many application areas. For them, we consider multi-touch and pen input on interactive surfaces as very promising. This fundamental work presents a user study ...
Grips and gestures on a multi-touch pen
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This paper explores the interaction possibilities enabled when the barrel of a digital pen is augmented with a multi-touch sensor. We present a novel multi-touch pen (MTPen) prototype and discuss its alternate uses beyond those of a standard stylus, ...
An experimental comparison of touch and pen gestures on a vertical display
PerDis '19: Proceedings of the 8th ACM International Symposium on Pervasive Displays

We present results of a user study that compared touch and pen gestures on a vertical large display in terms of precision, duration, and difficulty. Results of the study revealed that touch gestures were significantly faster, while pen gestures were ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

Diagrams'10: Proceedings of the 6th international conference on Diagrammatic representation and inference

August 2010

356 pages

ISBN:364214599X

Editors:
Ashok K. Goel
School of Interactive Computing, Georgia Institute of Technology, Design & Intelligence Laboratory, Atlanta, GA
,
Mateja Jamnik
University of Cambridge, Computer Laboratory, Cambridge, UK
,
N. Hari Narayanan
Auburn University, Department of Computer Science & Software Engineering, Auburn, AL

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 09 August 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kister UKlamka KTominski CDachselt R(2017)GraSpComputer Graphics Forum10.1111/cgf.1320636:3(503-514)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1111/cgf.13206
Kister UReipschläger PDachselt RHancock MMarquardt NSchöning JTory M(2016)MultiLensProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2992168(139-148)Online publication date: 6-Nov-2016
https://dl.acm.org/doi/10.1145/2992154.2992168
Wong-Villacres MBarzola VGranda RGarcia K(2016)Portable TabletopsProceedings, Part II, of the 18th International Conference on Human-Computer Interaction. Interaction Platforms and Techniques - Volume 973210.1007/978-3-319-39516-6_23(241-252)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1007/978-3-319-39516-6_23
Rangoni YMaquil VTobias ERas EPaternò FSantoro CZiegler J(2014)Implementing widgets using sifteo cubes for visual modelling on tangible user interfacesProceedings of the 2014 ACM SIGCHI symposium on Engineering interactive computing systems10.1145/2607023.2610271(205-210)Online publication date: 17-Jun-2014
https://dl.acm.org/doi/10.1145/2607023.2610271
Matulic FNorrie MQuigley AJacucci GHorn MNacenta M(2013)Pen and touch gestural environment for document editing on interactive tabletopsProceedings of the 2013 ACM international conference on Interactive tabletops and surfaces10.1145/2512349.2512802(41-50)Online publication date: 6-Oct-2013
https://dl.acm.org/doi/10.1145/2512349.2512802
Matulic FNorrie MAl Kabary ISchuldt HMackay WBrewster SBødker S(2013)Gesture-supported document creation on pen and touch tabletopsCHI '13 Extended Abstracts on Human Factors in Computing Systems10.1145/2468356.2468569(1191-1196)Online publication date: 27-Apr-2013
https://dl.acm.org/doi/10.1145/2468356.2468569
Matulic FNorrie MShaer OShen CMorris MHorn M(2012)Empirical evaluation of uni- and bimodal pen and touch interaction properties on digital tabletopsProceedings of the 2012 ACM international conference on Interactive tabletops and surfaces10.1145/2396636.2396659(143-152)Online publication date: 11-Nov-2012
https://dl.acm.org/doi/10.1145/2396636.2396659
Frisch MLangner RDachselt RRekimoto JKoike HFukuchi KKitamura YWigdor D(2011)NeatProceedings of the ACM International Conference on Interactive Tabletops and Surfaces10.1145/2076354.2076356(1-10)Online publication date: 13-Nov-2011
https://dl.acm.org/doi/10.1145/2076354.2076356
Lopes PMendes DAraújo BJorge JDo ELeon JHammond TNealen A(2011)Combining bimanual manipulation and pen-based input for 3D modellingProceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling10.1145/2021164.2021168(15-22)Online publication date: 5-Aug-2011
https://dl.acm.org/doi/10.1145/2021164.2021168
Hinrichs UCarpendale STan DFitzpatrick GGutwin CBegole BKellogg W(2011)Gestures in the wildProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1978942.1979391(3023-3032)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1978942.1979391
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents