[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2858036.2858041acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

TouchTokens: Guiding Touch Patterns with Passive Tokens

Published: 07 May 2016 Publication History

Abstract

TouchTokens make it possible to easily build interfaces that combine tangible and gestural input using passive tokens and a regular multi-touch surface. The tokens constrain users' grasp, and thus, the relative spatial configuration of fingers on the surface, theoretically making it possible to design algorithms that can recognize the resulting touch patterns. We performed a formative user study to collect and analyze touch patterns with tokens of varying shape and size. The analysis of this pattern collection showed that individual users have a consistent grasp for each token, but that this grasp is user-dependent and that different grasp strategies can lead to confounding patterns. We thus designed a second set of tokens featuring notches that constrain users' grasp. Our recognition algorithm can classify the resulting patterns with a high level of accuracy (>95%) without any training, enabling application designers to associate rich touch input vocabularies with command triggers and parameter controls.

Supplementary Material

suppl.mov (pn0111-file3.mp4)
Supplemental video
MP4 File (p4189-gonzalez.mp4)

References

[1]
Leonardo Angelini, Denis Lalanne, Elise van den Hoven, Ali Mazalek, Omar Abou Khaled, and Elena Mugellini. 2015. Tangible Meets Gestural: Comparing and Blending Post-WIMP Interaction Paradigms. In Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, 473-476.
[2]
Gilles Bailly, Jörg Müller, and Eric Lecolinet. 2012. Design and Evaluation of Finger-count Interaction: Combining Multitouch Gestures and Menus. Int. J. Hum.-Comput. Stud. 70, 10 (Oct. 2012), 673-689.
[3]
Tom Bartindale and Chris Harrison. 2009. Stacks on the Surface: Resolving Physical Order Using Fiducial Markers with Structured Transparency. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, 57-60.
[4]
Tom Bartindale, Chris Harrison, Patrick Olivier, and Scott E. Hudson. 2011. SurfaceMouse: Supplementing Multi-touch Interaction with a Virtual Mouse. In Proceedings of the 5th International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, 293-296.
[5]
Patrick Baudisch, Torsten Becker, and Frederik Rudeck. 2010. Lumino: Tangible Blocks for Tabletop Computers Based on Glass Fiber Bundles. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, 1165-1174.
[6]
Hrvoje Benko, T. Scott Saponas, Dan Morris, and Desney Tan. 2009. Enhancing Input on and Above the Interactive Surface with Muscle Sensing. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, 93-100.
[7]
Hrvoje Benko, Andrew D Wilson, and Patrick Baudisch. 2006. Precise Selection Techniques for Multi-Touch Screens. In Proceedings of the SIGCHI conference on Human Factors in computing systems (CHI '06). 1263-1272.
[8]
Andrea Bianchi and Ian Oakley. 2013. Designing Tangible Magnetic Appcessories. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, 255-258.
[9]
Andrea Bianchi and Ian Oakley. 2015. MagnID: Tracking Multiple Magnetic Tokens. In Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, 61-68.
[10]
Eric A. Bier, Maureen C. Stone, Ken Pier, William Buxton, and Tony D. DeRose. 1993. Toolglass and Magic Lenses: The See-through Interface. In Proceedings of the 20th Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '93). ACM, 73-80.
[11]
Rachel Blagojevic and Beryl Plimmer. 2013. CapTUI: Geometric Drawing with Tangibles on a Capacitive Multi-touch Display. In Proceedings of INTERACT '13. Springer, 511-528.
[12]
Sebastian Boring, David Ledo, Xiang 'Anthony' Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The fat thumb: using the thumb's contact size for single-handed mobile interaction. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion (MobileHCI '12). ACM, 207-208.
[13]
Michael Bostock, Vadim Ogievetsky, and Jeffrey Heer. 2011. D3 Data-Driven Documents. IEEE Transactions on Visualization and Computer Graphics 17, 12 (Dec. 2011), 2301-2309.
[14]
Bryan Buchholz, Thomas J Armstrong, and Steven A Goldstein. 1992. Anthropometric data for describing the kinematics of the human hand. Ergonomics 35, 3 (1992), 261-273.
[15]
Wolfgang Büschel, Ulrike Kister, Mathias Frisch, and Raimund Dachselt. 2014. T4 - Transparent and Translucent Tangibles on Tabletops. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '14). ACM, 81-88.
[16]
Xiang Cao, A.D. Wilson, R. Balakrishnan, K. Hinckley, and S.E. Hudson. 2008. ShapeTouch: Leveraging contact shape on interactive surfaces. In Proceedings of the 3rd International Workshop on Horizontal Interactive Human Computer Systems (TABLETOP '08). IEEE, 129-136.
[17]
Liwei Chan, Stefanie Müller, Anne Roudaut, and Patrick Baudisch. 2012. CapStones and ZebraWidgets: Sensing Stacks of Building Blocks, Dials and Sliders on Capacitive Touch Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 2189-2192.
[18]
George W. Fitzmaurice, Hiroshi Ishii, and William A. S. Buxton. 1995. Bricks: Laying the Foundations for Graspable User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '95). ACM Press/Addison-Wesley Publishing Co., 442-449.
[19]
Dustin Freeman, Hrvoje Benko, Meredith Ringel Morris, and Daniel Wigdor. 2009. ShadowGuides: Visualizations for In-situ Learning of Multi-touch and Whole-hand Gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, 165-172.
[20]
Mathias Frisch, Sebastian Kleinau, Ricardo Langner, and Raimund Dachselt. 2011. Grids & Guides: Multi-touch Layout and Alignment Tools. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, 1615-1618.
[21]
Emilien Ghomi, Stéphane Huot, Olivier Bau, Michel Beaudouin-Lafon, and Wendy E. Mackay. 2013. Arpège: Learning Multitouch Chord Gestures Vocabularies. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '13). ACM, 209-218.
[22]
Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011. TapSense: Enhancing Finger Interaction on Touch Surfaces. In Proceedings of the 24th ACM Symposium on User Interface Software and Technology (UIST '11). ACM, 627-636.
[23]
Chris Harrison, Robert Xiao, Julia Schwarz, and Scott E. Hudson. 2014. TouchTools: Leveraging Familiarity and Skill with Physical Tools to Augment Touch Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, 2913-2916.
[24]
Björn Hartmann, Meredith Ringel Morris, Hrvoje Benko, and Andrew D. Wilson. 2009. Augmenting Interactive Tables with Mice & Keyboards. In Proceedings of the 22nd ACM Symposium on User Interface Software and Technology (UIST '09). ACM, 149-152.
[25]
Seongkook Heo and Geehyuk Lee. 2011. Force Gestures: Augmenting Touch Screen Gestures with Normal and Tangential Forces. In Proceedings of the 24th ACM Symposium on User Interface Software and Technology (UIST '11). ACM, 621-626.
[26]
Lars Erik Holmquist, Johan Redström, and Peter Ljungstrand. 1999. Token-Based Access to Digital Information. In Proceedings of the 1st International Symposium on Handheld and Ubiquitous Computing (HUC '99). Springer-Verlag, 234-245. http://dl.acm.org/citation.cfm?id=647985.743869
[27]
Christian Holz and Patrick Baudisch. 2013. Fiberio: A Touchscreen That Senses Fingerprints. In Proceedings of the 26th ACM Symposium on User Interface Software and Technology (UIST '13). ACM, 41-50.
[28]
Yvonne Jansen, Pierre Dragicevic, and Jean-Daniel Fekete. 2012. Tangible Remote Controllers for Wall-size Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 2865-2874.
[29]
Hans-Christian Jetter, Jens Gerken, Michael Zöllner, Harald Reiterer, and Natasa Milic-Frayling. 2011. Materializing the Query with Facet-streams: A Hybrid Surface for Collaborative Search on Tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, 3013-3022.
[30]
Sergi Jordà, Günter Geiger, Marcos Alonso, and Martin Kaltenbrunner. 2007. The reacTable: Exploring the Synergy Between Live Music Performance and Tabletop Tangible Interfaces. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI '07). ACM, 139-146.
[31]
Martin Kaltenbrunner and Ross Bencina. 2007. reacTIVision: A Computer-vision Framework for Table-based Tangible Interaction. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI '07). ACM, 69-74.
[32]
Hideki Koike, Wataru Nishikawa, and Kentaro Fukuchi. 2009. Transparent 2-D Markers on an LCD Tabletop System. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, 163-172.
[33]
Sven Kratz, Tilo Westermann, Michael Rohs, and Georg Essl. 2011. CapWidgets: Tangible Widgets Versus Multi-touch Controls on Mobile Devices. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, 1351-1356.
[34]
Rong-Hao Liang, Kai-Yin Cheng, Liwei Chan, Chuan-Xhyuan Peng, Mike Y. Chen, Rung-Huei Liang, De-Nian Yang, and Bing-Yu Chen. 2013. GaussBits: Magnetic Tangible Bits for Portable and Occlusion-free Near-surface Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, 1391-1400.
[35]
Rong-Hao Liang, Han-Chih Kuo, Liwei Chan, De-Nian Yang, and Bing-Yu Chen. 2014. GaussStones: Shielded Magnetic Tangibles for Multi-token Interactions on Portable Displays. In Proceedings of the 27th ACM Symposium on User Interface Software and Technology (UIST '14). ACM, 365-372.
[36]
Jack M Loomis and Susan J Lederman. 1986. Tactual perception. In Handbook of Perception and Human Performance, K. R. Boff, L. Kaufman, and J. P. Thomas (Eds.). John Wiley & Sons.
[37]
Halla Olafsdottir and Caroline Appert. 2014. Multi-touch Gestures for Discrete and Continuous Control. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '14). ACM, 177-184.
[38]
Halla Olafsdottir, Theophanis Tsandilas, and Caroline Appert. 2014. Prospective Motor Control on Tabletops: Planning Grasp for Multitouch Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, 2893-2902.
[39]
Brandon Paulson, Danielle Cummings, and Tracy Hammond. 2011. Object Interaction Detection Using Hand Posture Cues in an Office Setting. Int. J. Hum.-Comput. Stud. 69, 1--2 (Jan. 2011), 19-29.
[40]
Jun Rekimoto. 2002. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, 113-120.
[41]
Jun Rekimoto, Brygg Ullmer, and Haruo Oba. 2001. DataTiles: A Modular Platform for Mixed Physical and Graphical Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01). ACM, 269-276.
[42]
Marco Santello and John F Soechting. 1998. Gradual molding of the hand to object contours. Journal of neurophysiology 79, 3 (1998), 1307-1320.
[43]
Atsushi Sugiura and Yoshiyuki Koseki. 1998. A User Interface Using Fingerprint Recognition: Holding Commands and Data Objects on Fingers. In Proceedings of the 11th ACM Symposium on User Interface Software and Technology (UIST '98). ACM, 71-79.
[44]
Brygg Ullmer, Hiroshi Ishii, and Dylan Glas. 1998. mediaBlocks: Physical Containers, Transports, and Controls for Online Media. In Proceedings of the 25th Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '98). ACM, 379-386.
[45]
Brygg Ullmer, Hiroshi Ishii, and Robert J. K. Jacob. 2003. Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries. In Proceedings of INTERACT '03. 279-286.
[46]
Consuelo Valdes, Diana Eastman, Casey Grote, Shantanu Thatte, Orit Shaer, Ali Mazalek, Brygg Ullmer, and Miriam K. Konkel. 2014. Exploring the Design Space of Gestural Interaction with Active Tokens Through User-defined Gestures. In Proceedings of the SIGCHI conference on Human Factors in computing systems (CHI '14). ACM, 4107-4116.
[47]
Radu-Daniel Vatavu and Ionu Alexandru Zaii. 2013. Automatic Recognition of Object Size and Shape via User-dependent Measurements of the Grasping Hand. Int. J. Hum.-Comput. Stud. 71, 5 (May 2013), 590-607.
[48]
Simon Voelker, Kosuke Nakajima, Christian Thoresen, Yuichi Itoh, Kjell Ivar Øvergård, and Jan Borchers. 2013. PUCs: Detecting Transparent, Passive Untouched Capacitive Widgets on Unmodified Multi-touch Displays. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '13). ACM, 101-104.
[49]
Daniel Vogel and Géry Casiez. 2011. Conté: Multimodal Input Inspired by an Artist's Crayon. In Proceedings of the 24th ACM Symposium on User Interface Software and Technology (UIST '11). ACM, 357-366.
[50]
Malte Weiss, Julie Wagner, Yvonne Jansen, Roger Jennings, Ramsin Khoshabeh, James D. Hollan, and Jan Borchers. 2009. SLAP Widgets: Bridging the Gap Between Virtual and Physical Controls on Tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, 481-490.
[51]
Alexander Wiethoff, Hanna Schneider, Michael Rohs, Andreas Butz, and Saul Greenberg. 2012. Sketch-a-TUI: Low Cost Prototyping of Tangible Interactions Using Cardboard and Conductive Ink. In Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction (TEI '12). ACM, 309-312.
[52]
Daniel Wigdor, Hrvoje Benko, John Pella, Jarrod Lombardo, and Sarah Williams. 2011. Rock & Rails: Extending Multi-touch Interactions with Shape Gestures to Enable Precise Spatial Manipulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, 1581-1590.
[53]
Mike Wu and Ravin Balakrishnan. 2003. Multi-finger and Whole Hand Gestural Interaction Techniques for Multi-user Tabletop Displays. In Proceedings of the 16th ACM Symposium on User Interface Software and Technology (UIST '03). ACM, 193-202.
[54]
Mike Wu, Chia Shen, Kathy Ryall, Clifton Forlines, and Ravin Balakrishnan. 2006. Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces. In Proceedings of the 1st International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06). IEEE, 185-192.
[55]
Neng-Hao Yu, Sung-Sheng Tsai, I-Chun Hsiao, Dian-Je Tsai, Meng-Han Lee, Mike Y. Chen, and Yi-Ping Hung. 2011. Clip-on Gadgets: Expanding Multi-touch Interaction Area with Unpowered Tactile Controls. In Proceedings of the 24th ACM Symposium on User Interface Software and Technology (UIST '11). ACM, 367-372.
[56]
Shumin Zhai, Per Ola Kristensson, Caroline Appert, Tue Haste Andersen, and Xiang Cao. 2012. Foundational Issues in Touch-Surface Stroke Gesture Design: An Integrative Review. Found. Trends Hum.-Comput. Interact. 5, 2 (Feb. 2012), 97-205.

Cited By

View all
  • (2024)The FlexiBoard: Tangible and Tactile Graphics for People with Vision ImpairmentsMultimodal Technologies and Interaction10.3390/mti80300178:3(17)Online publication date: 27-Feb-2024
  • (2024)Exploiting Physical Referent Features as Input for Multidimensional Data Selection in Augmented RealityACM Transactions on Computer-Human Interaction10.1145/364861331:4(1-40)Online publication date: 19-Sep-2024
  • (2024)TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking OnlyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642323(1-18)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. TouchTokens: Guiding Touch Patterns with Passive Tokens

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
    May 2016
    6108 pages
    ISBN:9781450333627
    DOI:10.1145/2858036
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 May 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Badges

    • Honorable Mention

    Author Tags

    1. multi-touch input
    2. tangible interaction

    Qualifiers

    • Research-article

    Conference

    CHI'16
    Sponsor:
    CHI'16: CHI Conference on Human Factors in Computing Systems
    May 7 - 12, 2016
    California, San Jose, USA

    Acceptance Rates

    CHI '16 Paper Acceptance Rate 565 of 2,435 submissions, 23%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)28
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 13 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)The FlexiBoard: Tangible and Tactile Graphics for People with Vision ImpairmentsMultimodal Technologies and Interaction10.3390/mti80300178:3(17)Online publication date: 27-Feb-2024
    • (2024)Exploiting Physical Referent Features as Input for Multidimensional Data Selection in Augmented RealityACM Transactions on Computer-Human Interaction10.1145/364861331:4(1-40)Online publication date: 19-Sep-2024
    • (2024)TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking OnlyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642323(1-18)Online publication date: 11-May-2024
    • (2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
    • (2022)Enabling Tangible Interaction on Non-touch Displays with Optical Mouse Sensor and Visible Light CommunicationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517666(1-14)Online publication date: 29-Apr-2022
    • (2021)Impact of the Size of Modules on Target Acquisition and Pursuit for Future Modular Shape-changing Physical User InterfacesProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479936(297-307)Online publication date: 18-Oct-2021
    • (2021)Shaping Concrete for InteractionProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440625(1-11)Online publication date: 14-Feb-2021
    • (2021)UltraPower: Powering Tangible & Wearable Devices with Focused UltrasoundProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440620(1-13)Online publication date: 14-Feb-2021
    • (2021)Combining Touchscreens with Passive Rich-ID Building Blocks to Support Context Construction in Touchscreen InteractionsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445722(1-14)Online publication date: 6-May-2021
    • (2021)WallTokens: Surface Tangibles for Vertical DisplaysProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445404(1-13)Online publication date: 6-May-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media