More Web Proxy on the site http://driver.im/

research-article

Haptic Edge Display for Mobile Tactile Interaction

Authors:

Lawrence H. Kim,

Sean FollmerAuthors Info & Claims

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Pages 3706 - 3716

https://doi.org/10.1145/2858036.2858264

Published: 07 May 2016 Publication History

Abstract

Current mobile devices do not leverage the rich haptic channel of information that our hands can sense, and instead focus primarily on touch based graphical interfaces. Our goal is to enrich the user experience of these devices through bi-directional haptic and tactile interactions (display and control) around the edge of hand-held devices. We propose a novel type of haptic interface, a Haptic Edge Display, consisting of actuated pins on the side of a display, to form a linear array of tactile pixels (taxels). These taxels are implemented using small piezoelectric actuators, which can be made cheaply and have ideal characteristics for mobile devices. We developed two prototype Haptic Edge Displays, one with 24 actuated pins (3.75mm in pitch) and a second with 40 pins (2.5mm in pitch). This paper describes several novel haptic interactions for the Haptic Edge Display including dynamic physical affordances, shape display, non-dominant hand interactions, and also in-pocket ``pull' style haptic notifications. In a laboratory experiment we investigated the limits of human perception for Haptic Edge Displays, measuring the just-noticeable difference for pin width and height changes for both in-hand and simulated in-pocket conditions.

Supplementary Material

suppl.mov (pn1223-file3.mp4)

Supplemental video

Download
67.14 MB

MP4 File (p3706-jang.mp4)

Download
206.69 MB

References

[1]

Jason Alexander, Andrés Lucero, and Sriram Subramanian. 2012. Tilt Displays: Designing Display Surfaces with Multi-axis Tilting and Actuation. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, NY, NY, USA, 161-170.

Digital Library

[2]

Olivier Bau, Ivan Poupyrev, Ali Israr, and Chris Harrison. 2010. TeslaTouch: Electrovibration for Touch Surfaces. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, NY, NY, USA, 283-292.

Digital Library

[3]

Patrick Baudisch and Gerry Chu. 2009. Back-of-device Interaction Allows Creating Very Small Touch Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, NY, NY, USA, 1923-1932.

Digital Library

[4]

Mohamed Benali-Khoudja, Moustapha Hafez, Jean-Marc Alexandre, and Abderrahmane Kheddar. 2004. Tactile interfaces: a state-of-the-art survey. In International Symposium on Robotics, Vol. 31. Citeseer.

[5]

Gábor Blaskó and Steven Feiner. 2004. Single-handed Interaction Techniques for Multiple Pressure-sensitive Strips. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04). ACM, NY, NY, USA, 1461-1464.

Digital Library

[6]

Stephen Brewster, Faraz Chohan, and Lorna Brown. 2007. Tactile Feedback for Mobile Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, NY, NY, USA, 159-162.

Digital Library

[7]

Alex Butler, Shahram Izadi, and Steve Hodges. 2008. SideSight: Multi-"Touch" Interaction Around Small Devices. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, NY, NY, USA, 201-204.

Digital Library

[8]

Angela Chang, Sile O'Modhrain, Rob Jacob, Eric Gunther, and Hiroshi Ishii. 2002. ComTouch: Design of a Vibrotactile Communication Device. In Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '02). ACM, NY, NY, USA, 312-320.

Digital Library

[9]

Craig Michael Ciesla and Micah B Yairi. 2012. Tactus User interface system. (April 10 2012). US Patent 8,154,527.

[10]

Panteleimon Dimitriadis and Jason Alexander. 2014. Evaluating the Effectiveness of Physical Shape-change for In-pocket Mobile Device Notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, NY, USA, 2589-2592.

Digital Library

[11]

Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: Dynamic Physical Affordances and Constraints Through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, NY, NY, USA, 417-426.

Digital Library

[12]

S C Gandevia, L A Hall, D I McCloskey, and E K Potter. 1983. Proprioceptive sensation at the terminal joint of the middle finger. The Journal of Physiology 335, 1 (1983), 507-517.

[13]

George A Gescheider. 2013. Psychophysics: the fundamentals. Psychology Press.

[14]

Antonio Gomes, Andrea Nesbitt, and Roel Vertegaal. 2013. MorePhone: A Study of Actuated Shape Deformations for Flexible Thin-film Smartphone Notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NY, NY, USA, 583-592.

Digital Library

[15]

L A Hall and D I McCloskey. 1983. Detections of movements imposed on finger, elbow and shoulder joints. The Journal of Physiology 335, 1 (1983), 519-533.

[16]

Chris Harrison and Scott E. Hudson. 2009. Providing Dynamically Changeable Physical Buttons on a Visual Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, NY, NY, USA, 299-308.

Digital Library

[17]

Fabian Hemmert, Susann Hamann, Matthias Löwe, Josefine Zeipelt, and Gesche Joost. 2010. Shape-changing Mobiles: Tapering in Two-dimensional Deformational Displays in Mobile Phones. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, NY, NY, USA, 3075-3080.

Digital Library

[18]

Fabian Hemmert, Gesche Joost, André Knörig, and Reto Wettach. 2008. Dynamic Knobs: Shape Change As a Means of Interaction on a Mobile Phone. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, NY, NY, USA, 2309-2314.

Digital Library

[19]

Eve Hoggan, Sohail Anwar, and Stephen A. Brewster. 2007. Mobile Multi-actuator Tactile Displays. In Proceedings of the 2Nd International Conference on Haptic and Audio Interaction Design (HAID'07). Springer-Verlag, Berlin, Heidelberg, 22-33. http://dl.acm.org/citation.cfm?id=1775512.1775518

Digital Library

[20]

David Holman, Andreas Hollatz, Amartya Banerjee, and Roel Vertegaal. 2013. Unifone: Designing for Auxiliary Finger Input in One-handed Mobile Interactions. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, NY, NY, USA, 177-184.

Digital Library

[21]

Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX: Adding Haptic Surface to Graphics. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, NY, NY, USA, 469-476.

Digital Library

[22]

K. O. Johnson and S. S. Hsiao. 1992. Neural mechanisms of tactual form and texture perception. Annu. Rev. Neurosci. 15 (1992), 227-250.

[23]

K. O. Johnson and J. R. Phillips. 1981. Tactile spatial resolution. I. Two-point discrimination, gap detection, grating resolution, and letter recognition. J. Neurophysiol. 46, 6 (Dec 1981), 1177-1192.

[24]

Y. Kato, T. Sekitani, M. Takamiya, M. Doi, K. Asaka, T. Sakurai, and T. Someya. 2007. Sheet-Type Braille Displays by Integrating Organic Field-Effect Transistors and Polymeric Actuators. Electron Devices, IEEE Transactions on 54, 2 (Feb 2007), 202-209.

[25]

Dong-Soo Kwon and Seung-Chan Kim. 2008. Haptic Interfaces for Mobile Devices: A Survey of the State of the Art. Recent Patents on Computer Science 1, 2 (2008), 84-92.

[26]

Sangwon Lee, Kwangmok Jung, Jachoon Koo, Sungil Lee, Hoogon Choi, Jaewook Jeon, Jaedo Nam, and Hyoukryeol Choi. 2004. Braille display device using soft actuator. Proc. SPIE 5385 (2004), 368-379.

[27]

V. Levesque, L. Oram, and K. MacLean. 2012. Exploring the design space of programmable friction for scrolling interactions. In Haptics Symposium (HAPTICS), 2012 IEEE. 23-30.

[28]

Joseph Luk, Jerome Pasquero, Shannon Little, Karon MacLean, Vincent Levesque, and Vincent Hayward. 2006. A Role for Haptics in Mobile Interaction: Initial Design Using a Handheld Tactile Display Prototype. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, NY, NY, USA, 171-180.

Digital Library

[29]

J. Pasquero, J. Luk, V. Levesque, Qi Wang, V. Hayward, and K.E. MacLean. 2007. Haptically Enabled Handheld Information Display With Distributed Tactile Transducer. Multimedia, IEEE Transactions on 9, 4 (June 2007), 746-753.

Digital Library

[30]

Ivan Poupyrev and Shigeaki Maruyama. 2003. Tactile Interfaces for Small Touch Screens. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST '03). ACM, NY, NY, USA, 217-220.

Digital Library

[31]

Ivan Poupyrev, Shigeaki Maruyama, and Jun Rekimoto. 2002a. Ambient Touch: Designing Tactile Interfaces for Handheld Devices. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST '02). ACM, NY, NY, USA, 51-60.

Digital Library

[32]

Ivan Poupyrev, Jun Rekimoto, and Shigeaki Maruyama. 2002b. TouchEngine: A Tactile Display for Handheld Devices. In CHI '02 Extended Abstracts on Human Factors in Computing Systems (CHI EA '02). ACM, NY, NY, USA, 644-645.

Digital Library

[33]

Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: Toward High "Shape Resolution" in Self-actuated Flexible Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NY, NY, USA, 593-602.

Digital Library

[34]

Scott S. Snibbe, Karon E. MacLean, Rob Shaw, Jayne Roderick, William L. Verplank, and Mark Scheeff. 2001. Haptic Techniques for Media Control. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (UIST '01). ACM, NY, NY, USA, 199-208.

Digital Library

[35]

Ian R Summers, Craig M Chanter, Anna L Southall, and Alan C Brady. 2001. Results from a Tactile Array on the Fingertip. In Proceedings of Eurohaptics. 26-28.

[36]

R. W. Van Boven and K. O. Johnson. 1994. The limit of tactile spatial resolution in humans: grating orientation discrimination at the lip, tongue, and finger. Neurology 44, 12 (Dec 1994), 2361-2366.

[37]

Qi Wang and Vincent Hayward. 2010. Biomechanically Optimized Distributed Tactile Transducer Based on Lateral Skin Deformation. The International Journal of Robotics Research 29, 4 (2010), 323-335.

Digital Library

Cited By

He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Qian WGao CSathya ASuzuki RNakagaki K(2024)SHAPE-IT: Exploring Text-to-Shape-Display for Generative Shape-Changing Behaviors with LLMsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676348(1-29)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676348
Kim MOfek EPahud MSinclair MBianchi A(2024)Big or Small, It’s All in Your Head: Visuo-Haptic Illusion of Size-Change Using Finger-RepositioningProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642254(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642254
Show More Cited By

Index Terms

Haptic Edge Display for Mobile Tactile Interaction
1. Human-centered computing

Recommendations

shiftIO: Reconfigurable Tactile Elements for Dynamic Affordances and Mobile Interaction
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Currently, virtual (i.e. touchscreen) controls are dynamic, but lack the advantageous tactile feedback of physical controls. Similarly, devices may also have dedicated physical controls, but they lack the flexibility to adapt for different contexts and ...
Using a Fingertip Tactile Device to Substitute Kinesthetic Feedback in Haptic Interaction
Proceedings, Part I, of the International Conference on Haptics: Generating and Perceiving Tangible Sensations - Volume 6191

A prototype of a joystick where the kinesthetic feedback is substituted by tactile feedback is proposed. Tactile feedback is provided by a wearable device able to apply vertical stress to the fingertip in contact with the joystick. To test the device, ...
Electrostatic tactile display with thin film slider and its application to tactile tele-presentation systems
VRST '04: Proceedings of the ACM symposium on Virtual reality software and technology

A new electrostatic tactile display is proposed to realize compact tactile display devices that can be incorporated with virtual reality systems. The tactile display of this study consists of a thin conductive film slider with stator electrodes that ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

May 2016

6108 pages

ISBN:9781450333627

DOI:10.1145/2858036

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Kwanjeong Educational Foundation
Intel Coporation

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI '16 Paper Acceptance Rate 565 of 2,435 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

83
Total Citations
View Citations
1,885
Total Downloads

Downloads (Last 12 months)229
Downloads (Last 6 weeks)36

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Qian WGao CSathya ASuzuki RNakagaki K(2024)SHAPE-IT: Exploring Text-to-Shape-Display for Generative Shape-Changing Behaviors with LLMsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676348(1-29)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676348
Kim MOfek EPahud MSinclair MBianchi A(2024)Big or Small, It’s All in Your Head: Visuo-Haptic Illusion of Size-Change Using Finger-RepositioningProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642254(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642254
Stellmacher CMathis FWeiss YLoerakker MWagener NSchöning J(2024)Exploring Mobile Devices as Haptic Interfaces for Mixed RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642176(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642176
Yasu K(2024)MagneSwift: Low-Cost, Interactive Shape Display Leveraging Magnetic MaterialsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642058(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642058
Steer CSauvé KJain ALawal OProulx MJicol CAlexander J(2024)Squishy, Yet Satisfying: Exploring Deformable Shapes' Cross-Modal Correspondences with Colours and EmotionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641952(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641952
Gonzalez EPatel KAhuja KGonzalez-Franco M(2024)XDTK: A Cross-Device Toolkit for Input & Interaction in XR2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00092(467-470)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00092
Law WToro Wyetzner SZhen RFollmer S(2024)A Multi-Stable Curved Line Shape Display2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10610902(9696-9703)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10610902
Wu QLi J(2024)Analysis and Performance Evaluation of a Modular Finger-Mounted Haptic Device for High-Density FeedbackJournal of Ocean University of China10.1007/s11802-024-5845-023:6(1583-1594)Online publication date: 12-Nov-2024
https://doi.org/10.1007/s11802-024-5845-0
Choi CHardwick JBansal SSubramanian S(2024)Fluid Driven Membrane Actuation for Reconfigurable Acoustic ManipulationAdvanced Functional Materials10.1002/adfm.20240409334:49Online publication date: 30-Aug-2024
https://doi.org/10.1002/adfm.202404093
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents