More Web Proxy on the site http://driver.im/

poster

Expanding Touch Interaction Capabilities for Smart-rings: An Exploration of Continual Slide and Microroll Gestures

Authors:

Anuradha Herath,

Pourang IraniAuthors Info & Claims

CHI EA '22: CHI Conference on Human Factors in Computing Systems Extended Abstracts

Article No.: 292, Pages 1 - 7

https://doi.org/10.1145/3491101.3519714

Published: 28 April 2022 Publication History

Abstract

As smart-rings emerge in both research and commercial markets, their limited physical size remains to restrict the interaction potential and input vocabulary possible. Thus, focusing on touch interaction for its natural and preferred input potential, this early work explores the combination of slide and microroll gestures performed by the thumb in continual motion on a smart-ring’s touch capacitive surface. We first capture over 3000 slide and microroll gesture instances, extract features, and generate and test machine learning models that are able to discern the slide and microroll gestures within the same touch instance. Through the use of 18 features, our Random Forest model provides a 92.4% accuracy. We conclude with demonstrations of potential applications utilizing continual slide and microroll gestures, and a short discussion which provides future research directions stemming from the positive results obtained from this preliminary work.

Supplementary Material

MP4 File (3491101.3519714-video-preview.mp4)

Video Preview

Download
3.76 MB

MP4 File (3491101.3519714-talk-video.mp4)

Talk Video

Download
233.16 MB

References

[1]

M Usman Akram, Zabeel Bashir, Anam Tariq, and Shoab A Khan. 2013. Geometric feature points based optical character recognition. In 2013 IEEE Symposium on Industrial Electronics & Applications. IEEE, 86–89.

[2]

Lisa Anthony and Jacob O Wobbrock. 2010. A lightweight multistroke recognizer for user interface prototypes. In Proceedings of Graphics Interface 2010. 245–252.

Digital Library

[3]

Daniel Ashbrook, Patrick Baudisch, and Sean White. 2011. Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2043–2046.

Digital Library

[4]

Sandra Bardot, Surya Rawat, Duy Thai Nguyen, Sawyer Rempel, Huizhe Zheng, Bradley Rey, Jun Li, Kevin Fan, Da-Yuan Huang, Wei Li, 2021. ARO: Exploring the Design of Smart-Ring Interactions for Encumbered Hands. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction. 1–11.

Digital Library

[5]

Patrick Baudisch and Gerry Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1923–1932.

Digital Library

[6]

Hrvoje Benko, Andrew D. Wilson, and Patrick Baudisch. 2006. Precise Selection Techniques for Multi-Touch Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1263–1272.

Digital Library

[7]

Rachel Blagojevic, Samuel Hsiao-Heng Chang, and Beryl Plimmer. 2010. The Power of Automatic Feature Selection: Rubine on Steroids.SBIM 10(2010), 79–86.

[8]

Roger Boldu, Alexandru Dancu, Denys JC Matthies, Pablo Gallego Cascón, Shanaka Ransir, and Suranga Nanayakkara. 2018. Thumb-In-Motion: Evaluating Thumb-to-Ring Microgestures for Athletic Activity. In Proceedings of the Symposium on Spatial User Interaction. 150–157.

Digital Library

[9]

David Bonnet, Caroline Appert, and Michel Beaudouin-Lafon. 2013. Extending the Vocabulary of Touch Events with ThumbRock(GI ’13). Canadian Information Processing Society, 221–228.

[10]

Sebastian Boring, David Ledo, Xiang’Anthony’ Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The fat thumb: using the thumb’s contact size for single-handed mobile interaction. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. 39–48.

Digital Library

[11]

Jared Cechanowicz, Pourang Irani, and Sriram Subramanian. 2007. Augmenting the mouse with pressure sensitive input. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1385–1394.

Digital Library

[12]

Nitesh V Chawla, Kevin W Bowyer, Lawrence O Hall, and W Philip Kegelmeyer. 2002. SMOTE: synthetic minority over-sampling technique. Journal of artificial intelligence research 16 (2002), 321–357.

[13]

Mayur Datar, Aristides Gionis, Piotr Indyk, and Rajeev Motwani. 2002. Maintaining stream statistics over sliding windows. SIAM journal on computing 31, 6 (2002), 1794–1813.

[14]

Ramy El-Hajj, Laurence Likforman-Sulem, and Chafic Mokbel. 2005. Arabic handwriting recognition using baseline dependant features and hidden markov modeling. In Eighth International Conference on Document Analysis and Recognition (ICDAR’05). IEEE, 893–897.

Digital Library

[15]

Barrett Ens, Ahmad Byagowi, Teng Han, Juan David Hincapié-Ramos, and Pourang Irani. 2016. Combining ring input with hand tracking for precise, natural interaction with spatial analytic interfaces. In Proceedings of the 2016 Symposium on Spatial User Interaction. 99–102.

Digital Library

[16]

Bogdan-Florin Gheran, Jean Vanderdonckt, and Radu-Daniel Vatavu. 2018. Gestures for smart rings: empirical results, insights, and design implications. In Proceedings of the 2018 Designing Interactive Systems Conference. 623–635.

Digital Library

[17]

Kyohei Hakka, Toshiya Isomoto, and Buntarou Shizuki. 2019. One-Handed Interaction Technique for Single-Touch Gesture Input on Large Smartphones. In Symposium on Spatial User Interaction. 1–2.

[18]

Da-Yuan Huang, Ming-Chang Tsai, Ying-Chao Tung, Min-Lun Tsai, Yen-Ting Yeh, Liwei Chan, Yi-Ping Hung, and Mike Y Chen. 2014. TouchSense: expanding touchscreen input vocabulary using different areas of users’ finger pads. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 189–192.

Digital Library

[19]

Jingun Jung, Sangyoon Lee, Jiwoo Hong, Eunhye Youn, and Geehyuk Lee. 2020. Voice+ Tactile: Augmenting In-vehicle Voice User Interface with Tactile Touchpad Interaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[20]

Wolf Kienzle and Ken Hinckley. 2014. LightRing: always-available 2D input on any surface. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 157–160.

Digital Library

[21]

Junhyeok Kim, William Delamare, and Pourang Irani. 2018. Thumbtext: Text entry for wearable devices using a miniature ring. In Graphics Interface.

[22]

Young-Ho Kim, Bongshin Lee, Arjun Srinivasan, and Eun Kyoung Choe. 2021. Data Hand: Fostering Visual Exploration of Personal Data on Smartphones Leveraging Speech and Touch Interaction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–17.

Digital Library

[23]

DoYoung Lee, Jiwan Kim, and Ian Oakley. 2021. FingerText: Exploring and Optimizing Performance for Wearable, Mobile and One-Handed Typing. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–15.

Digital Library

[24]

Wing Ho Andy Li, Hongbo Fu, and Kening Zhu. 2016. BezelCursor: Bezel-initiated cursor for one-handed target acquisition on mobile touch screens. International Journal of Mobile Human Computer Interaction (IJMHCI) 8, 1(2016), 1–22.

Digital Library

[25]

Hyunchul Lim, Jungmin Chung, Changhoon Oh, SoHyun Park, and Bongwon Suh. 2016. OctaRing: examining pressure-sensitive multi-touch input on a finger ring device. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 223–224.

Digital Library

[26]

David C McCallum, Edward Mak, Pourang Irani, and Sriram Subramanian. 2009. PressureText: pressure input for mobile phone text entry. In CHI’09 Extended Abstracts on Human Factors in Computing Systems. 4519–4524.

[27]

Ali Neshati, Bradley Rey, Ahmed Shariff Mohommed Faleel, Sandra Bardot, Celine Latulipe, and Pourang Irani. 2021. BezelGlide: Interacting with Graphs on Smartwatches with Minimal Screen Occlusion. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[28]

Sebastien Pelurson and Laurence Nigay. 2016. Bimanual input for multiscale navigation with pressure and touch gestures. In Proceedings of the 18th ACM International Conference on Multimodal Interaction. 145–152.

Digital Library

[29]

J Pradeep, E Srinivasan, and S Himavathi. 2011. Diagonal based feature extraction for handwritten character recognition system using neural network. In 2011 3rd international conference on electronics computer technology, Vol. 4. IEEE, 364–368.

[30]

Gonzalo Ramos, Matthew Boulos, and Ravin Balakrishnan. 2004. Pressure widgets. In Proceedings of the SIGCHI conference on Human factors in computing systems. 487–494.

Digital Library

[31]

Mikko J Rissanen, Samantha Vu, Owen Noel Newton Fernando, Natalie Pang, and Schubert Foo. 2013. Subtle, Natural and Socially Acceptable Interaction Techniques for Ringterfaces—Finger-Ring Shaped User Interfaces. In International Conference on Distributed, Ambient, and Pervasive Interactions. Springer, 52–61.

Digital Library

[32]

Anne Roudaut, Eric Lecolinet, and Yves Guiard. 2009. MicroRolls: Expanding Touch-Screen Input Vocabulary by Distinguishing Rolls vs. Slides of the Thumb(CHI ’09). Association for Computing Machinery, 927–936.

[33]

Dean Rubine. 1991. Specifying Gestures by Example(SIGGRAPH ’91). Association for Computing Machinery, 329–337.

[34]

Hasti Seifi and Kent Lyons. 2016. Exploring the design space of touch-based vibrotactile interactions for smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers. 156–165.

Digital Library

[35]

Marcos Serrano, Eric Lecolinet, and Yves Guiard. 2013. Bezel-Tap gestures: quick activation of commands from sleep mode on tablets. In Proceedings of the SIGCHI conference on Human factors in computing systems. 3027–3036.

Digital Library

[36]

Roy Shilkrot, Jochen Huber, Jürgen Steimle, Suranga Nanayakkara, and Pattie Maes. 2015. Digital digits: A comprehensive survey of finger augmentation devices. ACM Computing Surveys (CSUR) 48, 2 (2015), 1–29.

Digital Library

[37]

Gaganpreet Singh, William Delamare, and Pourang Irani. 2018. D-SWIME: A design space for smartwatch interaction techniques supporting mobility and encumbrance. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[38]

Eugene M Taranta II, Amirreza Samiei, Mehran Maghoumi, Pooya Khaloo, Corey R Pittman, and Joseph J LaViola Jr. 2017. Jackknife: A reliable recognizer with few samples and many modalities. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 5850–5861.

[39]

Karl Thurnhofer-Hemsi, Ezequiel López-Rubio, Miguel A Molina-Cabello, and Kayvan Najarian. 2020. Radial basis function kernel optimization for Support Vector Machine classifiers. arXiv preprint arXiv:2007.08233(2020).

[40]

Hsin-Ruey Tsai, Min-Chieh Hsiu, Jui-Chun Hsiao, Lee-Ting Huang, Mike Chen, and Yi-Ping Hung. 2016. TouchRing: subtle and always-available input using a multi-touch ring. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. 891–898.

Digital Library

[41]

Radu-Daniel Vatavu, Lisa Anthony, and Jacob O Wobbrock. 2012. Gestures as point clouds: a $ P recognizer for user interface prototypes. In Proceedings of the 14th ACM international conference on Multimodal interaction. 273–280.

Digital Library

[42]

Radu-Daniel Vatavu, Lisa Anthony, and Jacob O Wobbrock. 2018. $ Q: a super-quick, articulation-invariant stroke-gesture recognizer for low-resource devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–12.

Digital Library

[43]

Bryan Wang and Tovi Grossman. 2020. BlyncSync: Enabling Multimodal Smartwatch Gestures with Synchronous Touch and Blink. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[44]

Andrew D Wilson and Maneesh Agrawala. 2006. Text entry using a dual joystick game controller. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 475–478.

Digital Library

[45]

Jacob O Wobbrock, Andrew D Wilson, and Yang Li. 2007. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proceedings of the 20th annual ACM symposium on User interface software and technology. 159–168.

Digital Library

[46]

Pui Chung Wong, Kening Zhu, and Hongbo Fu. 2017. FingerT9: Leveraging thumb-to-finger interaction for one-handed text entry on smartwatches. In SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications. 1–3.

[47]

Pui Chung Wong, Kening Zhu, Xing-Dong Yang, and Hongbo Fu. 2020. Exploring eyes-free bezel-initiated swipe on round smartwatches. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–11.

Digital Library

[48]

Zheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo, Te-Yen Wu, Jun Gong, Sicheng Yin, Jialun Zhai, and Xing-Dong Yang. 2020. Bitiptext: Bimanual eyes-free text entry on a fingertip keyboard. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[49]

Yina Ye and Petteri Nurmi. 2015. Gestimator: Shape and stroke similarity based gesture recognition. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction. 219–226.

Digital Library

Cited By

Lee JBaeck MYeo HStarner TWoo W(2024)GestureMark: Shortcut Input Technique using Smartwatch Touch Gestures for XR GlassesProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652941(63-71)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652941
Perella-Holfeld FFaleel SIrani P(2023)Evaluating design guidelines for hand proximate user interfacesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596117(1159-1173)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596117
Bardot SRey BAudette LFan KHuang DLi JLi WIrani P(2022)One Ring to Rule Them AllProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503156:3(1-20)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550315

Recommendations

MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

The input vocabulary for touch-screen interaction on handhelds is dramatically limited, especially when the thumb must be used. To enrich that vocabulary we propose to discriminate, among thumb gestures, those we call MicroRolls, characterized by zero ...
A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Proximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...
One-Handed Interaction Technique for Single-Touch Gesture Input on Large Smartphones
SUI '19: Symposium on Spatial User Interaction

We propose a one-handed interaction technique using cursor based on touch pressure to enable users to perform various single-touch gestures such as a tap, swipe, drag, and double-tap on unreachable targets. In the proposed technique, cursor mode is ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

3066 pages

ISBN:9781450391566

DOI:10.1145/3491101

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
353
Total Downloads

Downloads (Last 12 months)98
Downloads (Last 6 weeks)16

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lee JBaeck MYeo HStarner TWoo W(2024)GestureMark: Shortcut Input Technique using Smartwatch Touch Gestures for XR GlassesProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652941(63-71)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652941
Perella-Holfeld FFaleel SIrani P(2023)Evaluating design guidelines for hand proximate user interfacesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596117(1159-1173)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596117
Bardot SRey BAudette LFan KHuang DLi JLi WIrani P(2022)One Ring to Rule Them AllProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503156:3(1-20)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550315

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents