More Web Proxy on the site http://driver.im/

research-article

Botential: Localizing On-Body Gestures by Measuring Electrical Signatures on the Human Skin

Authors:

Denys J. C. Matthies,

Simon T. Perrault,

Shengdong ZhaoAuthors Info & Claims

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

Pages 207 - 216

https://doi.org/10.1145/2785830.2785859

Published: 24 August 2015 Publication History

Abstract

We present Botential, an on-body interaction method for a wearable input device that can identify the location of on-body tapping gestures, using the entire human body as an interactive surface to expand the usually limited interaction space in the context of mobility. When the sensor is being touched, Botential identifies a body part's unique electric signature, which depends on its physiological and anatomical compositions. This input method exhibits a number of advantages over previous approaches, which include: 1) utilizing the existing signal the human body already emits, to accomplish input with various body parts, 2) the ability to also sense soft and long touches, 3) an increased sensing range that covers the whole body, and 4) the ability to detect taps and hovering through clothes.

Supplementary Material

matthies (p207-matthies-suppl.zip)

Supplemental movie and image files for, Botential: Localizing On-Body Gestures by Measuring Electrical Signatures on the Human Skin

Download
33.55 MB

References

[1]

Aylward, R., and Paradiso, J. A. (2007). A compact, high-speed, wearable sensor network for biomotion capture and interactive media. In Proc of Information processing in sensor networks. ACM, 380--389.

Digital Library

[2]

Ashbrook, D. Enabling mobile microinteractions. (2010) PhD Thesis, Georgia Institute of Technology.

Digital Library

[3]

Ashbrook, D., Baudisch, P. and White, S. (2011). Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring. In Proc of CHI'11. ACM, 2043--2046.

Digital Library

[4]

Bailly, G., Müller, J., Rohs, M., Wigdor, D. and Kratz, S. (2012). ShoeSense: a new perspective on gestural interaction and wearable applications. In Proc of CHI'12. ACM, 1239--1248.

Digital Library

[5]

Bender, A. E., & Bender, D. A. (1995). Body surface area. A Dictionary of Food and Nutrition. Oxford University Press, New York.

[6]

Chen, K. Y., Lyons, K., White, S. and Patel, S. (2013). uTrack: 3D input using two magnetic sensors. In Proc of UIST'13. ACM, 237--244.

Digital Library

[7]

Cohn, G., Gupta, S., Lee, T-J., Morris, D., Smith, J. R., Reynolds, M. S., Tan, D. S. and Patel, S. N. (2012). An ultra-low-power human body motion sensor using static electric field sensing. In Proc of Ubicomp'12. 99--102.

Digital Library

[8]

Cohn, G., Morris, D., Patel, S. and Tan, D. (2012). Humantenna: using the body as an antenna for real-time whole-body interaction. In Proc of CHI'12, 1901--1910.

Digital Library

[9]

Dementyev, A., & Paradiso, J. A. (2014). WristFlex: Low-power gesture input with wrist-worn pressure sensors. In Proc of UIST'14. ACM. 161--166.

Digital Library

[10]

Dourish. P. (2004). Where the action is: the foundations of embodied interaction. MIT Press.

[11]

Farina, D., Cescon, C., & Merletti, R. (2002). Influence of anatomical, physical, and detection-system parameters on surface EMG. In Biological cybernetics, 86(6), 445--456.

[12]

FitzHugh, R. (1961). Impulses and physiological states in theoretical models of nerve membrane. In Biophysical journal, 1(6), 445--466.

[13]

Fluhler, E., Burnham, V. G., & Loew, L. M. (1985). Spectra, membrane binding, and potentiometric responses of new charge shift probes. In Biochemistry, 24(21), 5749--5755.

[14]

Gustafson, S. Bierwirth, D. and Baudisch, P. (2010). Imaginary interfaces: spatial interaction with empty hands and without visual feedback. In Proc of UIST'10. ACM, 3--12.

Digital Library

[15]

Hall, M. A. (1999). Correlation-based feature selection for machine learning. PhD Thesis, Waikato University.

[16]

Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009). The WEKA data mining software: an update. ACM SIGKDD explorations newsletter, 11(1), 10--18.

Digital Library

[17]

Harrison, C., Benko, H. and Wilson, A. D. (2011). OmniTouch: wearable multitouch interaction everywhere. In Proc UIST'11. ACM, 441--450.

Digital Library

[18]

Harrison, C., Ramamurthy, S., & Hudson, S. E. (2012, February). On-body interaction: armed and dangerous. In Proc of TEI'12. ACM, 69--76.

Digital Library

[19]

Harrison, C., Tan, D. and Morris, D. (2010). Skinput: appropriating the body as an input surface. In Proc of CHI'10. ACM, 453--462.

Digital Library

[20]

Hertenstein, M.J., Holmes, R., McCullough, M., and Keltner, D. (2009). The communication of emotion via touch. In Emotion'09. American Psychological Association, 566--573.

[21]

Hodgkin, A. L. (1951). The ionic basis of electrical activity in nerve and muscle. Biological Reviews, 26(4), 339--409.

[22]

Karrer, T., Wittenhagen, M., Lichtschlag, L., Heller, F. and Borchers, J. (2011). Pinstripe: eyes-free continuous input on interactive clothing. In Proc CHI'11. ACM, 1313--1322.

Digital Library

[23]

Kelso, J. S., Holt, K. G., & Flatt, A. E. (1980). The role of proprioception in the perception and control of human movement: Toward a theoretical reassessment. In Perception & Psychophysics, 28(1), 45--52.

[24]

Ogata, M., Sugiura, Y., Makino, Y., Inami, M. and Imai, M. (2013). SenSkin: adapting skin as a soft interface. In Proc of UIST'13. ACM, 539--544.

Digital Library

[25]

Profita, H. P., Clawson, J., Gilliland, S., Zeagler, C., Starner, T., Budd, J., & Do, E. Y. L. (2013). Don't mind me touching my wrist: a case study of interacting with on-body technology in public. In Proc of ISWC. 89--96.

Digital Library

[26]

Reaz, M. B. I., Hussain, M. S., & Mohd-Yasin, F. (2006). Techniques of EMG signal analysis: detection, processing, classification and applications. In Biological procedures online, 8(1), 11--35.

[27]

Rekimoto, J. (2001). Gesturewrist and Gesturepad: Unobtrusive wearable interaction devices. In Proc of ISWC'01. 21--27.

Digital Library

[28]

Rekimoto, J. (1996). Tilting operations for small screen interfaces. In Proc of UIST'96. ACM, 167--168.

Digital Library

[29]

Richardson, T. (2004). The Human Skin---Engineered by God. In Apologetics Press, Montgomery, Alabama.

[30]

Rico, J., & Brewster, S. (2010). Usable gestures for mobile interfaces: evaluating social acceptability. In Proc of CHI'10. ACM, 887--896.

Digital Library

[31]

Rohracher, H. (1964). Microvibration, permanent muscleactivity and constancy of body-temperature. In Perceptual and motor skills, 19(1), 198--198.

[32]

Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J. and Landay, J. A. (2009). Enabling always-available input with muscle-computer interfaces. In Proc of UIST'09. ACM, 167--176.

Digital Library

[33]

Sato, M., Poupyrev, I. and Harrison, C. (2012). Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proc CHI'12. ACM, 483--492.

Digital Library

[34]

Scharfetter, H., Hartinger, P., Hinghofer-Szalkay, H., & Hutten, H. (1998). A model of artefacts produced by stray capacitance during whole body or segmental bioimpedance spectroscopy. In Physiological measurement, 19(2), 247.

[35]

Smith, J. R. (1999). Electric Field Imaging. PhD Thesis, MIT - Massachusetts Institute of Technology.

Digital Library

[36]

Verveen, A. A., & Derksen, H. E. (1968). Fluctuation phenomena in nerve membrane. In Proc of the IEEE, 56(6), 906--916.

[37]

Weigel, M., Lu, T., Bailly, G., Oulasvirta, A., Majidi, C., & Steimle, J. (2015) iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. In Proc of CHI'15. ACM, 2991--3000.

Digital Library

[38]

Weigel, M., Mehta, V. and Steimle, J. (2014). More Than Touch: Understanding How People Use Skin as an Input Surface for Mobile Computing. In Proc of CHI'14. ACM, 179--188.

Digital Library

[39]

Windmiller, J. R., Bandodkar, A. J., Valdés-Ramírez, G., Parkhomovsky, S., Martinez, A. G., & Wang, J. (2012). Electrochemical sensing based on printable temporary transfer tattoos. In Chemical Communications, 48(54), 6794--6796.

Cited By

Kunieda NManabe H(2024)OSIRITap: Whole-Body Interface that Recognizes Tap Input Using Only an HMD and Wrist-Mounted IMUsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3688871(1-2)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3688871
Liu MBello HZhou BLukowicz PKarolus J(2024)iFace: Hand-Over-Face Gesture Recognition Leveraging Impedance SensingProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652923(131-137)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652923
Bian SLiu MZhou BLukowicz PMagno M(2024)Body-Area Capacitive or Electric Field Sensing for Human Activity Recognition and Human-Computer InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435558:1(1-49)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643555
Show More Cited By

Index Terms

Botential: Localizing On-Body Gestures by Measuring Electrical Signatures on the Human Skin
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Skin Drag Displays: Dragging a Physical Tactor across the User's Skin Produces a Stronger Tactile Stimulus than Vibrotactile
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

We propose a new type of tactile displays that drag a physical tactor across the skin in 2D. We call this skin drag. We demonstrate how this allows us to communicate geometric shapes or characters to users. The main benefit of our approach is that it ...
DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Thumb-to-fingers interfaces augment touch widgets on fingers, which are manipulated by the thumb. Such interfaces are ideal for one-handed eyes-free input since touch widgets on the fingers enable easy access by the stylus thumb. This study presents ...
CapWidgets: tangile widgets versus multi-touch controls on mobile devices
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

We present CapWidgets, passive tangible controls for capacitive touch screens. CapWidgets bring back physical controls to off-the-shelf multi-touch surfaces as found in mobile phones and tablet computers. While the user touches the widget, the surface ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 2015

611 pages

ISBN:9781450336529

DOI:10.1145/2785830

General Chairs:
Sebastian Boring
University of Copenhagen, Denmark
,
Enrico Rukzio
University of Ulm, Germany
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Ken Hinckley
Microsoft Research Redmond, USA

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

German Federal State of M-V and the European Social Fund
National University of Singapore Academic Research Fund

Conference

MobileHCI '15

Sponsor:

SIGCHI

MobileHCI '15: 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 24 - 27, 2015

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
494
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kunieda NManabe H(2024)OSIRITap: Whole-Body Interface that Recognizes Tap Input Using Only an HMD and Wrist-Mounted IMUsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3688871(1-2)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3688871
Liu MBello HZhou BLukowicz PKarolus J(2024)iFace: Hand-Over-Face Gesture Recognition Leveraging Impedance SensingProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652923(131-137)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652923
Bian SLiu MZhou BLukowicz PMagno M(2024)Body-Area Capacitive or Electric Field Sensing for Human Activity Recognition and Human-Computer InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435558:1(1-49)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643555
Matthies DSellhorn OGabrecht MSchuljak JHellbrück H(2023)NOSEwrist: Natural Olfactory Substitution and Extension wristProceedings of Mensch und Computer 202310.1145/3603555.3608528(370-374)Online publication date: 3-Sep-2023
https://dl.acm.org/doi/10.1145/3603555.3608528
Chen WWang ZQuan PPeng ZLin SSrivastava MMatusik WStankovic J(2023)Robust Finger Interactions with COTS Smartwatches via Unsupervised Siamese AdaptationProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606794(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606794
Catană AVatavu R(2023)Fingerhints: Understanding Users’ Perceptions of and Preferences for On-Finger Kinesthetic NotificationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581022(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581022
Bilius LUngurean OVatavu R(2023)Understanding Wheelchair Users’ Preferences for On-Body, In-Air, and On-Wheelchair GesturesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580929(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580929
Muñoz JMosquera VRengifo C(2022)A low-cost, portable, two-dimensional bioimpedance distribution estimation system based on the AD5933 impedance converterHardwareX10.1016/j.ohx.2022.e0027411(e00274)Online publication date: Apr-2022
https://doi.org/10.1016/j.ohx.2022.e00274
Kaluarachchi TReis ANanayakkara S(2021)A Review of Recent Deep Learning Approaches in Human-Centered Machine LearningSensors10.3390/s2107251421:7(2514)Online publication date: 3-Apr-2021
https://doi.org/10.3390/s21072514
Matthies DWeerasinghe CUrban BNanayakkara S(2021)CapGlasses: Untethered Capacitive Sensing with Smart GlassesProceedings of the Augmented Humans International Conference 202110.1145/3458709.3458945(121-130)Online publication date: 22-Feb-2021
https://dl.acm.org/doi/10.1145/3458709.3458945
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents