More Web Proxy on the site http://driver.im/

research-article

Advancing Hand Gesture Recognition with High Resolution Electrical Impedance Tomography

Authors:

Chris HarrisonAuthors Info & Claims

UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

Pages 843 - 850

https://doi.org/10.1145/2984511.2984574

Published: 16 October 2016 Publication History

Abstract

Electrical Impedance Tomography (EIT) was recently employed in the HCI domain to detect hand gestures using an instrumented smartwatch. This prior work demonstrated great promise for non-invasive, high accuracy recognition of gestures for interactive control. We introduce a new system that offers improved sampling speed and resolution. In turn, this enables superior interior reconstruction and gesture recognition. More importantly, we use our new system as a vehicle for experimentation ' we compare two EIT sensing methods and three different electrode resolutions. Results from in-depth empirical evaluations and a user study shed light on the future feasibility of EIT for sensing human input.

Supplementary Material

ZIP File (uist4326-file5.zip)

Download
6.72 MB

suppl.mov (uist4326-file3.mp4)

Supplemental video

Download
55.57 MB

MP4 File (p843-zhang.mp4)

Download
212.00 MB

References

[1]

Ackmann, J.J. 1993. Complex bioelectric impedance measurement system for the frequency range from 5 Hz to 1 MHz. Annals of biomedical engineering 21, 2: 135--146. http://doi.org/10.1007/BF02367609

[2]

Adler, A. and Guardo, R. 1996. Electrical impedance tomography: Regularized imaging and contrast detection. IEEE Transactions on Medical Imaging 15, 2: 170--179. http://doi.org/10.1109/42.491418

[3]

Amento, B., Hill, W. and Terveen, L. 2002. The sound of one hand. In Proc. CHI EA '02, 724. http://dx.doi.org/10.1145/506443.506566

Digital Library

[4]

Amma, C., Krings, T., Böer, J. and Schultz, T. 2015. Advancing Muscle-Computer Interfaces with HighDensity Electromyography. In Proc. CHI '15, 929--938. http://doi.org/10.1145/2702123.2702501

Digital Library

[5]

Analog Devices Inc. 2010. JFET Input Instrumentation Amplifier with Rail-to-Rail Output in MSOP Package. Retrieved July 10, 2016 from http://www.analog.com/media/en/technicaldocumentation/data-sheets/AD8220.pdf

[6]

Analog Devices. 2005. 32-Channel Analog Multiplexer. ADG732. Retrieved July 10, 2016 from http://www.analog.com/media/en/technicaldocumentation/data-sheets/ADG726_732.pdf

[7]

Analog Devices. 2005. Programmable Frequency Sweep and Output Burst Waveform Generator. AD8220. Retrieved July 10, 2016 from http://www.analog.com/media/en/technicaldocumentation/data-sheets/AD8220.pdf

[8]

Aristovich, K.Y., Packham, B.C., Koo, H., Santos, G. S., McEvoy, A. and Holder, D. S. 2016. Imaging fast electrical activity in the brain with electrical impedance tomography. NeuroImage 124: 204--213. http://doi.org/10.1016/j.neuroimage.2015.08.071

[9]

Barber, D.C., Brown, B.H. and Avis, N.J. 1992. Image Reconstruction in Electrical Impedance Tomography Using Filtered Back - Projection. In Proc. EMBS '92, 1691--1692. http://dx.doi.org/10.1109/IEMBS.1992.5761992

[10]

Borcea, L. 2002. Electrical Impedance Tomography. Inverse Problems 18, 6: R99--R136. http://doi.org/10.1088/0266--5611/18/6/201

[11]

Chen, J., Cao, Z. and Xu, L. 2011. Four-terminal scheme used in a two-terminal EIT system. In Proc. IMT '11, 1648'1652. http://doi.org/10.1109/IMTC.2011.5944264

[12]

D'Antona, G., Ferrero, A., Lazzaroni, M., Ottoboni, R. and Samarani, E. 2002. Active monitoring apparatus for underground pollutant detection based on electrical impedance tomography. In Proc. IMTC '02, (IEEE Cat. No.00CH37276) 1, May: 577--579. http://doi.org/10.1109/IMTC.2002.1006906

[13]

Dementyev, A. and Paradiso, J.A. 2014. WristFlex: Low-Power Gesture Input with Wrist-Worn Pressure Sensors. In Proc. UIST '14, 161--166. http://doi.org/10.1145/2642918.2647396

Digital Library

[14]

Deyle, T., Palinko, S., Poole, E.S. and Starner, T. 2007. Hambone: A bio-acoustic gesture interface. In Proc. ISWC '07, 3--10. http://doi.org/10.1109/ISWC.2007.4373768

Digital Library

[15]

Dowrick, T., Blochet, C. and Holder, D. 2015. In vivo bioimpedance measurement of healthy and ischaemic rat brain: implications for stroke imaging using electrical impedance tomography. Physiological Measurement 36, 6: 1273--1282. http://doi.org/10.1088/09673334/36/6/1273

[16]

Dyakowski, T., Jeanmeure, L.F.C. and Jaworski, A.J. 2000. Applications of electrical tomography for gassolids and liquid-solids flows - A review. Powder Technology 112, 3: 174--192. http://doi.org/10.1016/S0032--5910(00)00292--8

[17]

Fukui, R., Watanabe, M., Gyota, T., Shimosaka, M. and Sato, T. 2011. Hand shape classification with a wrist contour sensor. In Proc. UbiComp '11, 311--314. http://doi.org/10.1145/2030112.2030154

Digital Library

[18]

Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P. and Witten, I.H. 2009. The WEKA data mining software. ACM SIGKDD Explorations 11, 1: 10--18. http://doi.org/10.1145/1656274.1656278

Digital Library

[19]

Halter, R.L., Hartov, A. and Paulsen, K.D. 2008. Imaging Forearm Blood Flow with Pulse-Ox Gated Electrical Impedance Tomography. In Proc. EMBS'08, 1192--1195. http://doi.org/10.1109/IEMBS.2008.4649376

[20]

Harikumar, R., Prabu, R. and Raghavan, S. 2013. Electrical Impedance Tomography (EIT) and Its Medical Applications'': A Review. International Journal of Soft Computing and Engineering (IJSCE) 3, 4: 193--198.

[21]

Harrison, C., Tan, D. and Morris, D. 2010. Skinput: Appropriating the Body as an Input Surface. In Proc. CHI '10, 453--462. http://doi.org/10.1145/1753326.1753394

Digital Library

[22]

Henderson, R. P. and Webster, J. G. 1978. An impedance camera for spatially specific measurements of the thorax. IEEE transactions on bio-medical engineering 25, 3: 250--254. http://doi.org/10.1109/TBME.1978.326329

[23]

Hilbich, C., Hauck, C., Hoelzle, M., Scherler, M., Schudel, L., Völksch, I., Vonder Mühll, D. and Mäusbacher, R. 2008. Monitoring mountain permafrost evolution using electrical resistivity tomography: A 7-year study of seasonal, annual, and long-term variations at Schilthorn, Swiss Alps. Journal of Geophysical Research: Earth Surface 113, 1: 1--12. http://doi.org/10.1029/2007JF000799

[24]

Holder, D. S. 2015. Electrical Impedance Tomography, Methods, History and Applications. Institute of Physics Publishing. CRC Press: 456. http://doi.org/10.1118/1.1995712

[25]

Holder, D.S. 1992. Electrical impedance tomography (EIT) of brain function. Brain Topography 5, 2: 87--93. http://doi.org/10.1007/BF01129035

[26]

Jung, P.G., Lim, G., Kim, S. and Kong, K. 2015. A Wearable Gesture Recognition Device for Detecting Muscular Activities Based on Air-Pressure Sensors. IEEE Transactions on Industrial Informatics 11, 2: 485--494. http://doi.org/10.1109/TII.2015.2405413

[27]

Kalender, W. 2000. Computed Tomograpy: Fundamentals, System Technology, Image Quality, Applications. Publicis MCD Verlag.

[28]

Kim, D., Hilliges, O. and Izadi, S. 2012. Digits: Freehand 3D Interactions Anywhere Using a Wrist-Worn Gloveless Sensor. In Proc. UIST '12, 167--176. http://doi.org/10.1145/2380116.2380139

Digital Library

[29]

Laput, G., Xiao, R. and Harrison, C. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. To appear in Proc. UIST '16.

Digital Library

[30]

Lionheart, W.R.B. 2004. EIT Reconstruction Algorithms: Pitfalls, Challenges and Recent Developments. Physiological Measurement 25.1 http://doi.org/10.1088/0967--3334/25/1/021

[31]

Moeller, J. and Kerne, A. 2012. ZeroTouch: an optical multi-touch and free-air interaction architecture. In Proc. CHI '12, 2165--2174. DOI=http://dx.doi.org/10.1145/2207676.2208368

Digital Library

[32]

Rekimoto, J. 2001. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. In Proc. ISWC '01, 21--27. http://dx.doi.org/10.1109/ISWC.2001.962092

Digital Library

[33]

Saponas, T.S., Tan, D.S., Morris, D. and Balakrishnan, R. 2008. Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces. In Proc. CHI '08, 515--524. http://doi.org/10.1145/1357054.1357138

Digital Library

[34]

Saponas, T.S., Tan, D.S., Morris, D., Balakrishnan, R., Turner, J. and Landay, J.A. Enabling always-available input with muscle-computer interfaces. In Proc. UIST '09, 167--176. http://doi.org/10.1145/1622176.1622208

Digital Library

[35]

Teschner, E., Imhoff, M. and Leonhardt, S. Electrical Impedance Tomography: The realization of regional ventilation monitoring, 2nd Edition.

[36]

Treetronic. 2015. PiCUS: Treetronic, Electric Resistance Tomography. http://www.arguselectronic.de/en/content/download/431/4060/.../ TreeTronic+3+manual.pdf

[37]

Vauhkonen, M., Lionheart, W.R.B., Heikkinen, L.M., Vauhkonen, P.J. and Kaipio, J.P. A MATLAB package for the EIDORS project to reconstruct two-dimensional EIT images. Physiological Measurement 22.1 http://dx.doi.org/10.1088/0967--3334/22/1/314

[38]

Vauhkonen, P.J. 2004. Image Reconstruction in ThreeDimensional Electrical Impedance Tomography.

[39]

Withana, A., Peiris, R., Samarasekara, N. and Nanayakkara, S. zSense: Enabling Shallow Depth Gesture Recognition for Grater Input Expressivity on Smart Wearables. In Proc. CHI '15, 3661--3670. http://dx.doi.org/10.1145/2702123.2702371

Digital Library

[40]

Way, D. and Paradiso, J. A usability user study concerning free-hand microgesture and wrist-worn sensors. In Proc. BSN '14, 138--142. http://dx.doi.org/10.1109/BSN.2014.32

Digital Library

[41]

Wen, H., Rojas, J.R. and Dey, A.K. Serendipity: Finger Gesture Recognition using an Off-the-shelf Smartwatch. In Proc. CHI '16. http://dx.doi.org/10.1145/2858036.2858466

Digital Library

[42]

Wu, K., Yang, J. and Dong, X. 2012. Comparative study of reconstruction algorithms for electrical impedance tomography. IEEE Transactions on Biomedical Engineering, 51077127: 2296--2299.

[43]

Zhang, Y. and Harrison, C. 2015. Tomo: Wearable, Low-Cost Electrical Impedance Tomography for Hand Gesture Recognition. In Proc. UIST '15, 167--173. DOI=http://dx.doi.org/10.1145/2807442.2807480

Digital Library

Cited By

Huynh HDiep QDinh MTran ADang NPhan TTran TChing C(2024)Machine learning-enhanced gesture recognition through impedance signal analysisJournal of Electrical Bioimpedance10.2478/joeb-2024-000715:1(63-74)Online publication date: 11-Jun-2024
https://doi.org/10.2478/joeb-2024-0007
Takahashi ATanaka YTamhane AShen ATeng SLopes P(2024)Can a Smartwatch Move Your Fingers? Compact and Practical Electrical Muscle Stimulation in a SmartwatchProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676373(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676373
Takahashi RWhitmire EBoldu RNg SKienzle WBenko H(2024)picoRing: battery-free rings for subtle thumb-to-index inputProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676365(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676365
Show More Cited By

Index Terms

Advancing Hand Gesture Recognition with High Resolution Electrical Impedance Tomography
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

EtherPose: Continuous Hand Pose Tracking with Wrist-Worn Antenna Impedance Characteristic Sensing
UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology

EtherPose is a continuous hand pose tracking system employing two wrist-worn antennas, from which we measure the real-time dielectric loading resulting from different hand geometries (i.e., poses). Unlike worn camera-based methods, our RF approach is ...
Tomo: Wearable, Low-Cost Electrical Impedance Tomography for Hand Gesture Recognition
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

We present Tomo, a wearable, low-cost system using Electrical Impedance Tomography (EIT) to recover the interior impedance geometry of a user's arm. This is achieved by measuring the cross-sectional impedances between all pairs of eight electrodes ...
Hand Gesture and On-body Touch Recognition by Active Acoustic Sensing throughout the Human Body
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology

In this paper, we present a novel acoustic sensing technique that recognizes two convenient input actions: hand gestures and on-body touch. We achieved them by observing the frequency spectrum of the wave propagated in the body, around the periphery of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

October 2016

908 pages

ISBN:9781450341899

DOI:10.1145/2984511

General Chairs:
Jun Rekimoto
The University of Tokyo
,
Takeo Igarashi
The University of Tokyo
,
Program Chairs:
Jacob O. Wobbrock
University of Washington
,
Daniel Avrahami
FXPAL

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '16

Sponsor:

UIST '16: The 29th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2016

Tokyo, Japan

Acceptance Rates

UIST '16 Paper Acceptance Rate 79 of 384 submissions, 21%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

117
Total Citations
View Citations
2,022
Total Downloads

Downloads (Last 12 months)222
Downloads (Last 6 weeks)41

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Huynh HDiep QDinh MTran ADang NPhan TTran TChing C(2024)Machine learning-enhanced gesture recognition through impedance signal analysisJournal of Electrical Bioimpedance10.2478/joeb-2024-000715:1(63-74)Online publication date: 11-Jun-2024
https://doi.org/10.2478/joeb-2024-0007
Takahashi ATanaka YTamhane AShen ATeng SLopes P(2024)Can a Smartwatch Move Your Fingers? Compact and Practical Electrical Muscle Stimulation in a SmartwatchProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676373(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676373
Takahashi RWhitmire EBoldu RNg SKienzle WBenko H(2024)picoRing: battery-free rings for subtle thumb-to-index inputProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676365(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676365
Lee CZhang RAgarwal DYu TGunda VLopez OKim JYin SDong BLi KSakashita MGuimbretiere FZhang C(2024)EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a WristbandProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642910(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642910
Kyu AMao HZhu JGoel MAhuja K(2024)EITPose: Wearable and Practical Electrical Impedance Tomography for Continuous Hand Pose EstimationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642663(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642663
Li DWang L(2024)Development of a Portable and Low-Cost Data Acquisition System With Edge Intelligence for Electrical Impedance Tomography-Based Spatial Damage DetectionIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.347005473(1-11)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3470054
Chen ZZhang LLiang SWang SZhang L(2024)Electrical Impedance Tomography for Thorax Image Using Connected Component Labeling and Sparse Group LassoIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.342785973(1-12)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3427859
Yang DLi SSun NTang CZhao YXu B(2024)A Portable EIT System for Gesture Recognition With Feature Selection and ANN ImplantationIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.342037273(1-10)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3420372
Mušikić M(2024)The Usage of Electroimpedance Tomography along with Artificial Intelligence in Application Development in the field of Medicine2024 32nd Telecommunications Forum (TELFOR)10.1109/TELFOR63250.2024.10819142(1-4)Online publication date: 26-Nov-2024
https://doi.org/10.1109/TELFOR63250.2024.10819142
Deng TTeng ZTakahashi SZhong H(2024)Multichannel Bioimpedance-Based Gesture Classification System for Enhanced Human-Machine InteractionIEEE Sensors Journal10.1109/JSEN.2024.348069224:23(39699-39709)Online publication date: 1-Dec-2024
https://doi.org/10.1109/JSEN.2024.3480692
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten