More Web Proxy on the site http://driver.im/

research-article

EM-Sense: Touch Recognition of Uninstrumented, Electrical and Electromechanical Objects

Authors:

Chouchang Yang,

Alanson Sample,

Chris HarrisonAuthors Info & Claims

UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

Pages 157 - 166

https://doi.org/10.1145/2807442.2807481

Published: 05 November 2015 Publication History

Abstract

Most everyday electrical and electromechanical objects emit small amounts of electromagnetic (EM) noise during regular operation. When a user makes physical contact with such an object, this EM signal propagates through the user, owing to the conductivity of the human body. By modifying a small, low-cost, software-defined radio, we can detect and classify these signals in real-time, enabling robust on-touch object detection. Unlike prior work, our approach requires no instrumentation of objects or the environment; our sensor is self-contained and can be worn unobtrusively on the body. We call our technique EM-Sense and built a proof-of-concept smartwatch implementation. Our studies show that discrimination between dozens of objects is feasible, independent of wearer, time and local environment.

References

[1]

Abbott, R.E. and S.C. Hadden, Product Specification for a Nonintrusive Appliance Load Monitoring System. EPRI Report #NI-101, 1990.

[2]

B. Clarkson, N. Sawhney, and A. Pentland. Auditory context awareness in wearable computing. In Workshop on Perceptual User Interfaces, November 1998.

[3]

Bao, L. and Intille,S.S. Activity Recognition from UserAnnotated Acceleration Data. In Proc. of Pervasive Computing '04.

[4]

Buettner, M., Prasad, R., Philipose, M., Wetherall, D. 2009. Recognizing daily activities with RFID-based sensors. In Proc. of UbiComp '09.

Digital Library

[5]

C. Randell and H. Muller. Context awareness by analysing accelerometer data. In Proc. of ISWC '00.

Digital Library

[6]

Chen, K.Y., Cohn, G., Gupta, S., Patel. S.N. uTouch: sensing touch gestures on unmodified LCDs. In Proc. of CHI '13.

Digital Library

[7]

The Federal Communications Commission. Code of Federal Regulations, Title 47, Part 15.

[8]

Cohen, G., Gupta, S., Froehlich, J., Larson, E., and Patel, S. GasSense: Appliance-Level, Single-Point Sensing of Gas Activity in the Home. In Proc. of Pervasive '10.

Digital Library

[9]

Cohn, C., Morris, D., Patel, S., Tan, D. Humantenna: using the body as an antenna for real-time whole-body interaction. In Proc. of CHI'12.

Digital Library

[10]

Cohn, G., Morris, D., Patel, S.N., Tan, D.S. Your noise is my command: sensing gestures using the body as an antenna. In Proc. of CHI '11.

Digital Library

[11]

Cohn, G., Stuntebeck, E., Pandey, J., Otis, B., Abowd, G.D., Patel, S.N. SNUPI: sensor nodes utilizing powerline infrastructure. In Proc. UbiComp '10.

Digital Library

[12]

Dietz, P., Leigh, D. DiamondTouch: a multi-user touch technology. In Proc. of UIST '01

Digital Library

[13]

Do, T.M.T., Kalimeri, K., Lepri, B., Pianesi, F., GaticaPerez, D. Inferring social activities with mobile sensor networks. In Proc of ICMI '13.

Digital Library

[14]

Fogarty, J., Au, C. and Hudson, S.E.: Sensing from the Basement: A Feasibility Study of Unobtrusive and LowCost Home Activity Recognition. In Proc. of UIST '06.

Digital Library

[15]

Froehlich, J., Larson, E., Campbell, T., Haggerty, C., Fogarty, J., Patel, S.N.: HydroSense: infrastructuremediated singlepoint sensing of whole-home water activity. In Proc. of UbiComp '09.

Digital Library

[16]

Gaëtanne Haché, Edward D. Lemaire, N.B. Wearable mobility monitoring using a multimedia smartphone platform. In IEEE Trans. on Instrumentation and Measurement.

[17]

Grosse-Puppendahl, T., Herber, S., Wimmer, R., Englert, F., Beck, S., von Wilmsdorff, J., Wichert, R., Kuijper, A. 2014. Capacitive near-field communication for ubiquitous interaction and perception. In Proc. of UbiComp '14.

Digital Library

[18]

Gupta, S., Chen, K.Y., Reynolds, M.S., Patel, S.N. 2011. LightWave: using compact fluorescent lights as sensors. In Proc. UbiComp '11.

Digital Library

[19]

Gupta, S., Reynolds, M.S., Patel, S.N. ElectriSense: single-point sensing using EMI for electrical event detection and classification in the home. In Proc. UbiComp '10.

Digital Library

[20]

Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P. and Witten, I. The WEKA Data Mining Software: An Update. SIGKDD Explor., 11(1), 2009.

Digital Library

[21]

Harrison, C., Xiao, R., Hudson, S.E. Acoustic barcodes: passive, durable and inexpensive notched identification tags. In Proc. UIST '12.

Digital Library

[22]

Hart, G. Advances in Nonintrusive Appliance Load Monitoring. In Proc. EPRI Information and Automation Conference '91.

[23]

Hart, G., Nonintrusive appliance load monitoring. In Proc. of the IEEE, 1992.

[24]

Hodges,S.,Thorne,A.,Mallinson,H.,andFloerkemeier, C. Assessing and optimizing the range of UHF RFID to enable real-world pervasive computing applications. Pervasive Computing, (2007).

Digital Library

[25]

Holz, C., Baudisch, P. Fiberio: A Touchscreen That Senses Fingerprints. In Proc. of UIST'13.

Digital Library

[26]

Kim, Y., Schmid, T., Charbiwala, Z., Srivastava, M.B.: ViridiScope: design and implementation of a finegrained power monitoring system for homes. In Proc. of UbiComp '09.

Digital Library

[27]

Lange, B.M., Jones, M.A., Meyers, J.L. Insight lab: an immersiveteam environment linking paper, displays, and data. In Proc. of CHI '98.

Digital Library

[28]

Laput G., Lasecki, W.S., Wiese, J., Xiao, R., Wiese, J., Bigham, J.P., Harrison, C. Zensors: Adaptive, Rapidly Deployable, Human-Intelligent Sensor Feeds. In Proc. of CHI '15.

Digital Library

[29]

Lasecki, W.S., Song, Y., Kautz, H., and Bigham, J.P. Real-time crowd labeling for deployable activity recognition. In Proc. of CSCW '13.

Digital Library

[30]

Li, H., Ye, C., Sample, A.P. IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID. In Proc. of CHI '15.

Digital Library

[31]

Maekawa, T., Kishino, Y., Sakurai, Y., Suyama, T. 2011. Recognizing the use of portable electrical devices with hand-worn magnetic sensors. In Proc. of Pervasive'11

Digital Library

[32]

Maekawa, T., Kishino, Y., Yanagisawa, Y., Sakurai, Y. 2012. Recognizing handheld electrical device usage with hand-worn coil of wire. In Proc. of Pervasive'12

Digital Library

[33]

Buchler, M.C. Algorithms for Sound Classification in Hearing Instruments. PhD thesis, ETH Zurich, 2002.

[34]

Movassaghi, S., Abolhasan, M., Lipman, J., Smith, D., Jamalipour, A. 2014. Wireless Body Area Networks: A Survey. In Communications Surveys & Tutorials.

[35]

Paglin, M.D., Hobson, J.R., Rosenbloom, J. (1999), The Communications Act: A Legislative History of the Major Amendments, 1934--1996, Pike & Fische.

[36]

Patel, S.N., Reynolds, M.S., Abowd, G.D. Detecting Human Movement by Differential Air Pressure Sensing in HVAC System Ductwork: An Exploration in Infrastructure Mediated Sensing. In Pervasive '08.

Digital Library

[37]

Patel, S.N., Robertson, T., Kientz, J.A., Reynolds, M.S., Abowd, G.D. At the flick of a switch: detecting and classifying unique electrical events on the residential power line. In Proc. of UbiComp '07.

Digital Library

[38]

Philipose, M. Large-scale human activity recognition using ultra-dense sensing. The Bridge, National Academy of Engineering. 35.

[39]

Ranjan, J., Yao, Y., Griffiths, E., Whitehouse, K. Using mid-range RFID for location based activity recognition. In Proc. of UbiComp '12.

Digital Library

[40]

Rekimoto J., and Ayatsuka, Y. CyberCode: designing augmented reality environments with visual tags. In Proc. DARE '00.

Digital Library

[41]

Ren, X. 2009. Egocentric recognition of handled objects: Benchmark and analysis. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[42]

Smith, J.R., Fishkin, K.P., Jiang, B., Mamishev, A., Philipose, M., Rea, A.D., Roy, S., Sundara-Rajan. K. 2005. RFID-based techniques for human-activity detection. In Commun. ACM.

Digital Library

[43]

V. Peltonen, J. Tuomi, A. Klapuri, J. Huopaniemi, T. Sorsa. Computational auditory scene recognition. In IEEE Int'l Conf. on Acoust, Speech, and Signal Proc.

[44]

Wang, Y., Liu, J., Chen, Y., Gruteser, M., Yang, J., Liu, H. E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures. In Proc. of MobiCom '14.

Digital Library

[45]

Ward, J.A., Lukowicz, P., Tröster, G., and Starner, T.E. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Transactions on Pattern Analysis and Machine Intelligence.

Digital Library

[46]

Zhao, W., Chellappa, R., Phillips, P., Rosenfeld, R. Face recognition: A literature survey. ACM Comput. Surv.

Digital Library

[47]

Zhao, Y., LaMarca, A., Smith, J.R. A battery-free object localization and motion sensing platform. In Proc of UbiComp '14.

Digital Library

Cited By

Takahashi ATanaka YTamhane AShen ATeng SLopes P(2024)Can a Smartwatch Move Your Fingers? Compact and Practical Electrical Muscle Stimulation in a SmartwatchProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676373(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676373
Chen WLin SPeng ZParizi FHeo SPatel SMatusik WZhao WStankovic J(2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643547
Wang XZhang Y(2024)TextureSightProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314137:4(1-27)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631413
Show More Cited By

Index Terms

EM-Sense: Touch Recognition of Uninstrumented, Electrical and Electromechanical Objects
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

EMI reduction technique by employing a conductive connection between frames
ICUIMC '08: Proceedings of the 2nd international conference on Ubiquitous information management and communication

In this paper, we propose an EMI (Electromagnetic Interference) reduction technique by employing a conductive connection between frames. Several cconductors were used to connect two frames, which might provide another return path of signal current loop, ...
Mobile Assisted Living: Smartwatch-based Fall Risk Assessment for Elderly People
iWOAR '18: Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and Interaction

We present a novel Smartwatch-based approach, to enable Mobile Assisted Living (MAL) for users with special needs. A major focus group for this approach are elderly people. We developed a tool for caregivers applicable in home environments, nursing care,...
Function and Visual Experience Design Strategy of Chinese Elderly Health Monitoring Smartwatch
Design, User Experience, and Usability
Abstract
Since the 1990s, China’s ageing process has accelerated. With the increase of age and the ageing of physiological functions, the elderly are more prone to diseases. At present, there are not many health-monitoring smartwatches for the elderly in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

November 2015

686 pages

ISBN:9781450337793

DOI:10.1145/2807442

General Chair:
Celine Latulipe
UNC Charlotte, USA
,
Program Chairs:
Bjoern Hartmann
UC Berkeley, USA
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '15

Sponsor:

UIST '15: The 28th Annual ACM Symposium on User Interface Software and Technology

November 11 - 15, 2015

NC, Charlotte, USA

Acceptance Rates

UIST '15 Paper Acceptance Rate 70 of 297 submissions, 24%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

88
Total Citations
View Citations
1,513
Total Downloads

Downloads (Last 12 months)86
Downloads (Last 6 weeks)11

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Takahashi ATanaka YTamhane AShen ATeng SLopes P(2024)Can a Smartwatch Move Your Fingers? Compact and Practical Electrical Muscle Stimulation in a SmartwatchProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676373(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676373
Chen WLin SPeng ZParizi FHeo SPatel SMatusik WZhao WStankovic J(2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643547
Wang XZhang Y(2024)TextureSightProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314137:4(1-27)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631413
Yang XSayono JXu JZhang Y(2024)Interaction-Power Stations: Turning Environments into Ubiquitous Power Stations for Charging WearablesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650769(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650769
Zhang H(2024)Searching for the Non-Consequential: Dialectical Activities in HCI and the Limits of ComputersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641945(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641945
Liu ZLin FWang CShen YBa ZLu LXu WRen K(2023)CamRadarProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35695056:4(1-25)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569505
Fan YPietroni NFerguson S(2023)A Neural Network-based Low-cost Soft Sensor for Touch Recognition and Deformation CaptureProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595963(889-903)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595963
Waghmare ABen Taleb YChatterjee INarendra APatel S(2023)Z-Ring: Single-Point Bio-Impedance Sensing for Gesture, Touch, Object and User RecognitionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581422(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581422
Yan ZSong QTan R(2023)Touch-to-Access Device Authentication For Indoor Smart ObjectsIEEE Transactions on Mobile Computing10.1109/TMC.2021.308949722:2(1185-1197)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TMC.2021.3089497
Hong SHeo SLee B(2023)MaterialSense: Estimating and utilizing material properties of contact objects in multi-touch interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102985172(102985)Online publication date: Apr-2023
https://doi.org/10.1016/j.ijhcs.2022.102985
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents