short-paper

Estimating visual attention from a head mounted IMU

Authors:

Teesid Leelasawassuk,

Dima Damen,

Walterio W. Mayol-CuevasAuthors Info & Claims

ISWC '15: Proceedings of the 2015 ACM International Symposium on Wearable Computers

Pages 147 - 150

https://doi.org/10.1145/2802083.2808394

Published: 07 September 2015 Publication History

Get Access

Abstract

This paper concerns with the evaluation of methods for the estimation of both temporal and spatial visual attention using a head-worn inertial measurement unit (IMU). Aimed at tasks where there is a wearer-object interaction, we estimate the when and the where the wearer is interested in. We evaluate various methods on a new egocentric dataset from 8 volunteers and compare our results with those achievable with a commercial gaze tracker used as ground-truth. Our approach is primarily geared for sensor-minimal EyeWear computing.

Supplementary Material

MP4 File (p147-leelasawassuk.mp4)

Download
25.51 MB

References

[1]

Bulling, A., Roggen, D., and Tröster, G. Wearable EOG goggles: Seamless sensing and context-awareness in everyday environments. Journal of Ambient Intelligence and Smart Environments 1, 2 (May 2009), 157--171.

Digital Library

Google Scholar

[2]

Ishimaru, S., Kunze, K., Uema, Y., Kise, K., Inami, M., and Tanaka, K. Smarter eyewear: using commercial eog glasses for activity recognition. In UbiComp14 Adjunct (2014).

Digital Library

Google Scholar

[3]

Land, M., Mennie, N., and Rusted, J. The roles of vision and eye movements in the control of activities of daily living. Perception 28, 11 (1999), 1311--1328.

Crossref

Google Scholar

[4]

Leelasawassuk, T., and Mayol-Cuevas, W. W. 3D from looking. In ISWC, ACM Press (2013), 105.

Digital Library

Google Scholar

[5]

Li, Y., Fathi, A., and Rehg, J. Learning to predict gaze in egocentric video. In ICCV (2013).

Digital Library

Google Scholar

[6]

Ward, J. A., Lukowicz, P., Troster, G., and Starner, T. E. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE PAMI 28, 10 (2006), 1553--1567.

Digital Library

Google Scholar

[7]

Yamada, K., Sugano, Y., Okabe, T., Sato, Y., Sugimoto, A., and Hiraki, K. Attention prediction in egocentric video using motion and visual saliency. In Adv in Image and Video Tech. 2012.

Digital Library

Google Scholar

Cited By

View all

Hu JJiang HXiao ZChen SDustdar SLiu J(2024)HeadTrack: Real-Time Human–Computer Interaction via Wireless EarphonesIEEE Journal on Selected Areas in Communications10.1109/JSAC.2023.334538142:4(990-1002)Online publication date: Apr-2024
https://doi.org/10.1109/JSAC.2023.3345381
Ge LZhang QZhang JChen H(2024)EHTrack: Earphone-Based Head Tracking via Only Acoustic SignalsIEEE Internet of Things Journal10.1109/JIOT.2023.329841211:3(4063-4075)Online publication date: 1-Feb-2024
https://doi.org/10.1109/JIOT.2023.3298412
Xu XYu AJonker TTodi KLu FQian XEvangelista Belo JWang TLi MMun AWu TShen JZhang TKokhlikyan NWang FSorenson PKim SBenko H(2023)XAIR: A Framework of Explainable AI in Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581500(1-30)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581500
Show More Cited By

Index Terms

Estimating visual attention from a head mounted IMU
1. Computing methodologies
  1. Machine learning
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Pointing by gaze, head, and foot in a head-mounted display
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

This paper presents a Fitts' law experiment and a clinical case study performed with a head-mounted display (HMD). The experiment compared gaze, foot, and head pointing. With the equipment setup we used, gaze was slower than the other pointing methods, ...
Accuracy of Pedometry on a Head-mounted Display
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

The accuracy of pedometry varies depending on where an inertial sensor is located on the body. Motivated by the increasing popularity of wearable computing, this paper investigates the accuracy with which pedometry can be achieved on a head-mounted ...
Self-Calibrating Head-Mounted Eye Trackers Using Egocentric Visual Saliency
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

Head-mounted eye tracking has significant potential for gaze-based applications such as life logging, mental health monitoring, or the quantified self. A neglected challenge for the long-term recordings required by these applications is that drift in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ISWC '15: Proceedings of the 2015 ACM International Symposium on Wearable Computers

September 2015

223 pages

ISBN:9781450335782

DOI:10.1145/2802083

General Chairs:
Kenji Mase
Nagoya University, JP
,
Marc Langheinrich
Università della Svizzera italiana (USI), CH
,
Daniel Gatica-Perez
IDIAP-EPFL, CH
,
Program Chairs:
Kristof Van Laerhoven,
Tsutomu Terada

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Short-paper

Conference

UbiComp '15

Sponsor:

Yahoo! Japan
SIGMOBILE
FX Palo Alto Laboratory, Inc.
ACM
Rakuten Institute of Technology
Microsoft
Bell Labs
SIGCHI
Panasonic
Telefónica
ISTC-PC

UbiComp '15: The 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 7 - 11, 2015

Osaka, Japan

Acceptance Rates

Overall Acceptance Rate 38 of 196 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
430
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)7

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Hu JJiang HXiao ZChen SDustdar SLiu J(2024)HeadTrack: Real-Time Human–Computer Interaction via Wireless EarphonesIEEE Journal on Selected Areas in Communications10.1109/JSAC.2023.334538142:4(990-1002)Online publication date: Apr-2024
https://doi.org/10.1109/JSAC.2023.3345381
Ge LZhang QZhang JChen H(2024)EHTrack: Earphone-Based Head Tracking via Only Acoustic SignalsIEEE Internet of Things Journal10.1109/JIOT.2023.329841211:3(4063-4075)Online publication date: 1-Feb-2024
https://doi.org/10.1109/JIOT.2023.3298412
Xu XYu AJonker TTodi KLu FQian XEvangelista Belo JWang TLi MMun AWu TShen JZhang TKokhlikyan NWang FSorenson PKim SBenko H(2023)XAIR: A Framework of Explainable AI in Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581500(1-30)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581500
Thakur SBEYAN CMorerio PDel Bue A(2021)Predicting Gaze from Egocentric Social Interaction Videos and IMU DataProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479954(717-722)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479954
Chan KLouis JAlbert A(2020)Incorporating Worker Awareness in the Generation of Hazard Proximity WarningsSensors10.3390/s2003080620:3(806)Online publication date: 2-Feb-2020
https://doi.org/10.3390/s20030806
Yang ZWei YShen SChoudhury R(2020)Ear-ARProceedings of the 26th Annual International Conference on Mobile Computing and Networking10.1145/3372224.3419213(1-14)Online publication date: 16-Apr-2020
https://dl.acm.org/doi/10.1145/3372224.3419213
CHEN LNAKAMURA YKONDO KMAYOL-CUEVAS W(2019)Hotspot Modeling of Hand-Machine Interaction Experiences from a Head-Mounted RGB-D CameraIEICE Transactions on Information and Systems10.1587/transinf.2018EDP7146E102.D:2(319-330)Online publication date: 1-Feb-2019
https://doi.org/10.1587/transinf.2018EDP7146
Stolzenwald JMayol-Cuevas W(2018)I Can See Your Aim: Estimating User Attention from Gaze for Handheld Robot Collaboration2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2018.8594184(3897-3904)Online publication date: Oct-2018
https://doi.org/10.1109/IROS.2018.8594184
Turton AAngilley JLongley VClatworthy PGilchrist I(2017)Search training for people with visual field loss after stroke: A cohort studyBritish Journal of Occupational Therapy10.1177/030802261774348181:5(255-265)Online publication date: 19-Dec-2017
https://doi.org/10.1177/0308022617743481
Leelasawassuk TDamen DMayol-Cuevas WMistry PMaes PSeigneur JNanayakkara SParadiso J(2017)Automated capture and delivery of assistive task guidance with an eyewear computerProceedings of the 8th Augmented Human International Conference10.1145/3041164.3041185(1-9)Online publication date: 16-Mar-2017
https://dl.acm.org/doi/10.1145/3041164.3041185
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Pointing by gaze, head, and foot in a head-mounted display

Accuracy of Pedometry on a Head-mounted Display

Self-Calibrating Head-Mounted Eye Trackers Using Egocentric Visual Saliency