More Web Proxy on the site http://driver.im/

poster

InfoFinder: just-in-time information interface from the combination of an HWD with a smartwatch

Authors:

Tomonori YazakiAuthors Info & Claims

MUM '15: Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia

Pages 355 - 359

https://doi.org/10.1145/2836041.2841207

Published: 30 November 2015 Publication History

Abstract

We present InfoFinder, a novel interface running on wearable devices that allows a user to perceive information using a simple finger-framing gesture. InfoFinder works in combination with a see-through head-worn display (HWD) and a smartwatch. Whenever the smartwatch detects a user's finger-framing gesture, it activates the HWD to extract the finger-framing area and display recognized object's information. InfoFinder avoids continuously tracking with the HWD camera, offering the advantages of fast, easily intuitive information acquisition as well as decreasing the possibility of misrecognition. An experiment shows InfoFinder responds in a timely manner to information acquisition requests (4.1 seconds), more than 5 times faster than using an HWD's conventional controller. We also verified that the task success rate of InfoFinder was improved by 32.8% compared to a reference prototype using real-time gesture tracking on the HWD.

References

[1]

Ali Erol, George Bebis, Mircea Nicolescu, Richard D. Boyle, and Xander Twombly. 2007. Vision-based hand pose estimation: A review. Computer Vision and Image Understanding, 108, 52--73.

Digital Library

[2]

Allu Sneha. (October 11, 2011). Advantages and Disadvantages about the technology. Retrieved June 5, 2015 from http://sallu-sixthsense.blogspot.jp/2011/10/sixth-sense-advantages-and.html

[3]

Andrea Colaço. 2013. Sensor design and interaction techniques for gestural input to smart glasses and mobile devices. In Proceedings of the adjunct publication of the 26th annual ACM symposium on User interface software and technology (UIST 2013), 49--52.

Digital Library

[4]

David Dobbelstein, Hock Philipp, and Rukzio Enrico. 2015. Belt: An Unobtrusive Touch Input Device for Head-worn Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015), 2135--2138.

Digital Library

[5]

Google Goggles. Retrieved July 20, 2014 from http://www.google.com/mobile/goggles/

[6]

Grubert Jens, Heinisch Matthias, Quigley Aaron and Schmalstieg Dieter. (2015). MultiFi: multi-fidelity interaction with displays on and around the body. In Proceedings of the SIGCHI conference on Human Factors in computing systems. ACM Press-Association for Computing Machinery.

Digital Library

[7]

Holger Junker, Oliver Amft, Paul Lukowicz, and Gerhard Tröster. 2008. Gesture spotting with body-worn inertial sensors to detect user activities. Pattern Recognition, 41(6), 2010--2024.

Digital Library

[8]

Karen E. Fisher. 2005. Theories of information behavior, ISBN 978-1-57387-230-0

Digital Library

[9]

Lv Zhihan, Feng Liangbing, Li Haibo, and Feng Shengzhong. 2014. Hand-free motion interaction on Google glass. In Proc. SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications, 21.

Digital Library

[10]

Mayer Simon and Soros Gabor. 2014. User Interface Beaming--Seamless Interaction with Smart Things Using Personal Wearable Computers. In Wearable and Implantable Body Sensor Networks Workshops (BSN Workshops 2014), 46--49.

Digital Library

[11]

Ohannessian Kevin. (Nov 7, 2013). Wearable Tech: Americans Interested but Doubtful, Poll Finds. Retrieved April 20, 2015 from http://www.tomsguide.com/us/wearable-tech-americans-doubtful,news-17833.html

[12]

Orbeus Rekognition API. Retrieved July 20, 2014 from https://rekognition.com/

[13]

Pierce S. Jeffrey, et al. 1997. Image plane interaction techniques in 3D immersive environments. In Proceedings of the 1997 symposium on Interactive 3D graphics, 39-ff.

Digital Library

[14]

Pranav Mistry and Pattie Maes. SixthSense: a wearable gestural interface. In Proc. ACM SIGGRAPH ASIA 2009 Sketches, 11.

Digital Library

[15]

Pratham Parikh, et al. 2013. Fgest: Finger Tracking and Gesture Recognition in Smartphones. International Journal of Advanced Research in Computer Engineering & Technology (IJARCET 2013), 2(3), pp-0947.

Cited By

Hoshikawa JFujishiro I(2022)DVF: Toward Semiautomatic Composition of Perceptual Images of a Virtual Scene Through Hand Gesture Interface2022 International Conference on Cyberworlds (CW)10.1109/CW55638.2022.00040(169-170)Online publication date: Sep-2022
https://doi.org/10.1109/CW55638.2022.00040

Index Terms

InfoFinder: just-in-time information interface from the combination of an HWD with a smartwatch
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Exploring the use of hand-to-face input for interacting with head-worn displays
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We propose the use of Hand-to-Face input, a method to interact with head-worn displays (HWDs) that involves contact with the face. We explore Hand-to-Face interaction to find suitable techniques for common mobile tasks. We evaluate this form of ...
Investigating the effectiveness of peephole interaction for smartwatches in a map navigation task
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

With the increasing availability of smartwatches the question of suited input modalities arises. While direct touch input comes at the cost of the fat-finger problem, we propose to use a dynamic peephole to explore larger content such as websites or ...
PressTact: Side Pressure-Based Input for Smartwatch Interaction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Smartwatches have gained a lot of public interest as one of the most popular wearable devices in recent times, but their diminutive touch screens mar the user experiences. The small screen of watch suffers from visual occlusion and the fat finger ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '15: Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia

November 2015

442 pages

ISBN:9781450336055

DOI:10.1145/2836041

General Chairs:
Clemens Holzmann
University of Applied Sciences Upper Austria, Hagenberg, Austria
,
René Mayrhofer
Johannes Kepler University Linz, Linz, Austria
,
Program Chairs:
Jonna Häkkilä
University of Lapland
,
Enrico Rukzio
University of Ulm
,
Publications Chair:
Michael Roland
University of Applied Sciences Upper Austria

Copyright © 2015 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

FH OOE: University of Applied Sciences Upper Austria
Johannes Kepler Univ Linz: Johannes Kepler Universität Linz

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 November 2015

Check for updates

Author Tags

Qualifiers

Poster

Conference

MUM '15

Sponsor:

FH OOE
Johannes Kepler Univ Linz

MUM '15: 14th International Conference on Mobile and Ubiquitous Multimedia

November 30 - December 2, 2015

Linz, Austria

Acceptance Rates

MUM '15 Paper Acceptance Rate 33 of 89 submissions, 37%;

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
150
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)2

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hoshikawa JFujishiro I(2022)DVF: Toward Semiautomatic Composition of Perceptual Images of a Virtual Scene Through Hand Gesture Interface2022 International Conference on Cyberworlds (CW)10.1109/CW55638.2022.00040(169-170)Online publication date: Sep-2022
https://doi.org/10.1109/CW55638.2022.00040

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents