More Web Proxy on the site http://driver.im/

research-article

One-handed interaction with augmented virtual objects on mobile devices

Authors:

Junyeoung Choi,

Jong-Il ParkAuthors Info & Claims

VRCAI '08: Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry

Article No.: 8, Pages 1 - 6

https://doi.org/10.1145/1477862.1477873

Published: 08 December 2008 Publication History

Abstract

We present a one-handed approach for augmented reality and interaction on mobile devices. The proposed application considers common situations with mobile devices such as when a user's hand holds a mobile device while the other hand is free. It also supports natural augmented reality environment such as when a user interacts with augmented reality contents anytime and anywhere without special equipment such as visual markers or tags. In our approach, a virtual object is augmented on the palm of a user's free hand, as if the virtual object is just sitting on the palm, using a palm pose estimation method. The augmented virtual object reacts (e.g. moving or animation) to motions of the hand such as opening or closing the hand based on fingertip tracking. Moreover, it provides tactile interactions with the virtual object by wearing a tactile glove with vibration sensors. This paper describes how to implement the augmented reality application, and preliminary results show its potential as a new approach to mobile augmented reality interaction.

References

[1]

Borgefors, G. 1986. Distance transformations in digital images. Computer Vision, Graphics, and Image Processing 34, 344--371.

Digital Library

[2]

Erol, A., Bebis, G., Nicolescu, M., Boyle, R. D., and Twombly, X. 2007. Vision-based hand pose estimation: A review. Computer Vision and Image Understanding 108, 52--73.

Digital Library

[3]

Henrysson, A., Ollila, M., and Billinghurst, M. 2005. Mobile phone based AR scene assembly. In Proceedings of International Conference on Mobile and Ubiquitous Multimedia 2005, 95--102.

Digital Library

[4]

Herbst, I., Braun, A.-K., McCall, R., and Broll, W. 2008. TimeWarp: Interactive time travel with a mobile mixed reality game. In Proceedings of International Conference on Human Computer Interaction with Mobile Devices and Services 2008, 235--244.

Digital Library

[5]

Honkamaa, P., Siltanen, S., Jappinen, J., Woodward, C., and Korkalo, O. 2007. Interactive outdoor mobile augmentation using markerless tracking and GPS. In Proceedings of Virtual Reality International Conference 2007, 285--288.

[6]

Immersion, Corp. 2007. CyberTouch and CyberGlove.

[7]

Jones, M. J., and Rehg, J. M. 2002. Statistical color models with application to skin detection. International Journal of Computer Vision 46, 81--96.

Digital Library

[8]

Lee, G. G., Billinghurst, M., and Kim, G. J. 2004. Occlusion based interaction methods for tangible augmented reality environments. In Proceedings of ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry 2004, 419--426.

Digital Library

[9]

Minamizawa, K., Fukamachi, S., Kajimoto, H., Kawakami, N., and Tachi, S. 2007. Gravity Grabber: Wearable haptic display to present virtual mass sensation. In Proceedings of ACM SIGGRAPH Emerging Technologies 2007.

Digital Library

[10]

Minamizawa, K., Kamuro, S., Fukamachi, S., Kawakami, N., and Tachi, S. 2008. GhostGlove: Haptic existence of the virtual world. In Proceedings of ACM SIGGRAPH 2008.

Digital Library

[11]

Narzt, W., Kolb, D., Muller, R., and Hortner, H. 2003. Pervasive information acquisition for mobile AR-navigation systems. In Proceedings of IEEE Workshop on Mobile Computing Systems & Applications 2003, 13--20.

[12]

Olwal, A. 2006. LightSense: Enabling spatially aware handheld interaction devices. In Proceedings of IEEE and ACM International Symposium on Mixed and Augmented Reality 2006, 119--122.

Digital Library

[13]

Paelke, V., Reimann, C., and Stichling, D. 2004. Footbased mobile interaction with games. In Proceedings of ACM SIGCHI International Conference on Advances in Computer Entertainment Technology 2004, 321--324.

Digital Library

[14]

Rohs, M. 2005. Visual code widgets for marker-based interaction. In Proceedings of International Workshop on Smart Appliances and Wearable Computing 2005, 506--518.

Digital Library

[15]

Rohs, M., 2008. Camera-based interaction and interaction with public displays. ACM MobileHCI 2008 Tutorial Notes.

[16]

Schall, G., Grabner, H., Grabner, M., Wohlhart, P., Schmalstieg, D., and Bischof, H. 2008. 3D tracking in unknown environments using on-line keypoint learning for mobile augmented reality. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2008, 285--288.

[17]

Wagner, D., Pintaric, T., Ledermann, F., and Schmalstieg, D. 2005. Towards massively multi-user augmented reality on handheld devices. Lecture Notes in Computer Science 3468, 208--219.

Digital Library

[18]

Wagner, D., Billinghurst, M., and Schmalstieg, D. 2006. How real should virtual characters be? In Proceedings of ACM SIGCHI International Conference on Advances in Computer Entertainment Technology 2006.

Digital Library

[19]

Wilson, A. D. 2007. Depth-sensing video cameras for 3D tangible tabletop interaction. In Proceedings of IEEE International Workshop on Horizontal Interactive Human-Computer Systems 2007, 201--204.

Cited By

Wu QLi YShe YLiu FLuo YYang XBottoni PPanizzi E(2022)Bridging Virtual and Reality in Mobile Augmented Reality Applications to Promote Immersive ExperienceProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3531122(1-5)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3531122
Qian JMa JLi XAttal BLai HTompkin JHughes JHuang JGuimbretière FBernstein MReinecke K(2019)Portal-ble: Intuitive Free-hand Manipulation in Unbounded Smartphone-based Augmented RealityProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347904(133-145)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347904
Goh ESunar MIsmail A(2019)3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A ReviewIEEE Access10.1109/ACCESS.2019.29063947(40581-40601)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2906394
Show More Cited By

Index Terms

One-handed interaction with augmented virtual objects on mobile devices
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices
    2. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

Interaction with Virtual Content using Augmented Reality: A User Study in Assembly Procedures
ISS

Assembly procedures are a common task in several domains of application. Augmented Reality (AR) has been considered as having great potential in assisting users while performing such tasks. However, poor interaction design and lack of studies, often ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Multi-sensorial virtual reality and augmented human food interaction
MHFI '16: Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction

In the field of virtual reality (VR) research, media technologies to create a realistic feeling of being present in a real/virtual world by duplicating multi-sensory information have been studied over a long period. Recently, technologies for multi-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '08: Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry

December 2008

223 pages

ISBN:9781605583358

DOI:10.1145/1477862

Conference Chairs:
Susanto Rahardja
Singapore
,
Enhua Wu
China
,
Program Chairs:
Daniel Thalmann
Switzerland
,
Zhiyong Huang
Singapore

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
Institute for Infocomm Research, A*STAR

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 December 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

IT R&D program of MKE/IITA
Ministry of Knowledge Economy

Conference

VRCAI '08

Sponsor:

SIGGRAPH

VRCAI '08: ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry 2008

December 8 - 9, 2008

Singapore

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
1,111
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wu QLi YShe YLiu FLuo YYang XBottoni PPanizzi E(2022)Bridging Virtual and Reality in Mobile Augmented Reality Applications to Promote Immersive ExperienceProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3531122(1-5)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3531122
Qian JMa JLi XAttal BLai HTompkin JHughes JHuang JGuimbretière FBernstein MReinecke K(2019)Portal-ble: Intuitive Free-hand Manipulation in Unbounded Smartphone-based Augmented RealityProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347904(133-145)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347904
Goh ESunar MIsmail A(2019)3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A ReviewIEEE Access10.1109/ACCESS.2019.29063947(40581-40601)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2906394
Kim HHwang J(2018)Manipulating augmented virtual character using dynamic hierarchical pointing interfaceComputer Animation and Virtual Worlds10.1002/cav.182429:3-4Online publication date: 18-Apr-2018
https://doi.org/10.1002/cav.1824
Bai HLee GBillinghurst M(2015)Free-hand Gesture Interfaces for an Augmented Exhibition PodiumProceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction10.1145/2838739.2838799(182-186)Online publication date: 7-Dec-2015
https://dl.acm.org/doi/10.1145/2838739.2838799
Ahmed LHamdy SHegazy DEl-Arif T(2015)Interaction techniques in mobile Augmented Reality: State-of-the-art2015 IEEE Seventh International Conference on Intelligent Computing and Information Systems (ICICIS)10.1109/IntelCIS.2015.7397255(424-433)Online publication date: Dec-2015
https://doi.org/10.1109/IntelCIS.2015.7397255
Nivedha S. Hemalatha S. (2015)Enhancing user experience through physical interaction in handheld Augmented Reality2015 International Conference on Computer Communication and Informatics (ICCCI)10.1109/ICCCI.2015.7218127(1-7)Online publication date: Jan-2015
https://doi.org/10.1109/ICCCI.2015.7218127
Jung JJeon JLee HKwon KZemerly JYang HJin XMagnenat-Thalmann NYang HYang XBednarz TFujishiro I(2014)Augmented keyboardProceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/2670473.2670482(159-164)Online publication date: 30-Nov-2014
https://dl.acm.org/doi/10.1145/2670473.2670482
Bai HLee GRamakrishnan MBillinghurst M(2014)3D gesture interaction for handheld augmented realitySIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications10.1145/2669062.2669073(1-6)Online publication date: 24-Nov-2014
https://dl.acm.org/doi/10.1145/2669062.2669073
Niijima AOgawa T(2014)A Study of Changing Locations of Vibrotactile Perception on a Forearm by Visual StimulationCollaboration Technologies and Social Computing10.1007/978-3-662-44651-5_8(86-95)Online publication date: 2014
https://doi.org/10.1007/978-3-662-44651-5_8
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents