research-article

Virtual shelves: interactions with orientation aware devices

Authors:

Frank Chun Yat Li,

David Dearman,

Khai N. TruongAuthors Info & Claims

UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

Pages 125 - 128

https://doi.org/10.1145/1622176.1622200

Published: 04 October 2009 Publication History

Get Access

Abstract

Triggering shortcuts or actions on a mobile device often requires a long sequence of key presses. Because the functions of buttons are highly dependent on the current application's context, users are required to look at the display during interaction, even in many mobile situations when eyes-free interactions may be preferable. We present Virtual Shelves, a technique to trigger programmable shortcuts that leverages the user's spatial awareness and kinesthetic memory. With Virtual Shelves, the user triggers shortcuts by orienting a spatially-aware mobile device within the circular hemisphere in front of her. This space is segmented into definable and selectable regions along the phi and theta planes. We show that users can accurately point to 7 regions on the theta and 4 regions on the phi plane using only their kinesthetic memory. Building upon these results, we then evaluate a proof-of-concept prototype of the Virtual Shelves using a Nokia N93. The results show that Virtual Shelves is faster than the N93's native interface for common mobile phone tasks.

Supplementary Material

JPG File (p125-li.jpg)

Download
13.58 KB

MPEG File (p125-li.mpeg)

Download
46.81 MB

References

[1]

Biggs, J. and Srinivasan, M.A.: Haptic Interfaces. In Handbook of Virtual Environments, Lawrence Earlbaum, Inc (2002), pp. 93--116.

Google Scholar

[2]

Cao, X., Massimi, M., and Balakrishnan, R.: Flashlight jigsaw: an exploratory study of an ad-hoc multi-player game on public displays. In Proc. CSCW 2008, ACM (2008), pp. 77--86.

Digital Library

Google Scholar

[3]

Clark, F.J.: How accurately can we perceive positions of our limbs? In Behavior and Brain Sciences, Cambridge University Press (1992), pp. 725--726.

Google Scholar

[4]

Cockburn, A., Gutwin, C., and Alexander, J.: Faster document navigation with space-filling thumbnails. In Proceedings of CHI '06, ACM Press (2006), pp. 1--10.

Digital Library

Google Scholar

[5]

Cockburn, A., Gutwin, C., and Greenberg, S.: A predictive model of menu performance. In Proceedings of CHI '07, ACM Press (2007), pp. 627--636.

Digital Library

Google Scholar

[6]

Czerwinski, M., van Dantzich, M., Robertson, G. and Hoffman, H.: The Contribution of Thumbnail Image, Mouse-over Text and Spatial Location Memory to Web Page Retrieval in 3D. In Proceedings of INTERACT '99, IOS Press (1999), pp. 163--170.

Google Scholar

[7]

Gray, W. and Fu, W.: Soft constraints in interactive behavior: the case of ignoring perfect knowledge in-the-world for imperfect knowledge in-the-head. Cognitive Science 28 (2004), pp. 359--382.

Google Scholar

[8]

Hinckley, K., Pierce, J., Sinclair, M. and Horvitz, E.: Sensing techniques for mobile interaction. In Proc. UIST '00, ACM (2000), pp. 91--100.

Digital Library

Google Scholar

[9]

Rekimoto, J.: Tilting operations for small screen interfaces. In Proceedings of UIST '96, ACM Press (1996), pp. 167--168.

Digital Library

Google Scholar

[10]

Robertson, G., Czerwinski, M., Larson, K., Robbins, D., Thiel, D., and van Dantzich, M.: Data Mountain: Using Spatial Memory for Document Management. In Proceedings of UIST '98, ACM Press (1998), pp. 153--162.

Digital Library

Google Scholar

[11]

Tan, D.S., Pausch, R., Stefanucci, J.K., and Proffitt, D.R.: Kinesthetic cues aid spatial memory. In CHI '02 Extended Abstracts on Human Factors in Computing System, ACM (2002), pp. 806--807.

Digital Library

Google Scholar

[12]

Teitelbaum, R.C., and Granda, R.E.: The effects of positional constancy on searching menus for information. In Proceedings of CHI '83, ACM (1983), pp. 150--153.

Digital Library

Google Scholar

[13]

Yee, K.-P.: Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. In Proceedings of CHI '03, ACM Press (2003), pp. 1--8.

Digital Library

Google Scholar

Cited By

View all

Cheng WChan L(2024)BodyTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314267:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631426
Preim BMeuschke MWeiß V(2024)A Survey of Medical Visualization Through the Lens of MetaphorsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.333054630:10(6639-6664)Online publication date: Oct-2024
https://doi.org/10.1109/TVCG.2023.3330546
Faisandaz GGoguey AJouffrais CNigay L(2023)µGeT: Multimodal eyes-free text selection technique combining touch interaction and microgesturesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614131(594-603)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614131
Show More Cited By

Index Terms

Virtual shelves: interactions with orientation aware devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

"Where Did I Put That?" --- Effectiveness of Kinesthetic Memory in Immersive Virtual Environments
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services

Kinesthetic memory is an essential factor in human interaction with the outside world. It helps adept keyboard users to type rapidly and hit the keys without having to look at them. It enables musicians to play their instruments without consciously ...
Studying spatial memory and map navigation performance on projector phones with peephole interaction
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Smartphones are useful personal assistants and omnipresent communication devices. However, collaboration is not among their strengths. With the advent of embedded projectors this might change. We conducted a study with 56 participants to find out if map ...
Interacting with virtual reality scenes on mobile devices
MobileHCI '05: Proceedings of the 7th international conference on Human computer interaction with mobile devices & services

This paper discusses alternative approaches for interacting with virtual reality scenes on mobile devices, based upon work conducted as part of the locus project [4]. Three prototypes are introduced that adopt different interaction paradigms for mobile ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

October 2009

278 pages

ISBN:9781605587455

DOI:10.1145/1622176

General Chair:
Andrew Wilson
Microsoft Research, USA
,
Program Chair:
François Guimbretière
Cornell University, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '09

Sponsor:

UIST '09: The 22nd Annual ACM Symposium on User Interface Software and Technology

October 4 - 7, 2009

BC, Victoria, Canada

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

89
Total Citations
View Citations
1,597
Total Downloads

Downloads (Last 12 months)34
Downloads (Last 6 weeks)3

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Cheng WChan L(2024)BodyTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314267:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631426
Preim BMeuschke MWeiß V(2024)A Survey of Medical Visualization Through the Lens of MetaphorsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.333054630:10(6639-6664)Online publication date: Oct-2024
https://doi.org/10.1109/TVCG.2023.3330546
Faisandaz GGoguey AJouffrais CNigay L(2023)µGeT: Multimodal eyes-free text selection technique combining touch interaction and microgesturesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614131(594-603)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614131
Streli PArmani RCheng YHolz C(2023)HOOV: Hand Out-Of-View Tracking for Proprioceptive Interaction using Inertial SensingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581468(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581468
Yeo HWu EKim DLee JKim HOh STakagi LWoo WKoike HQuigley A(2023)OmniSense: Exploring Novel Input Sensing and Interaction Techniques on Mobile Device with an Omni-Directional CameraProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580747(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580747
Allgaier MSpitz LBehme DMpotsaris ABerg PPreim BSaalfeld S(2023)Design of a virtual data shelf to effectively explore a large database of 3D medical surface models in VRInternational Journal of Computer Assisted Radiology and Surgery10.1007/s11548-023-02851-z18:11(2013-2022)Online publication date: 3-Mar-2023
https://doi.org/10.1007/s11548-023-02851-z
Grubert J(2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_5
Liu JProuzeau AEns BDwyer T(2022)Effects of Display Layout on Spatial Memory for Immersive EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/35677296:ISS(468-488)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567729
Ye HLee CWu TYang XChen BLiang R(2022)Body-Centric NFC: Body-Centric Interaction with NFC Devices Through Near-Field Enabled ClothingProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3534569(1626-1639)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3534569
Jannat MVo THasan K(2022)Face-Centered Spatial User Interfaces on SmartwatchesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519720(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519720
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

"Where Did I Put That?" --- Effectiveness of Kinesthetic Memory in Immersive Virtual Environments

Studying spatial memory and map navigation performance on projector phones with peephole interaction

Interacting with virtual reality scenes on mobile devices