More Web Proxy on the site http://driver.im/

research-article

Memory in Motion: The Influence of Gesture- and Touch-Based Input Modalities on Spatial Memory

Authors:

Johannes Zagermann,

Philipp von Bauer,

Harald ReitererAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 1899 - 1910

https://doi.org/10.1145/3025453.3026001

Published: 02 May 2017 Publication History

Abstract

People's ability to remember and recall spatial information can be harnessed to improve navigation and search performances in interactive systems. In this paper, we investigate how display size and input modality influence spatial memory, especially in relation to efficiency and user satisfaction. Based on an experiment with 28 participants, we analyze the effect of three input modalities (trackpad, direct touch, and gesture-based motion controller) and two display sizes (10.6" and 55") on people's ability to navigate to spatially spread items and recall their positions. Our findings show that the impact of input modality and display size on spatial memory is not straightforward, but characterized by trade-offs between spatial memory, efficiency, and user satisfaction.

Supplementary Material

suppl.mov (pn4457-file3.mp4)

Supplemental video

Download
65.12 MB

suppl.mov (pn4457p.mp4)

Supplemental video

Download
2.15 MB

MP4 File (p1899-zagermann.mp4)

Download
241.35 MB

References

[1]

Gary L Allen. 2004. Human spatial memory: Remembering where. Psychology Press.

[2]

Patrick Baudisch and Ruth Rosenholtz. 2003. Halo: A Technique for Visualizing Off-screen Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, NY, NY, USA, 481--488.

Digital Library

[3]

Simon Butscher and Harald Reiterer. 2016. Applying Guidelines for the Design of Distortions on Focus+Context Interfaces. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '16). ACM, NY, NY, USA, 244--247.

Digital Library

[4]

Andy Cockburn, Amy Karlson, and Benjamin B. Bederson. 2009. A Review of Overview+Detail, Zooming, and Focus+Context Interfaces. ACM Comput. Surv. 41, 1, Article 2 (Jan. 2009), 31 pages.

Digital Library

[5]

Sean Gustafson, Patrick Baudisch, Carl Gutwin, and Pourang Irani. 2008. Wedge: Clutter-free Visualization of Off-screen Locations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, NY, NY, USA, 787--796.

Digital Library

[6]

Sandra G. Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human mental workload 1, 3 (1988), 139--183.

[7]

Kasper Hornbæk. 2006. Current Practice in Measuring Usability: Challenges to Usability Studies and Research. Int. J. Hum.-Comput. Stud. 64, 2 (Feb. 2006), 79--102.

Digital Library

[8]

Kasper Hornbæk, Benjamin B. Bederson, and Catherine Plaisant. 2002. Navigation Patterns and Usability of Zoomable User Interfaces with and Without an Overview. ACM Trans. Comput.-Hum. Interact. 9, 4 (Dec. 2002), 362--389.

Digital Library

[9]

Kasper Hornbæk and Effie Lai-Chong Law. 2007. Meta-analysis of Correlations Among Usability Measures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, NY, NY, USA, 617--626.

Digital Library

[10]

Mikkel R. Jakobsen, Yvonne Jansen, Sebastian Boring, and Kasper Hornbæk. 2015. Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction. Springer International Publishing, Cham, 455--473.

[11]

Hans-Christian Jetter, Svenja Leifert, Jens Gerken, Sören Schubert, and Harald Reiterer. 2012. Does (Multi-)Touch Aid Users' Spatial Memory and Navigation in "Panning" and in "Zooming & Panning" UIs?. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12). ACM, NY, NY, USA, 83--90.

Digital Library

[12]

Bonifaz Kaufmann and David Ahlström. 2013. Studying Spatial Memory and Map Navigation Performance on Projector Phones with Peephole Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NY, NY, USA, 3173--3176.

Digital Library

[13]

Daniel Klinkhammer, Jan Oke Tennie, Paula Erdoes, and Harald Reiterer. 2013. Body Panning: A Movement-based Navigation Technique for Large Interactive Surfaces. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS '13). ACM, NY, NY, USA, 37--40.

Digital Library

[14]

Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and Usability Engineering Group. Springer, 63--76.

Digital Library

[15]

Svenja Leifert. 2011. The Influence of Grids on Spatial and Content Memory. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, NY, NY, USA, 941--946.

Digital Library

[16]

Jens Müller, Roman Rädle, Hans-Christian Jetter, and Harald Reiterer. 2015. An Experimental Comparison of Vertical and Horizontal Dynamic Peephole Navigation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 1523--1526.

Digital Library

[17]

Jens Müller, Roman Rädle, and Harald Reiterer. 2016. Virtual Objects As Spatial Cues in Collaborative Mixed Reality Environments: How They Shape Communication Behavior and User Task Load. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 1245--1249.

Digital Library

[18]

Jakob Nielsen and Jonathan Levy. 1994. Measuring Usability: Preference vs. Performance. Commun. ACM 37, 4 (April 1994), 66--75.

Digital Library

[19]

Kenton O'Hara, Abigail Sellen, and Richard Bentley. 1999. Supporting Memory for Spatial Location While Reading from Small Displays. In CHI '99 Extended Abstracts on Human Factors in Computing Systems (CHI EA '99). ACM, NY, NY, USA, 220--221.

Digital Library

[20]

Henri Palleis and Heinrich Hussmann. 2016. Indirect 2D Touch Panning: How Does It Affect Spatial Memory and Navigation Performance?. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 1947--1951.

Digital Library

[21]

Kathrin Probst. 2016. Peripheral Interaction in Desktop Computing: Why It's Worth Stepping Beyond Traditional Mouse and Keyboard. Springer International Publishing, Cham, 183--205.

[22]

Roman Rädle, Hans-Christian Jetter, Simon Butscher, and Harald Reiterer. 2013. The Effect of Egocentric Body Movements on Users' Navigation Performance and Spatial Memory in Zoomable User Interfaces. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS '13). ACM, NY, NY, USA, 23--32.

Digital Library

[23]

Roman Rädle, Hans-Christian Jetter, Jens Müller, and Harald Reiterer. 2014. Bigger is Not Always Better: Display Size, Performance, and Task Load During Peephole Map Navigation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, NY, USA, 4127--4136.

Digital Library

[24]

Joey Scarr, Andy Cockburn, and Carl Gutwin. 2012. Supporting and exploiting spatial memory in user interfaces. Interaction 6, 1 (2012), 1--84.

Digital Library

[25]

Amy Skopik and Carl Gutwin. 2005. Improving Revisitation in Fisheye Views with Visit Wear. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, NY, NY, USA, 771--780.

Digital Library

[26]

Desney S. Tan, Darren Gergle, Peter Scupelli, and Randy Pausch. 2003. With Similar Visual Angles, Larger Displays Improve Spatial Performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, NY, NY, USA, 217--224.

Digital Library

[27]

Desney S. Tan, Darren Gergle, Peter G. Scupelli, and Randy Pausch. 2004. Physically Large Displays Improve Path Integration in 3D Virtual Navigation Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, NY, NY, USA, 439--446.

Digital Library

[28]

Desney S. Tan, Randy Pausch, Jeanine K. Stefanucci, and Dennis R. Proffitt. 2002. Kinesthetic Cues Aid Spatial Memory. In CHI '02 Extended Abstracts on Human Factors in Computing Systems (CHI EA '02). ACM, NY, NY, USA, 806--807.

Digital Library

[29]

F. Tyndiuk, G. Thomas, V. Lespinet-Najib, and C. Schlick. 2005. Cognitive Comparison of 3D Interaction in Front of Large vs. Small Displays. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST '05). ACM, NY, NY, USA, 117--123.

Digital Library

[30]

Norman G. Vinson. 1999. Design Guidelines for Landmarks to Support Navigation in Virtual Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, NY, NY, USA, 278--285.

Digital Library

[31]

Daniel Wigdor and Dennis Wixon. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture (1st ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.

Digital Library

Cited By

In SLin TNorth CPfister HYang Y(2024)This is the Table I Want! Interactive Data Transformation on Desktop and in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329960230:8(5635-5650)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3299602
Hubenschmid SZagermann JLeicht DReiterer HFeuchtner T(2023)ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial MemoryProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581438(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581438
Jannat MHasan K(2023)Exploring the Effects of Virtually-Augmented Display Sizes on Users’ Spatial Memory in Smartwatches2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00070(553-562)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00070
Show More Cited By

Index Terms

Memory in Motion: The Influence of Gesture- and Touch-Based Input Modalities on Spatial Memory
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

SegTouch: Enhancing Touch Input While Providing Touch Gestures on Screens Using Thumb-To-Index-Finger Gestures
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Insufficient input modality on touchscreens causes icons, toolbars and mode switching steps required to perform different functions. Although various methods are proposed to increase touchscreen input modality, touch gestures (e.g., swipe), usually used ...
TouchSense: expanding touchscreen input vocabulary using different areas of users' finger pads
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present TouchSense, which provides additional touchscreen input vocabulary by distinguishing the areas of users' finger pads contacting the touchscreen. It requires minimal touch input area and minimal movement, making it especially ideal for ...
Studying spatial memory and map navigation performance on projector phones with peephole interaction
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Smartphones are useful personal assistants and omnipresent communication devices. However, collaboration is not among their strengths. With the advent of embedded projectors this might change. We conducted a study with 56 participants to find out if map ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
734
Total Downloads

Downloads (Last 12 months)59
Downloads (Last 6 weeks)4

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

In SLin TNorth CPfister HYang Y(2024)This is the Table I Want! Interactive Data Transformation on Desktop and in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329960230:8(5635-5650)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3299602
Hubenschmid SZagermann JLeicht DReiterer HFeuchtner T(2023)ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial MemoryProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581438(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581438
Jannat MHasan K(2023)Exploring the Effects of Virtually-Augmented Display Sizes on Users’ Spatial Memory in Smartwatches2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00070(553-562)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00070
Zagermann JHubenschmid SFink DWieland JReiterer HFeuchtner T(2023)Challenges and Opportunities for Collaborative Immersive Analytics with Hybrid User Interfaces2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00044(191-195)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00044
Zagermann JHubenschmid SBalestrucci PFeuchtner TMayer SErnst MSchmidt AReiterer H(2022)Complementary interfaces for visual computingit - Information Technology10.1515/itit-2022-003164:4-5(145-154)Online publication date: 3-Sep-2022
https://doi.org/10.1515/itit-2022-0031
Liu JProuzeau AEns BDwyer T(2022)Effects of Display Layout on Spatial Memory for Immersive EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/35677296:ISS(468-488)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567729
López García IHornecker EKaltenbrunner MMurer MWolf KOakley I(2021)Scaling Data Physicalization – How Does Size Influence Experience?Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440627(1-14)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440627
Gao SYan SZhao HNathan AGao SYan SZhao HNathan A(2021)User Experience EvaluationTouch-Based Human-Machine Interaction10.1007/978-3-030-68948-3_6(155-177)Online publication date: 26-Mar-2021
https://doi.org/10.1007/978-3-030-68948-3_6
Zagermann JPfeil Uvon Bauer PFink DReiterer HBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)"It's in my other hand!" Studying the Interplay of Interaction Techniques and Multi-Tablet ActivitiesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376540(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376540
Yang ZYu CYi XShi Y(2019)Investigating Gesture Typing for Indirect TouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33512753:3(1-22)Online publication date: 9-Sep-2019
https://dl.acm.org/doi/10.1145/3351275
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents