More Web Proxy on the site http://driver.im/

research-article

FlyMap: Interacting with Maps Projected from a Drone

Authors:

James A. Landay,

Jessica R. CauchardAuthors Info & Claims

PerDis '18: Proceedings of the 7th ACM International Symposium on Pervasive Displays

Article No.: 13, Pages 1 - 9

https://doi.org/10.1145/3205873.3205877

Published: 06 June 2018 Publication History

Abstract

Interactive maps have become ubiquitous in our daily lives, helping us reach destinations and discovering our surroundings. Yet, designing map interactions is not straightforward and depends on the device being used. As mobile devices evolve and become independent from users, such as with robots and drones, how will we interact with the maps they provide? We propose FlyMap as a novel user experience for drone-based interactive maps. We designed and developed three interaction techniques for FlyMap's usage scenarios. In a comprehensive indoor study (N = 16), we show the strengths and weaknesses of two techniques on users' cognition, task load, and satisfaction. FlyMap was then pilot tested with the third technique outdoors in real world conditions with four groups of participants (N = 13). We show that FlyMap's interactivity is exciting to users and opens the space for more direct interactions with drones.

References

[1]

Parastoo Abtahi, David Y. Zhao, L. E. Jane, and James A. Landay. 2017. Drone Near Me: Exploring Touch-Based Human-Drone Interaction. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 34 (Sept. 2017), 8 pages.

Digital Library

[2]

Mauro Avila Soto, Markus Funk, Matthias Hoppe, Robin Boldt, Katrin Wolf, and Niels Henze. 2017. DroneNavigator: Using Leashed and Free-Floating Quadcopters to Navigate Visually Impaired Travelers. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17). ACM, New York, NY, USA, 300--304.

Digital Library

[3]

Aaron Bangor, Philip T. Kortum, and James T. Miller. 2008. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction 24, 6 (July 2008), 574--594.

[4]

John Brooke. 1996. SUS: A quick and dirty usability scale. In Usability Evaluation in Industry, P. W. Jordan, B. Thomas, B. A. Weerdmeester, and I. L. McClelland (Eds.). Taylor & Francis, London, UK, 189--194.

[5]

Wolfram Burgard, Armin B. Cremers, Dieter Fox, Dirk Hähnel, Gerhard Lakemeyer, Dirk Schulz, Walter Steiner, and Sebastian Thrun. 1999. Experiences with an Interactive Museum Tour-guide Robot. Artif. Intell. 114, 1-2 (Oct. 1999), 3--55.

Digital Library

[6]

Jessica R. Cauchard, Jane L. E, Kevin Y. Zhai, and James A. Landay. 2015. Drone & me: an exploration into natural human-drone interaction. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, 361--365.

Digital Library

[7]

Jessica R. Cauchard, Markus Löchtefeld, Pourang Irani, Johannes Schoening, Antonio Krüger, Mike Fraser, and Sriram Subramanian. 2011. Visual Separation in Mobile Multi-display Environments. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 451--460.

Digital Library

[8]

Jessica R. Cauchard, Kevin Y. Zhai, Marco Spadafora, and James A. Landay. 2016. Emotion Encoding in Human-Drone Interaction. In Proceedings of the 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI'16). IEEE, 263--270.

Digital Library

[9]

Victoria Chang, Pramod Chundury, and Marshini Chetty. 2017. Spiders in the Sky: User Perceptions of Drones, Privacy, and Security. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6765--6776.

Digital Library

[10]

Ashley Colley, Lasse Virtanen, Pascal Knierim, and Jonna Häkkilä. 2017. Investigating Drone Motion As Pedestrian Guidance. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM '17). ACM, New York, NY, USA, 143--150.

Digital Library

[11]

Alexandru Dancu, Zlatko Franjcic, and Morten Fjeld. 2014. Smart Flashlight: Map Navigation Using a Bike-mounted Projector. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). 3627--3630.

Digital Library

[12]

Jane L. E, Ilene L. E, James A. Landay, and Jessica R. Cauchard. 2017. Drone & Wo: Cultural Influences on Human-Drone Interaction Techniques. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6794--6799.

Digital Library

[13]

Juan Fasola and Maja J Matarić 2013. A Socially Assistive Robot Exercise Coach for the Elderly. J. Hum.-Robot Interact. 2, 2 (June 2013), 3--32.

Digital Library

[14]

Aaron L. Gardony, Holly A. Taylor, and Tad T. Brunyé. 2016. Gardony Map Drawing Analyzer: Software for quantitative analysis of sketch maps. Behavior Research Methods 48, 1 (2016), 151--177.

[15]

Rachel Gockley, Allison Bruce, Jodi Forlizzi, Marek Michalowski, Anne Mundell, Stephanie Rosenthal, Brennan Sellner, Reid Simmons, Kevin Snipes, Alan C. Schultz, and Jue Wang. 2005. Designing robots for long-term social interaction. In 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems. 1338--1343.

[16]

Antonio Gomes, Calvin Rubens, Sean Braley, and Roel Vertegaal. 2016. BitDrones: Towards Using 3D Nanocopter Displays As Interactive Self-Levitating Programmable Matter. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 770--780.

Digital Library

[17]

Andrew Greaves, Alina Hang, and Enrico Rukzio. 2008. Picture Browsing and Map Interaction Using a Projector Phone. In Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '08). ACM, New York, NY, USA, 527--530.

Digital Library

[18]

Alina Hang, Enrico Rukzio, and Andrew Greaves. 2008. Projector Phone: A Study of Using Mobile Phones with Integrated Projector for Interaction with Maps. In Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '08). ACM, New York, NY, USA, 207--216.

Digital Library

[19]

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139--183.

[20]

Mary Hegarty, Anthony E. Richardson, Daniel R. Montello, Kristin Lovelace, and Ilavanil Subbiah. 2002. Development of a self-report measure of environmental spatial ability. Intelligence 30, 5 (2002), 425--447.

[21]

Bomyeong Kim, Hyun Young Kim, and Jinwoo Kim. 2016. Getting Home Safely with Drone. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM, New York, NY, USA, 117--120.

Digital Library

[22]

Konstantin Klamka, Andreas Siegel, Stefan Vogt, Fabian Göbel, Sophie Stellmach, and Raimund Dachselt. 2015. Look & Pedal: Hands-free Navigation in Zoomable Information Spaces Through Gaze-supported Foot Input. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction (ICMI '15). ACM, New York, NY, USA, 123--130.

Digital Library

[23]

Matjaž Kljun, Klen Čopič Pucihar, Mark Lochrie, and Paul Egglestone. 2015. StreetGamez: A Moving Projector Platform for Projected Street Games. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 589--594.

Digital Library

[24]

P. Knierim, S. Maurer, K. Wolf, and M. Funk. 2018. Quadcopter-projected in-situ navigation cues for improved location awareness. To appear in the ACM Conference on Human Factors in Computing Systems (2018), 1--6.

Digital Library

[25]

Florian 'Floyd' Mueller and Matthew Muirhead. 2015. Jogging with a Quadcopter. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2023--2032.

Digital Library

[26]

Jawad Nagi, Alessandro Giusti, Gianni A Di Caro, and Luca M Gambardella. 2014. Human control of UAVs using face pose estimates and hand gestures. In Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction. ACM, 252--253.

Digital Library

[27]

Tayyab Naseer, Jürgen Sturm, and Daniel Cremers. 2013. Followme: Person following and gesture recognition with a quadrocopter. In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 624--630.

[28]

Michel Pahud, Ken Hinckley, Shamsi Iqbal, Abigail Sellen, and Bill Buxton. 2013. Toward Compound Navigation Tasks on Mobiles via Spatial Manipulation. In Proceedings of the 15th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '13). ACM, New York, NY, USA, 113--122.

Digital Library

[29]

Michael Rohs, Johannes Schöning, Martin Raubal, Georg Essl, and Antonio Krüger. 2007. Map Navigation with Mobile Devices: Virtual versus Physical Movement with and without Visual Context. In Proceedings of the 9th international conference on Multimodal interfaces - ICMI '07. ACM Press, New York, New York, USA, 146.

Digital Library

[30]

Takuya Sasai, Yo Takahashi, Mitsunori Kotani, and Akio Nakamura. 2011. Development of a guide robot interacting with the user using information projection -Basic system. In Proceedings of the IEEE International Conference on Mechatronics and Automation. 1297--1302.

[31]

Jürgen Scheible, Achim Hoth, Julian Saal, and Haifeng Su. 2013. Displaydrone: A Flying Robot Based Interactive Display. In Proceedings of the 2nd ACM International Symposium on Pervasive Displays (PerDis '13). ACM, New York, NY, USA, 49--54.

Digital Library

[32]

Stefan Schneegass, Florian Alt, Jürgen Scheible, and Albrecht Schmidt. 2014. Mid-air Displays: Concept and First Experiences with Free-Floating Pervasive Displays. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14). ACM, New York, NY, USA, Article 27, 5 pages.

Digital Library

[33]

Zahra Shakeri Hossein Abad, Craig Anslow, and Frank Maurer. 2014. Multi Surface Interactions with Geospatial Data: A Systematic Review. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces - ITS '14. ACM Press, New York, New York, USA, 69--78.

Digital Library

[34]

Martin Spindler, Martin Schuessler, Marcel Martsch, and Raimund Dachselt. 2014. Pinch-drag-flick vs. Spatial Input: Rethinking Zoom & Pan on Mobile Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1113--1122.

Digital Library

[35]

Daniel Szafir, Bilge Mutlu, and Terrence Fong. 2014. Communication of intent in assistive free flyers. In Proceedings of the 2014 ACM/IEEE international conference on Human-Robot Interaction. ACM, 358--365.

Digital Library

[36]

Daniel Szafir, Bilge Mutlu, and Terry Fong. 2015. Communicating Directionality in Flying Robots. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI '15). ACM, New York, NY, USA, 19--26.

Digital Library

[37]

Desney S. Tan, Randy Pausch, Jeanine K. Stefanucci, and Dennis R. Proffitt. 2002. Kinesthetic Cues Aid Spatial Memory. In CHI '02 Extended Abstracts on Human Factors in Computing Systems (CHI EA '02). ACM, New York, NY, USA, 806--807.

Digital Library

[38]

Sebastian Thrun, Maren Bennewitz, Wolfram Burgard, Armin B. Cremers, Frank Dellaert, Dieter Fox, Dirk Hähnel, Charles Rosenberg, Nicholas Roy, Jamieson Schulte, and Dirk Schulz. 1999. MINERVA: A second-generation museum tour-guide robot. In Proceedings of IEEE International Conference on Robotics and Automation - ICRA '99.

[39]

Luke Vink, Jessica R. Cauchard, and James A. Landay. 2014. Autonomous Wandering Interface (AWI). (2014). https://www.youtube.com/watch?v=cqU_hR2_ILU/.

Cited By

Fernández USarasate IEzcurdia ILopez-Amo MFernández IMarzo A(2024)PointerVol: A Laser Pointer for Swept Volumetric DisplaysProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676432(1-8)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676432
Wang YHoggenmüller MZhang GTran TTomitsch M(2024)Immersive In-Situ Prototyping: Influence of Real-World Context on Evaluating Future Pedestrian Interfaces in Virtual RealityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651071(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651071
Dong KZhang ZChang XChirarattananon PLC R(2024)Dances with Drones: Spatial Matching and Perceived Agency in Improvised Movements with Drone and Human PartnersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642345(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642345
Show More Cited By

Index Terms

FlyMap: Interacting with Maps Projected from a Drone
1. Computing methodologies
  1. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Drone Near Me: Exploring Touch-Based Human-Drone Interaction

Personal drones are becoming more mainstream and are used for a variety of tasks, such as delivery and photography. The exposed blades in conventional drones raise serious safety concerns. To address this, commercial drones have been moving towards a ...
drone.io: a gestural and visual interface for human-drone interaction
HRI '19: Proceedings of the 14th ACM/IEEE International Conference on Human-Robot Interaction

Drones are becoming ubiquitous and offer support to people in various tasks, such as photography, in increasingly interactive social contexts. We introduce drone.io, a projected body-centric graphical user interface for human-drone interaction. Using ...
Drone & Wo: Cultural Influences on Human-Drone Interaction Techniques
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

As drones become ubiquitous, it is important to understand how cultural differences impact human-drone interaction. A previous elicitation study performed in the USA illustrated how users would intuitively interact with drones. We replicated this study ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

PerDis '18: Proceedings of the 7th ACM International Symposium on Pervasive Displays

June 2018

197 pages

ISBN:9781450357654

DOI:10.1145/3205873

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

PerDis '18

Sponsor:

SIGMOBILE

PerDis '18: The International Symposium on Pervasive Displays

June 6 - 8, 2018

Munich, Germany

Acceptance Rates

PerDis '18 Paper Acceptance Rate 22 of 36 submissions, 61%;

Overall Acceptance Rate 213 of 384 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
630
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fernández USarasate IEzcurdia ILopez-Amo MFernández IMarzo A(2024)PointerVol: A Laser Pointer for Swept Volumetric DisplaysProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676432(1-8)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676432
Wang YHoggenmüller MZhang GTran TTomitsch M(2024)Immersive In-Situ Prototyping: Influence of Real-World Context on Evaluating Future Pedestrian Interfaces in Virtual RealityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651071(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651071
Dong KZhang ZChang XChirarattananon PLC R(2024)Dances with Drones: Spatial Matching and Perceived Agency in Improvised Movements with Drone and Human PartnersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642345(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642345
Cauchard JDutau CCorsini GCognetti MSidobre DLacroix SBrock AGrollman DBroadbent EJu WSoh HWilliams T(2024)Considerations for Handover and Co-working with DronesCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640590(302-306)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640590
Lingam SFranssen MPetermeijer SMartens M(2024)Challenges and Future Directions for Human-Drone Interaction Research: An Expert PerspectiveInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2400756(1-17)Online publication date: 12-Sep-2024
https://doi.org/10.1080/10447318.2024.2400756
Gamboa MBaytaş MHendriks SLjungblad S(2023)Wisp: Drones as Companions for BreathingProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572740(1-16)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572740
Wilson-Small NGoedicke DPetersen KAzenkot SCastellano GRiek LCakmak MLeite I(2023)A Drone TeacherProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576985(311-320)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576985
Yamin LCauchard J(2022)Generative Adversarial Networks and Data Clustering for Likable Drone DesignSensors10.3390/s2217643322:17(6433)Online publication date: 26-Aug-2022
https://doi.org/10.3390/s22176433
Grübel JThrash TAguilar LGath-Morad MChatain JSumner RHölscher CSchinazi V(2022)The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart CitiesRemote Sensing10.3390/rs1413309514:13(3095)Online publication date: 27-Jun-2022
https://doi.org/10.3390/rs14133095
Rueben MHorrocks MMartinez JCormier MLaLone NFraune MToups Dugas P(2022)“I See You!”: A Design Framework for Interface Cues about Agent Visual Perception from a Thematic Analysis of VideogamesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517699(1-22)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517699
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents