More Web Proxy on the site http://driver.im/

research-article

Designing Telepresence Drones to Support Synchronous, Mid-air Remote Collaboration: An Exploratory Study

Authors:

David W. McDonaldAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 450, Pages 1 - 17

https://doi.org/10.1145/3411764.3445041

Published: 07 May 2021 Publication History

Abstract

Drones are increasingly used to support humanitarian crises and events that involve dangerous or costly tasks. While drones have great potential for remote collaborative work and aerial telepresence, existing drone technology is limited in its support for synchronous collaboration among multiple remote users. Through three design iterations and evaluations, we prototyped Squadrone, a novel aerial telepresence platform that supports synchronous mid-air collaboration among multiple remote users. We present our design and report results from evaluating our iterations with 13 participants in 3 different collaboration configurations. Our first design iteration validates the basic functionality of the platform. Then, we establish the effectiveness of collaboration using a 360-degree shared aerial display. Finally, we simulate a type of search task in an open environment to see if collaborative telepresence impacts members’ participation. The results validate some initial goals for Squadrone and are used to reflect back on a recent telepresence design framework.

Supplementary Material

MP4 File (3411764.3445041_videopreview.mp4)

Preview video

Download
19.46 MB

References

[1]

Evan Ackerman, Erico Guizzo. 2016. Marvin Minsky (1927-2016) and telepresence. Retrieved March 16, 2019 from https://ispr.info/2016/02/01/marvin-minsky-1927-2016-and-telepresence/

[2]

Il-han Bae. 2016. Avatar drone: Drone as telepresence platform with 3D mobility. In Proceedings of the 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), 452-453. https://doi.org/10.1109/URAI.2016.7734080

[3]

Jacob T. Biehl, Daniel Avrahami, and Anthony Dunnigan. 2015. "Not really there: Understanding embodied communication affordances in team perception and participation." In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing.

[4]

Alexandre Cherpillod, Stefano Mintchev, Dario Floreano. 2017. Embodied Flight with a Drone

[5]

Tracy Cozzens. 2020. China fights coronavirus with delivery drones. Retrieved May 20, 2020 from https://www.gpsworld.com/china-fights-coronavirus-with-delivery-drones/

[6]

Ken Goldberg. 1998. Virtual Reality in the Age of Telepresence. Convergence 4, 1: 33-37.

[7]

Mostafa Hassanalian, Abdessattar Abdelkefi. 2017. Classifications, applications, and design challenges of drones: A review. Progress in Aerospace Sciences 91: 99-131.

[8]

Hooman Hedayati, Michael Walker, and Daniel Szafir. 2018. "Improving collocated robot teleoperation with augmented reality." In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 78-86.

[9]

Keita Higuchi, Katsuya Fujii, and Jun Rekimoto. 2013. Flying Head: A Head- Synchronization Mechanism for Flying Telepresence. In Proceedings of the International Conference on Artificial Reality and Telexistence (ICAT), 28–34.

[10]

Jim Hollan, and Scott Stornetta. 1992. Beyond being there. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’92). 119-125.

Digital Library

[11]

Brennan Jones, Kody Dillman, Richard Tang, Anthony Tang, Ehud Sharlin, Lora Oehlberg, Carman Neustaedter, and Scott Bateman. (2016, June). Elevating communication, collaboration, and shared experiences in mobile video through drones. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (pp. 1123-1135). ACM.

Digital Library

[12]

Divya Joshi. 2016. Exploring the latest drone technology for commercial, industrial and military drone uses. Retrieved March 17, 2019 from https://www.businessinsider.com/drone-technology-uses-2017-7?r=US&IR=T

[13]

Shunichi Kasahara, and Jun Rekimoto. 2015. "JackIn head: immersive visual telepresence system with omnidirectional wearable camera for remote collaboration." Proceedings of the 21st ACM symposium on virtual reality software and technology. ACM.

[14]

Hiroki Kawasaki, Hiroyuki Iizuka, Shin Okamoto, Hideyuki Ando, and Taro Maeda. 2010. "Collaboration and skill transmission by first-person perspective view sharing system."19th International Symposium in Robot and Human Interactive Communication. IEEE.

[15]

N. Kloet, S. Watkins, and R. Clothier. 2017. Acoustic signature measurement of small multi-rotor unmanned aircraft systems. International Journal of Micro Air Vehicles 9, 1: 3-14.

[16]

Thomas Kosch, Markus Funk, Daniel Vietz, Marc Weise, Tamara Müller, and Albrecht Schmidt. 2018. DroneCTRL: A Tangible Remote Input Control for Quadcopters. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (UIST '18 Adjunct), 120-122. https://doi.org/10.1145/3266037.3266121

Digital Library

[17]

Annica Kristoffersson, Silvia Coradeschi, and Amy Loutfi. 2013. A review of mobile robotic telepresence. Adv. in Hum.-Comp. Int. 2013, Article 3 (January 2013), 1 pages. http://dx.doi.org/10.1155/2013/902316

[18]

Hideaki Kuzuoka. "Spatial workspace collaboration: a SharedView video support system for remote collaboration capability." Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 1992.

[19]

Megan Landau and Sebastian van Delden. 2017. A System Architecture for Hands-Free UAV Drone Control Using Intuitive Voice Commands. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI'17), 181-182. https://doi.org/10.1145/3029798.3038329

Digital Library

[20]

Jaron Lanier, Frank Biocca. 1992. An Insider's View of the Future of Virtual Reality. Journal of Communication 42, 4: 150-172.

[21]

Alexa Lardieri. 2018. NYPD to Use Drones for Search and Rescue, Hostage Situations. Retrieved January 20, 2020 from https://www.usnews.com/news/national-news/articles/2018-12-05/nypd-to-use-drones-for-search-and-rescue-hostage-situations

[22]

Tim Levin. 2017. Google Telepresence Drone: The Answer For Office Meetings From Home. Retrieved March 1, 2019 from https://www.wetalkuav.com/google-telepresence-drone/

[23]

Shannon Liao. 2019. DJI drones helped track and stop the Notre Dame fire. Retrieved January 20, 2020 from https://www.theverge.com/2019/4/16/18410723/notre-dame-fire-dji-drones-tracking-stopped-thermal-cameras

[24]

Matthew Lombard, Matthew Jones. 2007. Identifying the (Tele)Presence Literature. PsychNology Journal 5,197-206.

[25]

Kenneth Macdonald. 2020. Edinburgh University researchers use drones to map retreating Andes glaciers. Retrieved March 30, 2020 from https://www.bbc.com/news/uk-scotland-edinburgh-east-fife-51756592

[26]

Giuseppe Mantovani, Giuseppe Riva. 1999. “Real” Presence: How Different Ontologies Generate Different Criteria for Presence, Telepresence, and Virtual Presence. Presence 8: 540-550.

Digital Library

[27]

Harry McNabb. 2020. Spanish Police Use Drones to Get the Message Out: Stay at Home During Lockdown. Retrieved May 20, 2020 from https://dronelife.com/2020/03/18/spanish-police-use-drones-to-get-the-message-out-stay-at-home-during-lockdown/

[28]

Marvin Minsky. 1980. TELEPRESENCE. OMNI magazine: 45-52.

[29]

Jawad Nagi, Alessandro Giusti, Gianni A. Di Caro, and Luca M. Gambardella. 2014. "Human control of UAVs using face pose estimates and hand gestures." In 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 1-2. IEEE.

[30]

Jill M. Purdy, Pete Nye, and P. V. Balakrishnan. 2000. "The impact of communication media on negotiation outcomes." International Journal of Conflict Management 11.2: 162-187.

[31]

Irene Rae, Gina Venolia, John C. Tang, and David Molnar. 2015. A Framework for Understanding and Designing Telepresence. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15), 1552-1566. https://doi.org/10.1145/2675133.2675141

Digital Library

[32]

Eric Raymond. 1999. "The cathedral and the bazaar." Knowledge, Technology & Policy 12.3: 23-49.

[33]

Jason Reagan. 2020. EagleHawk Deploys Disinfectant Drones to Sanitize Facilities. Retrieved May 20, 2020 from https://dronelife.com/2020/05/05/disinfectant-drones-eaglehawk/

[34]

Goldman Sachs. 2019. Drones reporting for work. Retrieved March 30, 2019 from https://www.goldmansachs.com/insights/technology-driving-innovation/drones/

[35]

Hanieh Shakeri, and Carman Neustaedter. 2019. "Teledrone: Shared Outdoor Exploration Using Telepresence Drones." Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing.

[36]

Mel Slater, and Anthony Steed. 2000. "A virtual presence counter." Presence: Teleoperators & Virtual Environments 9, no. 5: 413-434.

Digital Library

[37]

Nikolai Smolyanskiy, and Mar Gonzalez-Franco. 2017. "Stereoscopic first person view system for drone navigation." Frontiers in Robotics and AI 4: 11.

[38]

SNOTBOT CORPORATION. 2019. API Index. https://whale.org/snotbot/

[39]

Brett Stoll, Samantha Reig, Lucy He, Ian Kaplan, Malte F. Jung, and Susan R. Fussell. 2018. "Wait, can you move the robot? examining telepresence robot use in collaborative teams." Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction.

[40]

Anthony Tang, and Omid Fakourfar. 2017. "Watching 360 videos together." Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems.

[41]

Eric Tilley and Jeff Gray. 2017. Dronely: A Visual Block Programming Language for the Control of Drones. In Proceedings of the SouthEast Conference (ACM SE '17), 208-211. https://doi.org/10.1145/3077286.3077307

Digital Library

[42]

Martin Usoh, Ernest Catena, Sima Arman, and Mel Slater. 2000. "Using presence questionnaires in reality." Presence: Teleoperators & Virtual Environments 9.5: 497-503.

Digital Library

[43]

Michael E. Walker, Hooman Hedayati, and Daniel Szafir. 2019. "Robot teleoperation with augmented reality virtual surrogates." In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 202-210. IEEE.

[44]

Ker-Jiun Wang, Hsiao-Wei Tung, Zihang Huang, Prakash Thakur, Zhi-Hong Mao, and Ming-Xian You. 2018. EXGbuds: Universal Wearable Assistive Device for Disabled People to Interact with the Environment Seamlessly. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (HRI '18), 369-370. https://doi.org/10.1145/3173386.3177836

Digital Library

[45]

Junwei Yang. 2020. 3 ways China is using drones to fight coronavirus. Retrieved March 30, 2019 from https://www.weforum.org/agenda/2020/03/three-ways-china-is-using-drones-to-fight-coronavirus/

[46]

Xujing Zhang. 2017. Lightbee: Design and Implementation of a Self-Levitating Light Field Display for Telepresence (Doctoral dissertation).

Cited By

Praveena PWang YSenft EGleicher MMutlu B(2023)Periscope: A Robotic Camera System to Support Remote Physical CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/36101997:CSCW2(1-39)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610199
Vijay HPushp SMittal AGupta PGupta MGambhira SChopra SBaranwal MArya AManchepalli APadmanabhan V(2023)HyWayProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962357:2(1-33)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596235
Sehad NCherif BKhadraoui IHamidouche WBader FJäntti RDebbah M(2023)Locomotion-Based UAV Control Toward the Internet of SensesIEEE Transactions on Circuits and Systems II: Express Briefs10.1109/TCSII.2023.325736370:5(1804-1808)Online publication date: May-2023
https://doi.org/10.1109/TCSII.2023.3257363
Show More Cited By

Index Terms

Designing Telepresence Drones to Support Synchronous, Mid-air Remote Collaboration: An Exploratory Study
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
  2. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Demonstrating Periscope: A Robotic Camera System to Support Remote Physical Collaboration
CSCW '23 Companion: Companion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing

This paper proposes a demonstration of Periscope, a robotic camera system that allows two people to collaborate remotely on physical tasks. With Periscope, a worker co-located with a robotic arm can receive guidance from a remote helper who observes the ...
Drones and Privacy

Drones, also referred to as UAV's Unmanned Aerial Vehicle, are an aircraft without a human pilot. Drones have been used by various military organisations for over a decade, but in recent years drones a have been emerging more and more in commercial and ...
Designing Robotic Camera Systems to Enable Synchronous Remote Collaboration
HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

Collaborative robots have the potential to be intelligent, embodied agents that can contribute to remote human collaboration. We explore this paradigm through the design of robot-mounted camera systems for remote assistance. In this extended abstract, we ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
748
Total Downloads

Downloads (Last 12 months)130
Downloads (Last 6 weeks)10

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Praveena PWang YSenft EGleicher MMutlu B(2023)Periscope: A Robotic Camera System to Support Remote Physical CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/36101997:CSCW2(1-39)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610199
Vijay HPushp SMittal AGupta PGupta MGambhira SChopra SBaranwal MArya AManchepalli APadmanabhan V(2023)HyWayProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962357:2(1-33)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596235
Sehad NCherif BKhadraoui IHamidouche WBader FJäntti RDebbah M(2023)Locomotion-Based UAV Control Toward the Internet of SensesIEEE Transactions on Circuits and Systems II: Express Briefs10.1109/TCSII.2023.325736370:5(1804-1808)Online publication date: May-2023
https://doi.org/10.1109/TCSII.2023.3257363
Qamar SAnwar ZAfzal M(2023)A systematic threat analysis and defense strategies for the metaverse and extended reality systemsComputers and Security10.1016/j.cose.2023.103127128:COnline publication date: 1-May-2023
https://dl.acm.org/doi/10.1016/j.cose.2023.103127
Venugopal JSubramanian APeatchimuthu J(2023)The realm of metaverse: A surveyComputer Animation and Virtual Worlds10.1002/cav.215034:5Online publication date: 2-Mar-2023
https://doi.org/10.1002/cav.2150
Kumar KPoretski LLi JTang A(2022)Tourgether360: Collaborative Exploration of 360° Videos using Pseudo-Spatial NavigationProceedings of the ACM on Human-Computer Interaction10.1145/35556046:CSCW2(1-27)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555604
Jones MVon Feldt MAndrus N(2022)Outside Where? A Survey of Climates and Built Environments in Studies of HCI outdoorsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3507656(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3507656
Zhang GHansen J(2022)Telepresence Robots for People with Special Needs: A Systematic ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2021.200967338:17(1651-1667)Online publication date: 10-Feb-2022
https://doi.org/10.1080/10447318.2021.2009673
Spittle BXu WFrutos-Pascual MCreed CWilliams I(2021)Socially Distanced: Have user evaluation methods for Immersive Technologies changed during the COVID-19 pandemic?2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct54149.2021.00094(415-420)Online publication date: Oct-2021
https://doi.org/10.1109/ISMAR-Adjunct54149.2021.00094

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents