Collaborative Design to Support Mutual Awareness in Single-Pilot Operation and Remote Collaboration
Authors: 
Maxime Bardou, 
Catherine Letondal, Mickaël Causse, Jean-Paul Imbert, Mathieu PoirierAuthors Info & Claims
Article No.: 22, Pages 1 - 12
Abstract
For economic reasons, manufacturers have been considering dedicating commercial flights to a single pilot for the last ten years. In order to ensure a certain redundancy, this pilot could be assisted by a ground pilot. In the absence of appropriate collaboration tools, the physical separation of these pilots will lead to a degradation of the mutual understanding of behaviors (observable fact on a person) and activities (i.e. mutual awareness). In order to restore mutual awareness, indicators of each pilot’s behavior (i.e. design element) need to be integrated into future flight tools. In this paper, we study the modalities of design elements in two new interfaces (ground and onboard) developed by iterations. These collaborative interfaces contain two types of elements: a remote display of the pilot’s eye movements, via an eye-tracking system, and an indicator of the activities performed in the tool (moving in the map, navigation in the tabs). Two remote collaboration scenarios were proposed to four professional pilots. They allowed to identify the cues to be transmitted, such as the availability of the pilots, and to test the transmission modalities: capture (eye-tracking, audio, interface inputs), temporality (continuous transmission) and representation (graphic, audio).
References
[1]
Deepak Akkil, Jobin Mathew James, Poika Isokoski, and Jari Kangas. 2016. GazeTorch: enabling gaze awareness in collaborative physical tasks. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 1151–1158.
[2]
Pedro Antunes, Valeria Herskovic, Sergio F Ochoa, and José A Pino. 2014. Reviewing the quality of awareness support in collaborative applications. Journal of Systems and Software 89 (2014), 146–169.
[3]
Maxime Bardou, Catherine Letondal, Jean-Paul Imbert, Mickaël Causse, Maxence Bidegaimberry, Romane Dubus, and Cécile Marcon. 2022. Redesigning systems for Single-Pilot Operations: the mutual awareness problem for remote crews. In Proceedings of 20th European Conference on Computer-Supported Cooperative Work. European Society for Socially Embedded Technologies (EUSSET).
[4]
Valentin Becquet, Catherine Letondal, Jean-Luc Vinot, and Sylvain Pauchet. 2019. How do Gestures Matter for Mutual Awareness in Cockpits? Disclosing Interactions through Graphical Representations. In Proceedings of the 2019 on Designing Interactive Systems Conference. 593–605.
[5]
James" Bo" Begole, John C Tang, and Rosco Hill. 2003. Rhythm modeling, visualizations and applications. In Proceedings of the 16th annual ACM symposium on User interface software and technology. 11–20.
[6]
Karl D Bilimoria, Walter W Johnson, and Paul C Schutte. 2014. Conceptual framework for single pilot operations. In Proceedings of the international conference on human-computer interaction in aerospace. 1–8.
[7]
Crescencio Bravo, Rafael Duque, and Jesús Gallardo. 2013. A groupware system to support collaborative programming: Design and experiences. Journal of Systems and Software 86, 7 (2013), 1759–1771.
[8]
Susan E Brennan, Xin Chen, Christopher A Dickinson, Mark B Neider, and Gregory J Zelinsky. 2008. Coordinating cognition: The costs and benefits of shared gaze during collaborative search. Cognition 106, 3 (2008), 1465–1477.
[9]
Barbara K Burian, Immanuel Barshi, and Key Dismukes. 2005. The challenge of aviation emergency and abnormal situations. Technical Report.
[10]
John M Carroll, Dennis C Neale, Philip L Isenhour, Mary Beth Rosson, and D Scott McCrickard. 2003. Notification and awareness: synchronizing task-oriented collaborative activity. International Journal of Human-Computer Studies 58, 5 (2003), 605–632.
[11]
Stephane Chatty. 2003. The Ivy software bus. white paper, www. tls. cena. fr/products/ivy/documentation/ivy. pdf (2003).
[12]
Li-Te Cheng, Susanne Hupfer, Steven Ross, and John Patterson. 2003. Jazzing up Eclipse with collaborative tools. In Proceedings of the 2003 OOPSLA workshop on eclipse technology eXchange. 45–49.
[13]
Herbert H Clark. 1996. Using language. Cambridge university press.
[14]
CleanAviation. 2022. At the sharp end: Innovative cockpit tech points the way. In https://clean-aviation.eu/media/results-stories/at-the-sharp-end-innovative-cockpit-tech-points-the-way.
[15]
National Research Council 2014. Autonomy research for civil aviation: toward a new era of flight. National Academies Press.
[16]
Laura Dabbish and Robert Kraut. 2008. Research note—awareness displays and social motivation for coordinating communication. Information Systems Research 19, 2 (2008), 221–238.
[17]
Sarah D’Angelo and Darren Gergle. 2018. An eye for design: gaze visualizations for remote collaborative work. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.
[18]
Paul Dourish and Victoria Bellotti. 1992. Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work. 107–114.
[19]
Romina Druta, Cristian Druta, Paul Negirla, and Ioan Silea. 2021. A review on methods and systems for remote collaboration. Applied Sciences 11, 21 (2021), 10035.
[20]
Clarence A Ellis, Simon J Gibbs, and Gail Rein. 1991. Groupware: some issues and experiences. Commun. ACM 34, 1 (1991), 39–58.
[21]
Mica R Endsley. 1995. Toward a theory of situation awareness in dynamic systems. Human factors 37, 1 (1995), 32–64.
[22]
James Fogarty, Amy J Ko, Htet Htet Aung, Elspeth Golden, Karen P Tang, and Scott E Hudson. 2005. Examining task engagement in sensor-based statistical models of human interruptibility. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 331–340.
[23]
Susan R Fussell, Robert E Kraut, and Jane Siegel. 2000. Coordination of communication: Effects of shared visual context on collaborative work. In Proceedings of the 2000 ACM conference on Computer supported cooperative work. 21–30.
[24]
Jesus Gallardo, Crescencio Bravo, and Ana Isabel Molina. 2018. A framework for the descriptive specification of awareness support in multimodal user interfaces for collaborative activities. Journal on Multimodal User Interfaces 12, 2 (2018), 145–159.
[25]
Saul Greenberg. 1996. A fisheye text editor for relaxed-WYSIWIS groupware. In Conference Companion on Human Factors in Computing Systems. 212–213.
[26]
Saul Greenberg and Carl Gutwin. 2016. Implications of we-awareness to the design of distributed groupware tools. Computer Supported Cooperative Work (CSCW) 25, 4 (2016), 279–293.
[27]
Zenzi M Griffin and Kathryn Bock. 2000. What the eyes say about speaking. Psychological science 11, 4 (2000), 274–279.
[28]
Kunal Gupta, Gun A Lee, and Mark Billinghurst. 2016. Do you see what I see? The effect of gaze tracking on task space remote collaboration. IEEE transactions on visualization and computer graphics 22, 11 (2016), 2413–2422.
[29]
Carl Gutwin and Saul Greenberg. 1999. The effects of workspace awareness support on the usability of real-time distributed groupware. ACM Transactions on Computer-Human Interaction (TOCHI) 6, 3 (1999), 243–281.
[30]
Carl Gutwin and Saul Greenberg. 2002. A descriptive framework of workspace awareness for real-time groupware. Computer Supported Cooperative Work (CSCW) 11, 3 (2002), 411–446.
[31]
Carl Gutwin, Saul Greenberg, and Mark Roseman. 1996. Workspace awareness in real-time distributed groupware: Framework, widgets, and evaluation. In People and computers XI. Springer, 281–298.
[32]
Keita Higuch, Ryo Yonetani, and Yoichi Sato. 2016. Can eye help you? Effects of visualizing eye fixations on remote collaboration scenarios for physical tasks. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5180–5190.
[33]
Jason Hill and Carl Gutwin. 2003. Awareness support in a groupware widget toolkit. In Proceedings of the 2003 international ACM SIGGROUP conference on Supporting group work. 258–267.
[34]
Robert Johansen, David Sibbet, Suzyan Benson, Alixia Martin, Robert Mittman, and Paul Saffo. 1991. Leading business teams: How teams can use technology and group process tools to enhance performance. Addison-Wesley Longman Publishing Co., Inc.
[35]
Jari Kangas, Antti Sand, Tero Jokela, Petri Piippo, Peter Eskolin, Marja Salmimaa, and Roope Raisamo. 2018. Remote expert for assistance in a physical operational task. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1–6.
[36]
Michael Koch and Jürgen Koch. 2000. Application of frameworks in groupware—The iris group editor environment. ACM Computing Surveys (CSUR) 32, 1es (2000), 28–es.
[37]
Joel Lachter, Vernol Battiste, Michael Matessa, Quang V. Dao, Robert Koteskey, and Walter W. Johnson. 2014. Toward single pilot operations: the impact of the loss of non-verbal communication on the flight deck. In Proceedings of the International Conference on Human-Computer Interaction in Aerospace - HCI-Aero ’14. ACM Press, 1–8. https://doi.org/10.1145/2669592.2669695
[38]
Joel Lachter, Summer L. Brandt, Vernol Battiste, Sarah V. Ligda, Michael Matessa, and Walter W. Johnson. 2014. Toward single pilot operations: developing a ground station. In Proceedings of the International Conference on Human-Computer Interaction in Aerospace - HCI-Aero ’14. ACM Press, 1–8. https://doi.org/10.1145/2669592.2669685
[39]
Joel Lachter, Summer L. Brandt, Vernol Battiste, Michael Matessa, and Walter W. Johnson. 2017. Enhanced ground support: lessons from work on reduced crew operations. Cognition, Technology & Work 19, 2–3 (Sep 2017), 279–288. https://doi.org/10.1007/s10111-017-0422-6
[40]
Larousse. 2023. Comportement. https://www.larousse.fr/dictionnaires/francais/comportement/17728
[41]
Catherine Letondal, Jean-Luc Vinot, Sylvain Pauchet, Caroline Boussiron, Stéphanie Rey, Valentin Becquet, and Claire Lavenir. 2018. Being in the sky: Framing tangible and embodied interaction for future airliner cockpits. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. 656–666.
[42]
Loukia D Loukopoulos, R Key Dismukes, and Immanuel Barshi. 2001. Cockpit interruptions and distractions: A line observation study. In Proceedings of the 11th international symposium on aviation psychology. Citeseer, 1–6.
[43]
Wendy E Mackay. 1999. Media spaces: Environments for informal multimedia interaction. Computer Supported Co-operative Work 7 (1999), 55–82.
[44]
Mathieu Magnaudet, Stéphane Chatty, Stéphane Conversy, Sébastien Leriche, Celia Picard, and Daniel Prun. 2018. Djnn/Smala: A conceptual framework and a language for interaction-oriented programming. Proceedings of the ACM on Human-Computer Interaction 2, EICS (2018), 1–27.
[45]
Ana Isabel Molina, Jesús Gallardo, Miguel Ángel Redondo, and Crescencio Bravo. 2015. Assessing the awareness mechanisms of a collaborative programming support system. Dyna 82, 193 (2015), 212–222.
[46]
Joshua Newn, Eduardo Velloso, Fraser Allison, Yomna Abdelrahman, and Frank Vetere. 2017. Evaluating real-time gaze representations to infer intentions in competitive turn-based strategy games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. 541–552.
[47]
Leysia Palen and Jonathan Grudin. 2003. Discretionary adoption of group support software: Lessons from calendar applications. In Implementing collaboration technologies in industry. Springer, 159–180.
[48]
Doug Palmer, Matt Adcock, Jocelyn Smith, Matthew Hutchins, Chris Gunn, Duncan Stevenson, and Ken Taylor. 2007. Annotating with light for remote guidance. In Proceedings of the 19th Australasian Conference on Computer-Human interaction: Entertaining User interfaces. 103–110.
[49]
Alexandre Pauchet, François Coldefy, Liv Lefebvre, S Louis Dit Picard, Arnaud Bouguet, Laurence Perron, Joël Guerin, Daniel Corvaisier, and Michel Collobert. 2007. Mutual awareness in collocated and distant collaborative tasks using shared interfaces. In IFIP Conference on Human-Computer Interaction. Springer, 59–73.
[50]
Tom Rodden. 1996. Populating the application: A model of awareness for cooperative applications. In Proceedings of the 1996 ACM conference on Computer supported cooperative work. 87–96.
[51]
AH Roscoe and BS Grieve. 1988. Assessment of pilot workload during Boeing 767 normal and abnormal operating conditions. SAE Transactions (1988), 968–972.
[52]
Mark Roseman and Saul Greenberg. 1996. Building real-time groupware with GroupKit, a groupware toolkit. ACM Transactions on Computer-Human Interaction (TOCHI) 3, 1 (1996), 66–106.
[53]
Kjeld Schmidt. 1998. Some notes on mutual awareness. COTCOS, CTI, DTU, Copenhagen, Denmark (1998).
[54]
Manrong She and Zhizhong Li. 2017. Design and evaluation of a team mutual awareness toolkit for digital interfaces of nuclear power plant context. International Journal of Human–Computer Interaction 33, 9 (2017), 744–755.
[55]
Dave Snowdon, Elizabeth F Churchill, and Alan J Munro. 2000. Collaborative virtual environments: digital spaces and places for CSCW. Collaborative Virtual Environments (2000) (2000), 1–34.
[56]
Mark Stefik, Daniel G Bobrow, Gregg Foster, Stan Lanning, and Deborah Tatar. 1987. WYSIWIS revised: Early experiences with multiuser interfaces. ACM Transactions on Information Systems (TOIS) 5, 2 (1987), 147–167.
[57]
Roel Vertegaal, Ivo Weevers, Changuk Sohn, and Chris Cheung. 2003. Gaze-2: conveying eye contact in group video conferencing using eye-controlled camera direction. In Proceedings of the SIGCHI conference on Human factors in computing systems. 521–528.
[58]
Xihui Yuan, Manrong She, Zhizhong Li, Yijing Zhang, and Xiaojun Wu. 2016. Mutual awareness: Enhanced by interface design and improving team performance in incident diagnosis under computerized working environment. International Journal of Industrial Ergonomics 54 (2016), 65–72.
[59]
Yanxia Zhang, Ken Pfeuffer, Ming Ki Chong, Jason Alexander, Andreas Bulling, and Hans Gellersen. 2017. Look together: using gaze for assisting co-located collaborative search. Personal and Ubiquitous Computing 21, 1 (2017), 173–186.
Index Terms
- Collaborative Design to Support Mutual Awareness in Single-Pilot Operation and Remote Collaboration
Recommendations
Conceptual framework for single pilot operations
HCI-Aero '14: Proceedings of the International Conference on Human-Computer Interaction in AerospaceSingle pilot operations (SPO) refers to flying a commercial aircraft with only one pilot in the cockpit, assisted by advanced onboard automation and/or ground operators providing piloting support services. Properly implemented, SPO could provide ...
Toward single pilot operations: developing a ground station
HCI-Aero '14: Proceedings of the International Conference on Human-Computer Interaction in AerospaceThis document describes the second human-in-the-loop study in a series that examines the role of a ground operator in enabling single pilot operations (SPO). The focus of this study was decision-making and communication between a distributed crew (...
How do Gestures Matter for Mutual Awareness in Cockpits?: Disclosing Interactions through Graphical Representations
DIS '19: Proceedings of the 2019 on Designing Interactive Systems ConferenceThis paper presents an approach ensuring mutual awareness among airliner pilots using touch-based interactions. Indeed, touchscreens are making their way into cockpits, but touchbased gestures are less performative than gestures on physical controls, ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
April 2023
288 pages
ISBN:9781450398244
DOI:10.1145/3583961
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 May 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
IHM '23
IHM '23: 34th International Francophone Conference on Human-Computer Interaction
April 3 - 6, 2023
TROYES, France
Acceptance Rates
Overall Acceptance Rate 103 of 199 submissions, 52%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 78Total Downloads
- Downloads (Last 12 months)38
- Downloads (Last 6 weeks)5
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format