More Web Proxy on the site http://driver.im/

research-article

Public Access

A New Mask for a New Normal: Investigating an AR Supported Future under COVID-19

Authors:

Zendai Kashino,

Shigeo Yoshida,

Masahiko InamiAuthors Info & Claims

AHs '22: Proceedings of the Augmented Humans International Conference 2022

Pages 243 - 253

https://doi.org/10.1145/3519391.3519409

Published: 18 April 2022 Publication History

All formats PDF

Abstract

Wearing masks and social distancing have become the norm during the COVID-19 pandemic. However, these are increasingly seen as a source of frustration in face-to-face communications. While efforts have been made to overcome these impediments to communication, they typically focus on recovering lost communication quality. Herein, we envision a future where everyone augments their vision using face masks with Augmented Reality capabilities, such that people can conduct safe and expressive face-to-face communication in public. To speculate on this vision, we developed an AR mask prototype which can overlay dynamic virtual “masks” on other users. The virtual mask is dynamic in that it accelerates towards any observer who approaches the wearer. Using this system, we conducted an explorative study to further our speculations on the impact of ubiquitous AR technologies.

References

[1]

Devon Adams, Alseny Bah, Catherine Barwulor, Nureli Musabay, Kadeem Pitkin, and Elissa M. Redmiles. 2018. Ethics emerging: the story of privacy and security perceptions in virtual reality. In Proceedings of the Fourteenth USENIX Conference on Usable Privacy and Security(SOUPS ’18). USENIX Association, USA, 443–458.

[2]

Olasile Babatunde Adedoyin and Emrah Soykan. 2020. Covid-19 pandemic and online learning: the challenges and opportunities. Interactive Learning Environments 0, 0 (Sept. 2020), 1–13. https://doi.org/10.1080/10494820.2020.1813180

[3]

James Auger. 2013. Speculative design: crafting the speculation. Digital Creativity 24, 1 (March 2013), 11–35. https://doi.org/10.1080/14626268.2013.767276

[4]

Awad M. Awadelkarim Mohamed and Yahia Abdallah M. Hamad. 2020. IoT Security: Review and Future Directions for Protection Models. In 2020 International Conference on Computing and Information Technology (ICCIT-1441). 1–4. https://doi.org/10.1109/ICCIT-144147971.2020.9213715

[5]

Rachel E. Baker, Sang Woo Park, Caroline E. Wagner, and C. Jessica E. Metcalf. 2021. The limits of SARS-CoV-2 predictability. Nat Ecol Evol (July 2021), 1–3. https://doi.org/10.1038/s41559-021-01514-z

[6]

Angel Belzunegui-Eraso and Amaya Erro-Garcés. 2020. Teleworking in the Context of the Covid-19 Crisis. Sustainability 12, 9 (Jan. 2020), 3662. https://doi.org/10.3390/su12093662

[7]

Claus-Christian Carbon. 2020. Wearing Face Masks Strongly Confuses Counterparts in Reading Emotions. Frontiers in Psychology 11 (2020), 2526. https://doi.org/10.3389/fpsyg.2020.566886

[8]

CDC. 2021. COVID-19 and Your Health. https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/prevention.html

[9]

Robert Connor Chick, Guy Travis Clifton, Kaitlin M. Peace, Brandon W. Propper, Diane F. Hale, Adnan A. Alseidi, and Timothy J. Vreeland. 2020. Using Technology to Maintain the Education of Residents During the COVID-19 Pandemic. Journal of Surgical Education 77, 4 (July 2020), 729–732. https://doi.org/10.1016/j.jsurg.2020.03.018

[10]

Kimberly M. Christopherson. 2007. The positive and negative implications of anonymity in Internet social interactions: “On the Internet, Nobody Knows You’re a Dog”. Computers in Human Behavior 23, 6 (Nov. 2007), 3038–3056. https://doi.org/10.1016/j.chb.2006.09.001

Digital Library

[11]

Derek K Chu, Elie A Akl, Stephanie Duda, Karla Solo, Sally Yaacoub, Holger J Schünemann, Derek K Chu, Elie A Akl, Amena El-harakeh, Antonio Bognanni, Tamara Lotfi, Mark Loeb, Anisa Hajizadeh, Anna Bak, Ariel Izcovich, Carlos A Cuello-Garcia, Chen Chen, David J Harris, Ewa Borowiack, Fatimah Chamseddine, Finn Schünemann, Gian Paolo Morgano, Giovanna E U Muti Schünemann, Guang Chen, Hong Zhao, Ignacio Neumann, Jeffrey Chan, Joanne Khabsa, Layal Hneiny, Leila Harrison, Maureen Smith, Nesrine Rizk, Paolo Giorgi Rossi, Pierre AbiHanna, Rayane El-khoury, Rosa Stalteri, Tejan Baldeh, Thomas Piggott, Yuan Zhang, Zahra Saad, Assem Khamis, Marge Reinap, Stephanie Duda, Karla Solo, Sally Yaacoub, and Holger J Schünemann. 2020. Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: a systematic review and meta-analysis. The Lancet 395, 10242 (June 2020), 1973–1987. https://doi.org/10.1016/S0140-6736(20)31142-9

[12]

Ellysse Dick. 2021. Balancing User Privacy and Innovation in Augmented and Virtual Reality. Technical Report. Information Technology and Innovation Foundation. https://itif.org/publications/2021/03/04/balancing-user-privacy-and-innovation-augmented-and-virtual-reality

[13]

Dmitriy Dryzhak. 2020. Masks pack 2 | Props | Unity Asset Store. https://assetstore.unity.com/packages/3d/props/clothing/accessories/masks-pack-2-157577

[14]

Anthony Dunne and Fiona Raby. 2013. Speculative Everything: Design, Fiction, and Social Dreaming. MIT Press, Cambridge, MA, USA.

Digital Library

[15]

Giada Ferrari, Raffaella Dobrina, Sara Buchini, Iva Rudan, Silvana Schreiber, and Livia Bicego. [n.d.]. The impact of personal protective equipment and social distancing on communication and relation between nurses, caregivers and children: a descriptive qualitative study in a maternal and child health hospital. Journal of Clinical Nursing n/a, n/a ([n. d.]). https://doi.org/10.1111/jocn.15857

[16]

Çağlar Genç, Ashley Colley, Markus Löchtefeld, and Jonna Häkkilä. 2020. Face mask design to mitigate facial expression occlusion. In Proceedings of the 2020 International Symposium on Wearable Computers(ISWC ’20). Association for Computing Machinery, New York, NY, USA, 40–44. https://doi.org/10.1145/3410531.3414303

Digital Library

[17]

Stefan Gössling, Daniel Scott, and C. Michael Hall. 2021. Pandemics, tourism and global change: a rapid assessment of COVID-19. Journal of Sustainable Tourism 29, 1 (Jan. 2021), 1–20. https://doi.org/10.1080/09669582.2020.1758708

[18]

Edward Twitchell Hall. 1966. The Hidden Dimension. Doubleday.

[19]

Liliana Hawrysz, Grażyna Gierszewska, and Agnieszka Bitkowska. 2021. The Research on Patient Satisfaction with Remote Healthcare Prior to and during the COVID-19 Pandemic. International Journal of Environmental Research and Public Health 18, 10 (Jan. 2021), 5338. https://doi.org/10.3390/ijerph18105338

[20]

Verena Hofmann, Nicola E. Stokburger-Sauer, Anna Wanisch, and Heike Hebborn. 2021. Masked smiles matter – employee verbal expertise and emotion display during COVID-19. The Service Industries Journal 41, 1-2 (Jan. 2021), 107–137. https://doi.org/10.1080/02642069.2021.1873296

[21]

itSeez3D Inc. 2021. Avatar Maker Free - 3D avatar from a single selfie | Modeling | Unity Asset Store. https://assetstore.unity.com/packages/tools/modeling/avatar-maker-free-3d-avatar-from-a-single-selfie-134782

[22]

Nicholas R. Jones, Zeshan U. Qureshi, Robert J. Temple, Jessica P. J. Larwood, Trisha Greenhalgh, and Lydia Bourouiba. 2020. Two metres or one: what is the evidence for physical distancing in covid-19?BMJ 370 (Aug. 2020), m3223. https://doi.org/10.1136/bmj.m3223

[23]

Teo Keipi. 2018. Relatedness Online: An Analysis of Youth Narratives Concerning the Effects of Internet Anonymity. YOUNG 26, 2 (April 2018), 91–107. https://doi.org/10.1177/1103308817715142

[24]

Joowon Klusowski, Deborah A. Small, and Joseph P. Simmons. 2021. Does Choice Cause an Illusion of Control?Psychol Sci 32, 2 (Feb. 2021), 159–172. https://doi.org/10.1177/0956797620958009

[25]

Sandjar Kozubaev. 2016. Stop Nigmas: Experimental Speculative Design through Pragmatic Aesthetics and Public Art. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction(NordiCHI ’16). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/2971485.2993921

Digital Library

[26]

Ryoga Kumazaki and Akifumi Inoue. 2019. Development and Evaluation of a Mask-type Display Transforming the Wearer’s Impression. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction(OZCHI’19). Association for Computing Machinery, New York, NY, USA, 568–571. https://doi.org/10.1145/3369457.3369533

Digital Library

[27]

Ryoga Kumazaki and Akifumi Inoue. 2019. Development and Evaluation of a Mask-type Display Transforming the Wearer’s Impression. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction. ACM, Fremantle WA Australia, 568–571. https://doi.org/10.1145/3369457.3369533

Digital Library

[28]

Chiwon Lee, Hyunjong Joo, and Soojin Jun. 2021. Social VR as the New Normal? Understanding User Interactions for the Business Arena. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. Number 420. Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3411763.3451740

Digital Library

[29]

Lucia Martinelli, Vanja Kopilaš, Matjaž Vidmar, Ciara Heavin, Helena Machado, Zoran Todorović, Norbert Buzas, Mirjam Pot, Barbara Prainsack, and Srećko Gajović. 2021. Face Masks During the COVID-19 Pandemic: A Simple Protection Tool With Many Meanings. Front. Public Health 0(2021). https://doi.org/10.3389/fpubh.2020.606635

[30]

Urvakhsh Meherwan Mehta, Ganesan Venkatasubramanian, and Prabha S. Chandra. 2020. The “mind” behind the “mask”: Assessing mental states and creating therapeutic alliance amidst COVID-19. Schizophrenia Research 222 (Aug. 2020), 503–504. https://doi.org/10.1016/j.schres.2020.05.033

[31]

Nour Mheidly, Mohamad Y. Fares, Hussein Zalzale, and Jawad Fares. 2020. Effect of Face Masks on Interpersonal Communication During the COVID-19 Pandemic. Front. Public Health 0(2020). https://doi.org/10.3389/fpubh.2020.582191

[32]

Enrico Muzzi, Carol Chermaz, Veronica Castro, Mattia Zaninoni, Amanda Saksida, and Eva Orzan. 2021. Short report on the effects of SARS-CoV-2 face protective equipment on verbal communication. Eur Arch Otorhinolaryngol 278, 9 (Sept. 2021), 3565–3570. https://doi.org/10.1007/s00405-020-06535-1

[33]

Maria Nicola, Zaid Alsafi, Catrin Sohrabi, Ahmed Kerwan, Ahmed Al-Jabir, Christos Iosifidis, Maliha Agha, and Riaz Agha. 2020. The socio-economic implications of the coronavirus pandemic (COVID-19): A review. International Journal of Surgery 78 (June 2020), 185–193. https://doi.org/10.1016/j.ijsu.2020.04.018

[34]

Mojtaba Noghabaei, Arsalan Heydarian, Vahid Balali, and Kevin Han. 2020. Trend Analysis on Adoption of Virtual and Augmented Reality in the Architecture, Engineering, and Construction Industry. Data 5, 1 (March 2020), 26. https://doi.org/10.3390/data5010026

[35]

Ardi Nugraha and Mohammad Faidzul Nasrudin. 2015. Augmented Reality System for Virtual Hijab Fitting. In Advances in Visual Informatics(Lecture Notes in Computer Science), Halimah Badioze Zaman, Peter Robinson, Alan F. Smeaton, Timothy K. Shih, Sergio Velastin, Azizah Jaafar, and Nazlena Mohamad Ali (Eds.). Springer International Publishing, Cham, 454–463. https://doi.org/10.1007/978-3-319-25939-0_40

[36]

Nicky Phillips. 2021. The coronavirus is here to stay — here’s what that means. Nature 590, 7846 (Feb. 2021), 382–384. https://doi.org/10.1038/d41586-021-00396-2

[37]

M Ashrith Reddy, K Prasanna, and T Venkata Kalyani. 2013. Optical camouflage technology. International Journal of Engineering Research 2, 11 (2013), 5.

[38]

Franziska Roesner, Tadayoshi Kohno, and David Molnar. 2014. Security and privacy for augmented reality systems. Commun. ACM 57, 4 (April 2014), 88–96. https://doi.org/10.1145/2580723.2580730

Digital Library

[39]

Matthew Round and Peter Isherwood. 2021. Speech intelligibility in respiratory protective equipment - Implications for verbal communication in critical care. Trends in Anaesthesia and Critical Care 36 (Feb. 2021), 23–29. https://doi.org/10.1016/j.tacc.2020.08.006

[40]

Manfred Spitzer. 2020. Masked education? The benefits and burdens of wearing face masks in schools during the current Corona pandemic. Trends in Neuroscience and Education 20 (Sept. 2020), 100138. https://doi.org/10.1016/j.tine.2020.100138

[41]

Shenando Stals, Michael Smyth, and Oli Mival. 2019. UrbanIxD: From Ethnography to Speculative Design Fictions for the Hybrid City. In Proceedings of the Halfway to the Future Symposium 2019(HTTF 2019). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3363384.3363486

Digital Library

[42]

Luna Takagi, Toshiki Sato, Shio Miyafuji, and Hideki Koike. 2021. Real-time Projection of Lip Animation onto Face Masks using OmniProcam. In ACM SIGGRAPH 2021 Posters(SIGGRAPH ’21). Association for Computing Machinery, New York, NY, USA, 1–2. https://doi.org/10.1145/3450618.3469171

Digital Library

[43]

Yoshinari Takegawa, Yutaka Tokuda, Akino Umezawa, Katsuhiro Suzuki, Katsutoshi Masai, Yuta Sugiura, Maki Sugimoto, Diego Martinez Plasencia, Sriram Subramanian, and Keiji Hirata. 2020. Digital Full-Face Mask Display with Expression Recognition using Embedded Photo Reflective Sensor Arrays. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 101–108. https://doi.org/10.1109/ISMAR50242.2020.00030

[44]

Julio Torales, Marcelo O’Higgins, João Mauricio Castaldelli-Maia, and Antonio Ventriglio. 2020. The outbreak of COVID-19 coronavirus and its impact on global mental health. Int J Soc Psychiatry 66, 4 (June 2020), 317–320. https://doi.org/10.1177/0020764020915212

[45]

Akino Umezawa, Yoshinari Takegawa, and Keiji Hirtata. 2017. e2-Mask: Design and Implementation of a Mask-Type Display to Support Face-to-Face Communication. In Entertainment Computing – ICEC 2017(Lecture Notes in Computer Science), Nagisa Munekata, Itsuki Kunita, and Junichi Hoshino (Eds.). Springer International Publishing, Cham, 88–93. https://doi.org/10.1007/978-3-319-66715-7_10

Digital Library

[46]

Robin Welsch, Heiko Hecht, David R. Kolar, Michael Witthöft, and Tanja Legenbauer. 2020. Body image avoidance affects interpersonal distance perception: A virtual environment experiment. European Eating Disorders Review 28, 3 (2020), 282–295. https://doi.org/10.1002/erv.2715

[47]

Adrian Wong, Serene Ho, Olusegun Olusanya, Marta Velia Antonini, and David Lyness. 2021. The use of social media and online communications in times of pandemic COVID-19. Journal of the Intensive Care Society 22, 3 (Aug. 2021), 255–260. https://doi.org/10.1177/1751143720966280

[48]

Charles Woodward, Petri Honkamaa, Timo Kinnunen, Markus Tallgren, and Teppo Veijonen. 2008. May Day masks augmented on mobile phones. In Proceedings of the 2008 International Conference in Advances on Computer Entertainment Technology - ACE ’08. ACM Press, Yokohama, Japan, 257. https://doi.org/10.1145/1501750.1501810

Digital Library

[49]

Dimitrios Xanthidis, Christos Manolas, Sujni Paul, and Ourania Koutzampasopoulou Xanthidou. 2020. Virtual and Augmented Reality: Enhancing the learning experience in higher education in the U.A.E. Current standing amp; research directions. In 2020 Seventh International Conference on Information Technology Trends (ITT). 206–211. https://doi.org/10.1109/ITT51279.2020.9320882

[50]

Jiaqi Xiong, Orly Lipsitz, Flora Nasri, Leanna M. W. Lui, Hartej Gill, Lee Phan, David Chen-Li, Michelle Iacobucci, Roger Ho, Amna Majeed, and Roger S. McIntyre. 2020. Impact of COVID-19 pandemic on mental health in the general population: A systematic review. Journal of Affective Disorders 277 (Dec. 2020), 55–64. https://doi.org/10.1016/j.jad.2020.08.001

Cited By

Bhatia ASaini AKalra IMukherjee MParnami AWard JMcGill MMarky K(2023)DUMask: A Discrete and Unobtrusive Mask-Based Interface for Facial GesturesProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582726(255-266)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582726

Index Terms

A New Mask for a New Normal: Investigating an AR Supported Future under COVID-19
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Index terms have been assigned to the content through auto-classification.

Recommendations

Exhibition approach using an AR and VR pillar
SA '17: SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications

This demonstration presents a development of an Augmented Reality (AR) and Virtual Reality (AR) pillar, a novel approach for showing AR and VR content in a public setting. A pillar in a public exhibition venue was converted to a four-sided AR and VR ...
A New Study of Integration Between Social Robotic Systems and the Metaverse for Dealing with Healthcare in the Post-COVID-19 Situations
Social Robotics
Abstract
With the popularity of the metaverse, researchers are turning to augmented reality and virtual reality to innovate their recent pain points, particularly healthcare issues during COVID-19. At the same time, social robots can be a great tool for ...
Requirements for Virtualization of AR Displays within VR Environments
Proceedings, Part I, of the 6th International Conference on Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments - Volume 8525

Everybody has been talking about new emerging products in augmented reality AR and their potential to enhance our daily life and work. The AR technology has been around for quite a while and various use cases have been thought and tested. Clearly, the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

AHs '22: Proceedings of the Augmented Humans International Conference 2022

March 2022

350 pages

ISBN:9781450396325

DOI:10.1145/3519391

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Japan Science and Technology Agency

Conference

AHs 2022

AHs 2022: Augmented Humans 2022

March 13 - 15, 2022

Kashiwa, Chiba, Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
291
Total Downloads

Downloads (Last 12 months)143
Downloads (Last 6 weeks)24

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bhatia ASaini AKalra IMukherjee MParnami AWard JMcGill MMarky K(2023)DUMask: A Discrete and Unobtrusive Mask-Based Interface for Facial GesturesProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582726(255-266)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582726

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten