abstract

Validating Social Distancing through Deep Learning and VR-Based Digital Twins

Authors:

Abhishek Mukhopadhyay,

G S Rajshekar Reddy,

Subhankar Ghosh,

Murthy L R D,

Pradipta BiswasAuthors Info & Claims

VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

Article No.: 104, Pages 1 - 2

https://doi.org/10.1145/3489849.3489959

Published: 08 December 2021 Publication History

Get Access

Abstract

The Covid-19 pandemic resulted in a catastrophic loss to global economies, and social distancing was consistently found to be an effective means to curb the virus's spread. However, it is only as effective when every individual partakes in it with equal alacrity. Past literature outlined scenarios where computer vision was used to detect people and to enforce social distancing automatically. We have created a Digital Twin (DT) of an existing laboratory space for remote monitoring of room occupancy and automatically detecting violation of social distancing. To evaluate the proposed solution, we have implemented a Convolutional Neural Network (CNN) model for detecting people, both in a limited-sized dataset of real humans, and a synthetic dataset of humanoid figures. Our proposed computer vision models are validated for both real and synthetic data in terms of accurately detecting persons, posture, and intermediate distances among people.

References

[1]

Considerations relating to social distancing measures in response to COVID-19 - second update. C. Adlhoch. Retrieved March 10, 2021 from https://www.ecdc.europa.eu/en/publications-data/considerations-relating-social-distancing-measures-response-covid-19-second

Google Scholar

[2]

Neil M Ferguson, Derek AT Cummings, Simon Cauchemez, Christophe Fraser, Steven Riley, Aronrag Meeyai, Sopon Iamsirithaworn, and Donald S Burke. 2005. Strategies for containing an emerging influenza pandemic in southeast asia. Nature, 437(7056):209–214

Crossref

Google Scholar

[3]

Neil M Ferguson, Derek AT Cummings, Christophe Fraser, James C Cajka, Philip C Cooley, and Donald S Burke. 2006. Strategies for mitigating an influenza pandemic. Nature, 442(7101):448–452

Crossref

Google Scholar

[4]

Christophe Fraser, Steven Riley, Roy M Anderson, and Neil M Ferguson. 2004. Factors that make an infectious disease outbreak controllable. Proceedings of the National Academy of Sciences. 101(16):6146–6151

Crossref

Google Scholar

[5]

Helen Leblanc. What are PBR Materials. Retrieved May 10, 2021 from https://info.e-onsoftware.com/learning_vue/what-are-pbr-materials

Google Scholar

[6]

Abhishek Mukhopadhyay, Imon Mukherjee, and Pradipta Biswas. 2019. Comparing cnns for non-conventional traffic participants. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings pages 171–175

Google Scholar

[7]

Narinder Singh Punn, Sanjay Kumar Sonbhadra, and Sonali Agarwal. 2020. Monitoring covid-19 social distancing with person detection and tracking via fine-tuned yolo v3 and deepsort techniques. arXiv preprint arXiv:2005.01385

Google Scholar

[8]

Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition. pages 779–788

Crossref

Google Scholar

[9]

Unity Technologies. For all the creators. Retrieved May 10, 2021 from https://unity.com/

Google Scholar

[10]

Unity Technologies. Unity real-time ray tracing. Retrieved May 10, 2021 from https://unity.com/ray-tracing

Google Scholar

[11]

Eric W Weisstein. Circle packing. Retrieved May 10, 2021 from https://mathworld.wolfram.com/

Google Scholar

[12]

Abhishek Mukhopadhyay, GS Rajshekar Reddy, KPS Saluja, Subhankar Ghosh, Anasol Peña-Rios, Gokul Kumar Gopal, Pradipta Biswas, A Virtual Reality-Based Digital Twin of Office Spaces with Social Distance Measurement Feature, Virtual Reality & Intelligent Hardware, Volume 3, Issue 5, 2021.

Google Scholar

Cited By

View all

Mukhopadhyay ATalwar NViswakarma HRajshekar Reddy GSrivastava SPena-Rios ABiswas P(2024)VR digital twin of office space with computer vision-based estimation of room occupancy and power consumptionDiscover Analytics10.1007/s44257-024-00008-z2:1Online publication date: 15-Apr-2024
https://doi.org/10.1007/s44257-024-00008-z
De Benedictis AMazzocca NSomma AStrigaro C(2023)Digital Twins in Healthcare: An Architectural Proposal and Its Application in a Social Distancing Case StudyIEEE Journal of Biomedical and Health Informatics10.1109/JBHI.2022.320550627:10(5143-5154)Online publication date: Oct-2023
https://doi.org/10.1109/JBHI.2022.3205506
Himeur YAl-Maadeed SAlmaadeed NAbualsaud KMohamed AKhattab TElharrouss O(2022)Deep visual social distancing monitoring to combat COVID-19: A comprehensive surveySustainable Cities and Society10.1016/j.scs.2022.10406485(104064)Online publication date: Oct-2022
https://doi.org/10.1016/j.scs.2022.104064

Recommendations

Uses and gratifications of social networking sites for bridging and bonding social capital

Applying uses and gratifications theory (UGT) and social capital theory, our study examined users of four social networking sites (SNSs) (Facebook, Twitter, Instagram, and Snapchat), and their influence on online bridging and bonding social capital. ...
Digital divide in social networking sites

This study investigated the effects of demographic variables on the use of social networking sites SNSs and SNS users internet skills to expand the theoretical scope of digital divide. The effects of individuals intentions of using SNSs on their social ...
Sustaining social capital online amidst social distancing during the COVID-19 pandemic: web-based communities, their mitigating effects, and associated issues

COVID-19 prompted the enforcement of strict social distancing measures in most parts of the world. These measures have serious implications for how people interact, socialise, and collaborate with one another. As social distancing contradicts the social ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

December 2021

563 pages

ISBN:9781450390927

DOI:10.1145/3489849

Editors:
Yuichi Itoh
Aoyama Gakuin University, Japan
,
Kazuki Takashima
Tohoku University, Japan
,
Parinya Punpongsanon
Osaka University, Japan
,
Misha Sra
University of California, Santa Barbara, USA
,
Kazuyuki Fujita
Tohoku University, Japan
,
Shigeo Yoshida
The University of Tokyo, Japan
,
Tham Piumsomboon
University of Canterbury, New Zealand

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 December 2021

Check for updates

Qualifiers

Abstract
Research
Refereed limited

Conference

VRST '21

Sponsor:

VRST '21: 27th ACM Symposium on Virtual Reality Software and Technology

December 8 - 10, 2021

Osaka, Japan

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
139
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)3

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Mukhopadhyay ATalwar NViswakarma HRajshekar Reddy GSrivastava SPena-Rios ABiswas P(2024)VR digital twin of office space with computer vision-based estimation of room occupancy and power consumptionDiscover Analytics10.1007/s44257-024-00008-z2:1Online publication date: 15-Apr-2024
https://doi.org/10.1007/s44257-024-00008-z
De Benedictis AMazzocca NSomma AStrigaro C(2023)Digital Twins in Healthcare: An Architectural Proposal and Its Application in a Social Distancing Case StudyIEEE Journal of Biomedical and Health Informatics10.1109/JBHI.2022.320550627:10(5143-5154)Online publication date: Oct-2023
https://doi.org/10.1109/JBHI.2022.3205506
Himeur YAl-Maadeed SAlmaadeed NAbualsaud KMohamed AKhattab TElharrouss O(2022)Deep visual social distancing monitoring to combat COVID-19: A comprehensive surveySustainable Cities and Society10.1016/j.scs.2022.10406485(104064)Online publication date: Oct-2022
https://doi.org/10.1016/j.scs.2022.104064

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Recommendations

Uses and gratifications of social networking sites for bridging and bonding social capital

Digital divide in social networking sites

Sustaining social capital online amidst social distancing during the COVID-19 pandemic: web-based communities, their mitigating effects, and associated issues

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations