short-paper

Edge4Real: a cost-effective edge computing based human behaviour recognition system for human-centric software engineering

Authors:

Di Shao,

Xiao Liu,

Ben Cheng,

Owen Wang,

Thuong HoangAuthors Info & Claims

ASE '20: Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering

Pages 1287 - 1291

https://doi.org/10.1145/3324884.3415297

Published: 27 January 2021 Publication History

Get Access

Abstract

Recognition of human behaviours including body motions and facial expressions plays a significant role in human-centric software engineering. However, due to the data and computation intensive nature of human behaviour recognition through video analytics, expensive powerful machines are often required, which could hinder the research and application in human-centric software engineering. To address such an issue, this paper proposes a cost-effective human behaviour recognition system named Edge4Real which can be easily deployed in an edge computing environment with commodity machines. Compared with existing centralised solutions, Edge4Real has three major advantages including cost-effectiveness, easy-to-use, and real-time. Specifically, Edge4Real adopts a distributed architecture where components such as motion capturing, human behaviour recognition, data decoding and extraction, and the application of the recognition result, can be deployed on separated end devices and edge nodes in an edge computing environment. Using a virtual reality application which can capture a user's motion and translate into the motion of a 3D avatar in real time, we successfully validate the effectiveness of the system and demonstrate its promising value to the research and application of human-centric software engineering. The demo video can be found at https://youtu.be/tnEshD8j-kA.

References

[1]

Rabaey, J.M., 2019. Human-Centric Computing. IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 28(1), pp.3-11.

Crossref

Google Scholar

[2]

Murphy, G.C., 2010. Human-centric software engineering. In Proceedings of the FSE/SDP workshop on Future of software engineering research, (Nov, 2010), pp. 251--254.

Digital Library

Google Scholar

[3]

The Industrial Internet Consortium, 2020. The Edge Computing Advantage [Online]. Available: https://www.iiconsortium.org/pdf/IIC_Edge_Computing_Advantages_White_Paper_2019-10-24.pdf, accessed on 30 May 2020

Google Scholar

[4]

Yusop, N.S.M., Grundy, J. and Vasa, R., 2016. Reporting usability defects: a systematic literature review. IEEE Transactions on Software Engineering, 43(9), pp.848-867.

Digital Library

Google Scholar

[5]

Karras, O., Kiesling, S. and Schneider, K., 2016. Supporting requirements elicitation by tool-supported video analysis. In 2016 IEEE 24th International Requirements Engineering Conference (RE), pp. 146--155.

Google Scholar

[6]

Grundy, J., Khalajzadeh, H. and Mcintosh, J., 2020. Towards Human-centric Model-driven Software Engineering. In ENASE, pp. 229--238.

Google Scholar

[7]

Zhang, F., Wu, T.Y., Pan, J.S., Ding, G. and Li, Z., 2019. Human motion recognition based on SVM in VR art media interaction environment. Human-centric Computing and Information Sciences, 9(1), p.40.

Crossref

Google Scholar

[8]

Li, J., Shi, D., Tumnrk P. and Xu H. 2020. A system for real-time intervention in negative emotional contagion deployed under edge computing service infrastructure. Peer-to-Peer Networking and Applications, pp. 1--14.

Google Scholar

[9]

de Assuncao, M.D., da Silva Veith, A. and Buyya, R., 2018. Distributed data stream processing and edge computing: A survey on resource elasticity and future directions. Journal of Network and Computer Applications, 103, pp.1--17.

Digital Library

Google Scholar

[10]

Claypool, K.T. and Claypool, M., 2007. On frame rate and player performance in first person shooter games. Multimedia systems, 13(1), pp. 3--17.

Google Scholar

[11]

Salleh, N., Mendes, E. and Grundy, J., 2010. Empirical studies of pair programming for CS/SE teaching in higher education: A systematic literature review. IEEE Transactions on Software Engineering, 37(4), pp.509-525.

Digital Library

Google Scholar

Cited By

View all

Karre SReddy YMittal R(2024)RE Methods for Virtual Reality Software Product Development: A Mapping StudyACM Transactions on Software Engineering and Methodology10.1145/364959533:4(1-31)Online publication date: 26-Feb-2024
https://dl.acm.org/doi/10.1145/3649595
Karre SMittal RReddy R(2023)Requirements Elicitation for Virtual Reality Products - A Mapping StudyProceedings of the 16th Innovations in Software Engineering Conference10.1145/3578527.3578536(1-11)Online publication date: 23-Feb-2023
https://dl.acm.org/doi/10.1145/3578527.3578536
Saha SDu YSandha SGarcia LJawed MSrivastava M(2023)Inertial Navigation on Extremely Resource-Constrained Platforms: Methods, Opportunities and Challenges2023 IEEE/ION Position, Location and Navigation Symposium (PLANS)10.1109/PLANS53410.2023.10139997(708-723)Online publication date: 24-Apr-2023
https://doi.org/10.1109/PLANS53410.2023.10139997
Show More Cited By

Index Terms

Edge4Real: a cost-effective edge computing based human behaviour recognition system for human-centric software engineering
1. Software and its engineering
  1. Software creation and management

Recommendations

Body posture graph: a new graph‐based posture descriptor for human behaviour recognition

Behaviour recognition and analysis is one of the most challenging problems in video processing. In this study, the authors propose a new graph‐based representation of body silhouette by means of non‐linear mixture modelling. Firstly, the authors suppose ...
Holobody galleries: blending augmented and virtual reality displays of human anatomy
VRIC '16: Proceedings of the 2016 Virtual Reality International Conference

In this paper, we propose a novel way to illustrate human anatomy by combining virtual and augmented reality display technologies. Our intention is to create an anatomy gallery, which blends real world anatomy specimens, in the form of 3D printed models,...
Modeling of Edge Server Cache-Reservation for Virtual Reality Applications
Q2SWinet '22: Proceedings of the 18th ACM International Symposium on QoS and Security for Wireless and Mobile Networks

Envisioned virtual reality (VR) systems include mobility as one of the important features of users' when interacting with virtual environments and objects. Thus, VR content encoding will be processed on cloud servers and delivered to users through the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ASE '20: Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering

December 2020

1449 pages

ISBN:9781450367684

DOI:10.1145/3324884

General Chair:
John Grundy,
Program Chairs:
Claire Le Goues,
David Lo

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

IEEE CS

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 January 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ASE '20

Sponsor:

ASE '20: 35th IEEE/ACM International Conference on Automated Software Engineering

December 21 - 25, 2020

Virtual Event, Australia

Acceptance Rates

Overall Acceptance Rate 82 of 337 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
123
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)3

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Karre SReddy YMittal R(2024)RE Methods for Virtual Reality Software Product Development: A Mapping StudyACM Transactions on Software Engineering and Methodology10.1145/364959533:4(1-31)Online publication date: 26-Feb-2024
https://dl.acm.org/doi/10.1145/3649595
Karre SMittal RReddy R(2023)Requirements Elicitation for Virtual Reality Products - A Mapping StudyProceedings of the 16th Innovations in Software Engineering Conference10.1145/3578527.3578536(1-11)Online publication date: 23-Feb-2023
https://dl.acm.org/doi/10.1145/3578527.3578536
Saha SDu YSandha SGarcia LJawed MSrivastava M(2023)Inertial Navigation on Extremely Resource-Constrained Platforms: Methods, Opportunities and Challenges2023 IEEE/ION Position, Location and Navigation Symposium (PLANS)10.1109/PLANS53410.2023.10139997(708-723)Online publication date: 24-Apr-2023
https://doi.org/10.1109/PLANS53410.2023.10139997
Du YSaha SSandha SLovekin AWu JSiddharth SChowdhary MJawed MSrivastava M(2023)Neural-Kalman GNSS/INS Navigation for Precision Agriculture2023 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48891.2023.10161351(9622-9629)Online publication date: 29-May-2023
https://doi.org/10.1109/ICRA48891.2023.10161351
Wang YLiu XCheng BArora CHoang T(2022)VR4HcRE: Virtual Reality Platform for Human-centric Requirements Elicitation2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct57072.2022.00168(788-793)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00168
Cheng BWang YShao DArora CHoang TLiu X(2021)Edge4Emotion: An Edge Computing based Multi-source Emotion Recognition Platform for Human-Centric Software Engineering2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid)10.1109/CCGrid51090.2021.00071(610-613)Online publication date: May-2021
https://doi.org/10.1109/CCGrid51090.2021.00071
Wang YCheng BHoang TArora CLiu X(2021)Virtual Reality Enabled Human-Centric Requirements Engineering2021 36th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW)10.1109/ASEW52652.2021.00041(159-164)Online publication date: Nov-2021
https://doi.org/10.1109/ASEW52652.2021.00041

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Body posture graph: a new graph‐based posture descriptor for human behaviour recognition

Holobody galleries: blending augmented and virtual reality displays of human anatomy

Modeling of Edge Server Cache-Reservation for Virtual Reality Applications