Abstract
Nowadays, machines like computers and mobile devices are developing towards having human-like behaviors and thoughts. However, they are unable to completely replace humans because of the high levels of uncertainty and vulnerability. It is expedient to combine humans and machines to complement disadvantages of each other. The previous computing methods are lack of a general definition and framework for combining humans and machines in a dynamic environment. This paper proposes a new concept on cooperation between humans and machines that can give more meaningful inspiration for future development of the filed; we call the proposed computing paradigm human–machine computing (HMC). HMC aims to provide a general framework for machines and humans working on a task interactively in an evolving environment, such that machines achieve optimized performance under human guidance during the computing procedure. In this paper, we describe HMC from six perspectives: definition, framework, challenges, technologies, comparisons, and case studies.
Similar content being viewed by others
Change history
23 February 2021
A Correction to this paper has been published: https://doi.org/10.1007/s42486-021-00056-4
Notes
Note that users and humans are two different concepts in the proposed framework. The user is who proposes the task and uses HMC to attain the final results of the task. The human is an element of HMC and he/she executes parts of the task.
References
Adam, A., Rivlin, E., Shimshoni, I., et al.: Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Trans. Pattern Anal. Mach. Intell. 30(3), 555–560 (2008)
Bouindour, S., Snoussi, H., Hittawe, M.M., et al.: An on-line and adaptive method for detecting abnormal events in videos using spatio-temporal ConvNet. Appl. Sci. 9(4), 757 (2019)
Candra, M.Z.C.: Hybrid Human–Machine Computing Systems. Doctoral dissertation, Technische Universitt Wien (2016)
Cheng, J., Bernstein, M.S.: Flock: hybrid crowd-machine learning classifiers. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work and Social Computing, p. 600611 (2015)
Chong, Y.S., Tay, Y.H.: Abnormal event detection in videos using spatiotemporal autoencoder. In: International Symposium on Neural Networks, pp. 189–196 (2017)
Daugherty, P.R., Wilson, H.J.: Human + Machine: Reimagining Work in the Age of AI. Harvard Business Press, Brighton (2018)
Fails, J.A., Olsen, Jr D.R.: Interactive machine learning. In: Proceedings of the 8th International Conference on Intelligent User Interfaces, pp. 39–45 (2003)
Filippov, A.I., Iuzbashev, A.V., Kurnev, A.S.: User authentication via touch pattern recognition based on isolation forest. In: 2018 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus), pp. 1485–1489 (2018)
Foster, I., Kesselman, C.: The Grid 2: Blueprint for a New Computing Infrastructure. Elsevier, Amsterdam (2003)
Guo, B., Chen, C., Zhang, D., et al.: Mobile crowd sensing and computing: when participatory sensing meets participatory social media. IEEE Commun. Mag. 54(2), 131137 (2016)
Hasan, M., Choi, J., Neumann, J., et al.: Learning temporal regularity in video sequences. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 733–742 (2016)
Hejazi, M., Al-Haddad, S.A.R., Hashim, S.J., et al.: Non-fiducial based ECG biometric authentication using one-class support vector machine. In: 2017 Signal Processing: Algorithms, Architectures, Arrangements, and Applications, pp. 190–194 (2017)
Hoc, J.: Towards a cognitive approach to human–machine cooperation in dynamic situations. Int. J. Hum. Comput. Stud. 54(4), 509540 (2001)
Jaimes, A., Sebe, N., Gatica-Perez, D.: Human-centered computing: a multimedia perspective. In: Proceedings of the 14th ACM international conference on Multimedia, pp. 855–864 (2006)
Lu, C., Shi, J., Jia, J.: Abnormal event detection at 150 fps in matlab. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2720–2727 (2013)
Mahadevan, V., Li, W., Bhalodia, V., et al.: Anomaly detection in crowded scenes. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1975–1981 (2010)
Malone, T.W., Laubacher, R., Dellarocas, C.: Harnessing crowds: Mapping the genome of collective intelligence. MIT Sloan Research (2009)
Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 935–942 (2009)
Mell, P., Grance, T., et al.: The nist definition of cloud computing. National Institute of Standards and Technology (2011)
Peleg, D.: Distributed computing. SIAM Monogr. Discrete Math. Appl. 5, 11 (2000)
Preece, J., Rogers, Y., Sharp, H., et al.: Human–Computer Interaction. Addison-Wesley Longman Ltd., Boston (1994)
Ren, X., Silpasuwanchai, C., Cahill, J.: Human-engaged computing: the future of human–computer interaction. CCF Trans. Pervas. Comput. Interact. 1(2), 47–68 (2019)
Schirner, G., Erdogmus, D., Chowdhury, K., et al.: The future of human-in-the-loop cyber-physical systems. Computer 1, 3645 (2013)
Shi, W., Cao, J., Zhang, Q., et al.: Edge computing: vision and challenges. IEEE Int. Things J. 3(5), 637646 (2016)
Toshev, A., Szegedy, C.: Deeppose: Human pose estimation via deep neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1653–1660 (2014)
Wang, S., Zhang, W.W., Wang, Y.S.: Fingerprint classification by directional fields. In: Proceedings of Fourth IEEE International Conference on Multimodal Interfaces, pp. 395–399 (2002)
Wang, X., Yu, T., Zeng, M., et al.: XRec: behavior-based user recognition across mobile devices. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, pp. 1–26 (2017)
Wei, J., Snider, J.M., Kim, J., et al.: Towards a viable autonomous driving research platform. In: 2013 IEEE Intelligent Vehicles Symposium (IV), p. 763770 (2013)
Weiser, M.: Some computer science issues in ubiquitous computing. Commun. ACM 36(7), 7584 (1993)
Xin, T., Guo, B., Wang, Z., et al.: Freesense: indoor human identification with Wi-Fi signals. In: 2016 IEEE Global Communications Conference (GLOBECOM), pp. 1–7 (2016)
Xin, T., Guo, B., Wang, Z., et al.: Freesense: a robust approach for indoor human detection using Wi-Fi signals. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, p. 143 (2018)
Xu, W., Yu, Z., Wang, Z., et al.: Acousticid: gait-based human identification using acoustic signal. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, pp. 1–25 (2019)
Yuen, M.C., Chen, L.J., King, I.: A survey of human computation systems. In: 2009 International Conference on Computational Science and Engineering, pp. 723–728 (2009)
Zhang, Q., Zhou, D., Zeng, X.: Heartid: a multiresolution convolutional neural network for ECG-based biometric human identification in smart health applications. IEEE Access 5, 1180511816 (2017)
Zhang, X., Yao, L., Kanhere, S.S., et al.: Mindid: person identification from brain waves through attention-based recurrent neural network. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, p. 149 (2018)
Zhao, Y., Deng, B., Shen, C., et al.: Spatio-temporal autoencoder for video anomaly detection. In: Proceedings of the 25th ACM International Conference on Multimedia, pp. 1933–1941 (2017)
Zheng, N., Liu, Z., Ren, P., et al.: Hybrid-augmented intelligence: collaboration and cognition. Front. Inf. Technol. Electron. Eng. 18(2), 153179 (2017)
Zieba, S., Polet, P., Vanderhaegen, F., et al.: Principles of adjustable autonomy: a framework for resilient human–machine cooperation. Cognit. Technol. Work 12(3), 193203 (2010)
Acknowledgements
This work was supported in part by the National Science Fund for Distinguished Young Scholars (No. 61725205), and the National Natural Science Foundation of China (No. 61960206008, No. 61772428, No. 61972319, No. 61902320).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yu, Z., Li, Q., Yang, F. et al. Human–machine computing. CCF Trans. Pervasive Comp. Interact. 3, 1–12 (2021). https://doi.org/10.1007/s42486-020-00051-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s42486-020-00051-1