Abstract
In this study, we have reviewed the possible negative side effects (NSEs) of existing artificial intelligence (AI) secretarial services and propose a task performance method that can mitigate these effects. An AI assistant is a voice user interface (VUI) that combines voice recognition with AI technology to support self-learning. When a user encounters the unintended behavior of an AI agent or they cannot predict all the outcomes of using an agent at the development stage, NSEs may occur. Reducing NSEs in AI has been emerging as a major research task, while there is a lack of research on applications and solutions regarding AI secretaries. In this study, we performed a user interface (UI) analysis of actual services; designed NSE mitigation task execution methods; and developed three prototypes: A-existing AI secretarial method, B-confirmation request method, and C-question guidance method. The usability assessment comprised these factors: efficiency, flexibility, meaningfulness, accuracy, trust, error count, and task execution time. Prototype C showed higher efficiency, flexibility, meaningfulness, accuracy, and trust than prototypes A and B did, with B showing higher error counts and task execution times. Most users preferred prototype C since it presented a verifiable option that enabled tasks to be quickly executed with short commands. The results of this study can be used as basic data for research related to the NSEs of using AI and be used as a reference in designing and evaluating AI services.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kim, B.W.: Trend analysis and national policy for artificial intelligence. Inform. Policy 23(1), 74–93 (2016)
Soo-ah, P., Sejung, M.C.: Understanding the factors influencing satisfaction and continued use intention of AI speakers: focusing on the utilitarian and hedonic values. Inf. Soc. Media 19(3), 159–182 (2018)
Cao, C., Zhao, L., Hu, Y.: Anthropomorphism of intelligent personal assistants (IPAs): antecedents and consequences. In: Wei, K.K., Jiang, J., Kim, H.-W. (eds.) Proceedings of the Twenty-Third Pacific Asia Conference on Information Systems, Association for Information Systems, Atlanta, Georgia (2019)
Zhou, Y.M., Shang, L.R., Lim, H.C., Hwang, M.K.: Verification of AI voice user interface (VUI) usability evaluation: focusing on Chinese navigation VUI. J. Korea Multimedia Soc. 24(7), 913–921 (2021)
Saisubramanian, S., Roberts, S.C., Zilberstein, S.: Understanding user attitudes towards negative side effects of AI systems. In: Kitamura, Y., Quigley, A., Isbister, K., Igarashi, T. (eds.) Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–6. Association for Computing Machinery, New York (2021)
Saisubramanian, S., Zilberstein, S., Kamar, E.: Avoiding negative side effects due to incomplete knowledge of AI systems. AI Mag. 42(4), 62–71 (2022)
Forlizzi, J., DiSalvo, C.: Service robots in the domestic environment: a study of the roomba vacuum in the home. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, pp. 258–265. Association for Computing Machinery, New York (2006)
Hulse, L.M., Xie, H., Galea, E.R.: Perceptions of autonomous vehicles: relationships with road users, risk, gender and age. Saf. Sci. 102, 1–13 (2018)
Kyriakidis, M., Happee, R., de Winter, J.C.: Public opinion on automated driving: results of an international questionnaire among 5000 respondents. Transport. Res. F: Traffic Psychol. Behav. 32, 127–140 (2015)
Liptak, A.: Amazon’s Alexa started ordering people dollhouses after hearing its name on TV. The Verge 7 (2017)
Hadfield-Menell, D., Milli, S., Abbeel, P., Russell, S.J., Dragan, A.: Inverse reward design. Adv. Neural Inf. Process. Syst. 30 (2017)
Saisubramanian, S., Kamar, E., Zilberstein, S.: A multi-objective approach to mitigate negative side effects. In: Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, pp. 354–361. International Joint Conferences on Artificial Intelligence, Yokohama (2021)
Saisubramanian, S., Zilberstein, S.: Mitigating negative side effects via environment shaping. In: Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, pp. 1640–1642. International Foundation for Autonomous Agents and MultiAgent Systems, Virtual Event, United Kingdom (2021)
Morville, P., Sullenger, P.: Ambient findability: libraries, serials, and the Internet of things. Ser. Libr. 58(1–4), 33–38 (2010)
Nielsen, J.: Ten usability heuristics (2005)
Acknowledgement
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. NRF-2021R1F1A1063155). And this research was also supported by the MSIT(Ministry of Science and ICT), Korea, under the ICAN(ICT Challenge and Advanced Network of HRD) program (IITP-2022-RS-2022-00156215) supervised by the IITP(Institute of Information & Communications Technology Planning & Evaluation).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lee, D., Kim, G., Kim, H.K. (2023). User Experience for Artificial Intelligence Assistant: Focusing on Negative Side Effects. In: Degen, H., Ntoa, S. (eds) Artificial Intelligence in HCI. HCII 2023. Lecture Notes in Computer Science(), vol 14051. Springer, Cham. https://doi.org/10.1007/978-3-031-35894-4_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-35894-4_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35893-7
Online ISBN: 978-3-031-35894-4
eBook Packages: Computer ScienceComputer Science (R0)