Smart Speakers for Inclusion: How Can Intelligent Virtual Assistants Really Assist Everybody?

• Abdolrahmani, A., Kuber, R., Branham, S.M.: Siri talks at you: an empirical investigation of voice-activated personal assistant (VAPA) usage by individuals who are blind. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018), pp. 249–258 (2018). https://doi.org/10.1145/3234695.3236344

• Arend, B.: Hey Siri, what can I tell about Sancho Panza in my presentation? Investigating Siri as a virtual assistant in a learning context? pp. 7854–7863 (2018). https://doi.org/10.21125/inted.2018.1874

• Azenkot, S., Lee, N.B.: Exploring the use of speech input by blind people on mobile devices. In: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2013), pp. 11:1–11:8 (2013). https://doi.org/10.1145/2513383.2513440

• Baber C.: Developing interactive speech technology. In: Interactive Speech Technology: Human Factors Issues in the Application of Speech Input/Output to Computers. Taylor & Francis, Inc., Bristol (1993)

  Google Scholar 

• Balasuriya, S.S., Sitbon, L., Bayor, A.A., Hoogstrate, M., Brereton, M.: Use of voice activated interfaces by people with intellectual disability. In: Proceedings of the 30th Australian Conference on Computer-Human Interaction (OzCHI 2018), pp. 102–112 (2018). https://doi.org/10.1145/3292147.3292161

• Ballati, F., Corno, F., De Russis, L.: Assessing virtual assistant capabilities with Italian dysarthric speech. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018), pp. 93–101, Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3234695.3236354

• Berdasco, A., López, G., Diaz, I., Quesada, L., Guerrero, L.A.: User experience comparison of intelligent personal assistants: Alexa, Google Assistant, Siri and Cortana. In: Proceedings of the 13th International Conference on Ubiquitous Computing and Ambient Intelligence UCAmI, vol. 31, no. 1, p. 51 (2019). https://doi.org/10.3390/proceedings2019031051

• Beksa, J., Desmarais, A., Terblanche, M.: Usability study of blind foundation’s Alexa library skill & low vision NZ (formerly the Blind Foundation) (2020)

  Google Scholar 

• Bigham, J.P., Kushalnagar, R., Huang, T.K., Flores, J.P., Savage, S.: On how deaf people might use speech to control devices. In: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017), pp. 383–384 (2017). https://doi.org/10.1145/3132525.3134821

• Branham, S.M., Kane, S.K.: The invisible work of accessibility: how blind employees manage accessibility in mixed-ability workplaces. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS 2015), pp. 163–171 (2015). https://doi.org/10.1145/2700648.2809864

• Branham, S.M., Mukkath Roy, A.R.: Reading between the guidelines: how commercial voice assistant guidelines hinder accessibility for blind users. In: The 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019), pp. 446–458. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3308561.3353797

• Brunhuber, K.: The hottest thing in technology is your voice. http://www.cbc.ca/news/technology/brunhuber-ces-voice-activated-1.4483912. Accessed Feb 2021

• Chkrou, M., Azaria, A.: LIA: a virtual assistant that can be taught new commands by speech. Int. J. Hum.-Comput. Interact. 35(17), 1596–1607 (2019). https://doi.org/10.1080/10447318.2018.1557972

  Article  Google Scholar 

• Cohen, M.H., Giangola, J., Balogh, J.: Voice User Interface Design. Addison-Wesley Professional, Boston (2004)

  Google Scholar 

• Corbett, E., Weber, A.: What can I say? Addressing user experience challenges of a mobile voice user interface for accessibility. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2016), pp. 72–82. Association for Computing Machinery, New York (2016). https://doi.org/10.1145/2935334.2935386

• Cowan, B.R., et al.: What can I help you with?: Infrequent users’ experiences of intelligent personal assistants. In: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2017), pp. 43:1–43:12 (2017). https://doi.org/10.1145/3098279.3098539

• Davis, K.H., Biddulph, R., Balashek, S.: Automatic recognition of spoken digits. J. Acoust. Soc. Am. 24, 637–642 (1952)

  Google Scholar 

• Desmond, D., et al.: Assistive technology and people: a position paper from the first global research, innovation and education on assistive technology (GREAT) summit. Disabil. Rehabil. Assist. Technol. 13, 1–8 (2018)

  Article  Google Scholar 

• Duffy, J.: Motor Speech Disorders E-Book: Substrates, Differential Diagnosis, and Management. Elsevier Health Sciences, Philadelphia (2013)

  Google Scholar 

• Feng, H., Fawaz, K., Shin, K.S.: Continuous authentication for voice assistants. In: Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking, pp. 343–355 (2017)

  Google Scholar 

• Friederike, E., Kuchenbrandt, D., Bobinger, S., de Ruiter, L., Hegel, F.: If you sound like me, you must be more human: on the interplay of robot and user features on human-robot acceptance and anthropomorphism. In: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, pp. 125–126. ACM (2012)

  Google Scholar 

• Gill, M.: Adaptability and affordances in new media: literate technologies, communicative techniques. J. Pragmatics 116, 104–108 (2017)

  Article  Google Scholar 

• Griswold, A.: Even Amazon is surprised by how much people love Alexa (2018). https://qz.com/1197615/even-amazon-is-surprised-by-how-much-people-love-alexa/. Accessed Feb 2021

• Grossman, T., Fitzmaurice, G., Attar, R.: A survey of software learnability: metrics, methodologies and guidelines. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI 2009), pp. 649–658 (2009). https://doi.org/10.1145/1518701.1518803

• Habler, F., Schwind, V., Henze, N.: Effects of smart virtual assistants’ gender and language. In: Proceedings of Mensch und Computer 2019 (MuC 2019), pp. 469–473. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3340764.3344441

• Hirschberg, J., Manning, C.D.: Advances in natural language processing. Science 349(6245), 261–266 (2015). https://doi.org/10.1126/science.aaa8685

  Article  MathSciNet  MATH  Google Scholar 

• Ho, D.K.: Voice-controlled virtual assistants for the older people with visual impairment. Eye (Lond) 32(1), 53–54 (2018). https://doi.org/10.1038/eye.2017.165

  Article  Google Scholar 

• Hoy, M.B.: Alexa, Siri, Cortana, and more: an introduction to voice assistants. Med. Ref. Serv. Q. 37(1), 81–88 (2018)

  Article  Google Scholar 

• Iannizzotto, G., Bello, L.L., Nucita, A., Grasso, G.M.: A vision and speech enabled, customizable, virtual assistant for smart environments. In: 2018 11th International Conference on Human System Interaction (HSI), Gdansk, pp. 50–56 (2018). https://doi.org/10.1109/HSI.2018.8431232

• Iyer, V., Shah, K., Sheth, S., Devadkar, K.: Virtual assistant for the visually impaired. In: 5th International Conference on Communication and Electronics Systems (ICCES), Coimbatore, India, pp. 1057–1062 (2020). https://doi.org/10.1109/ICCES48766.2020.9137874

• Jacko, J.A., Leonard, V.K., McClellan, M., Scott, I.U.: Perceptual impairments: new advancements promoting technological access. In: Sears, A., Jacko, J.A. (eds.) The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, pp. 853–870, Taylor & Francis Group, New York (2008)

  Google Scholar 

• Juniper Research: voice assistants used in smart homes to grow 1000%, reaching 275 million by 2023, as Alexa leads the way (2018). https://www.juniperresearch.com/press/press-releases/voice-assistants-used-in-smart-homes. Accessed Feb 2021

• Knote, R., Janson, A., Söllner, M., Leimeister, J.M.: Classifying smart personal assistants: an empirical cluster analysis. In: Proceedings of the 52nd Hawaii International Conference on System Sciences, Maui (2019)

  Google Scholar 

• Kobayashi, M., et al.: Effects of age-related cognitive decline on elderly user interactions with voice-based dialogue systems. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11749, pp. 53–74. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29390-1_4

  Chapter  Google Scholar 

• Li, C., Yanagisawa, H.: Intrinsic motivation in virtual assistant interaction for fostering spontaneous interactions. ArXiv abs/2010.06416 (2020)

  Google Scholar 

• Lopatovska, I., Williams, H.: Personification of the Amazon Alexa: BFF or a mindless companion. In: Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (CHIIR 2018), pp. 265–268. Association for Computing Machinery, New York (2018) https://doi.org/10.1145/3176349.3176868

• Luger, E., Sellen, A.: Like having a really bad PA: the gulf between user expectation and experience of conversational agents. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI 2016), pp. 5286–5297 (2016). https://doi.org/10.1145/2858036.2858288

• Mark, W., Perrault, R.: Calo: a cognitive agent that learns and organizes (2004)

  Google Scholar 

• Markets and Markets: Smart speaker market by IVA (Alexa, Google Assistant, Siri, Cortana), Component (Hardware (Speaker Driver, Connectivity IC, Processor, Audio IC, Memory, Power IC, Microphone,) and Software), Application, and Geography - Global Forecast to 2023 (2018). https://www.marketsandmarkets.com/Market-Reports/smart-speaker-market-44984088.html?gclid=EAIaIQobChMIs6Sn3abE5AIVFozICh1-PQLgEAAYASAAEgIZSvD_BwE. Accessed Feb 2021

• Masina, F., et al.: Investigating the accessibility of voice assistants with impaired users: mixed methods study. J. Med. Internet Res. 22(9), e18431 (2020). https://doi.org/10.2196/18431

  Article  Google Scholar 

• McCue, T.J.: Okay Google: voice search technology and the rise of voice commerce. Forbes Online (2018). https://www.forbes.com/sites/tjmccue/2018/08/28/okay-google-voice-search-technology-and-the-rise-of-voice-commerce/#57eca9124e29. Accessed Feb 2021

• McLean, G., Osei-Frimpong, K.: Hey Alexa ... examine the variables influencing the use of artificial intelligent in-home voice assistants. Comput. Hum. Behav. 99, 28–37 (2019)

  Google Scholar 

• McTear, M., Callejas, Z., Griol, D.: The Conversational Interface: Talking to Smart Devices. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-32967-3

  Book  Google Scholar 

• Morris, J.T., Thompson, N.A.: User personas: smart speakers, home automation and people with disabilities. J. Technol. Persons Disabil. 8 (2020)

  Google Scholar 

• Moussawi, S.: User experiences with personal intelligent agents: a sensory, physical, functional and cognitive affordances view. In: Proceedings of the 2018 ACM SIGMIS Conference on Computers and People Research, pp. 86–92. ACM (2018)

  Google Scholar 

• Peres, S.: 39 million Americans now own a smart speaker, report claims. TechCrunch (2019). https://techcrunch.com/2018/01/12/39-million-americans-now-own-a-smart-speaker-report-claims/. Accessed Feb 2021

• Pradhan, A., Mehta K., Findlater, L.: Accessibility came by accident: use of voice-controlled intelligent personal assistants by people with disabilities. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Paper 459, pp. 1–13. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3173574.3174033

• Purington A., Taft, J.G., Sannon, S., Bazarova, N.N., Hardman Taylor, S.: Alexa is my new BFF: social roles, user satisfaction, and personification of the Amazon Echo. In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2853–2859. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3027063.3053246

• Pyae, A., Joelsson, T.N.: Investigating the usability and user experiences of voice user interface: a case of Google home smart speaker. In: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI 2018), pp. 127–131. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3236112.3236130

• Rzepka, C.: Examining the use of voice assistants: a value-focused thinking approach. In: AMCIS (2019)

  Google Scholar 

• Sayago, S., Barbosa Neves, B., Cowan, B.R.: Voice assistants and older people: some open issues. In: Proceedings of the 1st International Conference on Conversational User Interfaces (CUI 2019), Article 7, pp. 1–3. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3342775.3342803

• Schlögl, S., Chollet, G., Garschall, M., Tscheligi, M., Legouverneur, G.: Exploring voice user interfaces for seniors. In: Proceedings of the 6th International Conference on Pervasive Technologies Related to Assistive Environments (PETRA 2013), pp. 52:1–52:2 (2013). https://doi.org/10.1145/2504335.2504391

• Schwind, V., Deierlein, N., Poguntke, R., Henze, N.: Understanding the social acceptability of mobile devices using the stereotype content model. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI 2019), Article 361, 12 p. ACM, New York (2019). https://doi.org/10.1145/3290605.3300591

• Sciarretta, E.: Libri digitali per tutti - Inclusione sociale tramite gli eBook. Eurilink University Press, Roma (2020) ISBN 979 12 80164 04 9

  Google Scholar 

• Sciuto, A., Saini, A., Forlizzi, J., Hong, J.I.: Hey Alexa, what’s up? A mixed-methods studies of in-home conversational agent usage. In: Proceedings of the 2018 on Designing Interactive Systems Conference, pp. 857–868. ACM (2018)

  Google Scholar 

• Smith, A.L., Chaparro, B.S.: Smartphone text input method performance, usability, and preference with younger and older adults. Hum. Factors 57(6), 1015–1028 (2015)

  Article  Google Scholar 

• Spallazzo, D., Sciannamè, M., Ceconello, M.: The domestic shape of AI: a reflection on virtual assistants. In: DeSForM19 Proceedings (2019). https://doi.org/10.21428/5395bc37.8108aa03

• Terzopoulos, G., Satratzemi, M.: Voice assistants and artificial intelligence in education. In: Proceedings of the 9th Balkan Conference on Informatics (BCI 2019), Article 34, pp. 1–6. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3351556.3351588

• The Economist: Now we’re talking, 7th Jan 2017. http://www.economist.com/news/leaders/21713836-casting-magic-spell-it-lets-people-control-world-through-words-alone-how-voice. Accessed Feb 2021

• White, R.W.: Skill discovery in virtual assistants. Commun. ACM 61(11), 106–113 (2018). https://doi.org/10.1145/3185336

  Article  Google Scholar 

• World Health Organization: Global data on visual impairments (2010). https://www.who.int/blindness/GLOBALDATAFINALforweb.pdf. Accessed Feb 2021

• Yang, X., Aurisicchio, M., Baxter, W.: Understanding affective experiences with conversational agents. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI 2019), Paper 542, pp. 1–12. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3290605.3300772

• Zamora, J.: I’m sorry, Dave, I’m afraid we can’t do that: chatbot perception and expectations. In: Proceedings of the 5th International Conference on Human Agent Interaction, pp. 253–260. ACM (2017)

  Google Scholar 

Download references