More Web Proxy on the site http://driver.im/

short-paper

Modeling Behavior Patterns with an Unfamiliar Voice User Interface

Authors:

Chelsea M. Myers,

David Grethlein,

Anushay Furqan,

Santiago Ontañón,

Jichen ZhuAuthors Info & Claims

UMAP '19: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization

Pages 196 - 200

https://doi.org/10.1145/3320435.3320475

Published: 07 June 2019 Publication History

Abstract

Voice User Interfaces (VUIs) are becoming increasingly popular. However, how VUIs can adapt to user differences remains insufficiently understood. We analyze usage data from a user study (n=50) where participants interacted with an unfamiliar VUI. Through automated clustering and statistical analysis, we present user models of their behavior patterns. We found user behavior can be grouped into three clusters: people who become proficient with the system and typically stay proficient while completing different tasks, people who exhibit an exploratory approach to completing tasks, and people who struggled to complete tasks. We discuss design implications based on these behavior clusters.

References

[1]

Frank Bentley, Chris Luvogt, Max Silverman, Rushani Wirasinghe, Brooke White, and Danielle Lottrjdge. 2018. Understanding the Long-Term Use of Smart Speaker Assistants . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 2, 3 (2018), 1--24.

Digital Library

[2]

Janghee Cho. 2018. Mental Models and Home Virtual Assistants (HVAs) . Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (2018), SRC05:1---SRC05:6.

Digital Library

[3]

J. Chu-Carroll. 2000. MIMIC: An adaptive mixed initiative spoken dialogue system for information queries . Proceedings of the sixth conference on Applied natural language processing 6 (2000), 97--104.

Digital Library

[4]

Eric Corbett and Astrid Weber. 2016. What can I say? Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '16 (2016), 72--82.

Digital Library

[5]

Benjamin R Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. "What can i help you with?": Infrequent Users' Experiences of Intelligent Personal Assistants . Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '17 (2017), 1--12.

Digital Library

[6]

Anders Drachen, Alessandro Canossa, and Georgios N. Yannakakis. 2009. Player modeling using self-organization in Tomb Raider: Underworld . CIG2009 - 2009 IEEE Symposium on Computational Intelligence and Games (2009), 1--8.

Digital Library

[7]

Anushay Furqan, Chelsea Myers, and Jichen Zhu. 2017. Learnability through Adaptive Discovery Tools in Voice User Interfaces . Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17 (2017), 1617--1623.

Digital Library

[8]

Ahmed Hassan, Ryen W. White, Susan T. Dumais, and Yi-Min Wang. 2014. Struggling or exploring?: disambiguating long search sessions. Seventh ACM WSDM (2014), 53--62.

Digital Library

[9]

S. Janarthanam and O. Lemon. 2010. Learning to adapt to unknown users: Referring expression generation in spoken dialogue systems . ACL 2010 - 48th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (2010), 69--78.

[10]

Jiepu Jiang, Ahmed Hassan Awadallah, Rosie Jones, Umut Ozertem, Imed Zitouni, Ranjitha Gurunath Kulkarni, and Omar Zia Khan. 2015. Automatic Online Evaluation of Intelligent Assistants . Proceedings of the 24th International Conference on World Wide Web - WWW '15 (2015), 506--516.

Digital Library

[11]

Laurent Karsenty and Valerie Botherel. 2005. Transparency strategies to help users handle system errors . Speech Communication, Vol. 45, 3 SPEC. ISS. (2005), 305--324.

[12]

Trupti M Kodinariya and Prashant R Makwana. 2013. Review on determining number of Cluster in K-Means Clustering. International Journal, Vol. 1, 6 (2013), 90--95.

[13]

Kazunori Komatani, Shinichi Ueno, Tatsuya Kawahara, and Hiroshi G. Okuno. 2005. User modeling in spoken dialogue systems to generate flexible guidance . User Modelling and User-Adapted Interaction, Vol. 15, 1 (2005), 169--183.

Digital Library

[14]

Tsvi Kuflik, Zvi Boger, and Massimo Zancanaro. 2012. Analysis and prediction of museum visitors' behavioral pattern types . Cognitive Technologies 1 (2012), 161--176.

[15]

Diane J Litman and Shimei Pan. 2000. Predicting and adapting to poor speech recognition in a spoken dialogue system . Proceedings of the National Conference on Artificial Intelligence (2000), 722--728.

Digital Library

[16]

Diane J Litman and Shimei Pan. 2002. Designing and Evaluating an Adaptive Spoken Dialogue System . (2002), 111--137.

Digital Library

[17]

Stuart Lloyd. 1982. Least squares quantization in PCM. IEEE transactions on information theory, Vol. 28, 2 (1982), 129--137.

Digital Library

[18]

Ewa Luger and Abigail Sellen. 2016. "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents . Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16 (2016), 5286--5297.

Digital Library

[19]

Chelsea Myers, Anushay Furqan, Jessica Nebolsky, Karina Caro, and Jichen Zhu. 2018. Patterns for How Users Overcome Obstacles in Voice User Interfaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 6:1---6:7.

Digital Library

[20]

Chelsea Myers, Anushay Furqan, and Jichen Zhu. 2019. The Impact of User Characteristics and Preferences on Performance with an Unfamiliar Voice User Interface. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, (forthcoming).

Digital Library

[21]

S. S. Poorna, C. Y. Jeevitha, Shyama Jayan Nair, Sini Santhosh, and G. J. Nair. 2016. Emotion recognition using multi-parameter speech feature classification . Proceedings - 2015 International Conference on Computers, Communications and Systems, ICCCS 2015 (2016), 217--222.

[22]

Georgios N Yannakakis, Pieter Spronck, Daniele Loiacono, and Elisabeth André. 2013. Player modeling. In Dagstuhl Follow-Ups, Vol. 6. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.

Cited By

Myers CLaris Pardo LAcosta-Ruiz ACanossa AZhu J(2021)“Try, Try, Try Again:” Sequence Analysis of User Interaction Data with a Voice User InterfaceProceedings of the 3rd Conference on Conversational User Interfaces10.1145/3469595.3469613(1-8)Online publication date: 27-Jul-2021
https://dl.acm.org/doi/10.1145/3469595.3469613
Kim YReza MMcGrenere JYoon DKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Designers Characterize Naturalness in Voice User Interfaces: Their Goals, Practices, and ChallengesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445579(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445579
Avdic MVermeulen J(2020)Intelligibility Issues Faced by Smart Speaker Enthusiasts in Understanding What Their Devices Do and WhyProceedings of the 32nd Australian Conference on Human-Computer Interaction10.1145/3441000.3441068(314-328)Online publication date: 2-Dec-2020
https://dl.acm.org/doi/10.1145/3441000.3441068

Index Terms

Modeling Behavior Patterns with an Unfamiliar Voice User Interface
1. Computing methodologies
  1. Machine learning
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Natural language interfaces

Recommendations

“Try, Try, Try Again:” Sequence Analysis of User Interaction Data with a Voice User Interface
CUI '21: Proceedings of the 3rd Conference on Conversational User Interfaces

Voice User Interfaces (VUIs) pose challenges for users to learn the system’s supported features and commands. Users often rely on trial-and-error to navigate VUI dialogues and complete desired tasks. The order in which users try different commands ...
Patterns for How Users Overcome Obstacles in Voice User Interfaces
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Voice User Interfaces (VUIs) are growing in popularity. However, even the most current VUIs regularly cause frustration for their users. Very few studies exist on what people do to overcome VUI problems they encounter, or how VUIs can be designed to aid ...
The Impact of User Characteristics and Preferences on Performance with an Unfamiliar Voice User Interface
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Voice User Interfaces (VUIs) are increasing in popularity. However, their invisible nature with no or limited visuals makes it difficult for users to interact with unfamiliar VUIs. We analyze the impact of user characteristics and preferences on how ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UMAP '19: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization

June 2019

377 pages

ISBN:9781450360210

DOI:10.1145/3320435

General Chairs:
George Angelos Papadopoulos
University of Cyprus, Cyprus
,
George Samaras
University of Cyprus, Cyprus
,
Stephan Weibelzahl
PFH Private University of Applied Sciences Göttingen, Germany
,
Program Chairs:
Dietmar Jannach
Alpen-Adria-Universität Klagenfurt, Austria
,
Olga C. Santos
aDeNu Research Group - UNED, Spain

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

UMAP '19

Sponsor:

UMAP '19: 27th Conference on User Modeling, Adaptation and Personalization

June 9 - 12, 2019

Larnaca, Cyprus

Acceptance Rates

UMAP '19 Paper Acceptance Rate 30 of 122 submissions, 25%;

Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Sponsor:
sigchi
sigchi

33rd ACM Conference on User Modeling, Adaptation and Personalization

June 16 - 19, 2025

New York City , NY , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
435
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Myers CLaris Pardo LAcosta-Ruiz ACanossa AZhu J(2021)“Try, Try, Try Again:” Sequence Analysis of User Interaction Data with a Voice User InterfaceProceedings of the 3rd Conference on Conversational User Interfaces10.1145/3469595.3469613(1-8)Online publication date: 27-Jul-2021
https://dl.acm.org/doi/10.1145/3469595.3469613
Kim YReza MMcGrenere JYoon DKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Designers Characterize Naturalness in Voice User Interfaces: Their Goals, Practices, and ChallengesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445579(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445579
Avdic MVermeulen J(2020)Intelligibility Issues Faced by Smart Speaker Enthusiasts in Understanding What Their Devices Do and WhyProceedings of the 32nd Australian Conference on Human-Computer Interaction10.1145/3441000.3441068(314-328)Online publication date: 2-Dec-2020
https://dl.acm.org/doi/10.1145/3441000.3441068

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents