[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3377325.3377507acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
research-article
Open access

Design and evaluation of intelligent agent prototypes for assistance with focus and productivity at work

Published: 17 March 2020 Publication History

Abstract

Current research on building intelligent agents for aiding with productivity and focus in the workplace is quite limited, despite the ubiquity of information workers across the globe. In our work, we present a productivity agent which helps users schedule and block out time on their calendar to focus on important tasks, monitor and intervene with distractions, and reflect on their daily mood and goals in a single, standalone application. We created two different prototype versions of our agent: a text-based (TB) agent with a similar UI to a standard chatbot, and a more emotionally expressive virtual agent (VA) that employs a video avatar and the ability to detect and respond appropriately to users' emotions. We evaluated these two agent prototypes against an existing product (control) condition through a three-week, within subjects study design with 40 participants, across different work roles in a large organization. We found that participants scheduled 134% more time with the TB prototype, and 110% more time with the VA prototype for focused tasks compared to the control condition. Users reported that they felt more satisfied and productive with the VA agent. However, The perception of anthropomorphism in the VA was polarized, with several participants suggesting that the human appearance was unnecessary. We discuss important insights from our work for the future design of conversational agents for productivity, wellbeing, and focus in the workplace.

References

[1]
Fatema Akbar, Ted Grover, Gloria Mark, and Michelle X Zhou. 2018. The Effects of Virtual Agents' Characteristics on User Impressions and Language Use. In Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion. ACM, 56.
[2]
Anja Baethge and Thomas Rigotti. 2013. Interruptions to workflow: Their relationship with irritation and satisfaction with performance, and the mediating roles of time pressure and mental demands. Work & Stress 27, 1 (2013), 43--63.
[3]
Emad Barsoum, Cha Zhang, Cristian Canton Ferrer, and Zhengyou Zhang. 2016. Training deep networks for facial expression recognition with crowd-sourced label distribution. In Proceedings of the 18th ACM International Conference on Multimodal Interaction. ACM, 279--283.
[4]
Fabrica Binaria. 2019. TrackTime. https://www.fabbricabinaria.it/solutions/tracktime
[5]
Jelmer P Borst, Niels A Taatgen, and Hedderik van Rijn. 2015. What makes interruptions disruptive?: A process-model account of the effects of the problem state bottleneck on task interruption and resumption. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, 2971--2980.
[6]
Stoney Brooks. 2015. Does personal social media usage affect efficiency and well-being? Computers in Human Behavior 46 (2015), 26--37.
[7]
Scott A Cambo, Daniel Avrahami, and Matthew L Lee. 2017. BreakSense: Combining physiological and location sensing to promote mobility during work-breaks. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 3595--3607.
[8]
Justin Cranshaw, Emad Elwany, Todd Newman, Rafal Kocielnik, Bowen Yu, Sandeep Soni, Jaime Teevan, and Andrés Monroy-Hernández. 2017. Calendar. help: Designing a workflow-based scheduling agent with humans in the loop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 2382--2393.
[9]
Mary Czerwinski, Eric Horvitz, and Susan Wilhite. 2004. A diary study of task switching and interruptions. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 175--182.
[10]
Andrew Faulring, Brad Myers, Ken Mohnkern, Bradley Schmerl, Aaron Steinfeld, John Zimmerman, Asim Smailagic, Jeffery Hansen, and Daniel Siewiorek. 2010. Agent-assisted task management that reduces email overload. In Proceedings of the 15th international conference on Intelligent user interfaces. ACM, 61--70.
[11]
Asma Ghandeharioun, Daniel McDuff, Mary Czerwinski, and Kael Rowan. 2018. EMMA: An Emotionally Intelligent Personal Assistant for Improving Wellbeing. arXiv preprint arXiv:1812.11423 (2018).
[12]
Jacek Gwizdka. 2000. Timely reminders: a case study of temporal guidance in PIM and email tools usage. In Chi'00 extended abstracts on human factors in computing systems. ACM, 163--164.
[13]
Annabell Ho, Jeff Hancock, and Adam S Miner. 2018. Psychological, relational, and emotional effects of self-disclosure after conversations with a chatbot. Journal of Communication 68, 4 (2018), 712--733.
[14]
Shamsi T Iqbal and Eric Horvitz. 2007. Conversations amidst computing: A study of interruptions and recovery of task activity. In International Conference on User Modeling. Springer, 350--354.
[15]
William Jones, Harry Bruce, and Susan Dumais. 2001. Keeping found things found on the web. In Proceedings of the tenth international conference on Information and knowledge management. ACM, 119--126.
[16]
Everlyne Kimani, Kael Rowan, Daniel McDuff, Mary Czerwinski, and Gloria Mark. 2019. A Conversational Agent in Support of Productivity and Wellbeing at Work. In Proceedings of the 7th Intenrational Conference on Affective Computing and Intelligent Interaction. IEEE.
[17]
Jonathan Klein, Youngme Moon, and Rosalind W Picard. 2002. This computer responds to user frustration: Theory, design, and results. Interacting with computers 14, 2 (2002), 119--140.
[18]
Rafal Kocielnik, Daniel Avrahami, Jennifer Marlow, Di Lu, and Gary Hsieh. 2018. Designing for workplace reflection: a chat and voice-based conversational agent. In Proceedings of the 2018 Designing Interactive Systems Conference. ACM, 881--894.
[19]
Gloria Mark, Mary Czerwinski, and Shamsi T Iqbal. 2018. Effects of Individual Differences in Blocking Workplace Distractions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 92.
[20]
Gloria Mark, Daniela Gudith, and Ulrich Klocke. 2008. The cost of interrupted work: more speed and stress. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 107--110.
[21]
Gloria Mark, Shamsi Iqbal, and Mary Czerwinski. 2017. How blocking distractions affects workplace focus and productivity. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. ACM, 928--934.
[22]
Gloria Mark, Shamsi Iqbal, Mary Czerwinski, and Paul Johns. 2015. Focused, aroused, but so distractible: Temporal perspectives on multitasking and communications. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 903--916.
[23]
Gloria Mark, Shamsi T Iqbal, Mary Czerwinski, Paul Johns, and Akane Sano. 2016. Neurotics can't focus: An in situ study of online multitasking in the workplace. In Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 1739--1744.
[24]
Daniel McDuff, Kael Rowan, Piali Choudhury, Jessica Wolk, ThuVan Pham, and Mary Czerwinski. 2019. A Multimodal Emotion Sensing Platform for Building Emotion-Aware Applications. arXiv preprint arXiv:1903.12133 (2019).
[25]
Daniel C McFarlane and Kara A Latorella. 2002. The scope and importance of human interruption in human-computer interaction design. Human-Computer Interaction 17, 1 (2002), 1--61.
[26]
Microsoft. 2017. Bot Framework. https://dev.botframework.com/
[27]
Microsoft. 2018. Language Instruction (LUIS). https://www.luis.ai/home
[28]
Microsoft. 2018. Project Conversation Learner. https://labs.cognitive.microsoft.com/en-us/project-conversation-learner
[29]
Microsoft. 2018. Turn Focus assist on or off in Windows 10. https://support.microsoft.com/en-us/help/4026996/windows-10-turn-focus-assist-on-or-off
[30]
Christopher A Monk, J Gregory Trafton, and Deborah A Boehm-Davis. 2008. The effect of interruption duration and demand on resuming suspended goals. Journal of Experimental Psychology: Applied 14, 4 (2008), 299.
[31]
Tim Rietz, Ivo Benke, and Alexander Maedche. 2019. The Impact of Anthropomorphic and Functional Chatbot Design Features in Enterprise Collaboration Systems on User Acceptance. (2019).
[32]
Monica A Riordan. 2017. Emojis as tools for emotion work: Communicating affect in text messages. Journal of Language and Social Psychology 36, 5 (2017), 549--567.
[33]
Brandon W Smit. 2016. Successfully leaving work at work: The self-regulatory underpinnings of psychological detachment. Journal of Occupational and Organizational Psychology 89, 3 (2016), 493--514.
[34]
Carlos Toxtli, Andrés Monroy-Hernández, and Justin Cranshaw. 2018. Understanding chatbot-mediated task management. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 58.
[35]
Steve Whittaker, Vaiva Kalnikaite, Victoria Hollis, and Andrew Guydish. 2016. `Don't Waste My Time': Use of Time Information Improves Focus. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1729--1738.
[36]
Yang Yang, Xiaojuan Ma, and Pascale Fung. 2017. Perceived emotional intelligence in virtual agents. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2255--2262.
[37]
Michelle X Zhou, Gloria Mark, Jingyi Li, and Huahai Yang. 2019. Trusting Virtual Agents: The Effect of Personality. ACM Transactions on Interactive Intelligent Systems (TiiS) 9, 2--3 (2019), 10.
[38]
Manuela Züger, Sebastian C Müller, André N Meyer, and Thomas Fritz. 2018. Sensing interruptibility in the office: A field study on the use of biometric and computer interaction sensors. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 591.

Cited By

View all
  • (2024)Enhancing Work Productivity through Generative Artificial Intelligence: A Comprehensive Literature ReviewSustainability10.3390/su1603116616:3(1166)Online publication date: 30-Jan-2024
  • (2024)Investigating Work Companion Robot Interactions to Enhance Work-from-Home Productivity and ExperienceArchives of Design Research10.15187/adr.2024.08.37.4.4337:4(43-63)Online publication date: 31-Aug-2024
  • (2024)“Hey Genie, You Got Me Thinking about My Menu Choices!” Impact of Proactive Feedback on User Perception and Reflection in Decision-making TasksACM Transactions on Computer-Human Interaction10.1145/368527431:5(1-30)Online publication date: 29-Jul-2024
  • Show More Cited By

Index Terms

  1. Design and evaluation of intelligent agent prototypes for assistance with focus and productivity at work

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IUI '20: Proceedings of the 25th International Conference on Intelligent User Interfaces
    March 2020
    607 pages
    ISBN:9781450371186
    DOI:10.1145/3377325
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 March 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. affective computing
    2. conversational agents
    3. focus
    4. personal digital assistants
    5. sensing
    6. workplace productivity

    Qualifiers

    • Research-article

    Conference

    IUI '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 746 of 2,811 submissions, 27%

    Upcoming Conference

    IUI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)405
    • Downloads (Last 6 weeks)62
    Reflects downloads up to 11 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Enhancing Work Productivity through Generative Artificial Intelligence: A Comprehensive Literature ReviewSustainability10.3390/su1603116616:3(1166)Online publication date: 30-Jan-2024
    • (2024)Investigating Work Companion Robot Interactions to Enhance Work-from-Home Productivity and ExperienceArchives of Design Research10.15187/adr.2024.08.37.4.4337:4(43-63)Online publication date: 31-Aug-2024
    • (2024)“Hey Genie, You Got Me Thinking about My Menu Choices!” Impact of Proactive Feedback on User Perception and Reflection in Decision-making TasksACM Transactions on Computer-Human Interaction10.1145/368527431:5(1-30)Online publication date: 29-Jul-2024
    • (2024)StayFocused: Examining the Effects of Reflective Prompts and Chatbot Support on Compulsive Smartphone UseProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642479(1-19)Online publication date: 11-May-2024
    • (2024)Enhancing UX Evaluation Through Collaboration with Conversational AI Assistants: Effects of Proactive Dialogue and TimingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642168(1-16)Online publication date: 11-May-2024
    • (2024)Understanding the Role of Large Language Models in Personalizing and Scaffolding Strategies to Combat Academic ProcrastinationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642081(1-18)Online publication date: 11-May-2024
    • (2024)An Empirical Study on the Willingness of Young Elderly to Use Elderly Companion RobotInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2344918(1-22)Online publication date: 5-May-2024
    • (2024)On-device query intent prediction with lightweight LLMs to support ubiquitous conversationsScientific Reports10.1038/s41598-024-63380-614:1Online publication date: 3-Jun-2024
    • (2023)"Let's Face It": Investigating User Preferences for Virtual Humanoid Home AssistantsProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623821(246-256)Online publication date: 4-Dec-2023
    • (2023)Focus Time: Effectiveness of Computer Assisted Protected Time for Wellbeing and Work Engagement of Information WorkersProceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3596671.3598571(1-13)Online publication date: 13-Jun-2023
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media