More Web Proxy on the site http://driver.im/

research-article

User experience of proactive audio-based social devices: a wizard-of-oz study

Authors:

Pradthana Jarusriboonchai,

Kaisa Väänänen-Vainio-MattilaAuthors Info & Claims

MUM '14: Proceedings of the 13th International Conference on Mobile and Ubiquitous Multimedia

Pages 98 - 106

https://doi.org/10.1145/2677972.2677995

Published: 25 November 2014 Publication History

Abstract

Social Devices (SDs) are mobile devices that are proactive in social settings and aim to encourage social interaction between co-located people. We conducted a study of people's reactions to SDs with an audio-based interface on a semi-functional prototype. Based on a Wizard-of-Oz simulation, two SDs proactively started talking to each other and to the participants, with an aim to involve the participants to the conversation. We present the resulted social interactions and reactions as well as the participants' opinions about speech-based proactive SDs. Overall, SDs created a collaborative social situation and triggered a broad variety of social interactions, ranging from grounding to lengthy conversations. Meanwhile, the novelty of the technology and its rather dominant social role often shifted the participants' attention from each other to the devices, thus hindering social interaction. We conclude with a discussion of the benefits and drawbacks of audio-based interaction and the social proactivity of technology.

References

[1]

Bales, E., Li, K. A., Griswold, W. CoupleVIBE: Mobile Implicit Communication to Improve Awareness for (Long-Distance) Couples. In Proc. CSCW'2011, ACM Press (2011), 65--74.

Digital Library

[2]

Bassoli, A., Moore, J. and Agamanolis, S. TUNA: Socialising Music Sharing on the Move. In: O'Hara, K. and Brown, B. (eds.) 2006. Consuming Music Together: Social and Collaborative Aspects of Music Consumption Technologies, 151--172. Springer.

[3]

Benford, S. et al. Uncomfortable Interactions. In Proc. CHI '12, ACM Press (2012), 2005--2014.

Digital Library

[4]

Beyer, H. and Holtzblatt, K. Contextual Design: Defining Customer Systems. Morgan Kaufmann Publishers, CA, USA, 1998.

Digital Library

[5]

Borovoy, R. et al. Meme Tags and Community Mirrors: Moving from Conferences to Collaboration. In Proc. CSCW'98, ACM Press (1998), 159--168.

Digital Library

[6]

Brewster, S. et al. Multimodal 'Eyes-Free' Interaction Techniques for Wearable Devices. In Proc. CHI 2003, ACM Press (2003), 473--480.

Digital Library

[7]

Brignull, H. and Rogers, Y. Enticing People to Interact with Large Public Displays in Public Spaces. In: M. Rauterberge et al. (eds.) 2003. Human-Computer Interaction -- INTERACT'03, 17--24.

[8]

Bruce, A., Nourbakhsh, I., and Simmons, R. The Role of Expressiveness and Attention in Human-Robot Interact ion. In Proc. ICRA '02, (2002), 4138--4142.

[9]

Clark, H. H. and Brennan, S. Grounding in Communication. In: L. Resnick, J. M. Levine, and S. D. Teasley (eds.) 1991, Perspectives on socially shared cognition. Washington, DC: APA Press, 127--149.

[10]

Esbjornsson, M., Juhlin, O. and Ostergren, M. Traffic encounter and Hocman: Associating motorcycle ethnography with design. Personal and Ubiquitous Computing 8, 2 (2004), 92--99.

Digital Library

[11]

Fong, T., Nourbakhsh, I., and Dautenhahn, K. A Survey of socially interactive robots. Robotics and Autonomous Systems. 42, 3-4 (2003), 143--166.

[12]

Goffman, E. 1963. Behavior in Public Places: Note on the Social Organization of Gathering. Free Press, 1966

[13]

Hall, E. The Hidden Dimension. Anchor Books, 1990

[14]

Huggard, A. et al. Musical embrace: exploring social awkwardness in digital games. In Proc. UbiComp '13, ACM Press (2013), 725--728.

Digital Library

[15]

Jarusriboonchai, P., Olsson, T., and Väänänen-Vainio-Mattila, K. Roles, scenarios and challenges of social devices. In Proc. UbiComp Adjunct'13, ACM Press (2013), 1575--1578.

Digital Library

[16]

Ju, W., Lee, B., and Klemmer, S. Range: Exploring Implicit Interaction through Electronic Whiteboard Design. In Proc. CSCW '08, ACM Press (2008), 17--26.

Digital Library

[17]

Larsen, L. B. et al. Affordance in Mobile Speech-based User Interaction. In Proc. MobileHCI'07, ACM Press (2007), 285--288.

Digital Library

[18]

Mäkitalo, N. et al. Social devices: collaborative co-located interactions in a mobile cloud. In Proc. MUM 2012. ACM Press (2012), Article No. 10.

Digital Library

[19]

Marquardt, N. et al. Gradual Engagement: Facilitating Information Exchange between Digital Devices as a Function of Proximity. In Proc. ITS'12. ACM Press (2012), 31--40.

Digital Library

[20]

McDonald, D., et al. Proactive Displays: Supporting Awareness in Fluid Social Environments. ACM TOCHI 14, 4 (2008), Article No. 16.

Digital Library

[21]

Memarovic, N. et al. Using Public Displays to Stimulate Passive Engagement, Active Engagement, and Discovery in Public Places. In Proc. MAB '12, ACM Press (2012), 55--64.

Digital Library

[22]

Nagao, K. and Katsuno, Y. Agent Augmented Community: Human-to-Human and Human-to-Environment Interactions Enhanced by Situation-Aware Personalized Mobile Agents. In: Ishida, T. (ed.) 1998. Community Computing and Support Systems, 1519, Lecture Notes in Computer Science, 342--358. Springer.

Digital Library

[23]

Nagao, K. and Takeuchi, A. Social Interaction: Multimodal Conversation with Social Agents. In Proc. AAAI-94, AAAI Press/MIT Press (1994), 22--28.

Digital Library

[24]

Nazzi, E. and Sokoler, T. Walky for embodied microblogging: sharing mundane activities through augmented everyday objects. In Proc. MobileHCI '11, ACM Press (2011), 563--568.

Digital Library

[25]

O'Hara, K. et al. Jukola: Democratic Music Choice in a Public Place. In Proc. DIS '04, ACM Press (2004), 145--154.

Digital Library

[26]

Online dictionary. http://dictionary.reference.com.

[27]

Palviainen, J. et al.2013. Exploring Usage Scenarios on Social Devices -- Balancing between Surprise and User Control. In Proc. DPPI '13, ACM Press (2013), 96--105.

Digital Library

[28]

Petersen, M. G. et al. Floor interaction HCI reaching new ground. Ext. Abstracts CHI2005, ACM Press (2005), 1717--1720.

Digital Library

[29]

Preece, J., Rogers, Y., and Sharp, H. Interaction Design, John Wiley & Sons, Inc., New York, NY, 2002.

Digital Library

[30]

Sacks, H. 1992. Lectures on Conversation: Volumes I and II. Oxford: Blackwell.

[31]

Sawhney, N and Schmandt, C. Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. ACM TOCHI. 7, 3 (2000), 353--383.

Digital Library

[32]

Sheldon K. M. et al. What is satisfying about satisfying events? Testing 10 candidate psychological needs. Journal of Personality and Social Psychology 80, 2 (2001), 325--339.

[33]

Strauss, P. M. and Minker, W. Proactive Spoken Dialogue Interaction in Multi-Party Environments. Springer, 2010

Digital Library

[34]

Sumi, Y. and Mase, K. AgentSalon: facilitating face-to-face knowledge exchange through conversations among personal agents. In Proc. AGENTS '01, ACM Press (2001), 393--400.

Digital Library

[35]

Svensson, M. S. and Sokoler, T. 2008. Ticket-to-talk-television: designing for the circumstantial nature of everyday social interaction. In Proc. NordiCHI '08, ACM Press (2008), 334--343.

Digital Library

[36]

Tennenhouse, D. Proactive Computing. Communications of the ACM. 4, 5 (2000), 43--50.

Digital Library

[37]

Turkle, S. Alone Together: Why We Expect More from Technology and Less from Each Other. Basic Books, 2012.

Digital Library

[38]

Väänänen-Vainio-Mattila, K. et al. 2013. Social Devices as New Type of Social System: Enjoyably or Embarrassing Experiences? In Workshop on Experiencing Interactivity in Public Spaces (EIPS) in conjunction with CHI'13.

[39]

Want, R., Pering, T., and Tennenhouse, D. Comparing autonomic and proactive computing. IBM Systems Journal 42, 1 (2003), 129--135.

Digital Library

[40]

Whyte, W. H. The Social Life of Small Urban Spaces. Conservation Foundation, Washington DC, USA, 198

Cited By

Šerpytytė RPakpour Haji Agha AHäkkinen ASekar BBakic IOlsson T(2024)Design Research Artefacts for Knowledge Co-creation with Civil Servants Supporting Migrants: A Case StudyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685489(1-10)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685489
Genç HCoşkun A(2024)From Silence to Dialogue: Boosting Collocated Social Interactions with TechnologyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685391(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685391
Bylieva D(2023)Infants in the digital realitySemiotic studies10.18287/2782-2966-2023-3-2-13-203:2(13-20)Online publication date: 17-Jul-2023
https://doi.org/10.18287/2782-2966-2023-3-2-13-20
Show More Cited By

Index Terms

User experience of proactive audio-based social devices: a wizard-of-oz study
1. Information systems
  1. Information systems applications
2. Social and professional topics

Recommendations

An exploratory study of user-generated spatial gestures with social mobile devices
MUM '12: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia

Social Devices are smart phones that interact with each other in order to proactively trigger interaction between co-located users. Social Devices promote proxemic interactions between people and can act as enablers of users' social contacts. Various ...
Exploring usage scenarios on social devices: balancing between surprise and user control
DPPI '13: Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces

Mobile devices and social media are designed primarily to support communication between remote people. However, the sensors in modern smart phones allow also proxemic interactions between the devices and their co-located users. In such interactions, ...
Social devices: collaborative co-located interactions in a mobile cloud
MUM '12: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia

Online social media services, such as Facebook and Twitter, have set new standards on how people interact with each other online, share their everyday activities, and media services. While current mobile services supporting social interaction are ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '14: Proceedings of the 13th International Conference on Mobile and Ubiquitous Multimedia

November 2014

275 pages

ISBN:9781450333047

DOI:10.1145/2677972

General Chair:
Arkady Zaslavsky,
Program Chairs:
Seng W. Loke,
Lars Kulik,
Evaggelia Pitoura

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 November 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Suomen Akatemia

Conference

MUM '14

MUM '14: International Conference on Mobile and Ubiquitous Multimedia

November 25 - 28, 2014

Victoria, Melbourne, Australia

Acceptance Rates

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
250
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Šerpytytė RPakpour Haji Agha AHäkkinen ASekar BBakic IOlsson T(2024)Design Research Artefacts for Knowledge Co-creation with Civil Servants Supporting Migrants: A Case StudyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685489(1-10)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685489
Genç HCoşkun A(2024)From Silence to Dialogue: Boosting Collocated Social Interactions with TechnologyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685391(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685391
Bylieva D(2023)Infants in the digital realitySemiotic studies10.18287/2782-2966-2023-3-2-13-203:2(13-20)Online publication date: 17-Jul-2023
https://doi.org/10.18287/2782-2966-2023-3-2-13-20
Genç HErdem DYıldırım ÇCoskun A(2022)Mind the Whisper: Enriching Collocated Social Interactions in Public Places through Audio NarrativesProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533507(1428-1440)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533507
McMillan DJaber R(2021)Leaving the Butler Behind: The Future of Role Reproduction in CUIProceedings of the 3rd Conference on Conversational User Interfaces10.1145/3469595.3469606(1-4)Online publication date: 27-Jul-2021
https://dl.acm.org/doi/10.1145/3469595.3469606
Bylieva DBekirogullari ZLobatyuk VNam T(2021)How Virtual Personal Assistants Influence Children’s CommunicationKnowledge in the Information Society10.1007/978-3-030-65857-1_12(112-124)Online publication date: 16-Jan-2021
https://doi.org/10.1007/978-3-030-65857-1_12
Jaber RMcMillan DTorres MSchlögl SClark LPorcheron M(2020)Conversational User Interfaces on Mobile DevicesProceedings of the 2nd Conference on Conversational User Interfaces10.1145/3405755.3406130(1-11)Online publication date: 22-Jul-2020
https://dl.acm.org/doi/10.1145/3405755.3406130
Tan HZhao YLi SWang WZhu MHong JYuan X(2020)Relationship between social robot proactive behavior and the human perception of anthropomorphic attributesAdvanced Robotics10.1080/01691864.2020.183169934:20(1324-1336)Online publication date: 12-Oct-2020
https://doi.org/10.1080/01691864.2020.1831699
Epp F(2019)Expressive WearablesInternational Journal of Mobile Human Computer Interaction10.4018/IJMHCI.201910010111:4(1-15)Online publication date: Oct-2019
https://doi.org/10.4018/IJMHCI.2019100101
Yuan YThompson SWatson KChase ASenthilkumar ABernheim Brush AYarosh S(2019)Speech interface reformulations and voice assistant personification preferences of children and parentsInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2019.04.00521:C(77-88)Online publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1016/j.ijcci.2019.04.005
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents