More Web Proxy on the site http://driver.im/

research-article

Designing the Expressivity of Multiple Smart Things for Intuitive and Unobtrusive Interactions

Author:

Yaliang ChuangAuthors Info & Claims

DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference

Pages 2007 - 2019

https://doi.org/10.1145/3357236.3395450

Published: 03 July 2020 Publication History

Abstract

Connected products and systems are becoming popular, but they seldom provide direct and intuitive communication to the users. In this study, we applied Disney's animation principles to design the expressivity with LED lights and speakers commonly embedded in electronic devices. We explored the subtle transitions of brightness and controlled the timing to compose individual and system-level behaviors with multiple devices. The designs were evaluated and improved through three iterations. In the main study, we recruited 16 designer participants to investigate whether lights and sounds could be intuitively interpreted as what the system wanted to convey. The result shows that group light behaviors could evoke meanings that are highly similar to the intents of the system. When the acoustic accompaniments were provided, participants could better perceive the presence of devices. We concluded with six sets of light behaviors that are capable of expressing smart devices and systems' intents intuitively and unobtrusively.

Supplementary Material

MP4 File (disfp3025.mp4)

Supplemental video

Download
13.39 MB

References

[1]

Jon Barwise. 1989. The situation in logic. Center for the study of language and information, Stanford. OCLC: 875309506.

[2]

Victoria Bellotti and Keith Edwards. 2001. Intelligibility and Accountability: Human Considerations in Context-Aware Systems. Human--Computer Interaction 16, 2--4 (Dec. 2001), 193--212.

Digital Library

[3]

Stephen A. Brewster, Peter C. Wright, and Alistair D. N. Edwards. 1993. An evaluation of earcons for use in auditory human-computer interfaces. In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). Association for Computing Machinery, Amsterdam, The Netherlands, 222--227.

Digital Library

[4]

Yung-Sun Chen. 2017. Have you ever noticed that everything chatting quietly. (2017). https://www.youtube.com/watch?v=QkLty3bzY4A&feature=youtu.be

[5]

Yaliang Chuang, Lin-Lin Chen, and Yoga Liu. 2018. Design Vocabulary for Human--IoT Systems Communication. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 274:1--274:11. event-place: Montreal QC, Canada.

Digital Library

[6]

Tom Djajadiningrat, Kees Overbeeke, and Stephan Wensveen. 2002. But How, Donald, Tell Us How?: On the Creation of Meaning in Interaction Design Through Feedforward and Inherent Feedback. In Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '02). ACM, New York, NY, USA, 285--291. event-place: London, England.

Digital Library

[7]

Muriel Domingo. 2019. Dieter Rams: 10 Timeless Commandments for Good Design. (2019). https://www.interaction-design.org/literature/article/dieter-rams-10-timeless-commandments-for-good-design

[8]

W. Keith Edwards and Rebecca E. Grinter. 2001. At Home with Ubiquitous Computing: Seven Challenges. In Ubicomp 2001: Ubiquitous Computing (Lecture Notes in Computer Science), Gregory D. Abowd, Barry Brumitt, and Steven Shafer (Eds.). Springer Berlin Heidelberg, 256--272.

[9]

Berry Eggen and Koert Van Mensvoort. 2009. Making Sense of What Is Going on "Around': Designing Environmental Awareness Information Displays. In Awareness Systems: Advances in Theory, Methodology and Design, Panos Markopoulos, Boris De Ruyter, and Wendy Mackay (Eds.). Springer London, London, 99--124.

[10]

Mica R. Endsley. 1995. Toward a Theory of Situation Awareness in Dynamic Systems. Human Factors 37, 1 (March 1995), 32--64.

[11]

Mica R Endsley and Debra G Jones. 2011. Designing for situation awareness: an approach to user-centered design. CRC Press, Boca Raton, FL. https://www.taylorfrancis.com/books/9781420063585 OCLC: 1116750398.

[12]

Sandra K. Evans, Katy E. Pearce, Jessica Vitak, and Jeffrey W. Treem. 2017. Explicating Affordances: A Conceptual Framework for Understanding Affordances in Communication Research. Journal of Computer-Mediated Communication 22, 1 (Jan. 2017), 35--52.

Digital Library

[13]

Anja Exler, Zeynep Günes, and Michael Beigl. 2019. Preferred notification modalities depending on the location and the location-based activity. ACM, 1064--1069.

Digital Library

[14]

Mads Nygaard Folkmann. 2012. The Aesthetics of Immateriality in Design: Smartphones as Digital Design Artifacts. In Proceedings of the Conference on Design and Semantics of Form and Movement. Victoria University of Wellington, New Zealand, 137--147.

[15]

Mathias Funk, Lin-Lin Chen, Shao-Wen Yang, and Yen-Kuang Chen. 2018. Addressing the Need to Capture Scenarios, Intentions and Preferences: Interactive Intentional Programming in the Smart Home. International Journal of Dsign 12, 1 (April 2018), 53--66. http://www.ijdesign.org/index.php/IJDesign/article/view/2995/807

[16]

Stavros Garzonis, Simon Jones, Tim Jay, and Eamonn O'Neill. 2009. Auditory icon and earcon mobile service notifications: intuitiveness, learnability, memorability and preference. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). Association for Computing Machinery, Boston, MA, USA, 1513--1522.

Digital Library

[17]

William W. Gaver. 1991. Technology affordances. ACM, 79--84.

Digital Library

[18]

William W. Gaver. 1997. Chapter 42 - Auditory Interfaces. In Handbook of Human-Computer Interaction (Second Edition), Marting G. Helander, Thomas K. Landauer, and Prasad V. Prabhu (Eds.). North-Holland, Amsterdam, 1003--1041.

[19]

James Jerome Gibson. 1986. The Ecological Approach to Visual Perception. Psychology Press, New York, N.Y. Google-Books-ID: DrhCCWmJpWUC.

[20]

John C. K. Hankinson and Alistair D. N. Edwards. 1999. Designing earcons with musical grammars. ACM SIGCAPH Computers and the Physically Handicapped 65 (Sept. 1999), 16--20.

Digital Library

[21]

Chris Harrison, John Horstman, Gary Hsieh, and Scott Hudson. 2012. Unlocking the Expressivity of Point Lights. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 1683--1692. event-place: Austin, Texas, USA.

Digital Library

[22]

H. Rex Hartson, Terence S. Andre, Robert C. Williges, and Linda van Rens. 1999. The User Action Framework: A Theory-Based Foundation for Inspection and Classification of Usability Problems. In HCI.

[23]

Rex Hartson. 2003. Cognitive, physical, sensory, and functional affordances in interaction design. Behaviour & Information Technology 22, 5 (Sept. 2003), 315--338.

[24]

Victor Kaptelinin. Affordances. In The Encyclopedia of Human-Computer Interaction (2nd ed.). Interaction Design Foundation. https://www.interaction-design.org/literature/book/ the-encyclopedia-of-human-computer-interaction-2nd-ed/ affordances

[25]

Michal Luria, Guy Hoffman, and Oren Zuckerman. 2017.comparing Social Robot, Screen and Voice Interfaces for Smart-Home Control. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 580--628. event-place: Denver, Colorado, USA.

Digital Library

[26]

David Maulsby, Saul Greenberg, and Richard Mander. 1993. Prototyping an Intelligent Agent Through Wizard of Oz. In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). ACM, New York, NY, USA, 277--284. event-place: Amsterdam, The Netherlands.

Digital Library

[27]

Marilyn McGee-Lennon, Maria Wolters, Ross McLachlan, Stephen Brewster, and Cordelia Hall. 2011. Name That Tune: Musicons As Reminders in the Home. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2803--2806. event-place: Vancouver, BC, Canada.

Digital Library

[28]

Sarah Mennicken, David Kim, and Elaine May Huang. 2016. Integrating the Smart Home into the Digital Calendar. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5958--5969. event-place: San Jose, California, USA.

Digital Library

[29]

Sarah Mennicken, Jo Vermeulen, and Elaine M. Huang. 2014. From today's augmented houses to tomorrow's smart homes: new directions for home automation research. ACM, 105--115.

Digital Library

[30]

Anton Nijholt. 2004. Where computers disappear, virtual humans appear.computers & Graphics 28, 4 (Aug. 2004), 467--476.

[31]

Donald Norman. 1993. Turn signals are the facial expressions of automobiles. Diversion Books, New York, NY:. https://www.nngroup.com/books/turn-signals-are-the-facial-expressions-of-auto/

[32]

Donald A. Norman. 1999. Affordance, Conventions, and Design. interactions 6, 3 (May 1999), 38--43.

Digital Library

[33]

Donald A. Norman. 2013. The design of everyday things (revised and expanded edition. ed.). MIT Press, Cambridge, Massachusetts.

[34]

Chris Norval and Jatinder Singh. 2019. Explaining Automated Environments: Interrogating Scripts, Logs, and Provenance Using Voice-assistants. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers (UbiComp/ISWC '19 Adjunct). ACM, New York, NY, USA, 332--335. event-place: London, United Kingdom.

Digital Library

[35]

Alice V. Pintus. 2010. Tangible Lightscapes. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10). ACM, New York, NY, USA, 379--380. event-place: Cambridge, Massachusetts, USA.

Digital Library

[36]

Erika Shehan Poole, Marshini Chetty, Rebecca E. Grinter, and W. Keith Edwards. 2008. More Than Meets the Eye: Transforming the User Experience of Home Network Management. In Proceedings of the 7th ACM Conference on Designing Interactive Systems (DIS '08). ACM, New York, NY, USA, 455--464. event-place: Cape Town, South Africa.

Digital Library

[37]

Serge A. Rijsdijk and Erik Jan Hultink. 2009. How Today's Consumers Perceive Tomorrow's Smart Products*. Journal of Product Innovation Management 26, 1 (2009), 24--42.

[38]

Claire Rowland. 2015. Things: The Technology of Connected Devices. In Designing Connected Products: UX for the Consumer Internet of Things, Elizabeth Goodman, Martin Charlier, Alfred Lui, Ann Light, and Claire Rowland (Eds.). O'Reilly Media, Sebastopol, CA:. http://shop.oreilly.com/product/0636920031109.do

[39]

Daniel Szafir, Bilge Mutlu, and Terry Fong. 2015.communicating Directionality in Flying Robots. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI '15). ACM, New York, NY, USA, 19--26. event-place: Portland, Oregon, USA.

Digital Library

[40]

Frank Thomas and Ollie Johnston. 1995. The principles of animation. In Illusion of life. Disney, New York, NY, 47--70.

[41]

Jo Vermeulen, Kris Luyten, Elise van den Hoven, and Karin Coninx. 2013. Crossing the Bridge over Norman's Gulf of Execution: Revealing Feedforward's True Identity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1931--1940. event-place: Paris, France.

Digital Library

[42]

Ron Wakkary, Doenja Oogjes, Sabrina Hauser, Henry Lin, Cheng Cao, Leo Ma, and Tijs Duel. 2017. Morse Things: A Design Inquiry into the Gap Between Things and Us. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 503--514. event-place: Edinburgh, United Kingdom.

Digital Library

[43]

S. A. G. Wensveen, J. P. Djajadiningrat, and C. J. Overbeeke. 2004. Interaction Frogger: A Design Framework to Couple Action and Function Through Feedback and Feedforward. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '04). ACM, New York, NY, USA, 177--184. event-place: Cambridge, MA, USA.

Digital Library

[44]

Rayoung Yang and Mark W. Newman. 2013. Learning from a Learning Thermostat: Lessons for Intelligent Systems for the Home. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, New York, NY, USA, 93--102. event-place: Zurich, Switzerland.

Digital Library

Cited By

Chuang YMuyrers TZhang WMartens M(2023)A Longitudinal Driving Experience Study with a Novel and Retrofit Intelligent Speed Assistant SystemHCI in Mobility, Transport, and Automotive Systems10.1007/978-3-031-35678-0_2(13-30)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35678-0_2
An JSu YChuang YEggen B(2022)Greeting the Guest: A Welcome Experience for First Encounters in Smart AirbnbProceedings of the Tenth International Symposium of Chinese CHI10.1145/3565698.3565796(270-276)Online publication date: 22-Oct-2022
https://dl.acm.org/doi/10.1145/3565698.3565796
EL-Zanfaly DChen ZKhoshoo AAnn Arredondo RNgan IFrancovich C(2022)Memory Portal: Investigating Data Meaning-making through Spatio-temporal ExperiencesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519798(1-8)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519798
Show More Cited By

Index Terms

Designing the Expressivity of Multiple Smart Things for Intuitive and Unobtrusive Interactions
1. Human-centered computing
  1. Interaction design
    1. Empirical studies in interaction design
    2. Interaction design process and methods
      1. User interface design
  2. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing design and evaluation methods

Recommendations

IoT Communicator: A Physical Interface for Expressing Situational Info of an IoT System
DIS' 20 Companion: Companion Publication of the 2020 ACM Designing Interactive Systems Conference

The Internet of Things and smart products are becoming ubiquitous in people's everyday lives. However, they rarely provide situational information to facilitate direct interactions. Users often need to check mobile devices to know the system's status. ...
Smart u-things and ubiquitous intelligence
ICESS'05: Proceedings of the Second international conference on Embedded Software and Systems

Smart u-things are real things with attached, embedded or blended computers, networks, and/or some other devices such as sensors, actors, e-tags and so on, and they can sense, compute, communicate and take some adaptive actions/reactions/proactions ...
Major requirements for building Smart Homes in Smart Cities based on Internet of Things technologies

The recent boom in the Internet of Things (IoT) will turn Smart Cities and Smart Homes (SH) from hype to reality. SH is the major building block for Smart Cities and have long been a dream for decades, hobbyists in the late 1970s made Home Automation (...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference

July 2020

2264 pages

ISBN:9781450369749

DOI:10.1145/3357236

General Chairs:
Ron Wakkary
Simon Fraser University, CA and Eindhoven University of Technology, NL
,
Kristina Andersen
Eindhoven University of Technology, NL
,
Program Chairs:
Will Odom
Simon Fraser University, CA
,
Audrey Desjardins
University of Washington, USA
,
Marianne Graves Petersen
Aarhus University, DK

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 July 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Ministry of Science and Technology, Taiwan

Conference

DIS '20

Sponsor:

SIGCHI

DIS '20: Designing Interactive Systems Conference 2020

July 6 - 10, 2020

Eindhoven, Netherlands

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
333
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)6

Reflects downloads up to 09 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chuang YMuyrers TZhang WMartens M(2023)A Longitudinal Driving Experience Study with a Novel and Retrofit Intelligent Speed Assistant SystemHCI in Mobility, Transport, and Automotive Systems10.1007/978-3-031-35678-0_2(13-30)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35678-0_2
An JSu YChuang YEggen B(2022)Greeting the Guest: A Welcome Experience for First Encounters in Smart AirbnbProceedings of the Tenth International Symposium of Chinese CHI10.1145/3565698.3565796(270-276)Online publication date: 22-Oct-2022
https://dl.acm.org/doi/10.1145/3565698.3565796
EL-Zanfaly DChen ZKhoshoo AAnn Arredondo RNgan IFrancovich C(2022)Memory Portal: Investigating Data Meaning-making through Spatio-temporal ExperiencesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519798(1-8)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519798
Chuang YGallegos Nieto J(2022)Element: An Ambient Display System for Evoking Self-Reflections and Supporting Social-Interactions in a WorkspaceExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519721(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519721
Liang RChiumento AZuniga MPawełczak PFunk MChuang Y(2021)CHIIoT:1st Workshop on Computer Human Interaction in IoT ApplicationsProceedings of the 2021 International Conference on Embedded Wireless Systems and Networks10.5555/3451271.3458746(198-201)Online publication date: 20-Feb-2021
https://dl.acm.org/doi/10.5555/3451271.3458746
Liang RChiumento AZuniga MPawelczak PFunk MChuang YFrens J(2021)CHIIoT 2: 2nd Workshop on Computer Human Interaction in IoT ApplicationsCompanion of the 2021 ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3459926.3464759(77-80)Online publication date: 8-Jun-2021
https://dl.acm.org/doi/10.1145/3459926.3464759

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents