More Web Proxy on the site http://driver.im/

extended-abstract

Azalea: Co-experiencing Embodied Information in Remote Communication

Authors:

Sjoerd Hendriks,

Mehmet Aydın Baytaş,

Mafalda Samuelsson-GamboaAuthors Info & Claims

MobileHCI '20: 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 27, Pages 1 - 6

https://doi.org/10.1145/3406324.3410538

Published: 25 February 2021 Publication History

Abstract

We wish to demonstrate Azalea: a smartphone-based design to enrich remote communication by making space for co-experience of embodied information. Azalea comprises a tactile cushion which envelops a smartphone, and a bespoke app. A pair of Azaleas are used by remote interlocutors to enrich the communication with a shared, synchronized motion-driven soundscape and audio-driven light. Our approach differs from most current strategies for enriching remote communication; since it is focused on diminishing distractions and creating a cryptic channel for co-experience, rather than augmenting and increasing the fidelity of communication channels. To achieve this, we have adopted the design tactics and intellectual foundation somaesthetic interaction design, and we also contribute to this field: while most current somaesthetic interaction design focuses on introspection, we have used the same foundation to enrich remote communication.

Supplementary Material

MP4 File (3410538.mp4)

Supplementary video

Download
191.77 MB

References

[1]

Cheryl Akner-Koler. 2007. Form & formlessness. Ph.D. Dissertation. Chalmers University of Technology and Konstfack University College of Arts.

[2]

Ilhan Aslan, Hadrian Burkhardt, Julian Kraus, and Elisabeth André. 2016. Hold My Heart and Breathe with Me: Tangible Somaesthetic Designs. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (Gothenburg, Sweden) (NordiCHI ’16). ACM, New York, NY, USA, Article 92, 6 pages. https://doi.org/10.1145/2971485.2996727

Digital Library

[3]

Simon Asplund and Martin Jonsson. 2018. SWAY - Designing for Balance and Posture Awareness. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction(Stockholm, Sweden) (TEI ’18). ACM, New York, NY, USA, 470–475. https://doi.org/10.1145/3173225.3173262

Digital Library

[4]

Katja Battarbee. 2003. Co-Experience: The Social User Experience. In CHI ’03 Extended Abstracts on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI EA ’03). Association for Computing Machinery, New York, NY, USA, 730–731. https://doi.org/10.1145/765891.765956

Digital Library

[5]

Katja Battarbee. 2003. Defining Co-Experience. In Proceedings of the 2003 International Conference on Designing Pleasurable Products and Interfaces (Pittsburgh, PA, USA) (DPPI ’03). Association for Computing Machinery, New York, NY, USA, 109–113. https://doi.org/10.1145/782896.782923

[6]

Katja Battarbee and Ilpo Koskinen. 2005. Co-experience: user experience as interaction. CoDesign 1, 1 (2005), 5–18.

[7]

Mehmet Aydın Baytaş. 2019. Behind Space: through Movement and Embodiment in Human-Computer Interaction. Ph.D. Dissertation. Koç University.

[8]

Ilias Bergström and Martin Jonsson. 2016. Sarka: Sonification and Somaesthetic Appreciation Design. In Proceedings of the 3rd International Symposium on Movement and Computing (Thessaloniki, GA, Greece) (MOCO ’16). ACM, New York, NY, USA, Article 1, 8 pages. https://doi.org/10.1145/2948910.2948922

Digital Library

[9]

Alan F. Blackwell. 2015. HCI as an Inter-Discipline. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 503–516. https://doi.org/10.1145/2702613.2732505

Digital Library

[10]

Antonio R. Damasio. 1994. Descartes’ Error: Emotion, Reason, and the Human Brain. Avon Books.

[11]

Antonio R. Damasio. 1999. The feeling of what happens: body and emotion in the making of consciousness. Harcourt Brace.

[12]

J. P. Djajadiningrat, W. W. Gaver, and J. W. Frens. 2000. Interaction Relabelling and Extreme Characters: Methods for Exploring Aesthetic Interactions. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (New York City, New York, USA) (DIS ’00). Association for Computing Machinery, New York, NY, USA, 66–71. https://doi.org/10.1145/347642.347664

Digital Library

[13]

Vittorio Gallese. 2001. The ’shared manifold’ hypothesis. From mirror neurons to empathy. Journal of Consciousness Studies 8, 5-6 (2001), 33–50. https://www.ingentaconnect.com/content/imp/jcs/2001/00000008/f0030005/1208

[14]

Vittorio Gallese. 2003. The roots of empathy: the shared manifold hypothesis and the neural basis of intersubjectivity. Psychopathology 36, 4 (2003), 171–180.

[15]

Vittorio Gallese and Alvin Goldman. 1998. Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences 2, 12 (1998), 493 – 501. https://doi.org/10.1016/S1364-6613(98)01262-5

[16]

William Gaver. 2012. What Should We Expect from Research Through Design?. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). ACM, New York, NY, USA, 937–946. https://doi.org/10.1145/2207676.2208538

Digital Library

[17]

Marc Hassenzahl, Stephanie Heidecker, Kai Eckoldt, Sarah Diefenbach, and Uwe Hillmann. 2012. All You Need is Love: Current Strategies of Mediating Intimate Relationships through Technology. ACM Trans. Comput.-Hum. Interact. 19, 4, Article 30 (Dec. 2012), 19 pages. https://doi.org/10.1145/2395131.2395137

Digital Library

[18]

Kristina Höök. 2018. Designing with the Body: Somaesthetic Interaction Design. MIT Press.

[19]

Kristina Höök, Martin P. Jonsson, Anna Ståhl, and Johanna Mercurio. 2016. Somaesthetic Appreciation Design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). ACM, New York, NY, USA, 3131–3142. https://doi.org/10.1145/2858036.2858583

Digital Library

[20]

Kristina Höök and Jonas Löwgren. 2012. Strong Concepts: Intermediate-level Knowledge in Interaction Design Research. ACM Trans. Comput.-Hum. Interact. 19, 3 (oct 2012), 23:1—-23:18. https://doi.org/10.1145/2362364.2362371

Digital Library

[21]

Kristina Höök, Anna Ståhl, Martin Jonsson, Johanna Mercurio, Anna Karlsson, and Eva-Carin Banka Johnson. 2015. COVER STORY: Somaesthetic Design. interactions 22, 4 (June 2015), 26–33. https://doi.org/10.1145/2770888

[22]

Steve Howard, Frank Vetere, Martin Gibbs, Jesper Kjeldskov, Sonja Pedell, Karen Mecoles, and Marcus Bunyan. 2004. Mediating Intimacy: Digital Kisses and Cut and Paste Hugs. In People and computers XVIII: Design for life. Proceedings of HCI 2004, S Fincher, P Markopoulos, D Moore, and R Ruddle (Eds.). BCS-HCI.

[23]

Marco Iacoboni. 2009. Imitation, Empathy, and Mirror Neurons. Annual Review of Psychology 60, 1 (2009), 653–670. https://doi.org/10.1146/annurev.psych.60.110707.163604 arXiv:https://doi.org/10.1146/annurev.psych.60.110707.163604

[24]

Ilpo Koskinen, John Zimmerman, Thomas Binder, Johan Redstrom, and Stephan Wensveen. 2011. Design research through practice: From the lab, field, and showroom. Elsevier.

Digital Library

[25]

Joseph La Delfa, Mehmet Aydın Baytaş, Olivia Wichtowski, Rohit Ashok Khot, and Florian ‘Floyd’ Mueller. 2019. Are Drones Meditative?. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland, UK) (CHI EA ’19). ACM, New York, NY, USA, Article INT046, 4 pages. https://doi.org/10.1145/3290607.3313274

Digital Library

[26]

Joseph La Delfa, Mehmet Aydın Baytaş, Emma Luke, Ben Koder, and Florian ‘Floyd’ Mueller. 2020. Designing Drone Chi: Unpacking the Thinking and Making of Somaesthetic Human-Drone Interaction. In Proceedings of the 2020 ACM on Designing Interactive Systems Conference (Eindhoven, Netherlands) (DIS ’20). Association for Computing Machinery, New York, NY, USA, 575–586. https://doi.org/10.1145/3357236.3395589

Digital Library

[27]

Joseph La Delfa, Mehmet Aydın Baytaş, Rakesh Patibanda, Hazel Ngari, Rohit Ashok Khot, and Florian “Floyd” Mueller. 2020. Drone Chi: Somaesthetic Human-Drone Interaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376786

[28]

Joseph La Delfa, Robert Jarvis, Rohit Ashok Khot, and Florian ’Floyd’ Mueller. 2018. Tai Chi In The Clouds: Using Micro UAV’s To Support Tai Chi Practice. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (Melbourne, VIC, Australia) (CHI PLAY ’18 Extended Abstracts). ACM, New York, NY, USA, 513–519. https://doi.org/10.1145/3270316.3271511

Digital Library

[29]

Khanh-Duy Le, Ignacio Avellino, Cédric Fleury, Morten Fjeld, and Andreas Kunz. 2019. GazeLens: Guiding Attention to Improve Gaze Interpretation in Hub-Satellite Collaboration. In Human-Computer Interaction – INTERACT 2019, David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Springer International Publishing, Cham, 282–303.

Digital Library

[30]

Khanh-Duy Le, Kening Zhu, and Morten Fjeld. 2017. Mirrortablet: Exploring a Low-Cost Mobile System for Capturing Unmediated Hand Gestures in Remote Collaboration. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (Stuttgart, Germany) (MUM ’17). Association for Computing Machinery, New York, NY, USA, 79–89. https://doi.org/10.1145/3152832.3152838

Digital Library

[31]

Wonjun Lee, Youn-kyung Lim, and Richard Shusterman. 2014. Practicing Somaesthetics: Exploring Its Impact on Interactive Product Design Ideation. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS ’14). ACM, New York, NY, USA, 1055–1064. https://doi.org/10.1145/2598510.2598561

Digital Library

[32]

Amanda Lenhart, Monica Anderson, and Aaron Smith. 2015. Teens, Technology, and Romantic Relationships. Technical Report. Pew Research Center. https://www.pewresearch.org/internet/2015/10/01/teens-technology-and-romantic-relationships/

[33]

Alan M. Leslie. 2001. Theory of Mind. In International Encyclopedia of the Social & Behavioral Sciences, Neil J. Smelserand Paul B. Baltes (Eds.). Pergamon, Oxford, 15652 – 15656. https://doi.org/10.1016/B0-08-043076-7/01640-5

[34]

Hong Li, Jonna Häkkilä, and Kaisa Väänänen. 2018. Review of Unconventional User Interfaces for Emotional Communication between Long-Distance Partners. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (Barcelona, Spain) (MobileHCI ’18). Association for Computing Machinery, New York, NY, USA, Article 18, 10 pages. https://doi.org/10.1145/3229434.3229467

Digital Library

[35]

Elena Márquez Segura, Laia Turmo Vidal, Asreen Rostami, and Annika Waern. 2016. Embodied Sketching. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 6014–6027. https://doi.org/10.1145/2858036.2858486

Digital Library

[36]

Pascal Molenberghs, Ross Cunnington, and Jason B. Mattingley. 2009. Is the mirror neuron system involved in imitation? A short review and meta-analysis. Neuroscience & Biobehavioral Reviews 33, 7 (2009), 975 – 980. https://doi.org/10.1016/j.neubiorev.2009.03.010

[37]

Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-Time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 741–754. https://doi.org/10.1145/2984511.2984517

Digital Library

[38]

Rakesh Patibanda, Nathan Arthur Semertzidis, Michaela Scary, Joseph Nathan La Delfa, Josh Andres, Mehmet Aydın Baytaş, Anna Lisa Martin-Niedecken, Paul Strohmeier, Bruno Fruchard, Sang-won Leigh, Elisa D. Mekler, Suranga Nanayakkara, Josef Wiemeyer, Nadia Berthouze, Kai Kunze, Thanassis Rikakis, Aisling Kelliher, Kevin Warwick, Elise van den Hoven, Florian Floyd Mueller, and Steve Mann. 2020. Motor Memory in HCI. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3375163

Digital Library

[39]

David Premack and Guy Woodruff. 1978. Does the chimpanzee have a theory of mind?Behavioral and Brain Sciences 1, 4 (1978), 515–526. https://doi.org/10.1017/S0140525X00076512

[40]

Yvonne Rogers. 2012. HCI Theory: Classical, Modern, and Contemporary. Synthesis Lectures on Human-Centered Informatics 5, 2(2012), 1–129. https://doi.org/10.2200/S00418ED1V01Y201205HCI014 arXiv:https://doi.org/10.2200/S00418ED1V01Y201205HCI014

[41]

Thecla Schiphorst. 2009. Soft(N): Toward a Somaesthetics of Touch. In CHI ’09 Extended Abstracts on Human Factors in Computing Systems (Boston, MA, USA) (CHI EA ’09). ACM, New York, NY, USA, 2427–2438. https://doi.org/10.1145/1520340.1520345

[42]

Thecla Schiphorst. 2011. Self-Evidence: Applying Somatic Connoisseurship to Experience Design. In CHI ’11 Extended Abstracts on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI EA ’11). Association for Computing Machinery, New York, NY, USA, 145–160. https://doi.org/10.1145/1979742.1979640

Digital Library

[43]

Richard Schusterman. [n.d.]. Somaesthetics. In The Encyclopedia of Human-Computer Interaction (2 ed.). Interaction Design Foundation, Chapter 21.

[44]

Anna Ståhl, Martin Jonsson, Johanna Mercurio, Anna Karlsson, Kristina Höök, and Eva-Carin Banka Johnson. 2016. The Soma Mat and Breathing Light. May 2019 (2016), 305–308. https://doi.org/10.1145/2851581.2889464

[45]

Adrian F. Ward, Kristen Duke, Ayelet Gneezy, and Maarten W. Bos. 2017. Brain Drain: The Mere Presence of One’s Own Smartphone Reduces Available Cognitive Capacity. Journal of the Association for Consumer Research 2, 2 (2017), 140–154. https://doi.org/10.1086/691462 arXiv:https://doi.org/10.1086/691462

[46]

Jacob O. Wobbrock and Julie A. Kientz. 2016. Research Contributions in Human-computer Interaction. Interactions 23, 3 (April 2016), 38–44. https://doi.org/10.1145/2907069

Digital Library

[47]

Peter Wright, Jayne Wallace, and John McCarthy. 2008. Aesthetics and Experience-centered Design. ACM Trans. Comput.-Hum. Interact. 15, 4, Article 18 (Dec. 2008), 21 pages. https://doi.org/10.1145/1460355.1460360

Digital Library

[48]

Xujing Zhang, Sean Braley, Calvin Rubens, Timothy Merritt, and Roel Vertegaal. 2019. LightBee: A Self-Levitating Light Field Display for Hologrammatic Telepresence. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3290605.3300242

Digital Library

[49]

John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research Through Design As a Method for Interaction Design Research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). ACM, New York, NY, USA, 493–502. https://doi.org/10.1145/1240624.1240704

Digital Library

Cited By

Sion YDiaz Reyes CLamas DMokhalled M(2023)Vibmory - Mapping Episodic Memories to Vibrotactile PatternsProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572747(1-12)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572747
Schneiders EBoudouraki AReyes-Cruz GMartinez Avila JElmimouni HGrønbæk JRintel SJoshi S(2023)Mobility and Utility in Robot Mediated InteractionProceedings of the 25th International Conference on Mobile Human-Computer Interaction10.1145/3565066.3609791(1-5)Online publication date: 26-Sep-2023
https://dl.acm.org/doi/10.1145/3565066.3609791
Jensen REncinas EStrengers YDannesboe CKruuse ESkovby JBach MTietze PChristensen S(2023)Provotyping Accountability: Exploring Smartphone Use in the Home through DesignProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596024(1595-1609)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596024
Show More Cited By

Recommendations

Azalea: Co-experience in Remote Dialog through Diminished Reality and Somaesthetic Interaction Design
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

We introduce Azalea: a design to enrich remote dialog by diminishing externalities, created through a process informed by somaesthetics. Azalea is a tactile cushion that envelops a smartphone running a bespoke app. A pair of Azaleas mediate an embodied ...
Communication Behavior in Embodied Virtual Reality
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Embodied virtual reality faithfully renders users' movements onto an avatar in a virtual 3D environment, supporting nuanced nonverbal behavior alongside verbal communication. To investigate communication behavior within this medium, we had 30 dyads ...
SenseBot: Leveraging Embodied Asymmetric Interaction and Social Robotic to Enhance Intergenerational Communication
UIST Adjunct '24: Adjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology

Embodied communication, which uses physical cues to convey meaning and emotions, is essential for building social connections. In this work, we introduce SenseBot, an augmented reality (AR)-enabled robotic representative designed to facilitate embodied ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MobileHCI '20: 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services

October 2020

248 pages

ISBN:9781450380522

DOI:10.1145/3406324

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 February 2021

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

MobileHCI '20

MobileHCI '20: 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services

October 5 - 8, 2020

Oldenburg, Germany

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
180
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)3

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sion YDiaz Reyes CLamas DMokhalled M(2023)Vibmory - Mapping Episodic Memories to Vibrotactile PatternsProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572747(1-12)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572747
Schneiders EBoudouraki AReyes-Cruz GMartinez Avila JElmimouni HGrønbæk JRintel SJoshi S(2023)Mobility and Utility in Robot Mediated InteractionProceedings of the 25th International Conference on Mobile Human-Computer Interaction10.1145/3565066.3609791(1-5)Online publication date: 26-Sep-2023
https://dl.acm.org/doi/10.1145/3565066.3609791
Jensen REncinas EStrengers YDannesboe CKruuse ESkovby JBach MTietze PChristensen S(2023)Provotyping Accountability: Exploring Smartphone Use in the Home through DesignProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596024(1595-1609)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596024
Johansen Svan Berkel NFritsch J(2022)Characterising Soundscape Research in Human-Computer InteractionProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533458(1394-1417)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533458

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents