More Web Proxy on the site http://driver.im/

poster

SomaFlatables: Supporting Embodied Cognition through Pneumatic Bladders

Authors:

Rakesh Patibanda,

Nathalie Overdevest,

Elise Van Den Hoven,

Florian Floyd MuellerAuthors Info & Claims

UIST '22 Adjunct: Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology

Article No.: 19, Pages 1 - 4

https://doi.org/10.1145/3526114.3558705

Published: 28 October 2022 Publication History

Abstract

Applying the theory of Embodied Cognition through design allows us to create computational interactions that engage our bodies by modifying our body schema. However, in HCI, most of these interactive experiences have been stationed around creating sensing-based systems that leverage our body’s position and movement to offer an experience, such as games using Nintendo Wii and Xbox Kinect. In this work, we created two pneumatic inflatables-based prototypes that actuate our body to support embodied cognition in two scenarios by altering the user’s body schema. We call these ”SomaFlatables” and demonstrate the design and implementation of these inflatables based prototypes that can move and even extend our bodies, allowing for novel bodily experiences. Furthermore, we discuss the future work and limitations of the current implementation.

References

[1]

Catarina Allen d’Ávila Silveira, Ozgun Kilic Afsar, and Sarah Fdili Alaoui. 2022. Wearable Choreographer: Designing Soft-Robotics for Dance Practice. In Designing Interactive Systems Conference. ACM, Virtual Event Australia, 1581–1596. https://doi.org/10.1145/3532106.3533499

Digital Library

[2]

Yuxin Chen, Zhuolin Yang, Ruben Abbou, Pedro Lopes, Ben Y. Zhao, and Haitao Zheng. 2021. User Authentication via Electrical Muscle Stimulation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 6, 15 pages. https://doi.org/10.1145/3411764.3445441

Digital Library

[3]

Sharice Clough and Melissa C. Duff. 2020. The Role of Gesture in Communication and Cognition: Implications for Understanding and Treating Neurogenic Communication Disorders. Frontiers in Human Neuroscience 14 (2020). https://doi.org/10.3389/fnhum.2020.00323

[4]

Elisa De Stefani and Doriana De Marco. 2019. Language, Gesture, and Emotional Communication: An Embodied View of Social Interaction. Frontiers in Psychology 10 (2019). https://www.frontiersin.org/articles/10.3389/fpsyg.2019.02063

[5]

Alexandra Delazio, Ken Nakagaki, Roberta L. Klatzky, Scott E. Hudson, Jill Fain Lehman, and Alanson P. Sample. 2018. Force Jacket: Pneumatically-Actuated Jacket for Embodied Haptic Experiences. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173894

Digital Library

[6]

Shreyosi Endow, Hedieh Moradi, Anvay Srivastava, Esau G Noya, and Cesar Torres. 2021. Compressables: A Haptic Prototyping Toolkit for Wearable Compression-based Interfaces. In Designing Interactive Systems Conference 2021(DIS ’21). Association for Computing Machinery, New York, NY, USA, 1101–1114. https://doi.org/10.1145/3461778.3462057

Digital Library

[7]

Jacques Grange, John Culling, Barry Bardsley, Laura Mackinney, Sarah Hughes, and Steven Backhouse. 2018. Turn an Ear to Hear: How Hearing-Impaired Listeners Can Exploit Head Orientation to Enhance Their Speech Intelligibility in Noisy Social Settings. Trends in hearing 22 (10 2018), 1–13. https://doi.org/10.1177/2331216518802701

[8]

Ozgun Kilic Afsar, Ali Shtarbanov, Hila Mor, Ken Nakagaki, Jack Forman, Karen Modrei, Seung Hee Jeong, Klas Hjort, Kristina Höök, and Hiroshi Ishii. 2021. OmniFiber: Integrated Fluidic Fiber Actuators for Weaving Movement based Interactions into the ‘Fabric of Everyday Life’. In The 34th Annual ACM Symposium on User Interface Software and Technology(UIST ’21). Association for Computing Machinery, New York, NY, USA, 1010–1026. https://doi.org/10.1145/3472749.3474802

Digital Library

[9]

KirshDavid. 2013. Embodied cognition and the magical future of interaction design. ACM Transactions on Computer-Human Interaction (TOCHI) (April 2013). https://doi.org/10.1145/2442106.2442109 Publisher: ACM PUB27 New York, NY, USA.

Digital Library

[10]

Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 11–19. https://doi.org/10.1145/2807442.2807443

Digital Library

[11]

Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 939–948. https://doi.org/10.1145/2702123.2702461

Digital Library

[12]

Pedro Lopes, Patrik Jonell, and Patrick Baudisch. 2015. Affordance++: Allowing Objects to Communicate Dynamic Use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2515–2524. https://doi.org/10.1145/2702123.2702128

Digital Library

[13]

Pedro Lopes, Sijing You, Alexandra Ion, and Patrick Baudisch. 2018. Adding Force Feedback to Mixed Reality Experiences and Games Using Electrical Muscle Stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174020

Digital Library

[14]

Hedieh Moradi and César Torres. 2020. Siloseam: A Morphogenetic Workflow for the Design and Fabrication of Inflatable Silicone Bladders. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 1995–2006. https://doi.org/10.1145/3357236.3395473

Digital Library

[15]

Florian ’Floyd’ Mueller, Richard Byrne, Josh Andres, and Rakesh Patibanda. 2018. Experiencing the Body as Play. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173784

Digital Library

[16]

Florian ’Floyd’ Mueller, Richard Byrne, Josh Andres, and Rakesh Patibanda. 2018. Experiencing the Body as Play. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173784

Digital Library

[17]

Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next Steps for Human-Computer Integration. Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376242

Digital Library

[18]

Florian ‚ÄòFloyd‚Äô Mueller, Pedro Lopes, Josh Andres, Richard Byrne, Nathan Semertzidis, Zhuying Li, Jarrod Knibbe, and Stefan Greuter. 2021. Towards understanding the design of bodily integration. International Journal of Human-Computer Studies 152 (Aug. 2021), 102643. https://doi.org/10.1016/j.ijhcs.2021.102643

[19]

Rakesh Patibanda, Xiang Li, Yuzheng Chen, Aryan Saini, Christian N Hill, Elise van den Hoven, and Florian Floyd Mueller. 2021. Actuating Myself: Designing Hand-Games Incorporating Electrical Muscle Stimulation. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play (Virtual Event, Austria) (CHI PLAY ’21). Association for Computing Machinery, New York, NY, USA, 228–235. https://doi.org/10.1145/3450337.3483464

Digital Library

[20]

Victoria Peng. 2021. Wigglears: Wiggle Your Ears With Your Emotions. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems(CHI EA ’21). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3411763.3451846

Digital Library

[21]

David M. Sidhu and Penny M. Pexman. 2016. Is Moving More Memorable than Proving? Effects of Embodiment and Imagined Enactment on Verb Memory. Frontiers in Psychology 7 (2016). https://www.frontiersin.org/articles/10.3389/fpsyg.2016.01010

[22]

Dag Svanaes and Martin Solheim. 2016. Wag Your Tail and Flap Your Ears: The Kinesthetic User Experience of Extending Your Body. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 3778–3779. https://doi.org/10.1145/2851581.2890268

Digital Library

[23]

Dag Svanæs and Louise Barkhuus. 2020. The Designer’s Body as Resource in Design: Exploring Combinations of Point-of-view and Tense. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–13. https://doi.org/10.1145/3313831.3376430

Digital Library

[24]

Shan-Yuan Teng, Tzu-Sheng Kuo, Chi Wang, Chi-huan Chiang, Da-Yuan Huang, Liwei Chan, and Bing-Yu Chen. 2018. PuPoP: Pop-up Prop on Palm for Virtual Reality. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology(UIST ’18). Association for Computing Machinery, New York, NY, USA, 5–17. https://doi.org/10.1145/3242587.3242628

Digital Library

[25]

Barbara Tversky. 2019. Mind in motion: How action shapes thought. Hachette UK.

[26]

Vincent van Rheden, Thomas Grah, Alexander Meschtscherjakov, Rakesh Patibanda, Wanyu Liu, Florian Daiber, Elise van den Hoven, and Florian ’Floyd’ Mueller. 2021. Out of Your Mind!? Embodied Interaction in Sports. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 79, 5 pages. https://doi.org/10.1145/3411763.3441329

Digital Library

[27]

Bowen Zhang and Misha Sra. 2021. PneuMod: A Modular Haptic Device with Localized Pressure and Thermal Feedback. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology(VRST ’21). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3489849.3489857

Digital Library

[28]

Xinlei Zhang, Ali Shtarbanov, Jiani Zeng, Valerie K. Chen, V. Michael Bove, Pattie Maes, and Jun Rekimoto. 2019. Bubble: Wearable Assistive Grasping Augmentation Based on Soft Inflatables. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems(CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312868

Digital Library

Cited By

Glöss M(2024)New Perspectives for Phenomenology in Interaction DesignProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685404(1-7)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685404
Zhang SLin WLi ZJiang RLiang CFan MMasu R(2024)Beadwork Bridge: Understanding and Exploring the Opportunities of Beadwork in Enriching School Education for Blind and Low Vision (BLV) PeopleProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675623(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675623
Saini AVan Den Hoven EMueller F(2024)PneuExtensio: Designing Pneumatic-based Bodily Extensions to Facilitate Embodiment across Everyday Life ExperiencesCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3665136(19-23)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3665136
Show More Cited By

Index Terms

SomaFlatables: Supporting Embodied Cognition through Pneumatic Bladders
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Design of Altered Cognition with Reshaped Bodies
AHs '20: Proceedings of the Augmented Humans International Conference

In this research, we aimed to expand humans' physical ability by reshaping natural physicalities that allow body transformation. By modifying the existing body parts, we proposed a system that changed humans' cognition of reality and their environment, ...
Effects of Body Duplication and Split on Body Schema
AHs '22: Proceedings of the Augmented Humans International Conference 2022

Visual-tactile synchronization or visual-motor synchronization makes a not innate body feel as if it was one’s own body (illusory body ownership). Although recent studies have shown that body ownership can be induced in multiple bodies, it is unclear ...
Pneunocchio: A playful nose augmentation for facilitating embodied representation
UIST '23 Adjunct: Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Prior research has offered a plethora of wearables centred around sensing bodily actions ranging from more explicit data, such as movement and physiological response, to implicit information, such as ocular and brain activity. Bodily augmentations that ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '22 Adjunct: Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology

October 2022

413 pages

ISBN:9781450393218

DOI:10.1145/3526114

Editors:
Maneesh Agrawala
Stanford University, USA
,
Jacob O. Wobbrock
University of Washington, USA
,
Eytan Adar
University of Michigan, USA
,
Vidya Setlur
Tableau Research, USA

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 October 2022

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

UIST '22

Sponsor:

UIST '22: The 35th Annual ACM Symposium on User Interface Software and Technology

October 29 - November 2, 2022

OR, Bend, USA

Acceptance Rates

Overall Acceptance Rate 355 of 1,733 submissions, 20%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
229
Total Downloads

Downloads (Last 12 months)78
Downloads (Last 6 weeks)7

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Glöss M(2024)New Perspectives for Phenomenology in Interaction DesignProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685404(1-7)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685404
Zhang SLin WLi ZJiang RLiang CFan MMasu R(2024)Beadwork Bridge: Understanding and Exploring the Opportunities of Beadwork in Enriching School Education for Blind and Low Vision (BLV) PeopleProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675623(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675623
Saini AVan Den Hoven EMueller F(2024)PneuExtensio: Designing Pneumatic-based Bodily Extensions to Facilitate Embodiment across Everyday Life ExperiencesCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3665136(19-23)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3665136
Patibanda ROverdevest NSaini ALi ZAndres JKnibbe Jvan den Hoven EMueller F(2024)Exploring Shared Bodily Control: Designing Augmented Human Systems for Intra- and Inter-CorporealityProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653037(318-323)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3653037
Patibanda ROverdevest NNisal SSaini AElvitigala DKnibbe JVan Den Hoven EMueller F(2024)Shared Bodily Fusion: Leveraging Inter-Body Electrical Muscle Stimulation for Social PlayProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660723(2088-2106)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660723
Overdevest NPatibanda RSaini AVan Den Hoven EMueller F(2024)GazeAway: Designing for Gaze Aversion ExperiencesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650771(1-6)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650771
Saini APatibanda ROverdevest NVan Den Hoven EMueller F(2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3649125(1-4)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3649125
Mueller FMontoya MPell SOppermann LBlythe MDietz PMarshall JBateman SSmith IAnanthanarayan SMazalek AVerni ABakogeorge ASimonnet MEllis KSemertzidis NBurleson WQuarles JMann SHill CClashing CElvitigala D(2024)Grand challenges in WaterHCIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642052(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642052
Saini ASridhar SRaheja APatibanda ROverdevest NWang PVan Den Hoven EMueller F(2023)Pneunocchio: A playful nose augmentation for facilitating embodied representationAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3616651(1-3)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3616651

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents