extended-abstract

Towards Social Touch Intelligence: Developing a Robust System for Automatic Touch Recognition

Author:

Merel M. JungAuthors Info & Claims

ICMI '14: Proceedings of the 16th International Conference on Multimodal Interaction

Pages 344 - 348

https://doi.org/10.1145/2663204.2666281

Published: 12 November 2014 Publication History

Get Access

Abstract

Touch behavior is of great importance during social interaction. Automatic recognition of social touch is necessary to transfer the touch modality from interpersonal interaction to other areas such as Human-Robot Interaction (HRI). This paper describes a PhD research program on the automatic detection, classification and interpretation of touch in social interaction between humans and artifacts. Progress thus far includes the recording of a Corpus of Social Touch (CoST) consisting of pressure sensor data of 14 different touch gestures and first classification results. Classification of these 14 gestures resulted in an overall accuracy of 53% using Bayesian classifiers. Further work includes the enhancement of the gesture recognition, building an embodied system for real-time classification and testing this system in a possible application scenario.

References

[1]

J. Chang, K. MacLean, and S. Yohanan. Gesture recognition in the haptic creature. In Proceedings of the International Conference EuroHaptics, (Amsterdam, The Netherlands), pages 385--391, 2010.

Digital Library

Google Scholar

[2]

M. D. Cooney, S. Nishio, and H. Ishiguro. Recognizing affection for a touch-based interaction with a humanoid robot. In Proceedings of the International Conference on Intelligent Robots and Systems (IROS), (Vilamoura, Portugal), pages 1420--1427, 2012.

Crossref

Google Scholar

[3]

A. Flagg and K. MacLean. Affective touch gesture recognition for a furry zoomorphic machine. In Proceedings of the International Conference on Tangible, Embedded and Embodied Interaction (TEI), (Barcelona, Spain), pages 25--32, 2013.

Digital Library

Google Scholar

[4]

A. Gallace and C. Spence. The science of interpersonal touch: an overview. Neuroscience & Biobehavioral Reviews, 34(2):246--259, 2010.

Crossref

Google Scholar

[5]

Y.-M. Kim, S.-Y. Koo, J. G. Lim, and D.-S. Kwon. A robust online touch pattern recognition for dynamic human-robot interaction. Transactions on Consumer Electronics, 56(3):1979--1987, 2010.

Digital Library

Google Scholar

[6]

H. Knight, R. Toscano, W. D. Stiehl, A. Chang, Y. Wang, and C. Breazeal. Real-time social touch gesture recognition for sensate robots. In Proceedings of the International Conference on Intelligent Robots and Systems (IROS), (St. Louis, MO), pages 3715--3720, 2009.

Digital Library

Google Scholar

[7]

K. Nakajima, Y. Itoh, Y. Hayashi, K. Ikeda, K. Fujita, and T. Onoye. Emoballoon a balloon-shaped interface recognizing social touch interactions. In Proceedings of Advances in Computer Entertainment (ACE), (Boekelo, The Netherlands), pages 182--197, 2013.

Crossref

Google Scholar

[8]

F. Naya, J. Yamato, and K. Shinozawa. Recognizing human touching behaviors using a haptic interface for a pet-robot. In Proceedings of the International Conference on Systems, Man, and Cybernetics (SMC), (Tokyo, Japan), volume 2, pages 1030--1034, 1999.

Crossref

Google Scholar

[9]

D. Silvera-Tawil, D. Rye, and M. Velonaki. Touch modality interpretation for an eit-based sensitive skin. In Proceedings of the International Conference on Robotics and Automation (ICRA), (Shanghai, China), pages 3770--3776, 2011.

Crossref

Google Scholar

[10]

D. Silvera-Tawil, D. Rye, and M. Velonaki. Interpretation of the modality of touch on an artificial arm covered with an eit-based sensitive skin. The International Journal of Robotics Research, 31(13):1627--1641, 2012.

Digital Library

Google Scholar

[11]

W. D. Stiehl, J. Lieberman, C. Breazeal, L. Basel, L. Lalla, and M. Wolf. Design of a therapeutic robotic companion for relational, affective touch. In Proceedings of International Workshop on Robot and Human Interactive Communication (ROMAN), (Nashville, TN), pages 408--415, 2005.

Crossref

Google Scholar

[12]

Z. Xing, J. Pei, and E. Keogh. A brief survey on sequence classification. SIGKDD Explorations Newsletter, 12(1):40--48, 2010.

Digital Library

Google Scholar

[13]

S. Yohanan and K. E. MacLean. The role of affective touch in human-robot interaction: Human intent and expectations in touching the haptic creature. International Journal of Social Robotics, 4(2):163--180, 2012.

Crossref

Google Scholar

Cited By

View all

Alhouli SAlmania NAhmad MSahoo D(2024)Towards Designing a Pet Robot for Older Adults by Young AdultsProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3690899(408-410)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3690899
Cang XGuerra RGuta BBucci PRodgers LMah HFeng QAgrawal AMacLean K(2024)FEELing (key)Pressed: Implicit Touch Pressure Bests Brain Activity for Modeling Emotion Dynamics in the Space Between Stressed & RelaxedIEEE Transactions on Haptics10.1109/TOH.2023.330805917:3(310-318)Online publication date: Jul-2024
https://doi.org/10.1109/TOH.2023.3308059
Fumelli CDutta AKaboli M(2024)Advancements in Tactile Hand Gesture Recognition for Enhanced Human-Machine Interaction2024 IEEE International Symposium on Robotic and Sensors Environments (ROSE)10.1109/ROSE62198.2024.10590799(01-08)Online publication date: 20-Jun-2024
https://doi.org/10.1109/ROSE62198.2024.10590799
Show More Cited By

Index Terms

Towards Social Touch Intelligence: Developing a Robust System for Automatic Touch Recognition
1. Computing methodologies
  1. Machine learning
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Touching the Void -- Introducing CoST: Corpus of Social Touch
ICMI '14: Proceedings of the 16th International Conference on Multimodal Interaction

Touch behavior is of great importance during social interaction. To transfer the tactile modality from interpersonal interaction to other areas such as Human-Robot Interaction (HRI) and remote communication automatic recognition of social touch is ...
Touch Challenge '15: Recognizing Social Touch Gestures
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Advances in the field of touch recognition could open up applications for touch-based interaction in areas such as Human-Robot Interaction (HRI). We extended this challenge to the research community working on multimodal interaction with the goal of ...
Social Touch Gesture Recognition using Random Forest and Boosting on Distinct Feature Sets
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Touch is a primary nonverbal communication channel used to communicate emotions or other social messages. Despite its importance, this channel is still very little explored in the affective computing field, as much more focus has been placed on visual ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICMI '14: Proceedings of the 16th International Conference on Multimodal Interaction

November 2014

558 pages

ISBN:9781450328852

DOI:10.1145/2663204

General Chairs:
Albert Ali Salah
Boğaziçi University, Turkey
,
Jeffrey Cohn
University of Pittsburgh, USA
,
Björn Schuller
University of Passau, Germany and Imperial College London, UK
,
Program Chairs:
Oya Aran
Idiap Research Institute, Switzerland
,
Louis-Philippe Morency
University of Southern California, USA
,
Philip R. Cohen
Adapx, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Extended-abstract

Funding Sources

Dutch national program COMMIT

Conference

ICMI '14

Sponsor:

SIGCHI

ICMI '14: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 12 - 16, 2014

Istanbul, Turkey

Acceptance Rates

ICMI '14 Paper Acceptance Rate 51 of 127 submissions, 40%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
263
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alhouli SAlmania NAhmad MSahoo D(2024)Towards Designing a Pet Robot for Older Adults by Young AdultsProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3690899(408-410)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3690899
Cang XGuerra RGuta BBucci PRodgers LMah HFeng QAgrawal AMacLean K(2024)FEELing (key)Pressed: Implicit Touch Pressure Bests Brain Activity for Modeling Emotion Dynamics in the Space Between Stressed & RelaxedIEEE Transactions on Haptics10.1109/TOH.2023.330805917:3(310-318)Online publication date: Jul-2024
https://doi.org/10.1109/TOH.2023.3308059
Fumelli CDutta AKaboli M(2024)Advancements in Tactile Hand Gesture Recognition for Enhanced Human-Machine Interaction2024 IEEE International Symposium on Robotic and Sensors Environments (ROSE)10.1109/ROSE62198.2024.10590799(01-08)Online publication date: 20-Jun-2024
https://doi.org/10.1109/ROSE62198.2024.10590799
Cang XBucci PRantala JMacLean K(2023)Discerning Affect From Touch and Gaze During Interaction With a Robot PetIEEE Transactions on Affective Computing10.1109/TAFFC.2021.309489414:2(1598-1612)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TAFFC.2021.3094894
Jung MPoel MPoppe RHeylen D(2016)Automatic recognition of touch gestures in the corpus of social touchJournal on Multimodal User Interfaces10.1007/s12193-016-0232-911:1(81-96)Online publication date: 21-Oct-2016
https://doi.org/10.1007/s12193-016-0232-9
Ta VJohal WPortaz MCastelli EVaufreydaz DZhang ZCohen PBohus DHoraud RMeng H(2015)The Grenoble System for the Social Touch Challenge at ICMI 2015Proceedings of the 2015 ACM on International Conference on Multimodal Interaction10.1145/2818346.2830598(391-398)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1145/2818346.2830598
Jung MCang XPoel MMacLean KZhang ZCohen PBohus DHoraud RMeng H(2015)Touch Challenge '15Proceedings of the 2015 ACM on International Conference on Multimodal Interaction10.1145/2818346.2829993(387-390)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1145/2818346.2829993
Cang XBucci PStrang AAllen JMacLean KLiu HZhang ZCohen PBohus DHoraud RMeng H(2015)Different Strokes and Different FolksProceedings of the 2015 ACM on International Conference on Multimodal Interaction10.1145/2818346.2820756(147-154)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1145/2818346.2820756

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Touching the Void -- Introducing CoST: Corpus of Social Touch

Touch Challenge '15: Recognizing Social Touch Gestures

Social Touch Gesture Recognition using Random Forest and Boosting on Distinct Feature Sets