extended-abstract

A 3D application to familiarize children with sign language and assess the potential of avatars and motion capture for learning movement

Authors:

Rémi Brun,

Ahmed Turki,

Aurélien LavilleAuthors Info & Claims

MOCO '16: Proceedings of the 3rd International Symposium on Movement and Computing

Article No.: 48, Pages 1 - 2

https://doi.org/10.1145/2948910.2948917

Published: 05 July 2016 Publication History

Get Access

Abstract

In order to explore the potentialities of 3D tools for teaching and learning movements, we are developing a prototype of a 3D application that will give children a first contact with sign language through an interactive 3D signing avatar.

It is not yet a finalized teaching tool but rather the first step in the process of exploring the possibilities given by a 3D character moving in a 3D environment to "connect" a child with a world of movement that he has to memorise and become familiar with. Our approach relies heavily on the fact that we have implemented a process to record movements of the body, the face, the eyes, and the fingers and transpose them onto an "avatar" with maximal accuracy and fidelity [3,5].

References

[1]

Susan Wagner Cook, Howard S. Friedman, Katherine A. Duggan, Jian Cui and Voicu Popescu 2016. Hand Gesture and Mathematics Learning: Lessons From an Avatar. Cognitive Science.

Crossref

Google Scholar

[2]

Elaine Farrow and Oliver Lemon 2011. Adding Sign Language Animation to the ECHOES Multimodal Technology Enhanced Learning Environment. In Proceedings of the International Symposium on Sign Language Translation and Avatar Technology 2011

Google Scholar

[3]

Sylvie Gibet, François Lefebvre-Albaret, Ludovic Hamon, Rémi Brun and Ahmed Turki 2015. Interactive Editing in French Sign Language Dedicated to Virtual Signers: Requirements and Challenges. Universal Access in the Information Society, 2015

Google Scholar

[4]

Alexis Heloir, Quan Nguyen and Michael Kipp 2011. Signing Avatars: a Feasibility Study. In Proceedings of the International Symposium on Sign Language Translation and Avatar Technology (SLTAT) 2011

Google Scholar

[5]

François Lefebvre-Albaret, Sylvie Gibet, Ludovic Hamon, Rémi Brun and Ahmed Turki 2013. Overview of the Sign3D Project High-fidelity 3D recording, indexing and editing of French Sign Language content In Proceedings of the International Symposium on Sign Language Translation and Avatar Technology 2013

Google Scholar

Cited By

View all

McDonald J(2024)Considerations on generating facial nonmanual signals on signing avatarsUniversal Access in the Information Society10.1007/s10209-024-01090-6Online publication date: 25-Mar-2024
https://doi.org/10.1007/s10209-024-01090-6
Morillas-Espejo FMartinez-Martin E(2024)A Virtual Avatar for Sign Language SigningThe 19th International Conference on Soft Computing Models in Industrial and Environmental Applications SOCO 202410.1007/978-3-031-75013-7_6(58-67)Online publication date: 16-Nov-2024
https://doi.org/10.1007/978-3-031-75013-7_6
Dimou APapavassiliou VGoulas TVasilaki KVacalopoulou AFotinea SEfthimiou E(2022)What about synthetic signing? A methodology for signer involvement in the development of avatar technology with generative capacityFrontiers in Communication10.3389/fcomm.2022.7986447Online publication date: 1-Aug-2022
https://doi.org/10.3389/fcomm.2022.798644
Show More Cited By

Index Terms

A 3D application to familiarize children with sign language and assess the potential of avatars and motion capture for learning movement
1. Human-centered computing

Recommendations

Teaching ASL Signs using Signing Avatars and Immersive Learning in Virtual Reality
ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

We present here a new system, in which signing avatars (computer-animated virtual humans built from motion capture recordings) teach introductory American Sign Language (ASL) in an immersive virtual environment. The system is called Signing Avatars & ...
Generating 3D architectural models based on hand motion and gesture

This paper presents a novel method for rapidly generating 3D architectural models based on hand motion and design gestures captured by a motion capture system. A set of sign language-based gestures, architectural hand signs (AHS), has been developed. ...
Recognizing Spatiotemporal Gestures and Movement Epenthesis in Sign Language
IMVIP '09: Proceedings of the 2009 13th International Machine Vision and Image Processing Conference

A novel system for the recognition of spatiotemporal hand gestures used in sign language is presented. While recognition of valid sign sequences is an important task in the overall goal of machine recognition of sign language, recognition of movement ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MOCO '16: Proceedings of the 3rd International Symposium on Movement and Computing

July 2016

300 pages

ISBN:9781450343077

DOI:10.1145/2948910

Conference Chair:
Sotiris Manitsaris

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

University of Macedonia
Aristotle University of Thessaloniki
Université Paris 8: Université Paris 8

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 July 2016

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

MOCO'16

MOCO'16: 3rd International Symposium on Movement and Computing

July 5 - 6, 2016

GA, Thessaloniki, Greece

Acceptance Rates

Overall Acceptance Rate 85 of 185 submissions, 46%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
114
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

McDonald J(2024)Considerations on generating facial nonmanual signals on signing avatarsUniversal Access in the Information Society10.1007/s10209-024-01090-6Online publication date: 25-Mar-2024
https://doi.org/10.1007/s10209-024-01090-6
Morillas-Espejo FMartinez-Martin E(2024)A Virtual Avatar for Sign Language SigningThe 19th International Conference on Soft Computing Models in Industrial and Environmental Applications SOCO 202410.1007/978-3-031-75013-7_6(58-67)Online publication date: 16-Nov-2024
https://doi.org/10.1007/978-3-031-75013-7_6
Dimou APapavassiliou VGoulas TVasilaki KVacalopoulou AFotinea SEfthimiou E(2022)What about synthetic signing? A methodology for signer involvement in the development of avatar technology with generative capacityFrontiers in Communication10.3389/fcomm.2022.7986447Online publication date: 1-Aug-2022
https://doi.org/10.3389/fcomm.2022.798644
Naert LLarboulette CGibet S(2021)Motion synthesis and editing for the generation of new sign language contentMachine Translation10.1007/s10590-021-09268-yOnline publication date: 7-Jun-2021
https://doi.org/10.1007/s10590-021-09268-y
Ferreira MGarcía LMota MSerique BPrates RCandello H(2018)Requirements for Avatar in Virtual Environment of Support Learning in the Literacy of Deaf People in Portuguese Mediated by LIBRASProceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems10.1145/3274192.3274241(1-6)Online publication date: 22-Oct-2018
https://dl.acm.org/doi/10.1145/3274192.3274241

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Teaching ASL Signs using Signing Avatars and Immersive Learning in Virtual Reality

Generating 3D architectural models based on hand motion and gesture

Recognizing Spatiotemporal Gestures and Movement Epenthesis in Sign Language