Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleDecember 2024
Quantifying inconsistencies in the Hamburg Sign Language Notation System
- Maria Ferlin,
- Sylwia Majchrowska,
- Marta Plantykow,
- Alicja Kwaśniewska,
- Agnieszka Mikołajczyk-Bareła,
- Milena Olech,
- Jakub Nalepa
Expert Systems with Applications: An International Journal (EXWA), Volume 256, Issue Chttps://doi.org/10.1016/j.eswa.2024.124911AbstractThe advent of machine learning (ML) has significantly advanced the recognition and translation of sign languages, bridging communication gaps for hearing-impaired communities. At the heart of these technologies is data labeling, crucial for ...
Highlights- HamNoSys notation system is not sufficient for ML labeling purposes
- HamNoSys-based labels are often subjective and inconsistent
- There is a need for a notation system useful in computer-aided systems
- research-articleNovember 2024
Structure-aware sign language recognition with spatial–temporal scene graph
Information Processing and Management: an International Journal (IPRM), Volume 61, Issue 6https://doi.org/10.1016/j.ipm.2024.103850AbstractContinuous sign language recognition (CSLR) is essential for the social participation of deaf individuals. The structural information of sign language motion units plays a crucial role in semantic representation. However, most existing CSLR ...
- posterOctober 2024
Insights from Immersive Learning: Using Sentiment Analysis and Real-time Narration to Refine ASL Instruction in Virtual Reality
ASSETS '24: Proceedings of the 26th International ACM SIGACCESS Conference on Computers and AccessibilityArticle No.: 108, Pages 1–4https://doi.org/10.1145/3663548.3688503Immersive virtual reality presents a rich opportunity for learning signed languages, given the immersive environment’s ability to represent three-dimensional information. We developed a proof-of-concept American Sign Language (ASL) learning in immersive ...
- research-articleDecember 2024
Research on Speech Information to Sign Language Translation Based on 1D-GoogLeNet and LSTM
ICCSIE '24: Proceedings of the 2024 9th International Conference on Cyber Security and Information EngineeringPages 707–712https://doi.org/10.1145/3689236.3691489In order to solve the problem of obtaining speech information for the deaf and mute population, a deep learning based intelligent speech to sign language translation technology is proposed. Firstly, a one-dimensional Google LeNet combined with Hidden ...
- ArticleJune 2024
An Evaluation of Portuguese to Libras Translator Apps Applied to the Medical Context
- Julia Manuela G. Soares,
- Isabel F. de Carvalho,
- Elidéa L. A. Bernardino,
- Milena Soriano Marcolino,
- Raquel Oliveira Prates
Universal Access in Human-Computer InteractionPages 290–304https://doi.org/10.1007/978-3-031-60884-1_20AbstractWith over 2.4 million Brazilians experiencing hearing loss, effective communication between deaf individuals and healthcare professionals is crucial but still faces various barriers. Existing studies highlight shortcomings in the availability of ...
-
- short-paperOctober 2024
Using Convolutional Neural Networks for Visual Sign Language Recognition: Towards a system that provides instant feedback to learners of sign language
W4A '24: Proceedings of the 21st International Web for All ConferencePages 70–74https://doi.org/10.1145/3677846.3677848This paper is about a machine learning system that uses a convolutional neural network approach to recognizing finger-spelled letters in British sign language (BSL). Motivated by a desire to improve sign language instruction, the software allows users to ...
- research-articleMarch 2024
Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 20, Issue 6Article No.: 185, Pages 1–18https://doi.org/10.1145/3648368Sign language provides a way for differently-abled individuals to express their feelings and emotions. However, learning sign language can be challenging and time consuming. An alternative approach is to animate user photos using sign language videos of ...
- research-articleJanuary 2024
Towards better transition modeling in recurrent neural networks: The case of sign language tokenization
AbstractRecurrent neural networks (RNNs) are a popular family of models widely used when facing sequential data such as videos. However, RNNs make assumptions about state transitions that could be damageable. This paper presents two theoretical ...
Highlights- Sign language tokenization is a challenging task involving complex transitions.
- The limitations of RNNs highlighted in theory can be observed in practice.
- Extensions have a positive impact, but there is still room for improvement.
- ArticleNovember 2023
A Few-Shot Approach to Sign Language Recognition: Can Learning One Language Enable Understanding of All?
AbstractSign language is a unique form of communication in which hand or other body part gestures are used to express oneself. A large proportion of the world’s population has speech and hearing impairments and communicates through sign language. Sign ...
- research-articleJanuary 2024
Exploring Acceptance Factors of a Technology for Textual Production among Deaf Users: A UTAUT2-Based Study
- Lucia Vilela Leite Filgueiras,
- Ely Bernardi,
- João Víctor de Araujo Lima,
- Alexandre de Faustino Miranda,
- Greice Franklin de Silveira Lima,
- Maria Clara Nascimento,
- Mateus Celestino Deletezze,
- Tania Aparecida Martins,
- Glauber Lima Silva
CLIHC '23: Proceedings of the XI Latin American Conference on Human Computer InteractionArticle No.: 22, Pages 1–7https://doi.org/10.1145/3630970.3631081For deaf individuals, sign language is their primary language, while written language is often considered a secondary language. Although progress has been made in developing technologies that facilitate communication between deaf and hearing individuals,...
- research-articleOctober 2023
Building the VisSE Corpus of Spanish SignWriting
Language Resources and Evaluation (SPLRE), Volume 58, Issue 2Pages 585–607https://doi.org/10.1007/s10579-023-09694-9AbstractSignWriting is a system for transcribing sign languages, using iconic depictions of the hands and other body parts, as well as exploiting the possibilities of the page as a two dimensional medium to capture the three-dimensional nature of signs. ...
- research-articleOctober 2023
Double handed dynamic Turkish Sign Language recognition using Leap Motion with meta learning approach
Expert Systems with Applications: An International Journal (EXWA), Volume 228, Issue Chttps://doi.org/10.1016/j.eswa.2023.120453AbstractSign language is one of the most important communication tools for hearing impaired people. In this study, the recognition of two-handed dynamic words in Turkish Sign Language (TSL) was studied using the LMC device. As a result of the repetition ...
- research-articleSeptember 2023
Exploring automatic text-to-sign translation in a healthcare setting
- Lyke Esselink,
- Floris Roelofsen,
- Jakub Dotlačil,
- Shani Mende-Gillings,
- Maartje de Meulder,
- Nienke Sijm,
- Anika Smeijers
Universal Access in the Information Society (UAIS), Volume 23, Issue 1Pages 35–57https://doi.org/10.1007/s10209-023-01042-6AbstractCommunication between healthcare professionals and deaf patients has been particularly challenging during the COVID-19 pandemic. We have explored the possibility to automatically translate phrases that are frequently used in the diagnosis and ...
- research-articleSeptember 2023
Development of a hybrid word recognition system and dataset for the Azerbaijani Sign Language dactyl alphabet
AbstractThe paper introduces a real-time fingerspelling-to-text translation system for the Azerbaijani Sign Language (AzSL), targeted to the clarification of the words with no available or ambiguous signs. The system consists of both statistical and ...
Highlights- A dataset of 13,444 Azerbaijani dactyl alphabet samples is introduced.
- To increase the robustness, a probabilistic and clustered model has been implemented.
- Augmentation, its problems, and considerations have been shared.
- The ...
- research-articleAugust 2023
Novel error correction-based key frame extraction technique for dynamic hand gesture recognition
Neural Computing and Applications (NCAA), Volume 35, Issue 28Pages 21165–21180https://doi.org/10.1007/s00521-023-08774-9AbstractBefore languages came into existence, sign language was the mode of communication. For human–computer interaction, recognizing these sign languages is vital; thus, hand gesture recognition comes into play. With the advancement of technology and ...
- ArticleJuly 2023
Using Lean UX in the Design and Evaluation of a Prototype for Automatic Translation Between Sign Languages
Universal Access in Human-Computer InteractionPages 319–339https://doi.org/10.1007/978-3-031-35681-0_21AbstractAlthough an International Sign Language has been created, only a small percentage of people in the world are able to use it. Given this context, it is important to support communication among deaf persons who use different sign languages and who ...
- research-articleApril 2023
HAKA: HierArchical Knowledge Acquisition in a sign language tutor
Expert Systems with Applications: An International Journal (EXWA), Volume 215, Issue Chttps://doi.org/10.1016/j.eswa.2022.119365Highlights- A tutor for learning the Spanish Sign Language basic hand configurations.
- Hand ...
Communication between people from different communities can sometimes be hampered by the lack of knowledge of each other's language. A large number of people needs to learn a language in order to ensure a fluid communication or want to ...
- review-articleApril 2023
Machine translation from signed to spoken languages: state of the art and challenges
Universal Access in the Information Society (UAIS), Volume 23, Issue 3Pages 1305–1331https://doi.org/10.1007/s10209-023-00992-1AbstractAutomatic translation from signed to spoken languages is an interdisciplinary research domain on the intersection of computer vision, machine translation (MT), and linguistics. While the domain is growing in terms of popularity—the majority of ...
- research-articleMarch 2023
A constructive deep convolutional network model for analyzing video-to-image sequences
AbstractThis paper proposes a new technique to add sign language as a special and real-time feature. In addition to gestures, sign language also uses grammatical rules, linguistic frameworks, etc. We require a method that can extract ...
- review-articleJanuary 2023
Landscape of sign language research based on smartphone apps: coherent literature analysis, motivations, open challenges, recommendations and future directions for app assessment
- Dianes David,
- A. H. Alamoodi,
- O. S. Albahri,
- B. B. Zaidan,
- A. A. Zaidan,
- Salem Garfan,
- Amelia Ritahani Ismail,
- A. S. Albahri,
- Belal Alsinglawi,
- R. Q. Malik
Universal Access in the Information Society (UAIS), Volume 23, Issue 2Pages 687–702https://doi.org/10.1007/s10209-022-00966-9AbstractNumerous nations have prioritised the inclusion of citizens with disabilities, such as hearing loss, in all aspects of social life. Sign language is used by this population, yet they still have trouble communicating with others. Many sign language ...