Abstract
The sign language is the only mean of communication for the vocally impaired people throughout the world. This is possible for a vocally impaired person who has undergone special training. In Bangladesh, learning sign language is a hard job because not enough institutes are available for teaching sign language, and not enough supporting materials or tools are available online. In this paper, an efficient learning tool was developed for vocally impaired people of Bangladesh to learn Bengali alphabet without any assistance or supervision of another person. The system consists of a computer software and a special sensor-fitted glove. The software shows various letters with associated signs to the user. The user can imitate the sign using the glove, while the system can detect the bending of the fingers and tilt of the hand and check whether the sign is correct or not. A between-subject experiment with 18 vocally impaired people were conducted to assess the performance and user experience of the proposed learning tool. The study results showed that the tool is effective for the vocally impaired people to learn Bengali alphabet comparing to the traditional learning approach. The results also showed the developed system is efficient, useful and acceptable to users.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Deafness and hearing loss. World Health Organisation. https://www.who.int/news-room/fact-sheets/detail/deafness-and-hearing-loss. Accessed 29 May 2019
Naruvir. Memrise - Sign Languages (n.d.). https://www.memrise.com/courses/english/sign-languages/. Accessed 6 Apr 2019
American Sign Language—NIDCD, 7 June 2010. https://www.nidcd.nih.gov/health/clearinghouse. Accessed 6 Apr 2019
Learn American Sign Language. StartASL.com (n.d.). https://www.startasl.com/. Accessed 6 Apr 2019
French Sign Language, 24 February 2019. https://en.wikipedia.org/wiki/French_Sign_Language. Accessed 6 Apr 2019
Arko, F., Tabassum, N., Trisha, T., Ahmed, F.: Bangla sign language interpretation using image processing. Ph.D. dissertation. BRAC University (2017)
Bauer, B., Karl-Friedrich, K.: Towards an automatic sign language recognition system using subunits. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 64–75. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-47873-6_7
Chai, X., et al.: Sign language recognition and translation with kinect. In: IEEE Conference on AFGR (2013)
Araujo, T., et al.: An approach to generate and embed sign language video tracks into multimedia contents. Inf. Sci. 281(2014), 762–780 (2014)
Gunasekaran, K., An, R.: Sign language to speech translation system using PIC microcontroller (2013)
Hasan, M., Sajib, T., Dey, M.: A machine learning based approach for the detection and recognition of Bangla sign language. In: 2016 International Conference on Medical Engineering, Health Informatics and Technology (MediTec), pp. 1–5. IEEE (2016)
Jarman, A., Arshad, S., Alam, N., Islam, M.: An automated bengali sign language recognition system based on fingertip finder algorithm. Int. J. Electron. Inform. 4, 1–10 (2015)
Karmokar, B., Alam, K., Siddiquee, M.: Bangladeshi sign language recognition employing neural network ensemble. Int. J. Comput. Appl. 58, 16 (2012)
Liang, R., Ouhyoung, M.: A real-time continuous gesture recognition system for sign language. In: Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 558–567. IEEE (1998)
López-Ludeña, V., González-Morcillo, C., López, J., Barra-Chicote, R., Córdoba, R., San-Segundo, R.: Translating bus information into sign language for deaf people. Eng. Appl. Artif. Intell. 32(2014), 258–269 (2014)
Shimada, Y., Shirai, Y.: 3-D Hand Pose Estimation from Image Sequence Using Probability-Based Search and Matching. https://ci.nii.ac.jp/naid/110003227566. Accessed 6 Apr 2019
San-Segundo, R., et al.: Speech to sign language translation system for Spanish. Speech Commun. 50(11–12), 1009–1020 (2008)
Shirai, Y.: Estimation of 3-D pose and shape from a monocular image sequence and real-time human tracking. In: Proceedings of the International Conference on Recent Advances in 3-D Digital Imaging and Modeling, pp. 130–139. IEEE (1997)
Starner, T., Weaver, J., Pentland, A.: Real-time American sign language recognition using desk and wearable computer based video. IEEE Trans. Pattern Anal. Mach. Intell. 20(12), 1371–1375 (1998)
Islam, M.N., Bouwman, H.: Towards user-intuitive web interface sign design and evaluation: a semiotic framework. Int. J. Hum.-Comput. Stud. 86(2016), 121–137 (2016)
Islam, M.N.: Semiotics perception towards designing users’ intuitive web user interface: a study on interface signs. In: Rahman, H., Mesquita, A., Ramos, I., Pernici, B. (eds.) MCIS 2012. LNBIP, vol. 129, pp. 139–155. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33244-9_10
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Islam, M.N., Hasan, A.M.S., Anannya, T.T., Hossain, T., Ema, M.B.I., Rashid, S.U. (2019). An Efficient Tool for Learning Bengali Sign Language for Vocally Impaired People. In: Awan, I., Younas, M., Ünal, P., Aleksy, M. (eds) Mobile Web and Intelligent Information Systems. MobiWIS 2019. Lecture Notes in Computer Science(), vol 11673. Springer, Cham. https://doi.org/10.1007/978-3-030-27192-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-27192-3_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-27191-6
Online ISBN: 978-3-030-27192-3
eBook Packages: Computer ScienceComputer Science (R0)