Applying situation-awareness for recommending phonological processes in the children's speech
Authors: 
Maria Helena Franciscatto, João Carlos Damasceno Lima, Celio Trois, Vinícius Maran, Márcia Keske Soares, Cristiano Cortez da RochaAuthors Info & Claims
Pages 739 - 746
Abstract
Situation-Awareness (SA) involves the correct interpretation of scenarios, allowing a system to respond to the observed environment in several domains. Speech therapy is an area where SA may provide benefits; however, the related literature generally is not concerned with identifying phonological processes (PPs) in pronunciation and their effects on the management of therapeutic tasks. An early identification of speech sound disorders allows the diagnosis and treatment of various pathologies and the reasoning about situations may aid clinical decision-making. So, in this paper, we present a novel method for predicting PPs, supporting speech therapists in the identification of speech disorders in children. Our approach uses SA tied to machine learning to first classify the correctness in the pronunciation of a set of target words. Then, a second instance of ML uses scores calculated from mispelled words to predict the PPs. The method was evaluated through a speech corpus containing over a thousand of audio files, collected from pronunciation assessments performed by speech-language pathologists with more than 1,000 children. Our results showed an average accuracy over 92.5% for classifying the pronunciations, and 92.2% for predicting the PPs.
References
[1]
Alberto Abad, Anna Pompili, Angela Costa, Isabel Trancoso, José Fonseca, Gabriela Leal, Luisa Farrajota, and Isabel P Martins. 2013. Automatic word naming recognition for an on-line aphasia treatment system. Computer Speech & Language 27, 6 (2013), 1235--1248.
[2]
Daniel Bolaños, Ronald A Cole, Wayne Ward, Eric Borts, and Edward Svirsky. 2011. FLORA: Fluent oral reading assessment of children's speech. ACM Transactions on Speech and Language Processing (TSLP) 7, 4 (2011), 16.
[3]
Leo Breiman. 2001. Random forests. Machine learning 45, 1 (2001), 5--32.
[4]
Santiago-Omar Caballero-Morales and Felipe Trujillo-Romero. 2014. Evolutionary approach for integration of multiple pronunciation patterns for enhancement of dysarthric speech recognition. Expert Systems with Applications 41, 3 (2014), 841--852.
[5]
Fanny Chuchuca-Méndez, Vladimir Robles-Bykbaev, Pablo Vanegas-Peralta, Juan Lucero-Saldaña, Martín López-Nores, and José Pazos-Arias. 2016. An educative environment based on ontologies and e-learning for training on design of speech-language therapy plans for children with disabilities and communication disorders. In Ciencias de la Informática y Desarrollos de Investigación (CACIDI), IEEE Congreso Argentino de. 1--6.
[6]
Barbara Dodd and Teresa Lacano. 1989. Phonological disorders in children: Changes in phonological process use during treatment. International Journal of Language & Communication Disorders 24, 3 (1989), 333--352.
[7]
Mica R Endsley. 1995. Toward a theory of situation awareness in dynamic systems. Human factors 37, 1 (1995), 32--64.
[8]
Yu-Hong Feng, Teck-Hou Teng, and Ah-Hwee Tan. 2009. Modelling situation awareness for Context-aware Decision Support. Expert Systems with Applications 36, 1 (2009), 455--463.
[9]
Maria Helena Franciscatto, Iara Augustin, João Carlos Damasceno Lima, and Vinícius Maran. 2018. Situation Awareness in the speech therapy domain: a systematic mapping study. Computer Speech & Language 53 (2018), 92--120.
[10]
Maria Helena Franciscatto, Celio Trois, João Carlos Damasceno Lima, and Iara Augustin. in press. Blending Situation Awareness with machine learning to identify children's speech disorders. In 12th International Conference on Application of Information and Communication Technologies, AICT 2018, Almaty, Kazakhstan, October 17--19. IEEE, 6.
[11]
André Grossinho, Isabel Guimaraes, Joao Magalhaes, and Sofia Cavaco. 2016. Robust phoneme recognition for a speech therapy environment. In Serious Games and Applications for Health (SeGAH), 2016 IEEE International Conference on. 1--7.
[12]
Tino Haderlein, Anne Schützenberger, Michael Döllinger, and Elmar Nöth. 2017. Robust Automatic Evaluation of Intelligibility in Voice Rehabilitation Using Prosodic Analysis. In Text, Speech, and Dialogue: 20th International Conference, TSD 2017, Prague, Czech Republic, August 27--31, 2017. Proceedings, Vol. 10415. Springer, 11.
[13]
Mieczyslaw M Kokar and Mica R Endsley. 2012. Situation awareness and cognitive modeling. IEEE Intelligent Systems 27, 3 (2012), 91--96.
[14]
Andy Liaw, Matthew Wiener, et al. 2002. Classification and regression by randomForest. R news 2, 3 (2002), 18--22.
[15]
María Luisa Martín-Ruiz, Miguel Angel Valero Duboy, and Iván Pau de la Cruz. 2013. Deployment and validation of a smart system for screening of language disorders in primary care. Sensors 13, 6 (2013), 7522--7545.
[16]
B Nithya and V Ilango. 2017. Predictive analytics in health care using machine learning tools and techniques. In Intelligent Computing and Control Systems (ICICCS), 2017 International Conference on. IEEE, 492--499.
[17]
Timo Ojala, Matti Pietikainen, and Topi Maenpaa. 2002. Multiresolution grayscale and rotation invariant texture classification with local binary patterns. IEEE Transactions on pattern analysis and machine intelligence 24, 7 (2002), 971--987.
[18]
Rudolph Oosthuizen and Leon Pretorius. 2015. System dynamics modelling of situation awareness. In Military Communications and Information Systems Conference (MilCIS), 2015. 1--6.
[19]
Avinash Parnandi, Virendra Karappa, Tian Lan, Mostafa Shahin, Jacqueline McKechnie, Kirrie Ballard, and journal=ACM Transactions on Accessible Computing volume=7 number=3 pages=10 year=2015 publisher=ACM Ahmed, Beena. {n. d.}. Development of a Remote Therapy Tool for Childhood Apraxia of Speech. ({n. d.}).
[20]
Vladimir E Robles-Bykbaev, Wilson Guamán-Murillo, Diego Quisi-Peralta, Martín López-Nores, José J Pazos-Arias, and Jorge García-Duque. 2016. An ontology-based expert system to generate therapy plans for children with disabilities and communication disorders. In Ecuador Technical Chapters Meeting (ETCM), IEEE, Vol. 1. 6.
[21]
Ovidiu Andrei Schipor, Stefan Gheorghe Pentiuc, and Maria Doina Schipor. 2012. Improving computer based speech therapy using a fuzzy expert system. Computing and Informatics 29, 2 (2012), 303--318.
[22]
Mirfat Akter Sharmin, Md Mizanur Rahman, Syed Ishtiaque Ahmed, Md Mustafizur Rahman, and SM Ferdous. 2011. Teaching intelligible speech to the autistic children by interactive computer games. In Proceedings of the 2011 ACM Symposium on Applied Computing. ACM, 1208--1209.
[23]
David Stampe. 1979. A dissertation on natural phonology. Ph.D. Dissertation. Indiana University Linguistics Club.
[24]
Philip H Swain and Hans Hauska. 1977. The decision tree classifier: Design and potential. IEEE Transactions on Geoscience Electronics 15, 3 (1977), 142--147.
[25]
Mehmet Yavas and Regina Lamprecht. 1988. Processes and intelligibility in disordered phonology. Clinical linguistics & phonetics 2, 4 (1988), 329--345.
Index Terms
- Applying situation-awareness for recommending phonological processes in the children's speech
Recommendations
A case-based approach using phonological knowledge for identifying error patterns in children's speech
SAC '19: Proceedings of the 34th ACM/SIGAPP Symposium on Applied ComputingCase-Based Reasoning (CBR) covers a range of different methods for organizing, retrieving, and indexing knowledge from previous cases. Thus, this methodology has been successfully applied in medical domain, due to its human and intelligent properties to ...
Computer-based speech training for children
A computer-based speech training system has been developed for children. The system is able to perform diagnostics and training in Malay language at both syllable and word level. The system allows children with difficulty in articulating plosive sounds ...
Deep learning applications in telerehabilitation speech therapy scenarios
AbstractNowadays, many application scenarios benefit from automatic speech recognition (ASR) technology. Within the field of speech therapy, in some cases ASR is exploited in the treatment of dysarthria with the aim of supporting articulation ...
Highlights- We propose mobile ASR tools in speech therapy for patients with dysarthria.
- The ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
April 2019
2682 pages
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 April 2019
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
SAC '19
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,650 of 6,669 submissions, 25%
Upcoming Conference
SAC '25
- Sponsor:
- sigapp
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 97Total Downloads
- Downloads (Last 12 months)8
- Downloads (Last 6 weeks)1
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in