Abstract
This paper presents a method for fine analysis of children handwriting on pen-based tablets. This work is in the context of the P2IA project, funded by the French government, which aims at designing a virtual notebook in order to foster handwriting learning for primary school pupils. In this work, we consider the task of analysing handwritten words in the context of a dictation exercise. This task is complex due to different factors: the children do not master yet the morphological aspects of handwriting, nor do they master orthography or translating phonetic sounds to actual graphemes (parts of word). In order to tackle this problem, we extend to the context of dictation exercises an analysis engine that was developed previously to deal with copying exercises. Two strategies were developed, the first one is a baseline approach and relies on double child input: the pupil types the word on a virtual keyboard after writing it with the stylus, thus the prior knowledge of the written word will drive the engine analysis. The second one relies on a single input: the child handwritten strokes. To drive the analysis, the strategy consists in generating hypotheses that are phonetically similar to the dictated instruction, which will act as probable approximations of the written word (sequence of letters), to cover potential orthographic mistakes by the pupil. To assist the learning process of the pupils, the engine returns different types of real-time feedbacks, that depend on the confidence of the analysis process (confident assessment on errors, warning, or reject).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bonneton-Botté, N.: Can tablet apps support the learning of handwriting? An investigation of learning outcomes in kindergarten classroom. Comput. Educ. 38 (2020)
Anquetil, E., Lorette, G.: On-line handwriting character recognition system based on hierarchical qualitative fuzzy modeling. In: Progress in Handwriting Recognition, pp. 109–116. World Scientific, New York (1997)
Simonnet, D., Girard, N., Anquetil, E., Renault, M., Thomas, S.: Evaluation of children cursive handwritten words for e-education. Pattern Recogn. Lett. 121, 133–139 (2018)
Almaksour, A., Anquetil, E.: Improving premise structure in evolving Takagi-Sugeno neuro-fuzzy classifiers. Evolv. Syst. 2, 25–33 (2011)
Takagi, T., Sugeno, M.: Fuzzy identification of systems and its applications to modeling and control. IEEE Trans. Syst. Man Cybern. SMC-15.1, pp. 116–132 (1985)
Simonnet, D., Anquetil, E., Bouillon, M.: Multi-criteria handwriting quality analysis with online fuzzy models. Pattern Recogn. 69, 310–324 (2017)
Damerau, F.J.: A technique for computer detection and correction of spelling errors. Commun. ACM 7, 171–176 (1964)
Novak, J., Dixon, P., Minematsu, N., Hirose, K., Hori, C., Kashioka, H.: Improving WFST-based G2P conversion with alignment constraints and RNNLM N-best rescoring (2012)
, Chickering, A.W., Zelda, F.G.: Seven principles for good practice in undergraduate education. AAHE Bull. 39(7), 3–7 (1987)
Haßler, B., Major, L., Hennessy, S.: Tablet use in schools: a critical review of the evidence for learning outcomes. J. Comput. Assist. Learn. 32, 139–156 (2016)
Bisani, M., Ney, H.: Joint-sequence models for grapheme-to-phoneme conversion. Speech Commun. 50, 434–451 (2008)
Nkambou, R., Mizoguchi, R., Bourdeau, J.: Advances in Intelligent Tutoring Systems. Studies in Computational Intelligence, vol. 308. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14363-2
Sheng, H., Schomaker, L.: Deep adaptive learning for writer identification based on single handwritten word images. Pattern Recogn. 88, 64–74 (2008)
Kang, L., Rusinol, M., Fornes, A., Riba, P., Villegas, M.: Unsupervised writer adaptation for synthetic-to-real handwritten word recognition. In: The IEEE Winter Conference on Applications of Computer Vision, pp. 3502–3511 (2020)
Acknowledgement
“P2IA” is funded by the French government. We would like to tank the project partners from Learn & Go, the University of Rennes 2, LP3C lab, INSA Rennes, University of Rennes 1 and IRISA lab. Additionally, parts of these works were supported by LabCom “Scripts and Labs” funded by the French National Agency for Research (ANR).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Krichen, O., Corbillé, S., Anquetil, E., Girard, N., Nerdeux, P. (2021). Online Analysis of Children Handwritten Words in Dictation Context. In: Barney Smith, E.H., Pal, U. (eds) Document Analysis and Recognition – ICDAR 2021 Workshops. ICDAR 2021. Lecture Notes in Computer Science(), vol 12916. Springer, Cham. https://doi.org/10.1007/978-3-030-86198-8_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-86198-8_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86197-1
Online ISBN: 978-3-030-86198-8
eBook Packages: Computer ScienceComputer Science (R0)