FPRNet: End-to-End Full-Page Recognition Model for Handwritten Chinese Essay
Pages 231 - 244
Abstract
Handwritten Chinese Essay Recognition (HCER) is a special branch of handwritten Chinese text recognition with great interest. In a naive way, it can be firstly segmented into text lines or even characters, followed by a text line or character recognition step. Instead, we propose an end-to-end recognition model named FPRNet which directly runs on full-page images in light of the segmentation-free strategy. Our well-designed model can extract text from a full-page image only supervised with text labels and adapt better to authentic noisy images. Besides, we propose an effective dimensionality reduction mechanism based on reshape operation to bridge features between 2D and 1D without information loss. Moreover, we propose an order-align strategy to mitigate the decoding confusion caused by skewness. Experiments are conducted on real-world essay images. Our model achieves a 5.83% character error rate (CER), which is comparable with the state-of-the-art approaches.
References
[1]
Su T, Zhang T, Guan D, and Huang H Off-line recognition of realistic Chinese handwriting using segmentation-free strategy Pattern Recogn. 2009 42 1 167-182
[2]
Wang Q, Yin F, and Liu C Handwritten Chinese text recognition by integrating multiple contexts IEEE TPAMI 2011 34 8 1469-1481
[3]
Toledo, J., et al.: Handwriting recognition by attribute embedding and recurrent neural networks. In: ICDAR (2017)
[4]
Lei, K., et al.: Convolve, attend and spell: an attention-based sequence-to-sequence model for handwritten word recognition. In: German Conference on Pattern Recognition (2018)
[5]
Wu Y, Yin F, and Liu C Improving handwritten Chinese text recognition using neural network language models and convolutional neural network shape models Pattern Recogn. 2017 65 251-264
[6]
Graves, A., Fernández, S., Gomez, F., et al.: Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 369–376 (2006)
[7]
Sandler, M., Howard, A., Zhu, M., et al.: Mobilenetv 2: inverted residuals and linear bottlenecks. In: CVPR (2018)
[8]
Chung, J., Delteil, T.: A computationally efficient pipeline approach to full page offline handwritten text recognition. In: ICDAR Workshop (2019)
[9]
Carbonell M, Fornés A, Villegas M, et al. A neural model for text localization, transcription and named entity recognition in full pages Pattern Recogn. Lett. 2020 136 219-227
[10]
Messina, R., Louradour, J.: Segmentation-free handwritten Chinese text recognition with LSTM-RNN. In: ICDAR (2015)
[11]
Wu, Y., Yin, F., et al.: Handwritten Chinese text recognition using separable multi-dimensional recurrent neural network. In: ICDAR (2017)
[12]
Yousef, M., Hussain, K.F., Mohammed, U.S.: Accurate, data-efficient, unconstrained text recognition with convolutional neural networks. Pattern Recogn. 108, 107482 (2020)
[13]
Bluche, T.: Joint line segmentation and transcription for end-to-end handwritten paragraph recognition. In: NeuIPS (2016)
[14]
Wigington, C., Tensmeyer, C., Davis, B., et al.: Start, follow, read: end-to-end full-page handwriting recognition. In: ECCV (2018)
[15]
Coquenet, D., Chatelain, C., Paquet, T.: End-to-end handwritten paragraph text recognition using a vertical attention network. IEEE Trans. Pattern Anal. Mach. Intell. (2022). (Accepted)
[16]
Yousef, M., Bishop, T.: OrigamiNet: weakly-supervised, segmentation-free, one-step, full page text recognition by learning to unfold. In: CVPR (2020)
[17]
Howard, A., Zhu, M., Chen, B., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. ArXiv:1704.04861 (2017)
[18]
Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: CVPR (2017)
[19]
Wang, F., Jiang, M., Qian, C., et al.: Residual attention network for image classification. In: CVPR (2017)
[20]
Srivastava, R.K., Greff, K., Schmidhuber, J.: Highway networks. ArXiv:1505.00387 (2015)
[21]
Coquenet, D., Chatelain, C., Paquet, T.: Recurrence-free unconstrained handwritten text recognition using gated fully convolutional network. In: International Conference on Frontiers in Handwriting Recognition, pp. 19–24 (2020)
[22]
Szegedy, C., Liu, W., Jia, Y., et al.: Going deeper with convolutions. In: CVPR (2015)
[23]
Kingma, D., Ba, J.: Adam: a method for stochastic optimization. ArXiv:1412.6980 (2014)
[24]
Yousef, M., Hussain, K., Mohammed, U.: Accurate, data-efficient, unconstrained text recognition with convolutional neural networks. Pattern Recogn. 108, 107482 (2020)
[25]
Coquenet, D., Chatelain, C., Paquet, T.: SPAN: a simple predict and align network for handwritten paragraph recognition. In: International Conference on Document Analysis and Recognition (2021)
Recommendations
ICDAR 2013 Chinese Handwriting Recognition Competition
ICDAR '13: Proceedings of the 2013 12th International Conference on Document Analysis and RecognitionThis paper describes the Chinese handwriting recognition competition held at the 12th International Conference on Document Analysis and Recognition (ICDAR 2013). This third competition in the series again used the CASIA-HWDB/OLHWDB databases as the ...
Radical aggregation network for few-shot offline handwritten Chinese character recognition
Highlights- A radical aggregation network for radical-level Chinese character recognition.
- ...
Graphical abstractOverall architecture of our radical aggregation network (RAN). The RAN consists of three components, a radical mapping encoder (RME), a radical aggregation module (RAM), and a character analysis decoder (CAD). The RME module ...
AbstractOffline handwritten Chinese character recognition has attracted much interest due to its various applications. The most cutting-edge methods treat Chinese character as a whole, ignoring the structures and radicals that compose ...
Semantic-Based Handwritten Chinese Character Recognition Model
ICCMS '10: Proceedings of the 2010 Second International Conference on Computer Modeling and Simulation - Volume 01There have been many different literals discussing algorithms for handwritten Chinese character recognition, but most algorithms aim at recognizing isolated Chinese character one by one. Therefore, their recognition accuracy isn’t good enough for the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Dec 2022
566 pages
ISBN:978-3-031-21647-3
DOI:10.1007/978-3-031-21648-0
- Editors:
- Utkarsh Porwal,
- Alicia Fornés,
- Faisal Shafait
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2022.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 04 December 2022
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 12 Dec 2024