[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3209280.3209538acmconferencesArticle/Chapter ViewAbstractPublication PagesdocengConference Proceedingsconference-collections
research-article

iDocChip: A Configurable Hardware Architecture for Historical Document Image Processing: Percentile Based Binarization

Published: 28 August 2018 Publication History

Abstract

End-to-end Optical Character Recognition (OCR) systems are heavily used to convert document images into machine-readable text. Commercial and open-source OCR systems (like Abbyy, OCRopus, Tesseract etc.) have traditionally been optimized for contemporary documents like books, letters, memos, and other end-user documents. However, these systems are difficult to use equally well for digitizing historical document images, which contain degradations like non-uniform shading, bleed-through, and irregular layout; such degradations usually do not exist in contemporary document images.
The open-source anyOCR is an end-to-end OCR pipeline, which contains state-of-the-art techniques that are required for digitizing degraded historical archives with high accuracy. However, high accuracy comes at a cost of high computational complexity that results in 1) long runtime that limits digitization of big collection of historical archives and 2) high energy consumption that is the most critical limiting factor for portable devices with constrained energy budget. Therefore, we are targeting energy efficient and high throughput acceleration of the anyOCR pipeline. Generalpurpose computing platforms fail to meet these requirements that makes custom hardware design mandatory. In this paper, we are presenting a new concept named iDocChip. It is a portable hybrid hardware-software FPGA-based accelerator that is characterized by low footprint meaning small size, high power efficiency that will allow using it in portable devices, and high throughput that will make it possible to process big collection of historical archives in real time without effecting the accuracy.
In this paper, we focus on binarization, which is the second most critical step in the anyOCR pipeline after text-line recognizer that we have already presented in our previous publication [21]. The anyOCR system makes use of a Percentile Based Binarization method that is suitable for overcoming degradations like non-uniform shading and bleed-through. To the best of our knowledge, we propose the first hardware architecture of the PBB technique. Based on the new architecture, we present a hybrid hardware-software FPGA-based accelerator that outperforms the existing anyOCR software implementation running on i7-4790T in terms of runtime by factor of 21, while achieving energy efficiency of 10 Images/J that is higher than that achieved by low power embedded processors with negligible loss of recognition accuracy.

References

[1]
{n. d.}. ABBYY. https://www.abbyy.com/en-eu/. ({n. d.}).
[2]
{n. d.}. Digital Multimeter Vilcraft. http://www.produktinfo.conrad.com/datenblaetter/100000-124999/124608-an-01-ml-VOLTCRAFT_VC_870_DMM__K__de_en_fr_nl.pdf. ({n. d.}).
[3]
{n. d.}. Efficiently Implementing Dilate and Erode Image Functions - Stephen Ostermiller. https://blog.ostermiller.org/dilate-and-erode. ({n. d.}).
[4]
{n. d.}. Narrenschif. http://kallimachos.de/kallimachos/index.php/Narragonien. ({n. d.}).
[5]
{n. d.}. OCRopus. https://github.com/tmbdev/ocropy. ({n. d.}).
[6]
{n. d.}. Omnipage. www.nuance.de/for-individuals/by-product/omnipage/index. htmwww.nuance.de/for-individuals/by-product/omnipage/index.htm. ({n. d.}).
[7]
{n. d.}. Tesseract. https://github.com/tesseract-ocr. ({n. d.}).
[8]
M Z Afzal, M. Kramer, Syed Saqib Bukhari, M R Yousefi, Faisal Shafait, and T M Breuel. 2014. Robust Binarization of Stereo and Monocular Document Images Using Percentile Filter. Vol. 1. Springer, 139--149.
[9]
Luis Alvarez and Luis Mazorra. 1994. Signal and Image Restoration Using Shock Filters and Anisotropic Diffusion. SIAM J. Numer. Anal. 31, 2 (April 1994), 590--605.
[10]
Thomas M Breuel, Adnan Ul-Hasan, Mayce Al-Azawi, and Faisal Shafait. 2013. High-performance OCR for printed English and Fraktur using LSTM networks. In Document Analysis and Recognition (ICDAR), 2013 12th International Conference on. IEEE, 683--687.
[11]
Syed Saqib Bukhari, Ahmad Kadi, Mohammad Ayman Jouneh, Fahim Mahmood Mir, and Andreas Dengel. 2017. anyOCR: An Open-Source OCR System for Historical Archives. The 14th IAPR International Conference on Document Analysis and Recognition (ICDAR2017), Kyoto, Japan (2017).
[12]
Alex Graves, Santiago Fernández, Faustino Gomez, and Jürgen Schmidhuber. 2006. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In Proceedings of the 23rd international conference on Machine learning. ACM, 369--376.
[13]
J. He, Q. D. M. Do, A. C. Downton, and J. H. Kim. 2005. A comparison of binarization methods for historical archive documents. In Eighth International Conference on Document Analysis and Recognition (ICDAR'05). 538--542 Vol. 1.
[14]
E. Kavallieratou and S. Stathis. 2006. Adaptive Binarization of Historical Document Images. In 18th International Conference on Pattern Recognition (ICPR'06), Vol. 3. 742--745.
[15]
Kazuya Kawakami. 2008. Supervised Sequence Labelling with Recurrent Neural Networks. Ph.D. Dissertation. Ph. D. thesis, Technical University of Munich.
[16]
F. Kheiri, S. Samavi, and N. Karimi. 2017. Hardware design for binarization and thinning of fingerprint images. ArXiv e-prints (Oct. 2017). arXiv:cs.CV/1710.05749
[17]
Claudie Faure Nicole Vincent Khurram Khurshid, Imran Siddiqi. 2009. Comparison of Niblack inspired binarization methods for ancient documents. (2009), 7247 - 7247 - 9 pages.
[18]
M. H. Najafi and M. E. Salehi. 2016. A Fast Fault-Tolerant Architecture for Sauvola Local Image Thresholding Algorithm Using Stochastic Computing. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 24, 2 (Feb 2016), 808--812.
[19]
N. Otsu. 1979. A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics 9, 1 (Jan 1979), 62--66.
[20]
Puneet and Naresh Garg. 2013. Binarization Techniques used for Grey Scale Images. International Journal of Computer Applications 71, 1 (June 2013), 8--11.
[21]
Vladimir Rybalkin, Norbert Wehn, Mohammad Reza Yousefi, and Didier Stricker. 2017. Hardware architecture of bidirectional long short-term memory neural network for optical character recognition. In Proceedings of the Conference on Design, Automation & Test in Europe. European Design and Automation Association, 1394--1399.
[22]
J. Sauvola, T. Seppanen, S. Haapakoski, and M. Pietikainen. 1997. Adaptive document binarization. In Proceedings of the Fourth International Conference on Document Analysis and Recognition, Vol. 1. 147--152 vol.1.
[23]
Brij Mohan Singh, Rahul Sharma, Ankush Mittal, and Debashish Ghosh. 2011. Parallel Implementation of Otsu's Binarization Approach on GPU. International Journal of Computer Applications 32, 2 (October 2011), 16--21.
[24]
Brij Mohan Singh, Rahul Sharma, Ankush Mittal, and Debashish Ghosh. 2011. Parallel Implementation of Souvola's Binarization Approach on GPU. International Journal of Computer Applications 32, 2 (October 2011), 28--33.
[25]
Robert A. Wagner and Michael J. Fischer. 1974. The String-to-String Correction Problem. J. ACM 21, 1 (Jan. 1974), 168--173.
[26]
Jeng-Daw Yang, Yung-Sheng Chen, and Wen-Hsing Hsu. 1994. Adaptive Thresholding Algorithm and Its Hardware Implementation. Pattern Recogn. Lett. 15, 2 (Feb. 1994), 141--150.
[27]
Mohammad Reza Yousefi, Mohammad Reza Soheili, Thomas M Breuel, Ehsanollah Kabir, and Didier Stricker. 2015. Binarization-free ocr for historical documents using lstm networks. In Document Analysis and Recognition (ICDAR), 2015 13th International Conference on. IEEE, 1121--1125.
[28]
Mohammad Reza Yousefi, Mohammad Reza Soheili, Thomas M Breuel, and Didier Stricker. 2015. A comparisonof 1D and 2D LSTM architectures for the recognition of handwritten Arabic. In Document Recognition and Retrieval XXII, Vol. 9402. International Society for Optics and Photonics, 94020H.

Cited By

View all
  • (2024)Digitizing History: Transitioning Historical Paper Documents to Digital Content for Information Retrieval and Mining—A Comprehensive SurveyIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.337841911:5(6151-6180)Online publication date: Oct-2024
  • (2021)iDocChip: A Configurable Hardware Accelerator for an End-to-End Historical Document Image ProcessingJournal of Imaging10.3390/jimaging70901757:9(175)Online publication date: 3-Sep-2021
  • (2021)iDocChip: A Configurable Hardware Architecture for Historical Document Image ProcessingInternational Journal of Parallel Programming10.1007/s10766-020-00690-yOnline publication date: 30-Jan-2021

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
DocEng '18: Proceedings of the ACM Symposium on Document Engineering 2018
August 2018
311 pages
ISBN:9781450357692
DOI:10.1145/3209280
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

  • SIGDOC: ACM Special Interest Group on Systems Documentation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 August 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Binarization
  2. FPGA
  3. Hardware Architecture
  4. HardwareSoftware Co-Design
  5. Machine Learning
  6. Optical Character Recognition
  7. Zynq

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

DocEng '18
Sponsor:
DocEng '18: ACM Symposium on Document Engineering 2018
August 28 - 31, 2018
NS, Halifax, Canada

Acceptance Rates

Overall Acceptance Rate 194 of 564 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)3
Reflects downloads up to 11 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Digitizing History: Transitioning Historical Paper Documents to Digital Content for Information Retrieval and Mining—A Comprehensive SurveyIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.337841911:5(6151-6180)Online publication date: Oct-2024
  • (2021)iDocChip: A Configurable Hardware Accelerator for an End-to-End Historical Document Image ProcessingJournal of Imaging10.3390/jimaging70901757:9(175)Online publication date: 3-Sep-2021
  • (2021)iDocChip: A Configurable Hardware Architecture for Historical Document Image ProcessingInternational Journal of Parallel Programming10.1007/s10766-020-00690-yOnline publication date: 30-Jan-2021
  • (2019)iDocChip - A Configurable Hardware Architecture for Historical Document Image Processing: Text Line Extraction2019 International Conference on ReConFigurable Computing and FPGAs (ReConFig)10.1109/ReConFig48160.2019.8994761(1-8)Online publication date: Dec-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media