research-article

Free access

Evaluation of techniques for visualizing mathematical expression recognition results

Authors:

Joseph J. LaViola, Jr.,

Anamary Leal,

Timothy S. Miller,

Robert C. ZeleznikAuthors Info & Claims

GI '08: Proceedings of Graphics Interface 2008

Pages 131 - 138

Published: 28 May 2008 Publication History

PDF eReader

Abstract

We present an experimental study that evaluates four different techniques for visualizing the machine interpretation of handwritten mathematics. Typeset in Place puts a printed form of the recognized expression in the same location as the handwritten mathematics. Adjusted Ink replaces what was written with scaled-to-fit, cleaned up handwritten characters using an ink font. The Large Offset technique scales a recognized printed form to be just as wide as the handwritten input, and places it below the handwritten mathematical expression. The Small Offset technique is similar to Large Offset but the printed form is set to be a fixed size which is generally small compared to the written expression.

Our experiment explores how effective each technique is with assisting users in identifying and correcting recognition mistakes with different types and quantities of mathematical expressions. Our evaluation is based on task completion time and a comprehensive post-questionnaire used to solicit reactions on each technique. The results of our study indicate that, although each technique has advantages and disadvantages depending on the complexity of the handwritten mathematics, subjects took significantly longer to complete the recognition task with Typeset in Place and generally preferred Adjusted Ink or Small Offset.

References

[1]

Blackwell F. W. and R. H. Anderson. An On-Line Symbolic Mathematics System Using Hand-Printed Two-Dimensional Notation. In Proceedings of the 1969 24th national conference, ACM Press, 551--557, 1969.

Digital Library

Google Scholar

[2]

Chan, Kam-Fai and Dit-Yan Yeung. Mathematical Expression Recognition: A Survey. In International Journal on Document Analysis and Recognition, 3(1):3--15, 2000.

Crossref

Google Scholar

[3]

Goldberg D. and A. Goodman. Stylus user interfaces for manipulating text. In Symposium on User Interface Software and Technology, ACM, 127--135, 1991.

Digital Library

Google Scholar

[4]

Holm, S. A Simple Sequentially Rejective Multiple Test Procedure. Scandinavian Journal of Statistics, 6:60--65, 1979.

Google Scholar

[5]

Igarashi T., S. Matsuoka, S. Kawachiya, and H. Tanaka. Interactive Beautification: A Technique for Rapid Geometric Design. In Symposium on User Interface Software and Technology, ACM, 105--114, 1997.

Digital Library

Google Scholar

[6]

LaViola Jr., J. J. An Initial evaluation of a Pen-Based Tool for Creating Dynamic Mathematical Illustrations. In the Proceedings of the Euro-graphics Workshop on Sketch-Based Interfaces and Modeling, 157--164, 2006.

Digital Library

Google Scholar

[7]

Martin W. A. Computer Input/Output of Mathematical Expressions. In SYMSAC '71: Proceedings of the Second ACM Symposium on Symbolic and Algebraic Manipulation, ACM Press, 78--89, 1971.

Digital Library

Google Scholar

[8]

Shilman M., D. S. Tan, and P. Simard. CueTIP: a mixed-initiative interface for correcting handwriting errors. In Symposium on User Interface Software and Technology, ACM, 323--332, 2006.

Digital Library

Google Scholar

[9]

Smirnova E. and S. M. Watt. A Pen-Based Mathematical Environment Mathink. Research Report TR-06-05, Ontario Research Centre for Computer Algebra, University of Western Ontario, 2006.

Google Scholar

[10]

Smithies S., K. Novins, and J. Arvo. A Handwriting-Based Equation Editor. In Graphics Interface 1999, 84--91, 1999.

Digital Library

Google Scholar

[11]

Thimbleby W. A novel pen-based calculator and its evaluation. In NordiCHI '04: Proceedings of the third Nordic conference on Human-computer interaction, 445--448, 2004.

Digital Library

Google Scholar

[12]

Wais P., A. Wolin and C. Alvarado. Designing a Sketch Recognition Front-End: User Perception of Interface Elements. In EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling, 2007.

Digital Library

Google Scholar

[13]

Zanibbi R., K. Novins, and J. Arvo. Aiding Manipulation of Handwritten Mathematical Expressions Through Style-Preserving Morphs. In Graphics Interface 2001. Canadian Information Processing Society, 127--134, 2001.

Digital Library

Google Scholar

[14]

Zeleznik, R. C., T. S. Miller, and C. Li. Designing UI Techniques for Handwritten Mathematics, In Eurographics Workshop on Sketch-Based Interfaces and Modeling, Riverside, CA, August 2007.

Digital Library

Google Scholar

Cited By

View all

Taranta EVargas ACompton SLaviola J(2016)A Dynamic Pen-Based Interface for Writing and Editing Complex Mathematical Expressions With Math BoxesACM Transactions on Interactive Intelligent Systems10.1145/29467956:2(1-25)Online publication date: 20-Jul-2016
https://dl.acm.org/doi/10.1145/2946795
Bott JLaviola Jr. J(2015)The WOZ RecognizerACM Transactions on Interactive Intelligent Systems10.1145/27430295:3(1-38)Online publication date: 16-Oct-2015
https://dl.acm.org/doi/10.1145/2743029
Taranta ELaViola JBrdiczka OChau PCarenini GPan SKristensson P(2015)Math BoxesProceedings of the 20th International Conference on Intelligent User Interfaces10.1145/2678025.2701400(87-96)Online publication date: 18-Mar-2015
https://dl.acm.org/doi/10.1145/2678025.2701400
Show More Cited By

Recommendations

Handwritten Mathematical Expression Recognition: A Survey
Pattern Recognition and Artificial Intelligence
Abstract
While the handwritten character recognition has reached a point of maturity, the recognition of handwritten mathematics is still a challenging problem. The problem usually consists of three major parts: strokes segmentation, single symbol ...
Online Recognition System for Handwritten ARABIC Mathematical Symbols
ACSAT '13: Proceedings of the 2013 International Conference on Advanced Computer Science Applications and Technologies

Same as Arabic scripts, Arabic mathematical symbols have some differences with Latin mathematical symbols shape. Although, Arabic Mathematical symbols follow Latin mathematical from the structure of writing the symbols, Arabic symbols have special shape ...
Histogram-based lines and words decomposition for arabic omni font-written OCR systems; enhancements and evaluation
CAIP'07: Proceedings of the 12th international conference on Computer analysis of images and patterns

Given font/type-written text rectangle bitmaps extracted from digitally scanned pages, inferring the boundaries of lines hence complete words is a preprocessing vital to whatever OCR system while the recognition process itself as well as the post ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

GI '08: Proceedings of Graphics Interface 2008

May 2008

301 pages

ISBN:9781568814230

Program Chairs:
Chris Shaw
Simon Fraser University, Canada
,
Lyn Bartram
Simon Fraser University, Canada

Publisher

Canadian Information Processing Society

Canada

Publication History

Published: 28 May 2008

Author Tags

Qualifiers

Research-article

Acceptance Rates

GI '08 Paper Acceptance Rate 34 of 85 submissions, 40%;

Overall Acceptance Rate 206 of 508 submissions, 41%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
291
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)6

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Taranta EVargas ACompton SLaviola J(2016)A Dynamic Pen-Based Interface for Writing and Editing Complex Mathematical Expressions With Math BoxesACM Transactions on Interactive Intelligent Systems10.1145/29467956:2(1-25)Online publication date: 20-Jul-2016
https://dl.acm.org/doi/10.1145/2946795
Bott JLaviola Jr. J(2015)The WOZ RecognizerACM Transactions on Interactive Intelligent Systems10.1145/27430295:3(1-38)Online publication date: 16-Oct-2015
https://dl.acm.org/doi/10.1145/2743029
Taranta ELaViola JBrdiczka OChau PCarenini GPan SKristensson P(2015)Math BoxesProceedings of the 20th International Conference on Intelligent User Interfaces10.1145/2678025.2701400(87-96)Online publication date: 18-Mar-2015
https://dl.acm.org/doi/10.1145/2678025.2701400
Bott JGabriele DLaViola JDo ELeon JHammond TNealen A(2011)Now or laterProceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling10.1145/2021164.2021187(125-132)Online publication date: 5-Aug-2011
https://dl.acm.org/doi/10.1145/2021164.2021187
Li CMiller TZeleznik RLaViola J(2008)AlgoSketchProceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling10.5555/2386301.2386331(175-182)Online publication date: 11-Jun-2008
https://dl.acm.org/doi/10.5555/2386301.2386331

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Handwritten Mathematical Expression Recognition: A Survey

Online Recognition System for Handwritten ARABIC Mathematical Symbols

Histogram-based lines and words decomposition for arabic omni font-written OCR systems; enhancements and evaluation