research-article

Free-sketch recognition: putting the chi in sketching

Authors:

Pankaj RajanAuthors Info & Claims

CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

Pages 3027 - 3032

https://doi.org/10.1145/1358628.1358802

Published: 05 April 2008 Publication History

Get Access

Abstract

Sketch recognition techniques have generally fallen into two camps. Gesture-based techniques, such as those used by the Palm Pilot's Graffiti, can provide high-accuracy, but require the user to learn a particular drawing style in order for shapes to be recognized. Free-sketch recognition allows users to draw shapes as they would naturally, but most current techniques have low accuracies or require significant domain-level tweaking to make them usable. Our goal is to recognize free-hand sketches with high accuracy by developing generalized techniques that work for a variety of domains, including design and education. This is a work-in-progress, but we have made significant advancements toward our over-arching goal.

References

[1]

Alvarado C., Davis R. Sketchread: A multi-domain sketch recognition engine. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (2004), Santa Fe, NM, 23--32.

Digital Library

Google Scholar

[2]

Hammond, T. LADDER: A Perceptually-based Language to Simplify Sketch Recognition User Interface Development (2007). MIT PhD Thesis.

Digital Library

Google Scholar

[3]

Herot, C. Graphical Input Through Machine Recognition of Sketches. In Proceedings of SIGGRAPH'76 (1976), 97--102.

Digital Library

Google Scholar

[4]

Kara, L. B, Stahovich, T. F. An image-based trainable symbol recognizer for sketch-based interfaces. AAAI Fall Symposium Series 2004: Making Pen-Based Interaction Natural (2004).

Google Scholar

[5]

Kim, D. H., Kim M. J. A curvature estimation for pen input segmentation in sketch-based modeling. Computer-Aided Design (2006), 38(3), 238--248.

Digital Library

Google Scholar

[6]

Long A. C. Quill: a gesture design tool for penbased user interfaces (2001), U. C. Berkeley PhD Thesis.

Digital Library

Google Scholar

[7]

Oltmans, M. Envisioning Sketch Recognition: A Local Feature Based Approach to Recognizing Informal Sketches (2007), MIT PhD Thesis.

Digital Library

Google Scholar

[8]

Paulson, B., Hammond, T. PaleoSketch: Accurate Primitive Sketch Recognition and Beautification. In Proceedings of Intelligent User Interfaces (IUI'08) (2008).

Digital Library

Google Scholar

[9]

Plimmer B. Ink Features. Eurographics Sketchbased Interfaces and Modeling (2007).

Google Scholar

[10]

Rubine D. Specifying gestures by example. Computer Graphics (1991), 25(4), 329--337

Digital Library

Google Scholar

[11]

Sezgin T. M., Stahovich T., Davis R. Sketch based interfaces: early processing for sketch understanding. In Proceedings of the 2001 Workshop on Perceptive User Interfaces (2001), ACM Press, 1--8.

Digital Library

Google Scholar

[12]

Sezgin, T. M., Davis, R. HMM-based efficient sketch recognition. In Proceedings of the International Conference on Intelligent User Interfaces (IUI'05) (2005), ACM Press, 281--283.

Digital Library

Google Scholar

[13]

Yu B., Cai S. A domain-independent system for sketch recognition. In Proceedings of the 1st International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia (2003), ACM Press, 141--146.

Digital Library

Google Scholar

Cited By

View all

Lee SLaw MHoffman G(2024)When and How to Use AI in the Design Process? Implications for Human-AI Design CollaborationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2353451(1-16)Online publication date: 22-May-2024
https://doi.org/10.1080/10447318.2024.2353451
Hammond T(2017)Learning Through the Lens of SketchFrontiers in Pen and Touch10.1007/978-3-319-64239-0_21(301-341)Online publication date: 2-Dec-2017
https://doi.org/10.1007/978-3-319-64239-0_21
Polepalli Ramesh BSethi RYu H(2015)Figure-Associated Text Summarization and EvaluationPLOS ONE10.1371/journal.pone.011567110:2(e0115671)Online publication date: 2-Feb-2015
https://doi.org/10.1371/journal.pone.0115671
Show More Cited By

Index Terms

Free-sketch recognition: putting the chi in sketching
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Graphics recognition and interpretation
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Interest point and salient region detections

Recommendations

Eyes Understand the Sketch!: Gaze-Aided Stroke Grouping of Hand-Drawn Flowcharts
IUI '17: Proceedings of the 22nd International Conference on Intelligent User Interfaces

Stroke grouping in sketch recognition is both difficult and time-consuming. Our preliminary experiment indicates that, when people drawing flowcharts, their gaze focused on non-arrow areas, which providing a spatial cue for stroke grouping. Therefore, ...
Supporting Chinese Character Educational Interfaces with Richer Assessment Feedback through Sketch Recognition
GI '18: Proceedings of the 44th Graphics Interface Conference

Students of Chinese as a Second Language (CSL) with primarily English fluency often struggle with the language's complex character set. Conventional classroom pedagogy and relevant educational applications have focused on providing valuable assessment ...
Developing sketch recognition and interaction techniques for intelligent surfaceless sketching user interfaces
IUI '14 Companion: Companion Proceedings of the 19th International Conference on Intelligent User Interfaces

As commercial motion-tracking sensors achieve greater reliability and ubiquity, intelligent sketching user interfaces can expand beyond traditional surface environments for richer surfaceless sketching interactions. However, relevant techniques for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

April 2008

2035 pages

ISBN:9781605580128

DOI:10.1145/1358628

General Chairs:
Mary Czerwinski
Microsoft Research, USA
,
Arnie Lund
Microsoft, USA
,
Program Chair:
Desney Tan
Microsoft Research, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '08

Sponsor:

CHI '08: CHI Conference on Human Factors in Computing Systems

April 5 - 10, 2008

Florence, Italy

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
728
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)3

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lee SLaw MHoffman G(2024)When and How to Use AI in the Design Process? Implications for Human-AI Design CollaborationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2353451(1-16)Online publication date: 22-May-2024
https://doi.org/10.1080/10447318.2024.2353451
Hammond T(2017)Learning Through the Lens of SketchFrontiers in Pen and Touch10.1007/978-3-319-64239-0_21(301-341)Online publication date: 2-Dec-2017
https://doi.org/10.1007/978-3-319-64239-0_21
Polepalli Ramesh BSethi RYu H(2015)Figure-Associated Text Summarization and EvaluationPLOS ONE10.1371/journal.pone.011567110:2(e0115671)Online publication date: 2-Feb-2015
https://doi.org/10.1371/journal.pone.0115671
Chang SBlagojevic RPlimmer B(2012)Rata.gestureArtificial Intelligence for Engineering Design, Analysis and Manufacturing10.1017/S089006041200019426:3(351-366)Online publication date: 1-Aug-2012
https://dl.acm.org/doi/10.1017/S0890060412000194
Paulson BCummings DHammond T(2011)Object interaction detection using hand posture cues in an office settingInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2010.09.00369:1-2(19-29)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1016/j.ijhcs.2010.09.003
Chang SPlimmer BBlagojevic RLaViola JLéon JAlexa MDo E(2010)Rata.SSRProceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium10.5555/1923363.1923380(95-102)Online publication date: 7-Jun-2010
https://dl.acm.org/doi/10.5555/1923363.1923380
Avola DDel Buono AGianforme GPaolozzi SWang R(2009)SketchML a representation language for novel sketch recognition approachProceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments10.1145/1579114.1579145(1-8)Online publication date: 9-Jun-2009
https://dl.acm.org/doi/10.1145/1579114.1579145
Avola DBuono AGianforme GPaolozzi S(2009)A Novel Recognition Approach for Sketch-Based InterfacesProceedings of the 15th International Conference on Image Analysis and Processing10.1007/978-3-642-04146-4_108(1015-1024)Online publication date: 29-Aug-2009
https://dl.acm.org/doi/10.1007/978-3-642-04146-4_108
Paulson BWolin AJohnston JHammond T(2008)SOUSAProceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling10.5555/2386301.2386316(81-88)Online publication date: 11-Jun-2008
https://dl.acm.org/doi/10.5555/2386301.2386316
Rajan PHammond T(2008)From paper to machineProceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling10.5555/2386301.2386309(41-48)Online publication date: 11-Jun-2008
https://dl.acm.org/doi/10.5555/2386301.2386309
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Eyes Understand the Sketch!: Gaze-Aided Stroke Grouping of Hand-Drawn Flowcharts

Supporting Chinese Character Educational Interfaces with Richer Assessment Feedback through Sketch Recognition

Developing sketch recognition and interaction techniques for intelligent surfaceless sketching user interfaces