Article

A domain-independent system for sketch recognition

Authors:

GRAPHITE '03: Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East Asia

Pages 141 - 146

https://doi.org/10.1145/604471.604499

Published: 11 February 2003 Publication History

Get Access

Abstract

Freehand sketching is a natural and powerful means of interpersonal communication. But to date, it still cannot be supported effectively by human-computer interface. In this paper, we describe a domain-independent system for sketch recognition. Our system allows users to draw sketches as naturally as how they do on paper, and it recognizes the drawing through imprecise stroke approximation which is implemented in a unified and incremental procedure. This method can handle smooth curves and hybrid shapes as gracefully as it does to polylines. With a feature-area verification mechanism and the intelligent adjustment in the post-process, the system can produce user-intended results. Moreover, the output is organized in a hierarchical structure which includes syntactic and semantic information as well as raw data. Our system mainly utilizes low-level geometric features and does not rely on any domain-specific knowledge. Therefore, it will serve as a general and solid foundation for future high-level applications.

References

[1]

J. Arvo and K. Novins, "Fluid Sketches: Continuous Recognition and Morphing of Simple Hand-Drawn Shapes", Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, 2000.

Digital Library

Google Scholar

[2]

C. Calhoun, T. F. Stahovich, T. Kurtoglu and L. B. Kara, "Recognizing Multi-Stroke Symbols", 2002 AAAI Spring Symposium on Sketch Understanding.

Google Scholar

[3]

M. J. Fonseca and J. A. Jorge, "Using Fuzzy Logic to Recognize Geometric Shapes Interactively", Proceedings of the 9th International Conference on Fuzzy Systems, 2000.

Digital Library

Google Scholar

[4]

Tracy Hammond and Randall Davis, "Tahuti: A Sketch Recognition System for UML Class Diagrams", 2002 AAAI Spring Symposium on Sketch Understanding.

Digital Library

Google Scholar

[5]

Michael Oltmans and Randall Davis, "Naturally Conveyed Explanations of Device Behavior", Proceedings of PUI-2001, November 2001.

Digital Library

Google Scholar

[6]

D. Rubine, "Specifying gestures by example", Computer Graphics (SIGGRAPH '91 Proceedings), pages 329-337.

Digital Library

Google Scholar

[7]

T. M. Sezgin, "Feature Point Detection and Curve Approximation for Early Processing of Free-Hand Sketches", Master's thesis, Massachusetts Institute of Technology.

Google Scholar

[8]

T. Igarashi, S. Matsuoka, S. Kawachiya and H. Tanaka, "Interactive Beautification: A Technique for Rapid Geometric Design", UIST'97, pages 105-114.

Digital Library

Google Scholar

Cited By

View all

Schäfer Bvan der Aa HLeopold HStuckenschmidt H(2023)Sketch2Process: End-to-End BPMN Sketch Recognition Based on Neural NetworksIEEE Transactions on Software Engineering10.1109/TSE.2022.322830849:4(2621-2641)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TSE.2022.3228308
Ito TKaneko TTanaka YSaga S(2022)An interactive sketch-based CAD interface realizing geometrical and topological editing across multiple objects based on fuzzy logicComputers and Graphics10.1016/j.cag.2022.02.007103:C(153-167)Online publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.cag.2022.02.007
Ibrahim KMohamed AFarouk A(2022)Genetic Algorithm Golden Ratio Design Model for Auto ArtsHandbook of Nature-Inspired Optimization Algorithms: The State of the Art10.1007/978-3-031-07512-4_8(229-242)Online publication date: 1-Sep-2022
https://doi.org/10.1007/978-3-031-07512-4_8
Show More Cited By

A domain-independent system for sketch recognition
1. Computing methodologies
  1. Computer graphics

Recommendations

Sketch recognition by fusion of temporal and image-based features

The increasing availability of pen-based hardware has recently resulted in a parallel growth in sketch-based user interfaces. Sketch-based user interfaces aim to combine the expressive power of free-hand sketching with the processing power of computers. ...
Developing sketch recognition and interaction techniques for intelligent surfaceless sketching user interfaces
IUI '14 Companion: Companion Proceedings of the 19th International Conference on Intelligent User Interfaces

As commercial motion-tracking sensors achieve greater reliability and ubiquity, intelligent sketching user interfaces can expand beyond traditional surface environments for richer surfaceless sketching interactions. However, relevant techniques for ...
Recognition of freehand sketches using mean shift
IUI '03: Proceedings of the 8th international conference on Intelligent user interfaces

Freehand sketching is a natural and powerful means of interpersonal communication. But to date, it still cannot be supported effectively by human-computer interface. In this paper, we propose a robust method for sketch recognition. It uses mean shift, a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

GRAPHITE '03: Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East Asia

February 2003

307 pages

ISBN:1581135785

DOI:10.1145/604471

Conference Chairs:
Matt Adcock
CSIRO
,
Ian Gwilt
Waikato University
,
Lee Yong Tsui
Nanyang Technological University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 February 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

GRAPHITE03

Sponsor:

SIGGRAPH

GRAPHITE03: International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia

February 11 - 14, 2003

Melbourne, Australia

Acceptance Rates

Overall Acceptance Rate 124 of 241 submissions, 51%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
677
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Schäfer Bvan der Aa HLeopold HStuckenschmidt H(2023)Sketch2Process: End-to-End BPMN Sketch Recognition Based on Neural NetworksIEEE Transactions on Software Engineering10.1109/TSE.2022.322830849:4(2621-2641)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TSE.2022.3228308
Ito TKaneko TTanaka YSaga S(2022)An interactive sketch-based CAD interface realizing geometrical and topological editing across multiple objects based on fuzzy logicComputers and Graphics10.1016/j.cag.2022.02.007103:C(153-167)Online publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.cag.2022.02.007
Ibrahim KMohamed AFarouk A(2022)Genetic Algorithm Golden Ratio Design Model for Auto ArtsHandbook of Nature-Inspired Optimization Algorithms: The State of the Art10.1007/978-3-031-07512-4_8(229-242)Online publication date: 1-Sep-2022
https://doi.org/10.1007/978-3-031-07512-4_8
Müller FBarnikol MFunk MSchmitz MMühlhäuser M(2018)CaMeaProceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference10.1145/3197768.3201569(345-350)Online publication date: 26-Jun-2018
https://dl.acm.org/doi/10.1145/3197768.3201569
Bhat AKasiviswanathan GMathew CPolsley SProut EGoldberg DHammond T(2017)An Intelligent Sketching Interface for Education Using Geographic Information SystemsFrontiers in Pen and Touch10.1007/978-3-319-64239-0_11(147-163)Online publication date: 2-Dec-2017
https://doi.org/10.1007/978-3-319-64239-0_11
Shaw AAnthony LKaye JDruin ALampe CMorris DHourcade J(2016)Toward a Systematic Understanding of Children's Touchscreen GesturesProceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2892425(1752-1759)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2851581.2892425
Wang SWang GGao MYu S(2013)Using Fuzzy Hybrid Features to Classify Strokes in Interactive SketchesAdvances in Mechanical Engineering10.1155/2013/2591525Online publication date: 1-Jan-2013
https://doi.org/10.1155/2013/259152
Schmidt MFibich AWeber G(2013)MTISProceedings of the First International Conference on Distributed, Ambient, and Pervasive Interactions - Volume 802810.1007/978-3-642-39351-8_7(62-71)Online publication date: 21-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-39351-8_7
Schmidt MWeber G(2013)Recognition of multi-touch drawn sketchesProceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV10.1007/978-3-642-39330-3_51(479-490)Online publication date: 21-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-39330-3_51
Hammond TPaulson B(2011)Recognizing sketched multistroke primitivesACM Transactions on Interactive Intelligent Systems10.1145/2030365.20303691:1(1-34)Online publication date: 31-Oct-2011
https://dl.acm.org/doi/10.1145/2030365.2030369
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Sketch recognition by fusion of temporal and image-based features

Developing sketch recognition and interaction techniques for intelligent surfaceless sketching user interfaces

Recognition of freehand sketches using mean shift