More Web Proxy on the site http://driver.im/

research-article

cLuster: Smart Clustering of Free-Hand Sketches on Large Interactive Surfaces

Authors:

Florian Perteneder,

Martin Bresler,

Eva-Maria Grossauer,

Michael HallerAuthors Info & Claims

UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

Pages 37 - 46

https://doi.org/10.1145/2807442.2807455

Published: 05 November 2015 Publication History

Abstract

Structuring and rearranging free-hand sketches on large interactive surfaces typically requires making multiple stroke selections. This can be both time-consuming and fatiguing in the absence of well-designed selection tools. Investigating the concept of automated clustering, we conducted a background study which highlighted the fact that people have varying perspectives on how elements in sketches can and should be grouped. In response to these diverse user expectations, we present cLuster, a flexible, domain-independent clustering approach for free-hand sketches. Our approach is designed to accept an initial user selection, which is then used to calculate a linear combination of pre-trained perspectives in real-time. The remaining elements are then clustered. An initial evaluation revealed that in many cases, only a few corrections were necessary to achieve the desired clustering results. Finally, we demonstrate the utility of our approach in a variety of application scenarios.

Supplementary Material

MP4 File (p37.mp4)

Download
80.47 MB

References

[1]

Accot, J., and Zhai, S. More than dotting the i's -- foundations for crossing-based interfaces. In CHI '02, ACM, 2002, 73--80.

Digital Library

[2]

Alvarado, C., and Davis, R. SketchREAD: a multi-domain sketch recognition engine. In UIST '04, ACM, 2004, 23--32.

Digital Library

[3]

Álvaro, F., Sánchez, J.-A., and Benedí, J.-M. Recognition of on-line handwritten mathematical expressions using 2d stochastic context-free grammars and hidden markov models. Pattern Recognition Letters 35 (2014), 58--67.

Digital Library

[4]

Bresler, M., Průša, D., and Hlaváč, V. Modeling flowchart structure recognition as a max-sum problem. In ICDAR '13, IEEE, August 2013, 1215--1219.

Digital Library

[5]

Costagliola, G., Deufemia, V., and Risi, M. Sketch grammars: a formalism for describing and recognizing diagrammatic sketch languages. In ICDAR '05, IEEE, 2005, 1226--1230 Vol. 2.

Digital Library

[6]

Davis, R. Magic paper: Sketch-understanding research. Computer 40, 9 (Sept. 2007), 34--41.

Digital Library

[7]

Dehmeshki, H., and Stuerzlinger, W. GPSel: A Gestural Perceptual-Based Path Selection Technique. In SG '09, SG '09, Springer, 2009, 243--252.

Digital Library

[8]

Dehmeshki, H., and Stuerzlinger, W. Design and evaluation of a perceptual-based object group selection technique. In BCS '10, British Computer Society, 2010, 365--373.

Digital Library

[9]

Delaye, A., and Lee, K. A flexible framework for online document segmentation by pairwise stroke distance learning. Pattern Recognition 48, 4 (April 2015), 1197--1210.

Digital Library

[10]

Feng, G., and Viard-Gaudin, C. Stroke fragmentation based on geometry features and HMM. In CoRR, 2008.

[11]

Feng, G., Viard-Gaudin, C., and Sun, Z. On-line hand-drawn electric circuit diagram recognition using 2D dynamic programming. Pattern Recogn. 42, 12 (Dec. 2009), 3215--3223.

Digital Library

[12]

Fu, L., and Kara, L. B. Neural network-based symbol recognition using a few labeled samples. Computers & Graphics 35, 5 (2011), 955--966.

Digital Library

[13]

Geyer, F., Pfeil, U., Budzinski, J., Höchtl, A., and Reiterer, H. Affinitytable - a hybrid surface for supporting affinity diagramming. In Interact '11, Springer, 2011, 477--484.

Digital Library

[14]

Glaser, B. G., and Strauss, A. L. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine de Gruyter, New York, NY, 1967.

[15]

Grossman, T., Baudisch, P., and Hinckley, K. Handle flags: Efficient and flexible selections for inking applications. In GI '09, Canadian Information Processing Society, 2009, 167--174.

Digital Library

[16]

Guimbreti'ere, F., Stone, M., and Winograd, T. Fluid interaction with high-resolution wall-size displays. In UIST '01, ACM, 2001, 21--30.

Digital Library

[17]

Hailpern, J., Hinterbichler, E., Leppert, C., Cook, D., and Bailey, B. P. TEAM STORM: Demonstrating an Interaction Model for Working with Multiple Ideas During Creative Group Work. In C&C '07, ACM, 2007, 193--202.

Digital Library

[18]

Haller, M. et al. The NiCE discussion room: Integrating Paper and Digital Media to Support Co-Located Group Meetings. In CHI '10, ACM, 2010, 609--618.

Digital Library

[19]

Hammond, T., and Davis, R. Ladder, a sketching language for user interface developers. In SIGGRAPH '07, no. 35, ACM, 2007.

Digital Library

[20]

Hilliges, O., Terrenghi, L., Boring, S., Kim, D., Richter, H., and Butz, A. Designing for collaborative creative problem solving. In C&C '07, ACM, 2007, 137--146.

Digital Library

[21]

Huang, Z., Fu, H., and Lau, R. W. H. Data-driven segmentation and labeling of freehand sketches. ACM Trans. Graph. 33, 6 (Nov. 2014), 175:1--175:10.

Digital Library

[22]

Igarashi, T., Matsuoka, S., and Masui, T. Adaptive recognition of implicit structures in human-organized layouts. In VL '95, IEEE, 1995, 258--266.

Digital Library

[23]

Lank, E., and Saund, E. Sloppy selection: Providing an accurate interpretation of imprecise selection gestures. Computers & Graphics 29, 4 (Aug. 2005), 490--500.

Digital Library

[24]

Lemaitre, A., Mouchére, H., Camillerapp, J., and Coüasnon, B. Interest of syntactic knowledge for on-line flowchart recognition. In GREC '11, Springer, 2011, 85--88.

Digital Library

[25]

Lindlbauer, D., Haller, M., Hancock, M., Scott, S. D., and Stuerzlinger, W. Perceptual grouping: Selection assistance for digital sketching. In ITS '13, ACM, 2013, 51--60.

Digital Library

[26]

Mankoff, J., Hudson, S. E., and Abowd, G. D. Interaction techniques for ambiguity resolution in recognition-based interfaces. In UIST '00, ACM, 2000, 11--20.

Digital Library

[27]

Mankoff, J., Hudson, S. E., and Abowd, G. D. Providing integrated toolkit-level support for ambiguity in recognition-based interfaces. In CHI '00, ACM, 2000, 368--375.

Digital Library

[28]

Mizobuchi, S., and Yasumura, M. Tapping vs. circling selections on pen-based devices: Evidence for different performance-shaping factors. In CHI '04, ACM, 2004, 607--614.

Digital Library

[29]

Moran, T. P., Chiu, P., and van Melle, W. Pen-based interaction techniques for organizing material on an electronic whiteboard. In UIST '97, ACM, 1997, 45--54.

Digital Library

[30]

Mynatt, E. D., Igarashi, T., Edwards, W. K., and LaMarca, A. Flatland: New dimensions in office whiteboards. In CHI '99, ACM, 1999, 346--353.

Digital Library

[31]

Nataneli, G., and Faloutsos, P. Robust Classification of Strokes with SVM and Grouping. In ISVC '07, Springer, 2007, 76--87.

Digital Library

[32]

Noris, G. et al. Smart scribbles for sketch segmentation. Comput. Graph. Forum 31, 8 (Dec. 2012), 2516--2527.

Digital Library

[33]

Ouyang, T. Y., and Davis, R. Chemink: A natural real-time recognition system for chemical drawings. In IUI '11, ACM, 2011, 267--276.

Digital Library

[34]

Pedersen, E. R. n., McCall, K., Moran, T. P., and Halasz, F. G. Tivoli: integrating structured domain objects into a freeform whiteboard environment. In CHI '93, ACM, 1993, 391--398.

[35]

Qi, Y., Szummer, M., and Minka, T. P. Diagram structure recognition by Bayesian conditional random flelds. In CVPR '05, IEEE, 2005, 191--196.

Digital Library

[36]

Saund, E., Fleet, D., Larner, D., and Mahoney, J. Perceptually-supported image editing of text and graphics. In UIST '03, ACM, 2003, 183--192.

Digital Library

[37]

Saund, E., and Mahoney, J. Scanscribe: Perceptually supported diagram image editing. In Diagrammatic Representation and Inference, vol. 2980 of Lecture Notes in Computer Science, Springer, 2004, 428--431.

[38]

Sezgin, T. M., and Davis, R. HMM-based efficient sketch recognition. In IUI '05, ACM, 2005, 281--283.

Digital Library

[39]

Shi, G., and Zhang, Y. An improved svm-hmm based classifier for online recognition of handwritten chemical symbols. In CCPR '10, IEEE, 2010, 1--5.

[40]

Shilman, M., Pasula, H., and Newton, S. R. R. Statistical visual language models for ink parsing. In AAAI Spring Symposium on Sketch Understanding, 2002, 126--132.

[41]

Shilman, M., Viola, P., and Chellapilla, K. Recognition and grouping of handwritten text in diagrams and equations. In Frontiers in Handwriting Recognition, Oct 2004, 569--574.

Digital Library

[42]

Shilman, M., Wei, Z., Raghupathy, S., Simard, P., and Jones, D. Discerning structure from freeform handwritten notes. In ICDAR '03, IEEE, 2003, 60--65.

Digital Library

[43]

Stahovich, T. F., Peterson, E. J., and Lin, H. An efficient, classification-based approach for grouping pen strokes into objects. Computers & Graphics 42 (2014), 14--30.

[44]

Walny, J., Carpendale, S., Riche, N., Venolia, G., and Fawcett, P. Visual thinking in action: Visualizations as used on whiteboards. Visualization and Computer Graphics, IEEE Transactions 17, 12 (Dec 2011), 2508--2517.

Digital Library

[45]

Xu, P., Fu, H., Au, O. K.-C., and Tai, C.-L. Lazy selection. ACM Transactions on Graphics 31, 6 (Nov. 2012), 142.

Digital Library

[46]

Zhou, X.-D., Wang, D.-H., and Liu, C.-L. A robust approach to text line grouping in online handwritten japanese documents. Pattern Recogn. 42, 9 (Sept. 2009), 2077--2088.

Digital Library

Cited By

Elsayed NMarriott KSmith RThomas B(2024)Situated Analytics Process and MantraExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650814(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650814
Cao YKazi RWei LAneja DXia H(2024)Elastica: Adaptive Live Augmented Presentations with Elastic Mappings Across ModalitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642725(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642725
Shi LCampbell RChi PCirimele MCleron MClimer KFleming CGanti AGervais PGonnet PKarim TMaksai AMelancon CMickle RMusat CNandy PQu XRobishaw DSingh AVenkatesan M(2024)Inkeraction: An Interaction Modality Powered by Ink Recognition and SynthesisProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642498(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642498
Show More Cited By

Index Terms

cLuster: Smart Clustering of Free-Hand Sketches on Large Interactive Surfaces
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

cLuster: Applications for Smart Clustering of Free-Hand Sketches
CSCW '16 Companion: Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion

Structuring and rearranging free-hand sketches on large interactive surfaces typically requires making multiple stroke selections. Without well-designed selection tools, this can be both time-consuming and fatiguing. Investigating the concept of ...
Proficient Normalised Fuzzy K-Means With Initial Centroids Methodology

This article describes how data is relevant and if it can be organized, linked with other data and grouped into a cluster. Clustering is the process of organizing a given set of objects into a set of disjoint groups called clusters. There are a number ...
A new cluster tendency assessment method for fuzzy co-clustering in hyperspectral image analysis
Highlights
- SACT is proposed to determine the suitable number of clusters and centroids.
- ...
Abstract
The assessment of cluster tendency is a method determining whether a considering data-set contains meaningful clusters. The raised questions often are: How many clusters is the data-set reasonably partitioned into and How is the data-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

November 2015

686 pages

ISBN:9781450337793

DOI:10.1145/2807442

General Chair:
Celine Latulipe
UNC Charlotte, USA
,
Program Chairs:
Bjoern Hartmann
UC Berkeley, USA
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Grant Agency of the CTU
European Union's Seventh Framework Programme FP7/2007-2001

Conference

UIST '15

Sponsor:

UIST '15: The 28th Annual ACM Symposium on User Interface Software and Technology

November 11 - 15, 2015

NC, Charlotte, USA

Acceptance Rates

UIST '15 Paper Acceptance Rate 70 of 297 submissions, 24%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
760
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Elsayed NMarriott KSmith RThomas B(2024)Situated Analytics Process and MantraExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650814(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650814
Cao YKazi RWei LAneja DXia H(2024)Elastica: Adaptive Live Augmented Presentations with Elastic Mappings Across ModalitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642725(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642725
Shi LCampbell RChi PCirimele MCleron MClimer KFleming CGanti AGervais PGonnet PKarim TMaksai AMelancon CMickle RMusat CNandy PQu XRobishaw DSingh AVenkatesan M(2024)Inkeraction: An Interaction Modality Powered by Ink Recognition and SynthesisProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642498(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642498
Romat HMarquardt NHinckley KHenry Riche N(2022)Style Blink: Exploring Digital Inking of Structured Information via Handcrafted Styling as a First-Class ObjectProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501988(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501988
Qi AGryaditskaya YXiang TSong Y(2022)One Sketch for All: One-Shot Personalized Sketch SegmentationIEEE Transactions on Image Processing10.1109/TIP.2022.316007631(2673-2682)Online publication date: 2022
https://doi.org/10.1109/TIP.2022.3160076
Le KTran TChlasta KKrejtz KFjeld MKunz A(2021)VXSlate: Exploring Combination of Head Movements and Mobile Touch for Large Virtual Display InteractionProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462076(283-297)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462076
Yang LZhuang JFu HWei XZhou KZheng Y(2021)SketchGNN: Semantic Sketch Segmentation with Graph Neural NetworksACM Transactions on Graphics10.1145/345028440:3(1-13)Online publication date: 1-Aug-2021
https://dl.acm.org/doi/10.1145/3450284
Aksan EHilliges O(2021)Generative Ink: Data-Driven Computational Models for Digital InkArtificial Intelligence for Human Computer Interaction: A Modern Approach10.1007/978-3-030-82681-9_13(417-461)Online publication date: 5-Nov-2021
https://doi.org/10.1007/978-3-030-82681-9_13
Deufemia VRisi M(2020)Multi-Domain Recognition of Hand-Drawn Diagrams Using Hierarchical ParsingMultimodal Technologies and Interaction10.3390/mti40300524:3(52)Online publication date: 14-Aug-2020
https://doi.org/10.3390/mti4030052
Walny JFrisson CWest MKosminsky DKnudsen SCarpendale SWillett W(2020)Data Changes Everything: Challenges and Opportunities in Data Visualization Design HandoffIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.293453826:1(12-22)Online publication date: Jan-2020
https://doi.org/10.1109/TVCG.2019.2934538
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents