Abstract
Pen-based interaction is an intuitive way to realize hand drawn structured documents, but few applications take advantage of it. Indeed, the interpretation of the user hand drawn strokes in the context of document is a complex problem. In this paper, we propose a new generic approach to develop such systems based on three independent components. The first one is a set of graphical and editing functions adapted to pen interaction. The second one is a rule-based formalism that models structured document composition and the corresponding interpretation process. The last one is a hand drawn stroke analyzer that is able to interpret strokes progressively, directly while the user is drawing. We highlight in particular the human-computer interaction induced from this progressive interpretation process. Thanks to this generic approach, three pen-based system prototypes have already been developed, for musical score editing, for graph editing, and for UML class diagram editing
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Alvarado, C., and Davis, R., SketchREAD: A Multi-domain Sketch Recognition Engine, in Proc. of the 17th Annual ACM Symposium on User Interface Software and Technology UIST’2004 (Santa Fe, 24–27 October 2004), ACM Press, New York, 2004, pp. 23–32.
Anquetil, É., and Bouchereau, H., Integration of an On-line Handwriting Recognition System in a Smart Phone Device, in Proc. of the 16th IAPR Int. Conf. on Pattern Recognition ICPR’2002 (Quebec, 11–15 August 2002), 2002, pp. 192–195.
Anstice, J., Bell, T., Cockburn, A., and Setchell, M., The Design of a Pen-Based Musical Input System, in Proc. of the 6th Australian Conf. on Computer-Human Interaction OZCHI’96 (Hamilton, 24–27 November 1996), IEEE Comp. Soc. Press, 1996, pp. 260–267.
Bishop, C.M., Neural Networks for Pattern Recognition, Oxford University Press, Oxford, 1995.
Blostein, D., Lank, A., Rose, A., and Zanibbi, R., User Interfaces for On-Line Diagram Recognition, in Proc. of the 4th IAPR International Workshop on Graphics Recognition Algorithms and Applications GREC’2001 (Kingston, 7–8 September 2001), Lecture Notes in Computer Science, Vol. 2390, Springer-Verlag, Berlin, 2001, pp. 92–103.
Donaldson, A.F., and Williamson, A., Pen-based Input of UML Activity Diagrams for Business Process Modelling, in Proc. of the 1st Workshop on Improving and Assessing Pen-Based Input Techniques (Edinburgh, 5 September 2005), 2005, pp. 31–38.
Hammond, T., and Davis, R., Ladder: A Language to Describe Drawing, Display, and Editing in Sketch Recognition, in Proc. of the 18th Int. J. Conf. on Artificial Intelligence IJCAI’03 (Acapulco, 9–15 Aug. 2003), M. Kaufmann, San Francisco, 2003, pp. 461–467.
Lank, E.H., A Retargetable Framework for Interactive Diagram Recognition, in Proc. of the 7th Int. Conf. on Document Analysis and Recognition ICDAR’2003 (Edinburgh, August 2003), IEEE Computer Society Press, Los Alamitos, 2003, pp. 185–189.
Macé, S., Anquetil, É., and Coüasnon, B., A Generic Method to Design Pen-Based Systems for Structured Document Composition: Development of a Musical Score Editor, in Proc. of the 1st Workshop on Improving and Assessing Pen-Based Input Techniques (Edinburgh, 5 September 2005), 2005, pp. 15–22.
Mas, J., Sanchez, G., and Llados, J., An Incremental Parser to Recognize Diagram Symbols and Gestures represented by Adjacency Grammars, in Proc. of the 6th IAPR Int. Workshop on Graphics Recognition GREC’2005, 2005, pp. 229–237.
Mouchère, H., Anquetil, É., and Ragot, N., Étude et gestion des types de rejet pour l’optimisation de classifieurs, in Actes du 15ème Congrès francophone Reconnaissance des Formes et Intelligence Artificielle RFIA’2006 (Tours, January 2006), 2006.
Nakagawa, M., Machii, K., Kato, N., and Souya, T., Lazy Recognition as a Principle of Pen Interfaces, in Proc. of the ACM Conf. Companion on Human Factors in Computing Systems InterCHI’93 (Amsterdam, 24–28 April 1993), ACM Press, 1993, pp. 89–90.
Toyozumi, K., Mori, K., Suenaga, Y., and Suzuki, T., A System for Real-time Recognition of Handwritten Mathematical Formulas, in Proc. of the 6th Int. Conf. on Document Analysis and Recognition ICDAR’2001 (Seattle, 10–13 September 2001), pp. 1059–1064.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer
About this paper
Cite this paper
Macé, S., Anquetil, É. (2007). A Generic Approach for Pen-Based User Interface Development. In: Calvary, G., Pribeanu, C., Santucci, G., Vanderdonckt, J. (eds) Computer-Aided Design of User Interfaces V. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-5820-2_5
Download citation
DOI: https://doi.org/10.1007/978-1-4020-5820-2_5
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-5819-6
Online ISBN: 978-1-4020-5820-2
eBook Packages: Computer ScienceComputer Science (R0)