More Web Proxy on the site http://driver.im/

article

SUMLOW: early design-stage sketching of UML diagrams on an E-whiteboard

Authors:

John HoskingAuthors Info & Claims

Software—Practice & Experience, Volume 38, Issue 9

Pages 961 - 994

Published: 01 July 2008 Publication History

Abstract

Most visual diagramming tools provide point-and-click construction of computer-drawn diagram elements using a conventional desktop computer and mouse. SUMLOW is a unified modelling language (UML) diagramming tool that uses an electronic whiteboard (E-whiteboard) and sketching-based user interface to support collaborative software design. SUMLOW allows designers to sketch UML constructs, mixing different UML diagram elements, diagram annotations, and hand-drawn text. A key novelty of the tool is the preservation of hand-drawn diagrams and support for manipulation of these sketches using pen-based actions. Sketched diagrams can be automatically ‘formalized’ into computer-recognized and -drawn UML diagrams and then exported to a third party CASE tool for further extension and use. We describe the motivation for SUMLOW, illustrate the use of the tool to sketch various UML diagram types, describe its key architecture abstractions and implementation approaches, and report on two evaluations of the toolset. We hope that our experiences will be useful for others developing sketching-based design tools or those looking to leverage pen-based interfaces in software applications. Copyright © 2007 John Wiley & Sons, Ltd.

References

[1]

Smart Technologies Inc. SMART Board. www.smarttech.com {18 September 2007}.

[2]

Plimmer B, Apperley M. Computer-aided sketching to capture preliminary design. In Proceedings of the Third Australasian Conference on User Interfaces--Volume 7, Melbourne, Victoria, Australia (ACM International Conference Proceeding Series, vol. 20). Australian Computer Society: Darlinghurst, Australia, 2002; 9-12.

[3]

Berque D, Johnson DK, Jovanovic L. Teaching theory of computation using pen-based computers and an electronic whiteboard. ACM SIGCSE Bulletin, vol. 33(3). ACM Press: New York, 2001; 169-172.

[4]

Lank E, Thorley J, Chen S, Blostein D. On-line recognition of UML diagrams. Proceedings of the Sixth International Conference on Document Analysis and Recognition. IEEE CS Press: Silver Spring, MD, 2001; 356-360.

[5]

Fowler M, Scott K. UML Distilled: A Brief Guide to the Standard Object Modeling Language (2nd edn). Addison-Wesley: Reading, MA, 1999.

[6]

UML^¿ Resource Page, OMG (Object Management Group). http://www.uml.org/ {18 September 2007}.

[7]

Quatrani T. Visual Modeling with Rational Rose 2002 and UML (3rd edn). Addison-Wesley: Reading, MA, 2002.

[8]

Robbins J, Redmiles D. Cognitive support, UML adherence, and XMI interchange in Argo/UML. Information and Software Technology, 2000.

[9]

Iivari J. Why are CASE tools not used? Communications of the ACM 1996; 39(10):94-103.

[10]

Black A. Visible planning on paper and on screen: The impact of working medium on decision-making by novice graphic designers. Behaviour and Information Technology 1990; 9(4):283-296.

[11]

Mackay D, Biddle R, Noble J. A lightweight web based case tool for UML class diagrams. Proceedings of the 4th Australasian User Interface Conference, Adelaide, South Australia, 2003 (Conferences in Research and Practice in Information Technology, vol. 18). Australian Computer Society: Adelaide, South Australia, 2003.

[12]

Gray J, Liu A, Scott L. Issues in software engineering tool construction. Information and Software Technology 2000; 42(2):73-77.

[13]

Damm CH, Hansen KM, Thomsen M. Tool support for cooperative object-oriented design: Gesture based modeling on an electronic whiteboard. Proceedings of the CHI 2000 on Human Factors in Computer Systems: The Future is Here. ACM Press: New York, 2000; 518-525.

Digital Library

[14]

Landay JA. SILK: Sketching interfaces like krazy. Proceedings of CHI'96 on Human Factors in Computer Systems: Common Ground. ACM Press: New York, 1996; 518-525.

[15]

Goel V. Sketches of Thought. The MIT Press: Cambridge, MA, 1995.

[16]

Brooks A, Scott L. Constraints in CASE Tools: Results from curiosity driven research. Proceedings of the 2001 Australian Software Engineering Conference, Canberra, Australia, 26-28 August 2001. IEEE CS Press: Silver Spring, MD, 2001; 285-296.

[17]

Grief I, Seliger A, Weihl W. A case study of CES: A distributed collaborative editing system implemented in Argus. IEEE Transactions on Software Engineering 1992; 18(9):827-839.

[18]

Grundy JC, Hosking JG. Engineering plug-in software components to support collaborative work. Software--Practice and Experience 2002; 32(10):983-1013.

[19]

Shuckman C, Kirchner L, Schummer J, Haake JM. Designing object-oriented synchronous groupware with COAST. Proceedings of the ACM Conference on Computer Supported Cooperative Work. ACM Press: New York, 1996; 21-29.

[20]

Wong YY. Rough and ready prototypes: Lessons from graphic design. Human Factors in Computing Systems CHI '92, Monterey, 1992.

Digital Library

[21]

Goldschmidt G. Serial sketching: Visual problem solving in design, the backtalk of self-generated sketches. Cybernetics and Systems 1992; 23:191-219.

[22]

Rubine D. Specifying gesture by examples. Proceedings of the 18th Annual Conference (1991) on Computer Graphics and Interactive Techniques. ACM Press: New York, 1991; 329-337.

Digital Library

[23]

Lin J, Newman MW, Hong JI, Landay JA. Denim: Finding a tighter fit between tools and practice for web design. Proceedings of CHI'2000. ACM Press: New York, 2000; 510-517.

[24]

Apperley M, Dahlberg B, Jefferies A, Paine L, Phillips M, Rogers B. Lightweight capture of presentations for review. Proceedings of IHM-HCI, Lille, France. ACM Press: New York, 2002.

[25]

Myers BA. The Amulet environment: New models for effective user interface software development. IEEE Transactions on Software Engineering 1997; 23(6):347-365.

[26]

Voida S, Mynatt ED, MacIntyre B, Corso GM. Integrating virtual and physical context to support knowledge workers. IEEE Pervasive Computing 2002; 1(3):73-79.

[27]

Ratzer AV, Hansen KM. Ideogramic: flexibility and formality in collaborative diagramming. Proceedings of the Second Nordic Conference on Human-Computer Interaction, NordiCHI'02, Aarhus, Denmark, 19-23 October 2002, vol 31. ACM Press: New York, NY, 291-292.

[28]

Hse H, Newton AR. Sketched symbol recognition using Zernike moments. Proceedings of the 2004 International Conference on Pattern Recognition, Cambridge, U.K., August 2004; 367-370.

[29]

Alvarado C, Davis R. SketchREAD: A multi-domain sketch recognition engine. Proceedings of the 2004 ACM Symposium on User Interface Software and Technology, ACM Press: New York, 2004.

[30]

Hse H, Shilman M, Newton AR. Robust sketched symbol fragmentation using templates. Proceedings of the 2004 International Conference on Intelligent User Interfaces, Funchal, Portugal, January 2004; 156-160.

Digital Library

[31]

Sezgin TM, Davis R. HMM-based efficient sketch recognition. Proceedings of the 2005 International Conference on Intelligent User Interfaces, New York, 9-12 January 2005.

Digital Library

[32]

Donaldson A, Williamson A. Pen-based input of UML activity diagrams for business process modelling. The HCI 2005 Workshop on Improving and Assessing Pen-based Input Techniques, Edinburgh, Scotland, Monday 5 September 2005.

[33]

Hammond T, Davis R. Tahuti: A geometrical sketch recognition system for UML class diagrams. Proceedings of the 2002 AAAI Spring Symposium on Sketch Understanding, Stanford, CA, 25-27 March 2002; 59-68.

[34]

Chen Q, Grundy JC, Hosking JG. An E-whiteboard application to support early design-stage sketching of UML diagrams. Proceedings of the 2003 IEEE Symposium on Human Centric Computing Languages and Environments, Auckland, New Zealand, October 2003. IEEE: New York, 2003; 219-226.

Digital Library

[35]

Mimio^® home page: from http://www.mimio.com {26 March 2003}.

[36]

Apte A, Vo V, Kimura TD. Recognizing multistroke geometric shapes: An experimental evaluation. Proceedings of the 6th Annual ACM Symposium on User Interface Software and Technology, ACM Press: New York, 1993; 121-128.

[37]

Green TRG, Petre M. Usability analysis of visual programming environments: A 'cognitive dimensions' framework. Journal of Visual Languages and Computing 1996; 7:131-174.

Cited By

Schäfer Bvan der Aa HLeopold HStuckenschmidt H(2023)Sketch2Process: End-to-End BPMN Sketch Recognition Based on Neural NetworksIEEE Transactions on Software Engineering10.1109/TSE.2022.322830849:4(2621-2641)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/TSE.2022.3228308
Wüest DSeyff NGlinz M(2019)FlexiSketchSoftware and Systems Modeling (SoSyM)10.1007/s10270-017-0623-818:2(1513-1541)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1007/s10270-017-0623-8
Book Mvan der Hoek ASharp Hde Souza CGraziotin DLevy MSocha D(2018)Sketching with a purposeProceedings of the 11th International Workshop on Cooperative and Human Aspects of Software Engineering10.1145/3195836.3195854(93-96)Online publication date: 27-May-2018
https://dl.acm.org/doi/10.1145/3195836.3195854
Show More Cited By

Index Terms

SUMLOW: early design-stage sketching of UML diagrams on an E-whiteboard
1. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software implementation planning
        Software design techniques
    2. Software development process management
      1. Software development methods
  2. Software notations and tools
    1. General programming languages
      1. Language types

Recommendations

Automatic code generation from unified modelling language sequence diagrams

Unified modelling language (UML) is a visual modelling language, which has gained popularity among software practitioners. In a model‐driven software development environment, the existing UML tools mainly support automatic generation of structural code ...
Reasoning on UML class diagrams

UML is the de-facto standard formalism for software design and analysis. To support the design of large-scale industrial applications, sophisticated CASE tools are available on the market, that provide a user-friendly environment for editing, storing, ...
Ontological Rules for UML-Based Conceptual Modeling: Design Considerations and a Prototype Implementation

UML is used as a language for object-oriented software design, and as a language for conceptual modeling of applications domains. Given the differences between these purposes, UML's origins in software engineering might limit its appropriateness for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Software

Software Volume 38, Issue 9

July 2008

109 pages

ISSN:0038-0644

EISSN:1097-024X

Issue’s Table of Contents

Publisher

John Wiley & Sons, Inc.

United States

Publication History

Published: 01 July 2008

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schäfer Bvan der Aa HLeopold HStuckenschmidt H(2023)Sketch2Process: End-to-End BPMN Sketch Recognition Based on Neural NetworksIEEE Transactions on Software Engineering10.1109/TSE.2022.322830849:4(2621-2641)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/TSE.2022.3228308
Wüest DSeyff NGlinz M(2019)FlexiSketchSoftware and Systems Modeling (SoSyM)10.1007/s10270-017-0623-818:2(1513-1541)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1007/s10270-017-0623-8
Book Mvan der Hoek ASharp Hde Souza CGraziotin DLevy MSocha D(2018)Sketching with a purposeProceedings of the 11th International Workshop on Cooperative and Human Aspects of Software Engineering10.1145/3195836.3195854(93-96)Online publication date: 27-May-2018
https://dl.acm.org/doi/10.1145/3195836.3195854
Chechik MGrünbacher P(2018)Guest editorialAutomated Software Engineering10.1007/s10515-017-0222-525:1(45-46)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1007/s10515-017-0222-5
Kleffmann MRöhl SBook MGruhn V(2018)Evaluation of a traceability approach for informal freehand sketchesAutomated Software Engineering10.1007/s10515-017-0221-625:1(1-43)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1007/s10515-017-0221-6
Kleffmann MRöhl SGruhn VBook MMäder POliveto R(2015)Establishing and navigating trace links between elements of informal diagram sketchesProceedings of the 8th International Symposium on Software and Systems Traceability10.5555/2821445.2821447(1-7)Online publication date: 16-May-2015
https://dl.acm.org/doi/10.5555/2821445.2821447
Wong-Villacres MOrtiz MEcheverría VChiluiza KNunes NCostanza EOlivier PSchöning J(2015)A Tabletop System to Promote Argumentation in Computer Science StudentsProceedings of the 2015 International Conference on Interactive Tabletops & Surfaces10.1145/2817721.2823501(325-330)Online publication date: 15-Nov-2015
https://dl.acm.org/doi/10.1145/2817721.2823501
Kleffmann MBook MGruhn VLanubile FAli R(2014)Supporting collaboration of heterogeneous teams in an augmented team roomProceedings of the 6th International Workshop on Social Software Engineering10.1145/2661685.2661688(9-16)Online publication date: 17-Nov-2014
https://dl.acm.org/doi/10.1145/2661685.2661688
Kleffmann MCrnkovic IChechik MGrünbacher P(2014)AugIRProceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering10.1145/2642937.2653467(883-886)Online publication date: 15-Sep-2014
https://dl.acm.org/doi/10.1145/2642937.2653467
Mangano NLaToza TPetre Mvan der Hoek AJones MPalanque PSchmidt AGrossman T(2014)Supporting informal design with interactive whiteboardsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2557411(331-340)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2556288.2557411
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents