An Experiment to Evaluate Constraint Diagrams with Novice Users

Constraint diagrams [1, 2] constitute a graphical notation for program specification. This paper presents an experiment that compares the efficacy of constraint diagrams (CD) with natural language (NL) for understanding program specification statements. In a web-based competition 33 participants were given training either on CD notation or equivalent NL expression, and answered questions about specification statements. It was predicted that the CD participants would find learning and answering questions harder than those in the NL group, because they had no prior experience of CD notation. Although the CD group spent more time on the training examples and were less confident about their answers, they spent less time answering the questions and achieved approximately the same proportion of correct answers as the NL group.

Authors and Affiliations

1. Representation and Cognition Research Group, Department of Informatics, University of Sussex, Falmer, Brighton, BN1 9QH, UK

   Noora Fetais & Peter C-H. Cheng

Editors and Affiliations

1. School of Interactive Computing, Design & Intelligence Laboratory, Georgia Institute of Technology,, 85 Fifth Street, NW 30308, Atlanta, GA, USA

   Ashok K. Goel

2. Computer Laboratory, University of Cambridge, JJ Thomson Avenue, CB3 0FD, Cambridge, UK

   Mateja Jamnik

3. Department of Computer Science & Software Engineering, Auburn University, 345 W. Magnolia Street, 36849-5347, Auburn, AL, USA

   N. Hari Narayanan

Reprints and permissions

© 2010 Springer-Verlag Berlin Heidelberg

Policies and ethics