Article

Free access

Mondrian: a teachable graphical editor

Author:

Henry LiebermanAuthors Info & Claims

CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems

Page 144

https://doi.org/10.1145/169059.169120

Published: 01 May 1993 Publication History

PDF eReader

Abstract

Mondrian is an object-oriented graphical editor that can learn new graphical procedures through programming by demonstration. A user can demonstrate a sequence of graphical editing commands on a concrete example to illustrate how the new procedure should work. An interface agent records the steps of the procedure in a symbolic form, using machine learning techniques, tracking relationships between graphical objects and dependencies among the interface operations. The agent generalizes a program that can then be used on “analogous” examples. The generalization heuristics set it apart from conventional “macros” that can only repeat an exact sequence of steps. The system represents user-defined operations using pictorial “storyboards” of examples. By bringing the power of procedural programming to easy-to-use graphical interfaces, we hope to break down the “Berlin Wall” that currently exists between computer users and computer programmers.

References

[1]

Lieberman, Henry, Capturing Design Expertise by Example, in East-West Conference on Human-Computer Interaction, St. Petersburg, Russia, August 1992.

Google Scholar

[2]

Lieberman, Henry, Dominoes and Storyboards: Beyond Icons on Strings, IEEE Workshop on Visual Languages, Seattle, Washington, USA, September, 1992.

Crossref

Google Scholar

[3]

Li~bcrman, H~nry, Mondrian: A TGachablc Graphical Editor, in Cypher, Allen, ed. Watch What i Do: Programming by Demonstration, MIT Press, 1993.

Digital Library

Google Scholar

Cited By

View all

Hempel BLubin JChugh RGuimbretière FBernstein MReinecke K(2019)Sketch-n-SketchProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347925(281-292)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347925
Krosnick RLee SLaseck WOnev S(2018)Expresso: Building Responsive Interfaces with Keyframes2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VLHCC.2018.8506516(39-47)Online publication date: Oct-2018
https://doi.org/10.1109/VLHCC.2018.8506516
Banerjee RYip JLee KPopović ZRead JStenton P(2016)Empowering Children To Rapidly Author Games and Animations Without Writing CodeProceedings of the The 15th International Conference on Interaction Design and Children10.1145/2930674.2930688(230-237)Online publication date: 21-Jun-2016
https://dl.acm.org/doi/10.1145/2930674.2930688
Show More Cited By

Index Terms

Mondrian: a teachable graphical editor

Recommendations

SIGCHI Lifetime Research Award Talk: Icons, Metaphor, and End-User Programming
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Throughout my career I have tried to make computers easier to use-and therefore more useful- for ordinary people. Along the way, I've invented a few things that have proven to be helpful. At the operating system level, I tried to make the interface to ...
Code3: A System for End-to-End Programming of Mobile Manipulator Robots for Novices and Experts
HRI '17: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction

This paper introduces Code3, a system for user-friendly, rapid programming of mobile manipulator robots. The system is designed to let non-roboticists and roboticists alike program end-to-end manipulation tasks. To accomplish this, Code3 provides three ...
Reactile: Programming Swarm User Interfaces through Direct Physical Manipulation
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We explore a new approach to programming swarm user interfaces (Swarm UI) by leveraging direct physical manipulation. Existing Swarm UI applications are written using a robot programming framework: users work on a computer screen and think in terms of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems

May 1993

547 pages

ISBN:0897915755

DOI:10.1145/169059

Chairmen:
Bert Arnold
Delft Univ. of Technology, The Netherlands
,
Gerrit van der Veer
Univ. of Twente and Vrije Univ., The Netherlands
,
Ted White
Univ. of Twente and Univ. of Ultrecht, Utrecht, The Netherlands

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 May 1993

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

INTERCHI93

Sponsor:

SIGCAPH
Austrian Comp Soc
SIGGRAPH
Human Factors Soc
SIGCHI
SIGGROUP
IEEE-CS
IFIP
NGI

INTERCHI93: Conference on Human Factors in Computing

April 24 - 29, 1993

Amsterdam, The Netherlands

Acceptance Rates

CHI '93 Paper Acceptance Rate 62 of 330 submissions, 19%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
215
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)12

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Hempel BLubin JChugh RGuimbretière FBernstein MReinecke K(2019)Sketch-n-SketchProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347925(281-292)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347925
Krosnick RLee SLaseck WOnev S(2018)Expresso: Building Responsive Interfaces with Keyframes2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VLHCC.2018.8506516(39-47)Online publication date: Oct-2018
https://doi.org/10.1109/VLHCC.2018.8506516
Banerjee RYip JLee KPopović ZRead JStenton P(2016)Empowering Children To Rapidly Author Games and Animations Without Writing CodeProceedings of the The 15th International Conference on Interaction Design and Children10.1145/2930674.2930688(230-237)Online publication date: 21-Jun-2016
https://dl.acm.org/doi/10.1145/2930674.2930688
Berthouzoz FLi WDontcheva MAgrawala M(2011)A Framework for content-adaptive photo manipulation macrosACM Transactions on Graphics10.1145/2019627.201963930:5(1-14)Online publication date: 22-Oct-2011
https://dl.acm.org/doi/10.1145/2019627.2019639
Grossman TMatejka JFitzmaurice GPerlin KCzerwinski MMiller R(2010)ChronicleProceedings of the 23nd annual ACM symposium on User interface software and technology10.1145/1866029.1866054(143-152)Online publication date: 3-Oct-2010
https://doi.org/10.1145/1866029.1866054
Grabler FAgrawala MLi WDontcheva MIgarashi TFunkhouser T(2009)Generating photo manipulation tutorials by demonstrationACM SIGGRAPH 2009 papers10.1145/1576246.1531372(1-9)Online publication date: 27-Jul-2009
https://dl.acm.org/doi/10.1145/1576246.1531372
Grabler FAgrawala MLi WDontcheva MIgarashi T(2009)Generating photo manipulation tutorials by demonstrationACM Transactions on Graphics10.1145/1531326.153137228:3(1-9)Online publication date: 27-Jul-2009
https://dl.acm.org/doi/10.1145/1531326.1531372
Kelleher CPausch R(2005)Lowering the barriers to programmingACM Computing Surveys10.1145/1089733.108973437:2(83-137)Online publication date: 1-Jun-2005
https://dl.acm.org/doi/10.1145/1089733.1089734
Modugno FMyers B(2005)Exploring graphical feedback in a demonstrational visual shellHuman-Computer Interaction10.1007/3-540-58648-2_27(64-76)Online publication date: 2-Jun-2005
https://doi.org/10.1007/3-540-58648-2_27
Ferrucci FTortora GVitiello G(2002)Visual ProgrammingEncyclopedia of Software Engineering10.1002/0471028959.sof143Online publication date: 15-Jan-2002
https://doi.org/10.1002/0471028959.sof143
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

SIGCHI Lifetime Research Award Talk: Icons, Metaphor, and End-User Programming

Code3: A System for End-to-End Programming of Mobile Manipulator Robots for Novices and Experts

Reactile: Programming Swarm User Interfaces through Direct Physical Manipulation