More Web Proxy on the site http://driver.im/

research-article

Automating Visual Language Generation

Authors:

Angela Guercio,

Giuliano Pacini,

Genoveffa Tortora,

Maurizio TucciAuthors Info & Claims

IEEE Transactions on Software Engineering, Volume 16, Issue 10

Pages 1122 - 1135

https://doi.org/10.1109/32.60293

Published: 01 October 1990 Publication History

Abstract

A system to generate and interpret customized visual languages in given application areas is presented. The generation is highly automated. The user presents a set of sample visual sentences to the generator. The generator uses inference grammar techniques to produce a grammar that generalizes the initial set of sample sentences, and exploits general semantic information about the application area to determine the meaning of the visual sentences in the inferred language. The interpreter is modeled on an attribute grammar. A knowledge base, constructed during the generation of the system, is then consulted to construct the meaning of the visual sentence. The architecture of the system and its use in the application environment of visual text editing (inspired by the Heidelberg icon set) enhanced with file management features are reported.

References

[1]

{1} D. Angluin and C. H. Smith, "Inductive inference theory and methods," ACM Comput. Surveys, vol. 15, pp. 237-269, 1983.

Digital Library

[2]

{2} A. W. Biermann and J. A. Feldman, "On the synthesis of finite-state machines for samples of behavior," IEEE Trans. Comput., vol. C- 21, pp. 592-597, June 1972.

[3]

{3} J. M. Brayer and K. S. Fu, "A note on the K-tail method of tree grammar inference," IEEE Trans. Syst., Man, Cybern., vol. SMC-7, pp. 293-300, Apr. 1977.

[4]

{4} S. K. Chang, "A method for the structural analysis of two dimensional mathematical expressions," Inform. Sci., vol. 2, pp. 253-272, 1970.

Digital Library

[5]

{5} S. K. Chang, "Visual languages: A tutorial and survey," IEEE Software , vol. 4, no. 1, pp. 29-39, Jan. 1987.

Digital Library

[6]

{6} S. K. Chang, "The design of a visual language compiler," in Proc. IEEE Workshop Visual Languages, Pittsburgh, PA, Oct. 1988, pp. 84-91.

[7]

{7} S. K. Chang, Visual Languages and Visual Programming, S. K. Chang, Ed. New York: Plenum, 1990, to be published.

[8]

{8} S. K. Chang, T. Ichikawa, and P. A. Ligomenides, Eds., Visual Languages . New York: Plenum, 1986.

[9]

{9} S. K. Chang, M. J. Tauber, B. Yu, and J. S. Yu, "The SILIcon compiler: An icon-oriented system generator," Int. J. Pattern Recog. Artificial Intell., vol. 2, no. 2, June 1988.

[10]

{10} S. K. Chang, M. J. Tauber, B. Yu, and J. S. Yu, "A visual langugage compiler," IEEE Trans. Software Eng., vol. 15, no. 5, pp. 506-525, May 1989.

Digital Library

[11]

{11} S. K. Chang, G. Tortora, B. Yu, and A. Guercio, "Icon purity: Toward a formal theory of icons," Int. J. Pattern Recog. Artificial Intell. , vol. 1, no. 3, 4, pp. 377-392, 1987.

[12]

{12} C. Crimi, A. Guercio, G. Tortora, and M. Tucci, "An algorithm for inference of tree grammars based on a measure of functional similarity," Univ. Salerno, Internal Rep., 1989.

[13]

{13} G. Filé, "Interpretation and reduction of attribute grammars," Acta Inform., vol. 19, pp. 115-150, 1983.

Digital Library

[14]

{14} H. Fukuda and K. Kamata, "Inference of tree automata from sample set of trees," Int. J. Comput. Inform. Sci., vol. 13, no. 3, pp. 177- 196, 1984.

[15]

{15} E. P. Glinert and S. L. Tanimoto, "Pict: An interactive graphical programming environment," Computer, vol. C-17, no. 11, pp. 7-25, Nov. 1984.

[16]

{16} E. M. Gold, "Language identification in the limit," Inform. Contr., vol. 10, pp. 447-474, 1967.

[17]

{17} R. C. Gonzales, J. J. Edwards, and M. G. Thomason, "An algorithm for the inference of tree grammars," Int. J. Comput. Inform. Sci., vol. 5, no. 2, pp. 145-164, 1976.

[18]

{18} H. R. Hartson and D. Hix, "Human computer interface development. Concepts and systems for its management," ACM Comput. Surveys, vol. 21, no. 1, Mar. 1989.

Digital Library

[19]

{19} M. Hirakawa, S. Iwata, I. Yoshimoto, and M. Tanaka, "HI-VISUAL iconic programming," in Proc. Workshop Visual Languages, Linkoping, Aug. 1987.

[20]

{20} M. Hirakawa, S. Iwata, Y. Tahara, M. Tanaka, and T. Ichikawa, "A framework for construction of icon systems," in Proc. IEEE Workshop Visual Languages, Pittsburgh, PA, Oct, 1988, pp. 70-77.

[21]

{21} T. Ichikawa and M. Hirakawa, "Visual programming--Toward realization of user-friendly programming environments," in Proc. FJCC'87, Dallas, TX, Oct. 25-29, 1987, pp. 129-137.

[22]

{22} D. E. Knuth, "Semantics of context-free languages," Math. Syst. Theory, vol. 2, pp. 127-145, 1968, correction, vol. 5, pp. 95-96, 1971.

[23]

{23} B. Levine, "Derivatives of tree sets with applications to grammatical inference," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI- 3, no, 3, pp. 285-293, 1981.

[24]

{24} B. Levine, "The use of the tree systems inference and a sample support parameter for inferring tree systems," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-4, no. 1, pp. 25-34, 1982.

Digital Library

[25]

{25} B. A. Myers, "User interface tools: Introduction and survey," IEEE Software, vol. 6, no. 1, pp. 15-23, Jan. 1989.

Digital Library

[26]

{26} D. A. Norman, "Some observations on mental models," in Mental Models, Gentner and Stevens, Eds. Hillsdale, NJ: Lawrence Erlbaum, 1983.

[27]

{27} G. Raeder, "A survey of current graphical programming techniques," Computer, vol. 18, no. 8, pp. 11-24, Aug. 1985.

Digital Library

[28]

{28} G. Rohr, "Using visual concepts," in Visual Languages, S. K. Chang, T. Ichikawa, and P. Ligomenides, Eds. New York: Plenum, 1986.

[29]

{29} B. Shneiderman, Designing the User Interface: Strategies for Effective Human-Computer Interaction. Reading, MA: Addison-Wesley, 1987.

Digital Library

[30]

{30} N. C. Shu, Visual Programming. New York: Van Nostrand Reinhold, 1988.

[31]

{31} M. J. Tauber, "On mental models and the user interface," in Outcomes in Human-Computer Interaction, Green, Hoc, Murray, and Veer, Eds. London: Academic, 1987.

[32]

{32} G. Tortora, "Structure and interpretation of visual languages," in Visual Languages and Visual Programming, S.-K. Chang, Ed. New York: Plenum, 1990, to be published.

[33]

{33} G. Tortora and P. Leoncini, "A model for the specification and interpretation of icon-oriented languages," in Proc. IEEE Workshop Visual Languages, Pittsburgh, PA, Oct. 1988, pp. 52-60.

Cited By

Miraz MAli MExcell P(2021)Adaptive user interfaces and universal usability through plasticity of user interface designComputer Science Review10.1016/j.cosrev.2021.10036340:COnline publication date: 1-May-2021
https://dl.acm.org/doi/10.1016/j.cosrev.2021.100363
Ryder BSoffa MBurnett M(2005)The impact of software engineering research on modern programming languagesACM Transactions on Software Engineering and Methodology10.1145/1101815.110181814:4(431-477)Online publication date: 1-Oct-2005
https://dl.acm.org/doi/10.1145/1101815.1101818
Costagliola GDeufemia VFerrucci FGravino CTortora GChang S(2002)Using extended positional grammars to develop visual modeling languagesProceedings of the 14th international conference on Software engineering and knowledge engineering10.1145/568760.568795(201-208)Online publication date: 15-Jul-2002
https://dl.acm.org/doi/10.1145/568760.568795
Show More Cited By

Index Terms

Automating Visual Language Generation
1. Software and its engineering
  1. Software notations and tools
    1. Context specific languages
      1. Visual languages
2. Theory of computation
  1. Formal languages and automata theory
    1. Grammars and context-free languages
  2. Semantics and reasoning
    1. Program semantics

Recommendations

Parsing Nonlinear Languages

The diagrammatic approach to user interfaces for computer-aided software development toolkits, visual query systems, and visual programming environments, is based on the use of diagrams and charts traditionally drawn on paper. In particular, the VLG ...
Design, Construction, and Application of a Generic Visual Language Generation Environment

The implementation of visual programming languages (VPLs) and their supporting environments is time consuming and tedious. To ease the task, researchers have developed some high level tools to reduce the development effort. None of these tools, however, ...
Transition network grammars for natural language analysis

The use of augmented transition network grammars for the analysis of natural language sentences is described. Structure-building actions associated with the arcs of the grammar network allow for the reordering, restructuring, and copying of constituents ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Software Engineering

IEEE Transactions on Software Engineering Volume 16, Issue 10

October 1990

116 pages

ISSN:0098-5589

Editor:
Victor R. Basili
Univ. of Maryland, College Park, MD

Issue’s Table of Contents

Copyright © Copyright © 1990 IEEE. All Rights Reserved.

Publisher

IEEE Press

Publication History

Published: 01 October 1990

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Miraz MAli MExcell P(2021)Adaptive user interfaces and universal usability through plasticity of user interface designComputer Science Review10.1016/j.cosrev.2021.10036340:COnline publication date: 1-May-2021
https://dl.acm.org/doi/10.1016/j.cosrev.2021.100363
Ryder BSoffa MBurnett M(2005)The impact of software engineering research on modern programming languagesACM Transactions on Software Engineering and Methodology10.1145/1101815.110181814:4(431-477)Online publication date: 1-Oct-2005
https://dl.acm.org/doi/10.1145/1101815.1101818
Costagliola GDeufemia VFerrucci FGravino CTortora GChang S(2002)Using extended positional grammars to develop visual modeling languagesProceedings of the 14th international conference on Software engineering and knowledge engineering10.1145/568760.568795(201-208)Online publication date: 15-Jul-2002
https://dl.acm.org/doi/10.1145/568760.568795
Costagliola GDe Lucia AOrefice STortor G(1997)A Parsing Methodology for the Implementation of Visual SystemsIEEE Transactions on Software Engineering10.1109/32.63739223:12(777-799)Online publication date: 1-Dec-1997
https://dl.acm.org/doi/10.1109/32.637392
Chang S(1996)Extending Visual Languages for MultimediaIEEE MultiMedia10.1109/93.5565363:3(18-26)Online publication date: 1-Sep-1996
https://dl.acm.org/doi/10.1109/93.556536
Ferrucci FTortora GTucci MVitiello G(1996)Semantics-Based Inference Algorithms for Adaptive Visual EnvironmentsIEEE Transactions on Software Engineering10.1109/32.54435122:10(730-750)Online publication date: 1-Oct-1996
https://dl.acm.org/doi/10.1109/32.544351
Ferrucci FPacini GSatta GSessa MTortora GTucci MVitiello G(1996)Symbol-Relation GrammarsInformation and Computation10.1006/inco.1996.0090131:1(1-46)Online publication date: 25-Nov-1996
https://dl.acm.org/doi/10.1006/inco.1996.0090
Chang SCostagliola GPacini GTucci MTortora GYu BYu J(1995)Visual-Language System for User InterfacesIEEE Software10.1109/52.36826212:2(33-44)Online publication date: 1-Mar-1995
https://dl.acm.org/doi/10.1109/52.368262
Costagliola GTortora GOrefice SDe Lucia A(1995)Automatic Generation of Visual Programming EnvironmentsComputer10.1109/2.36616228:3(56-66)Online publication date: 1-Mar-1995
https://dl.acm.org/doi/10.1109/2.366162
Tucci MVitiello GCostagliola G(1994)Parsing Nonlinear LanguagesIEEE Transactions on Software Engineering10.1109/32.31742720:9(720-739)Online publication date: 1-Sep-1994
https://dl.acm.org/doi/10.1109/32.317427

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents