More Web Proxy on the site http://driver.im/

article

Free access

Formative design evaluation of superbook

Editor: Robert B. Allen Authors:

Dennis E. Egan,

Louis M. Gomez,

Thomas K. Landauer,

Jennifer Eberhardt,

Carol C. LochbaumAuthors Info & Claims

ACM Transactions on Information Systems (TOIS), Volume 7, Issue 1

Pages 30 - 57

https://doi.org/10.1145/64789.64790

Published: 03 January 1989 Publication History

Abstract

SuperBook is a hypertext browsing system designed to improve the usability of conventional documents. Successive versions of SuperBook were evaluated in a series of behavioral studies. Students searched for information in a statistics text. presented either in conventional printed form or in SuperBook form. The best version of SuperBook enabled students to answer search questions more quickly and accurately than they could with the conventional text. Students wrote higher quality “open-book” essays using SuperBook than they did with the conventional text, and their subjective ratings of the documentation strongly favored SuperBook.

This work is a case study of formative design-evaluation. Behavioral evaluation of the first version of SuperBook showed how design factors and user strategies affected search and established baseline performance measures with printed text. The second version of SuperBook was implemented with the goal of improving search accuracy and speed. User strategies that had proved effective in the first study were made very easy and attractive to use. System response time for common operations was greatly improved. Behavioral evaluation of the new SuperBook demonstrated its superiority to printed text and suggested additional improvements that were incorporated into “MiteyBook,” a SuperBook implementation for PC-size screens. Search with MiteyBook proved to be approximately 25 percent faster and 25 percent more accurate than that obtained with a conventional printed book.

References

[1]

ALLISON, D.R. Electronic publishing technologies {Special Issue}. IEEE Computer 21, 1 (1988).]]

[2]

BECKER, R. A., AND CHAMBERS, J. M. S An Interactive Environment for Data Analysis and Graphics. Wadsworth, Belmont, Calif., 1984.]]

[3]

BUSH, V. As we may think. Atlantic Monthly 76, 1 (1945), 101-108.]]

[4]

CLEVERDON, C. Optimizing convenient online access to bibliographic databases. In{. Serv. Use 4 (1984), 37-47.]]

[5]

CONKLIN, J. Hypertext: An introduction and survey. IEEE Computer 20 (1987), 17-41.]]

[6]

DEERWESTER, S., DUMAIS, S. T., FURNAS, G. W., LANDAUER, T. K., AND HARSHMAN, R. A. Indexing by latent semantic analysis. In press.]]

[7]

DUMAIS, S.T. Textual information retrieval. In Handbook of Human-Computer Interaction, M. Helander, Ed. Elsevier Science Publishers B. V. (North-Holland), Amsterdam, 1988.]]

[8]

DUMAIS, S. T., FURNAS, G. W., LANDAUER, T. K., DEERWESTER, S., AND HARSHMAN, R. Using latent semantic analysis to improve access to textual information, in Proceedings of CHI' 88 Human Factors in Computing Systems (Washington, D.C., May 15-19). ACM, New York, 1988, pp. 281-285.]]

[9]

EGAN, D.E. Electronic Text Browsers {Special Issue}. In press.]]

[10]

EGAN, D. E., REMDE, J. R., LANDAUER, T. K., LOCHBAUM, C. C., AND GOMEZ, L.M. Acquiring information in books and SuperBooks. In press.]]

[11]

ELKERTON, J., AND WILLIGES, R.C. Information retrieval strategies in a file-search environment. Hum. Factors 26 (1984), 171-184.]]

[12]

ENGELBART, D. C., AND ENGLISH, W.K. A research center for augmenting human intellect. In Proceedings of the 1968 Fall Joint Computer Con{erence (San Francisco, Calif., Dec. 9-11). AFIPS Press, Montvale, N.J., 1968, pp. 395-410.]]

[13]

FURNAS, G.W. Experience with an adaptive indexing scheme. In Proceedings o/CHI' 85 Human Factors in Computing Systems (San Francisco, Calif., Apr. 14-18). ACM, New York, 1985, pp. 131-135.]]

[14]

FURNAS, G. W. Generalized fisheye views. In Proceedings o/ CHI '86 Human Factors in Computing Systems (Boston, Mass., Apr. 13-19). ACM, New York, 1986, pp. 16-23.]]

[15]

FURNAS, G. W., LANDAUER, T. K., GOMEZ, L. M., AND DUMAIS, S.T. Statistical semantics: Analysis of the potential performance of key-word information systems. Bell Sys. Tech. J. 62, 6 (1983), 1753-1806.]]

[16]

GOMEZ, L. M., AND LOCHBAUM, C.C. People can retrieve more objects with enriched key-word vocabularies. But is there a human performance cost? In Human-Computer Interaction--Interact '84, B. Shackel, Ed. North-Holland, Amsterdam, 1984, pp. 257-261.]]

[17]

GOMEZ, L. M., LOCHBAUM, C. C., AND LANDAUER, T.K. All the right words: Finding what you want as a function of richness of indexing vocabulary. In press.]]

[18]

GOOD, i., WHITESIDE, J. A., WIXON, D. R., AND JONES, S.J. Building a user-derived interface. Commun. ACM 27, 10 (Oct. 1984), 1032-1043.]]

[19]

GORDON, S., GUSTAVEL, J., MOORE, J., AND HANKEY, J. The effects of hypertext on reader knowledge representation. In Proceedings of the Human Factors Society--32nd Annual Meeting, Human Factors Society, Santa Monica, Calif., 1988, pp. 296-300.]]

[20]

GOULD, J. D. How to design usable systems. In Handbook of Human-Computer Interaction, M. Helander, Ed. Elsevier Science Publishers B. V. (North-Holland), Amsterdam, 1988.]]

[21]

GOULD, J. D., ALFARO, L., FINN, R., HAUPT, B., MINUTO, A., AND SALAUN, J. Why reading was slower from crt displays than from paper. In Proceedings of CHI/GI '87 Human Factors in Computing Systems and Graphics Interface (Toronto, Ontario, Apr. 5-9). ACM, New York, 1987, pp. 7-11.]]

[22]

HANSEN, W. J., AND HAAS, C. Reading and writing with computers: A framework for explaining differences in performance. Commun. ACM 31, 9 (Sept. 1988), 1080-1089.]]

[23]

MANTEI, M.M. A study of disorientation behavior in ZOG. Ph.D. dissertation, University of Southern California, Dept. of Computer Science, Los Angeles, 1982.]]

[24]

MARCHIONINI, G., AND SHNEIDERMAN, B. Finding facts vs. browsing knowledge in hypertext systems. IEEE Computer 2I, 1 (1988), 70-80.]]

[25]

MCCRACKEN, D. L., AND AKSCYN, R.M. Experience with the ZOG human-computer interface system. Int. J. Man-Mach. Stud. 21 (1984), 293-310.]]

[26]

NELSON, T. H. Getting it out of our system. In Information Retrieval: A Critical Review, G. Schechter, Ed. Thompson Books, Washington, D.C., 1967.]]

[27]

PERLMAN, G. An overview of SAM: A hypertext interface to Smith & Mosier's. Tech. Rep. TR- 87-09. Wang Institute, Tyngsboro, Mass., 1987.]]

[28]

REMDE, J. R., GOMEZ, L. M., AND LANDAUER, T. K. SuperBook: An Automatic Tool for Information Exploration--Hypertext? In Proceedings of Hypertext '87 (Chapel Hill, N.C.). 1987, pp. 175-188.]]

[29]

SHNEIDERMAN, B. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley, Reading, Mass., 1987.]]

[30]

SMITH, J. B., AND WEISS, S.F. An overview of hypertext. Commun. ACM 31, 7 (July 1988), 816-819.]]

[31]

UHLER, S.A. Architecture and design of the MGR window system. Tech. Memo. TM-ARH- 013070. Bellcore, Morristown, N.J., 1988.]]

[32]

VAN DAM, A. Hypertext '87 keynote address. Commun. ACM 31, 7 (July 1988), 887-895.]]

[33]

VAN SICKEL, P., SIERZEGA, K. F., HERRING, C. A., AND FRUND, J.J. Documentation management for large systems of equipment. In Proceedings of RIAO '88 User-Oriented Content-Based Text and Image Handling. MIT, Cambridge, Mass., 1988, pp. 124-137.]]

[34]

WALKER, J.H. Document Examiner: Delivery interface for hypertext documents. In Proceedings of Hypertext '87 (Chapel Hill, N.C., 1987) 1987, pp. 307-323.]]

[35]

WATT, J.H. Level of abstraction structured text. IEEE Trans. Syst., Man Cybern. 18 (1988), 497-505.]]

[36]

WEYER, S. A. Searching for information in a dynamic book. Ph.D. dissertation, Stanford University, Palo Alto, Calif., 1982.]]

[37]

WEYER, S.A. The design of a dynamic book for information search. Int. J. Man Mach. Stud. 17 (1982), 87-107.]]

Cited By

Taieb-Maimon MHarush H(2024)Web Search Engine Results Page Viewing Formats for Different Search TasksInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2376358(1-16)Online publication date: 29-Jul-2024
https://doi.org/10.1080/10447318.2024.2376358
Hutton Pospick CSuma Rosenberg E(2023)Creating and manipulating 3D paths with mixed reality spatial interfacesFrontiers in Virtual Reality10.3389/frvir.2023.11927574Online publication date: 6-Dec-2023
https://doi.org/10.3389/frvir.2023.1192757
Torfs-Leibman CAshikaga TKrag DLunna SRobtoy SBombardier R(2022)Pilot trial comparing COVID-19 publication database to conventional online search methodsBMJ Health & Care Informatics10.1136/bmjhci-2022-10061629:1(e100616)Online publication date: 8-Nov-2022
https://doi.org/10.1136/bmjhci-2022-100616
Show More Cited By

Index Terms

Formative design evaluation of superbook

Recommendations

SuperBook: an automatic tool for information exploration—hypertext?
HYPERTEXT '87: Proceedings of the ACM conference on Hypertext

The goals and methods of the text browser, SuperBook, are compared with those of hypertext systems in general. SuperBook, intended to provide improved access to text existing in electronic form, employs cognitive tools arising from human computer ...
An evaluation of parallel numerical hessian calculations
HPCS'09: Proceedings of the 23rd international conference on High Performance Computing Systems and Applications

The calculation of the Hessian (or force constant matrix), is an important part of geometry optimization calculations. The process of calculating the Hessian can be demanding in both computational time and resources. Even though many computational ...
Formative Assessment Management System Based on Fuzzy Evaluation
IITAW '09: Proceedings of the 2009 Third International Symposium on Intelligent Information Technology Application Workshops

Formative assessment is an important method to control the quality of the learning process. In this paper, a framework for the formative assessment management system is presented. This three-layer system framework is based on the J2EE technologies. The ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems

ACM Transactions on Information Systems Volume 7, Issue 1

Jan. 1989

98 pages

ISSN:1046-8188

EISSN:1558-2868

DOI:10.1145/64789

Editor:
Robert B. Allen

Issue’s Table of Contents

Copyright © 1989 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 January 1989

Published in TOIS Volume 7, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

215
Total Citations
View Citations
1,662
Total Downloads

Downloads (Last 12 months)188
Downloads (Last 6 weeks)26

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Taieb-Maimon MHarush H(2024)Web Search Engine Results Page Viewing Formats for Different Search TasksInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2376358(1-16)Online publication date: 29-Jul-2024
https://doi.org/10.1080/10447318.2024.2376358
Hutton Pospick CSuma Rosenberg E(2023)Creating and manipulating 3D paths with mixed reality spatial interfacesFrontiers in Virtual Reality10.3389/frvir.2023.11927574Online publication date: 6-Dec-2023
https://doi.org/10.3389/frvir.2023.1192757
Torfs-Leibman CAshikaga TKrag DLunna SRobtoy SBombardier R(2022)Pilot trial comparing COVID-19 publication database to conventional online search methodsBMJ Health & Care Informatics10.1136/bmjhci-2022-10061629:1(e100616)Online publication date: 8-Nov-2022
https://doi.org/10.1136/bmjhci-2022-100616
Hoadley CCampos F(2022)Design-based research: What it is and why it matters to studying online learningEducational Psychologist10.1080/00461520.2022.207912857:3(207-220)Online publication date: 1-Jul-2022
https://doi.org/10.1080/00461520.2022.2079128
Peng CGe TWang Y(2022)Optimizing word search within documents by showing results in the contextJournal of Visualization10.1007/s12650-022-00880-526:2(441-455)Online publication date: 26-Sep-2022
https://dl.acm.org/doi/10.1007/s12650-022-00880-5
Head ALo KKang DFok RSkjonsberg SWeld DHearst MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and SymbolsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445648(1-18)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445648
Hersh W(2021)Information RetrievalBiomedical Informatics10.1007/978-3-030-58721-5_23(755-794)Online publication date: 1-Jun-2021
https://doi.org/10.1007/978-3-030-58721-5_23
Hersh WHersh W(2020)EvaluationInformation Retrieval: A Biomedical and Health Perspective10.1007/978-3-030-47686-1_7(289-335)Online publication date: 23-Jul-2020
https://doi.org/10.1007/978-3-030-47686-1_7
Kim SKim J(2019)e-mmersive Book: a HMD AR Book that Assists Syntopical ReadingJournal of Digital Contents Society10.9728/dcs.2019.20.8.150320:8(1503-1512)Online publication date: 31-Aug-2019
https://doi.org/10.9728/dcs.2019.20.8.1503
Miller MFeigh K(2019)Addressing the envisioned world problem: a case study in human spaceflight operationsDesign Science10.1017/dsj.2019.25Online publication date: 29-Jan-2019
https://doi.org/10.1017/dsj.2019.2
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents