article

WebQuilt: A proxy-based approach to remote web usability testing

ACM Transactions on Information Systems (TOIS), Volume 19, Issue 3

Pages 263 - 285

Published: 01 July 2001 Publication History

Abstract

WebQuilt is a web logging and visualization system that helps web design teams run usability tests (both local and remote) and analyze the collected data. Logging is done through a proxy, overcoming many of the problems with server-side and client-side logging. Captured usage traces can be aggregated and visualized in a zooming interface that shows the web pages people viewed. The visualization also shows the most common paths taken through the web site for a given task, as well as the optimal path for that task, as designated by the designer. This paper discusses the architecture of WebQuilt and describes how it can be extended for new kinds of analyses and visualizations.

References

[1]

BEDERSON,B.AND HOLLAN, J. 1994. Pad CC : A Zooming Graphical Interface for Exploring Alternative Interface Physics. In ACM Symposium on User Interface Software and Technology: UIST '94. Marina del Rey, CA, November. 17-26.

Crossref

Google Scholar

[2]

BEYER,H.AND HOLTZBLATT, K. 1998. Contextual Design: Defining Customer-Centered Systems. Morgan Kaufmann, San Francisco.

Crossref

Google Scholar

[3]

CHI, E., ET AL. 1998. Visualizing the Evolution of Web Ecologies. In ACM CHI Conference on Human Factors in Computing Systems. 400-407.

Crossref

Google Scholar

[4]

CHOO,C.W.,DETLOR,B.,AND TURNBULL, D. 1998. A Behavioral Model of Information Seeking on the Web-Preliminary Results of a Study of How Managers and IT Specialists Use the Web. In Proceedings of the 61st Annual Meeting, 35, 290-302.

Google Scholar

[5]

CUGINI,J.AND SCHOLTZ, J. 1999. VISVIP: 3D Visualization of Paths through Web Sites. In International Workshop on Web-Based Information Visualization (WebVis'99). Florence, Italy. 259-263.

Crossref

Google Scholar

[6]

DAVISON, B. 1999. Web Traffic Logs: An Imperfect Resource for Evaluation. In Ninth Annual Conference of the Internet Society (INET'99). San Jose, CA, June.

Google Scholar

[7]

EDMONDS, A. 2001. http://sourceforge.net/projects/lucidity/.

Google Scholar

[8]

Ergosoft Laboratories. 2001. ErgoBrowser. http://www.ergolabs.com/ergoBrowser/ergoBrowser. htm.

Google Scholar

[9]

ETGEN,M.AND CANTOR, J. 1999. What Does Getting WET (Web Event-Logging Tool) Mean for Web Usability? In Proceedings of the Fifth Conference on Human Factors and the Web. Gaithersburg, MD, June.

Google Scholar

[10]

GOULD,J.AND LEWIS, C. 1985. Designing for Usability: Key Principles and What Designers Think. In Communications of the ACM, 28, 3, 300-311.

Crossref

Google Scholar

[11]

GUZDIAL, M., ET AL. 1994. Analyzing and visualizing event log files: A computational science of usability. Presented at Human Computer Interaction Consortium Workshop. Winter Park, CO, February.

Google Scholar

[12]

HELFRICH,B.AND LANDAY, J. A. 1999. QUIP: Quantitative User Interface Profiling, http:// home.earthlink.net/>>bhelfrich/quip/.

Google Scholar

[13]

HOCHHEISER,H.AND SHNEIDERMAN, B. 1999. Understanding Patterns of User Visits to Web Sites: Interactive Starfield Visualizations of WWW Log Data. Technical Report ncstrl.umcp/CS-TR-3989, University of Maryland. College Park, MD, February.

Google Scholar

[14]

MYERS,B.A.AND ROSSON, M. B. 1992. Survey on User Interface Programming. In Proceedings of the Conference on Human Factors in Computing Systems. Monterey, CA, May. 195-202.

Crossref

Google Scholar

[15]

NetrakerCorporation. 2001. NetRaker Suite. http://netraker.com.

Google Scholar

[16]

NIELSEN,J.AND LANDAUER, T. 1993. A mathematical model of the finding of usability problems. In ACM INTERCHI'93. Amsterdam, The Netherlands, April. 206-213.

Crossref

Google Scholar

[17]

NIST. 1999. WebVIP. http://zing.ncsl.nist.gov/webmet/vip/webvip-process.html.

Google Scholar

[18]

NORMAN, D. A. 1990. The Design of Everyday Things. Doubleday, NY.

Google Scholar

[19]

PITKOW,J.E.AND BHARAT, K. 1994. WebViz: A Tool for World-Wide Web Access Log Analysis. In First International Conference on the World-Wide Web. Geneva, Switzerland, May. 271-277.

Google Scholar

[20]

PITKOW,J.E.AND PIROLLI, P. 1999. Mining Longest Repeated Subsequences to Predict World Wide Web Surfing. In Second USENIX Symposium on Internet Technologies and Systems. Boulder, CO, October.

Crossref

Google Scholar

[21]

RUBIN, J. 1994. Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. John Wiley & Sons, NY.

Crossref

Google Scholar

[22]

SPOOL,J.M.,ET AL. 1998. Web Site Usability: A Designer's Guide. Academic Press, San Diego, CA.

Crossref

Google Scholar

[23]

SPOOL,J.AND SCHROEDER, W. 2001. Testing Web Sites: Five Users is Nowhere Near Enough. In ACM CHI Conference on Human Factors in Computing Systems, Extended Abstracts. Seattle, WA, April.

Crossref

Google Scholar

[24]

Sun Microsystems. 2001. Java Secure Socket Extension. http://java.sun.com/products/jsse/index. html.

Google Scholar

[25]

TAUSCHER, L. M. 1999. Evaluating History Mechanisms: An Empirical Study of Reuse Patterns in WWW Navigation. MS Thesis, Department of Computer Science, University of Calgary, Alberta, Canada.

Google Scholar

[26]

TEDESCHI, B. 1999. Good Web Site Design Can Lead to Healthy Sales, http://www.nytimes.com/ library/tech/99/08/cyber/commerce/30commerce.html.

Google Scholar

[27]

TSCHALAR, R. 2000. HTTPClient V0.3-2. http://www.innovation.ch/java/HTTPClient/index.htm.

Google Scholar

[28]

VIRZI, R. A. 1992. Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? Human Factors, 34, 4, 457-468.

Crossref

Google Scholar

[29]

VisualInsights. 2001. eBizinsights. http://www.visualinsights.com.

Google Scholar

[30]

Vividence. 2000a. Vividence Browser. http://www.vividence.com/resources/public/solutions/demo/ demo-print.htm.

Google Scholar

[31]

Vividence. 2000b. Vividence Clickstreams. http://www.vividence.com/resources/public/solutions/ demo/demo-print.htm.

Google Scholar

[32]

WEXELBLAT,A.AND MAES, P. 1999. Footprints: History-Rich Tools for Information Foraging. In ACM CHI Conference on Human Factors in Computing Systems. Pittsburgh, PA, May, 270-277.

Crossref

Google Scholar

[33]

ZonaResearch. 1999. Shop Until You Drop? A Glimpse into Internet Shopping Success. http:// www.zonaresearch.com/promotios/samples/zaps/Zap06.htm.

Google Scholar

[34]

Zoomerang. 2001. http://www.zoomerang.com.

Google Scholar

Cited By

View all

Desolda GLanzilotti RCaivano DCostabile MBuono P(2023)Asynchronous Remote Usability Tests Using Web-Based Tools Versus Laboratory Usability Tests: An Experimental StudyIEEE Transactions on Human-Machine Systems10.1109/THMS.2023.328222553:4(731-742)Online publication date: Aug-2023
https://doi.org/10.1109/THMS.2023.3282225
Mittal RMalik VSingh JSingh VMittal A(2022)Web Usage Mining—Process, Tools and PracticesRecent Innovations in Computing10.1007/978-981-16-8248-3_37(449-457)Online publication date: 10-Mar-2022
https://doi.org/10.1007/978-981-16-8248-3_37
Helfenstein MZweig KHerrlich M(2021)A Technical Framework for Investigating the Impact of Design Elements in the Wild: Using Instagram as an ExampleProceedings of Mensch und Computer 202110.1145/3473856.3473987(490-493)Online publication date: 5-Sep-2021
https://dl.acm.org/doi/10.1145/3473856.3473987
Show More Cited By

Index Terms

WebQuilt: A proxy-based approach to remote web usability testing

Recommendations

WebQuilt: a framework for capturing and visualizing the web experience
WWW '01: Proceedings of the 10th international conference on World Wide Web
What did they do? understanding clickstreams with the WebQuilt visualization system
AVI '02: Proceedings of the Working Conference on Advanced Visual Interfaces

This paper describes the visual analysis tool WebQuilt, a web usability logging and visualization system that helps web design teams record and analyze usability tests. The logging portion of WebQuilt unobtrusively gathers clickstream data as users ...
Visualization to Support Augmented Web Browsing
WI-IAT '13: Proceedings of the 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT) - Volume 01

In conventional Web browsing, to explore contents of interest while browsing a web page, in many cases users need to leave that web page and switch to external applications or other task-specific websites. To avoid switching between web pages, we ...

Reviews

Reviewer: James H. Bradford

Web browsing has become a significant activity throughout the developed world. It is an activity that underpins modern e-commerce, as well as facilitating access to the vast store of communal knowledge held in the World Wide Web. Research into the human factors of browsing behavior is important because Web browsing itself is important. This paper introduces an interesting new tool for the usability testing of Web pages. The authors point out that traditional transaction logging for user Web browsing behavior is either server-based or client-based. Both approaches have their drawbacks. The authors introduce a variation of the server-side technique that uses a proxy server to get around some of the traditional problems with server-side logging. This tool, called WebQuilt, represents a novel—and potentially very useful—approach to data collection. Much of the rest of the paper describes the implementation of the WebQuilt tool, in sufficient detail to guide other researchers in the development of their own proxy server monitoring tools. The paper concludes with a detailed discussion of action inferencing and visualization techniques that will be valuable to researchers in this area, no matter what data collection procedure is used. In summary, this is a good piece of applied research, which sets the groundwork for further experiments in an important area of human factors study. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACM Transactions on Information Systems Volume 19, Issue 3

July 2001

119 pages

ISSN:1046-8188

EISSN:1558-2868

DOI:10.1145/502115

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2001

Published in TOIS Volume 19, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

81
Total Citations
View Citations
2,408
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Desolda GLanzilotti RCaivano DCostabile MBuono P(2023)Asynchronous Remote Usability Tests Using Web-Based Tools Versus Laboratory Usability Tests: An Experimental StudyIEEE Transactions on Human-Machine Systems10.1109/THMS.2023.328222553:4(731-742)Online publication date: Aug-2023
https://doi.org/10.1109/THMS.2023.3282225
Mittal RMalik VSingh JSingh VMittal A(2022)Web Usage Mining—Process, Tools and PracticesRecent Innovations in Computing10.1007/978-981-16-8248-3_37(449-457)Online publication date: 10-Mar-2022
https://doi.org/10.1007/978-981-16-8248-3_37
Helfenstein MZweig KHerrlich M(2021)A Technical Framework for Investigating the Impact of Design Elements in the Wild: Using Instagram as an ExampleProceedings of Mensch und Computer 202110.1145/3473856.3473987(490-493)Online publication date: 5-Sep-2021
https://dl.acm.org/doi/10.1145/3473856.3473987
Wang EWang FKumari SYeh JChen C(2021)Intelligent monitor for typhoon in IoT system of smart cityThe Journal of Supercomputing10.1007/s11227-020-03381-077:3(3024-3043)Online publication date: 1-Mar-2021
https://dl.acm.org/doi/10.1007/s11227-020-03381-0
Wu CLiu Z(2021)Usability Study of a Public Culture Website for Improvement: A Case of Guangzhou Museum of ArtDesign, User Experience, and Usability: Design for Contemporary Technological Environments10.1007/978-3-030-78227-6_40(563-583)Online publication date: 24-Jul-2021
https://dl.acm.org/doi/10.1007/978-3-030-78227-6_40
Paranthaman PCooper SArnedo JNacke LVanden Abeele VToups Dugas P(2019)ARAPID: Towards Integrating Crowdsourced Playtesting into the Game Development EnvironmentProceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3311350.3347163(121-133)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3311350.3347163
Abascal JArrue MValencia X(2019)Tools for Web Accessibility EvaluationWeb Accessibility10.1007/978-1-4471-7440-0_26(479-503)Online publication date: 4-Jun-2019
https://doi.org/10.1007/978-1-4471-7440-0_26
Chawla S(2018)Multi-Agent-Based Information Retrieval System Using Information Scent in Query Log Mining for Effective Web SearchInformation Retrieval and Management10.4018/978-1-5225-5191-1.ch012(266-291)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-5191-1.ch012
Arrue MValencia XPérez JMoreno LAbascal J(2018)Inclusive Web Empirical Studies in Remote and In-Situ Settings: A User Evaluation of the RemoTest PlatformInternational Journal of Human–Computer Interaction10.1080/10447318.2018.1473941(1-16)Online publication date: 23-May-2018
https://doi.org/10.1080/10447318.2018.1473941
de Santana VBaranauskas M(2018)A Taxonomy for Website Evaluation Tools Grounded on Semiotic FrameworkUniversal Access in Human-Computer Interaction. Methods, Technologies, and Users10.1007/978-3-319-92049-8_3(38-49)Online publication date: 15-Jul-2018
https://dl.acm.org/doi/10.1007/978-3-319-92049-8_3
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

WebQuilt: a framework for capturing and visualizing the web experience

What did they do? understanding clickstreams with the WebQuilt visualization system

Visualization to Support Augmented Web Browsing

Reviews

Access critical reviews of Computing literature here