Article

Metrics for analyzing rich session histories

Authors:

Georges GrinsteinAuthors Info & Claims

BELIV '06: Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization

Pages 1 - 5

https://doi.org/10.1145/1168149.1168160

Published: 23 May 2006 Publication History

Get Access

Abstract

To be most useful, evaluation metrics should be based on detailed observation and effective analysis of a full spectrum of system use. Because observation is costly, ideally we want a system to provide in-depth data collection with allied analyses of the key user interface elements. We have developed a visualization and analysis platform [1] that automatically records user actions and states at a high semantic level [2 and 3], and can be directly restored to any state. Audio and text annotations are collected and indexed to states, allowing users to comment on their current situation as they work, and/or as they review the session. These capabilities can be applied to usability evaluation of the system, describing problems they encountered, or to suggest improvements to the environment. Additionally, computed metrics are provided at each state [3, 4, and 5]. We believe that the metrics and the associated history data will allow us to deduce patterns of data exploration, to compare users, to evaluate tools, and to understand in a more automated approach the usability of the visualization system as a whole.

References

[1]

Gee, A. G., Li, H., Yu, M., Smrtic, M. B., Cvek, U., Goodell, H., Gupta, V., Lawrence, C., Zhou, J., Chiang, C.-H. and Grinstein, G. G., Universal Visualization Platform, in Visualization and Data Analysis 2005, (San Jose, California, USA, 2005), SPIE, 274--283.]]

Google Scholar

[2]

Goodell, H., Chiang, C.-H. and Grinstein, G. G. Taxonomized Automated Monitoring of Interactive Visualization, Computer Science Department, University of Massachusetts at Lowell, Lowell, Massachusetts, 2006.]]

Google Scholar

[3]

Goodell, H., Chiang, C.-H., Kelleher, C., Baumann, A. and Grinstein, G., Collecting and Harnessing Rich Session Histories, in 10th International Conference on Information Visualisation, (London, England, 2006), IEEE Press.]]

Digital Library

Google Scholar

[4]

Lee, J. P. and Grinstein, G. G. An Architecture for Retaining and Analyzing Visual Explorations of Databases. Proceedings of IEEE Visualization 1995. 101--109.]]

Digital Library

Google Scholar

[5]

Lee, J. P. A systems and process model for data exploration Computer Science, Dissertation, University of Massachusetts at Lowell, Lowell, Massachusetts, USA, 1998, 245.]]

Digital Library

Google Scholar

[6]

Rooden, M. J. T., Ed. (1998). Thinking About Thinking Aloud. Contemporary Ergonomics. London, Taylor and Francis.]]

Google Scholar

[7]

Boren, M. T. and J. Ramey (2000). "Thinking Aloud: Reconciling Theory and Practice." IEEE Transactions on Professional Communication 43(3): 261--278]]

Crossref

Google Scholar

[8]

Bowers, V. A. (1990). Concurrent Versus Retrospective Verbal Protocols for Comparing Window Usability. Industrial Engineering and Operations Research. Blacksburg, Virginia, USA, Virginia Polytechnic Institute and State University. Doctorate thesis.]]

Google Scholar

[9]

Rekimoto, J., Time-Machine Computing: A Time-Centric Approach for the Information Environment, in ACM Symposium on User Interface Software and Technology, (1999), 45--54.]]

Digital Library

Google Scholar

Cited By

View all

Blaha LArendt DMohd-Zaid F(2014)More bang for your research buckProceedings of the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization10.1145/2669557.2669566(126-133)Online publication date: 10-Nov-2014
https://dl.acm.org/doi/10.1145/2669557.2669566

Index Terms

Metrics for analyzing rich session histories
1. Computing methodologies
  1. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Collecting and Harnessing Rich Session Histories
IV '06: Proceedings of the conference on Information Visualization

To be most useful, evaluation requires detailed observation and effective analysis of a full spectrum of system use. We have developed an approach and architecture for in-depth data collection and analysis of all use of a visualization system. User ...
Interactive exploration of music listening histories
AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

Over the past years, music listening histories have become easily accessible due to the expansion of online lifelogging services. These histories represent the sequence of songs listen by users over time. Although this data contains intrinsic users' ...
Validation metrics for response histories: perspectives and case studies

The quantified comparison of transient response results are useful to analysts as they seek to improve and evaluate numerical models. Traditionally, comparisons of time histories on a graph have been used to make subjective engineering judgments as to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

BELIV '06: Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization

May 2006

89 pages

ISBN:1595935622

DOI:10.1145/1168149

Conference Chairs:
Enrico Bertini
University of Rome "La Sapienza"
,
Catherine Plaisant
University of Maryland
,
Giuseppe Santucci
University of Rome "La Sapienza"

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 May 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

AVI06

AVI06: The International Conference on Advanced Visual Interfaces

May 23, 2006

Venice, Italy

Acceptance Rates

Overall Acceptance Rate 45 of 64 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
325
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Blaha LArendt DMohd-Zaid F(2014)More bang for your research buckProceedings of the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization10.1145/2669557.2669566(126-133)Online publication date: 10-Nov-2014
https://dl.acm.org/doi/10.1145/2669557.2669566

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Collecting and Harnessing Rich Session Histories

Interactive exploration of music listening histories

Validation metrics for response histories: perspectives and case studies

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations