More Web Proxy on the site http://driver.im/

research-article

DIVI: Dynamically Interactive Visualization

Authors:

Luke S. Snyder,

Jeffrey HeerAuthors Info & Claims

IEEE Transactions on Visualization and Computer Graphics, Volume 30, Issue 1

Pages 403 - 413

https://doi.org/10.1109/TVCG.2023.3327172

Published: 01 January 2024 Publication History

Abstract

Dynamically Interactive Visualization (DIVI) is a novel approach for orchestrating interactions within and across static visualizations. DIVI deconstructs Scalable Vector Graphics charts at runtime to infer content and coordinate user input, decoupling interaction from specification logic. This decoupling allows interactions to extend and compose freely across different tools, chart types, and analysis goals. DIVI exploits positional relations of marks to detect chart components such as axes and legends, reconstruct scales and view encodings, and infer data fields. DIVI then enumerates candidate transformations across inferred data to perform linking between views. To support dynamic interaction without prior specification, we introduce a taxonomy that formalizes the space of standard interactions by chart element, interaction type, and input event. We demonstrate DIVI's usefulness for rapid data exploration and analysis through a usability study with 13 participants and a diverse gallery of dynamically interactive visualizations, including single chart, multi-view, and cross-tool configurations.

References

[1]

[Online]. Available: https://uwdata.github.io/arquero/, 2022. 11.

[2]

M. Bostock and J. Heer. Protovis: A graphical toolkit for visualization. IEEE transactions on visualization and computer graphics, 15 (6): pp. 1121–1128, 2009. 2.

Digital Library

[3]

M. Bostock, V. Ogievetsky, and J. Heer. D³ data-driven documents. IEEE Transactions on Visualization and Computer Graphics, 17 (12): pp. 2301–2309, 2011. 1, 2, 3, 5,8, 9.

Digital Library

[4]

M. Brehmer and T. Munzner. A multi-level typology of abstract visualization tasks. IEEE Transactions on Visualization and Computer Graphics, 19 (12): pp. 2376–2385, 2013. 2,3,4.

Digital Library

[5]

J. Brosz, M. A. Nacenta, R. Pusch, S. Carpendale, and C. Hurter. Transmogrification: Causal manipulation of visualizations. In Proceedings of the 26th annual ACM symposium on User interface software and technology, pp. 97–106, 2013. 2.

[6]

J. Choi, D. G. Park, Y. L. Wong, E. Fisher, and N. Elmqvist. Visdock: A toolkit for cross-cutting interactions in visualization. IEEE Transactions on Visualization and Computer Graphics, 21 (9): pp. 1087–1100, 2015, 2, 3, 5, 8.

Digital Library

[7]

K. Davila, S. Setlur, D. Doermann, B. U. Kota, and V. Govindaraju. Chart mining: A survey of methods for automated chart analysis. IEEE transactions on pattern analysis and machine intelligence, 43 (11): pp. 3799–3819, 2020. 2.

[8]

A. K. Dey and J. Mankoff. Designing mediation for context-aware applications. in ACM Transactions on Computer-Human Interaction (TOCHI), 12 (1): pp. 53–80, 2005. 4.

[9]

J. Harper and M. Agrawala. Deconstructing and restyling d3 visualizations. In Proceedings of the 27th annual ACM symposium on User interface software and technoloey, pp. 253–262, 2014. 2.

Digital Library

[10]

J. Harper and M. Agrawala. Converting basic d3 charts into reusable style templates. IEEE transactions on visualization and computer graphics, 24 (3): pp. 1274–1286, 2017. 2.

[11]

D. Jung, W. Kim, H. Song, J.-I. Hwang, B. Lee, B. Kim, and J. Seo. Chartsense: Interactive data extraction from chart images. In Proceedings of the 2017 chi conference on human factors in computing systems, pp. 6706–6717, 2017. 2.

Digital Library

[12]

N. Kong and M. Agrawala. Graphical overlays: Using layered elements to aid chart reading. IEEE transactions on visualization and computer graphics, 18 (12): pp. 2631–2638, 2012. 2.

Digital Library

[13]

C. Liu, Y. Zhang, C. Wu, C. Li, and X. Yuan. A spatial-constraint model for manipulating static visualizations. arXiv preprint arXiv:, 2023. 2.

[14]

Z. Liu, J. Thompson, A. Wilson, M. Dontcheva, J. Delorey, S. Grigg, B. Kerr, and J. Stasko. Data illustrator: Augmenting vector design tools with lazy data binding for expressive visualization authoring. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–13, 2018. 2.

[15]

M. Lu, J. Liang, Y. Zhang, G. Li, S. Chen, Z. Li, and X. Yuan. Interaction+: Interaction enhancement for web-based visualizations. In 2017 IEEE Pacific Visualization Symoosium (PaciticVisi. pp. 61–70. IEEE. 2017. 2, 3.

[16]

S. Lu. D3-annotation. [Online]. Available: https://d3-annotation.susielu.com/, 2022. 7.

[17]

D. Masson, S. Malacria, D. Vogel, E. Lank, and G. Casiez. Chartdetective: Easy and accurate interactive data extraction from complex vector charts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, pp. 1–17, 2023. 2.

Digital Library

[18]

R. G. McDaniel and B. A. Myers. Getting more out of programming-by-demonstration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 442–449. 1999. 2.

Digital Library

[19]

C. North and B. Shneiderman. Snap-together visualization: a user interface for coordinating visualizations via relational schemata. In Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 128–135, 2000. 2.

Digital Library

[20]

[Online]. Available: https://qithub.com/observablehq/plot/, 2022. 2, 7.

[21]

[Online]. Available: https://matplotlib.org/, 2022. 1,3,4,5,8.

[22]

[Online]. Available: http://www.plotly.com/.2022. 2,3.

[23]

J. Poco and J. Heer. Reverse-engineering visualizations: Recovering visual encodings from chart images. Computer graphics forum, 36 (3): pp. 353–363, 2017. 2, 9.

Digital Library

[24]

J. Poco, A. Mayhua, and J. Heer. Extracting and retargeting color mappings from bitmap images of visualizations. IEEE transactions on visualization and computer graphics, 24 (1): pp. 637–646, 2017. 2,9.

[25]

D. Ren, B. Lee, and M. Brehmer. Charticulator: Interactive construction of bespoke chart layouts. IEEE transactions on visualization and computer graphics, 25 (1): pp. 789–799, 2018. 2.

Digital Library

[26]

[Online]. Available: https://github.com/parkerziegler/reviz/, 2022. 2.

[27]

B. Saket and A. Endert. Investigating the manual view specification and visualization by demonstration paradigms for visualization construction. Computer graphics forum, 38 (3): pp. 663–674, 2019. 2.

[28]

B. Saket, L. Jiang, C. Perin, and A. Endert. Liger: Combining interaction paradigms for visual analysis. arXiv preprint arXiv:, 2019. 2.

[29]

B. Saket, H. Kim, E. T. Brown, and A. Endert. Visualization by demonstration: An interaction paradigm for visual data exploration. IEEE transactions on visualization and computer graphics, 23 (1): pp. 331–340, 2016. 2.

Digital Library

[30]

A. Satyanarayan and J. Heer. Lyra: An interactive visualization design environment. Computer graphics forum, 33 (3): pp. 351–360, 2014. 2.

[31]

A. Satyanarayan, D. Moritz, K. Wongsuphasawat, and J. Heer. Vega-lite: A grammar of interactive graphics. IEEE Transactions on Visualization and Computer Graphics, 23 (1): pp. 341–350, 2016. 1, 2, 3, 5, 8.

Digital Library

[32]

M. Savva, N. Kong, A. Chhajta, L. Fei-Fei, M. Agrawala, and J. Heer. Revision: Automated classification, analysis and redesign of chart images. In Proceedings of the 24th annual ACM symposium on User interface software and technology, pp. 393–402, 2011. 2, 9.

[33]

K. Sedig and P. Parsons. Interaction design for complex cognitive activities with visual representations: A pattern-based approach. AIS Transactions on Human-Computer Interaction, 5 (2): pp. 84–133, 2013. 2.

[34]

A. Srinivasan, B. Lee, N. Henry Riche, S. M. Drucker, and K. Hinckley. Inchorus: Designing consistent multimodal interactions for data visualization on tablet devices. In Proceedings of the 2020 CHI conference on human factors in computing systems, pp. 1–13, 2020. 2,3.

Digital Library

[35]

[Online]. Available: http://www.tableau.com/. 2022. 2.

[36]

C. Wang, Y. Feng, R. Bodik, I. Dillig, A. Cheung, and A. J. Ko. Falx: Synthesis-powered visualization authoring. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–15, 2021. 2.

Digital Library

[37]

H. Wickham. ggplot2: elegant graphics for data analysis. springer, 2016. 1,2,3,4,5,8,9.

[38]

J. O. Wobbrock, M. R. Morris, and A. D. Wilson. User-defined gestures for surface computing. In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 1083–1092, 2009. 2, 3, 9.

Digital Library

[39]

J. S. Yi, Y. Ah Kang, J. Stasko, and J. A. Jacko. Toward a deeper understanding of the role of interaction in information visualization. IEEE Transactions on Visualization and Computer Graphics, 13 (6): pp. 1224–1231, 2007. 2,3,4.

Digital Library

[40]

J. Zong, D. Barnwal, R. Neogy, and A. Satyanarayan. Lyra 2: Designing interactive visualizations by demonstration. IEEE Transactions on Visualization and Computer Graphics, 27 (2): pp. 304–314, 2020. 1,2,3.

Cited By

Liu ZChen CHooker J(2024)Manipulable Semantic Components: A Computational Representation of Data Visualization ScenesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345629631:1(732-742)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456296

Index Terms

DIVI: Dynamically Interactive Visualization
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Software and its engineering
  1. Software notations and tools

Index terms have been assigned to the content through auto-classification.

Recommendations

Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

Interactive visualization plays a key role in the analysis of large datasets. It can help users to explore data, investigate hypotheses and find patterns. The easier and more tangible the interaction, the more likely it is to enhance understanding. This ...
Interactive Data Visualization to Understand Data Better: Case Studies in Healthcare System

This paper focuses on interactive data visualization techniques and their applications in healthcare systems. Interactive data visualization is a collection of techniques translating data from its numeric format to graphic presentation dynamically for ...
Trends in Interactive Visualization: State-of-the-Art Survey

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Visualization and Computer Graphics

IEEE Transactions on Visualization and Computer Graphics Volume 30, Issue 1

Jan. 2024

1456 pages

Issue’s Table of Contents

1077-2626 © 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.

Publisher

IEEE Educational Activities Department

United States

Publication History

Published: 01 January 2024

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu ZChen CHooker J(2024)Manipulable Semantic Components: A Computational Representation of Data Visualization ScenesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345629631:1(732-742)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456296

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents