[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3173574.3173593acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Public Access

When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration

Published: 19 April 2018 Publication History

Abstract

We explore the combination of smartwatches and a large interactive display to support visual data analysis. These two extremes of interactive surfaces are increasingly popular, but feature different characteristics-display and input modalities, personal/public use, performance, and portability. In this paper, we first identify possible roles for both devices and the interplay between them through an example scenario. We then propose a conceptual framework to enable analysts to explore data items, track interaction histories, and alter visualization configurations through mechanisms using both devices in combination. We validate an implementation of our framework through a formative evaluation and a user study. The results show that this device combination, compared to just a large display, allows users to develop complex insights more fluidly by leveraging the roles of the two devices. Finally, we report on the interaction patterns and interplay between the devices for visual exploration as observed during our study.

Supplementary Material

ZIP File (pn1124-file4.zip)
suppl.mov (pn1124-file3.mp4)
Supplemental video
suppl.mov (pn1124-file5.mp4)
Supplemental video

References

[1]
Christopher Andrews, Alex Endert, Beth Yost, and Chris North. 2011. Information visualization on large, high-resolution displays: Issues, challenges, and opportunities. Information Visualization 10, 4 (2011), 341--355.
[2]
Daniel L. Ashbrook, James R. Clawson, Kent Lyons, Thad E. Starner, and Nirmal Patel. 2008. Quickdraw: The Impact of Mobility and On-body Placement on Device Access Time. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 219--222.
[3]
Sriram Karthik Badam, Fereshteh Amini, Niklas Elmqvist, and Pourang Irani. 2016. Supporting Visual Exploration for Multiple Users in Large Display Environments. In Proceedings of the IEEE Conference on Visual Analytics Science and Technology. IEEE, 1--10.
[4]
Sriram Karthik Badam and Niklas Elmqvist. 2017. Visfer: Camera-based visual data transfer for cross-device visualization. Information Visualization (2017). in press.
[5]
Sriram Karthik Badam, Eli Fisher, and Niklas Elmqvist. 2015. Munin: A Peer-to-Peer Middleware for Ubiquitous Analytics and Visualization Spaces. IEEE Transactions on Visualization and Computer Graphics 21, 2 (Feb 2015), 215--228.
[6]
Robert Ball and Chris North. 2007. Realizing embodied interaction for visual analytics through large displays. Computers & Graphics 31, 3 (2007), 380--400.
[7]
Robert Ball, Chris North, and Doug A. Bowman. 2007. Move to Improve: Promoting Physical Navigation to Increase User Performance with Large Displays. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 191--200.
[8]
Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic interaction: designing for a proximity and orientation-aware environment. In ACM International Conference on Interactive Tabletops and Surfaces. ACM, 121--130.
[9]
Dominikus Baur, Bongshin Lee, and Sheelagh Carpendale. 2012. TouchWave: Kinetic Multi-touch Manipulation for Hierarchical Stacked Graphs. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, 255--264.
[10]
Anastasia Bezerianos and Petra Isenberg. 2012. Perception of Visual Variables on Tiled Wall-Sized Displays for Information Visualization Applications. IEEE Transactions on Visualization and Computer Graphics 18, 12 (2012), 2516--2525.
[11]
Michael Bostock, Vadim Ogievetsky, and Jeffrey Heer. 2011. D3: Data-Driven Documents. IEEE Transactions on Visualization and Computer Graphics 17, 12 (2011), 2301--2309.
[12]
Lauren Bradel, Alex Endert, Kristen Koch, Christopher Andrews, and Chris North. 2013. Large high resolution displays for co-located collaborative sensemaking: Display usage and territoriality. International Journal of Human-Computer Studies 71, 11 (2013), 1078--1088.
[13]
Matthew Brehmer and Tamara Munzner. 2013. A multi-level typology of abstract visualization tasks. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2376--2385.
[14]
Frederik Brudy, Steven Houben, Nicolai Marquardt, and Yvonne Rogers. 2016. CurationSpace: Cross-Device Content Curation Using Instrumental Interaction. In Proceedings of the ACM Conference on Interactive Surfaces and Spaces. ACM, 159--168.
[15]
Frederik Brudy, David Ledo, Saul Greenberg, and Andreas Butz. 2014. Is Anyone Looking? Mitigating Shoulder Surfing on Public Displays Through Awareness and Protection. In Proceedings of the International Symposium on Pervasive Displays. ACM, 1:1--1:6.
[16]
Olivier Chapuis, Anastasia Bezerianos, and Stelios Frantzeskakis. 2014. Smarties: an input system for wall display development. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 2763--2772.
[17]
Xiang Chen, Tovi Grossman, Daniel J. Wigdor, and George Fitzmaurice. 2014. Duet: exploring joint interactions on a smart phone and a smart watch. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 159--168.
[18]
Yang Chen. 2017. Visualizing Large Time-series Data on Very Small Screens. In Short Paper Proceedings of the IEEE VGTC/Eurographics Conference on Visualization. The Eurographics Association, 37--41.
[19]
Haeyong Chung, Chris North, Jessica Zeitz Self, Sharon Lynn Chu, and Francis K. H. Quek. 2014. VisPorter: facilitating information sharing for collaborative sensemaking on multiple displays. Personal and Ubiquitous Computing 18, 5 (2014), 1169--1186.
[20]
Steven M. Drucker, Danyel Fisher, Ramik Sadana, Jessica Herron, and m.c. schraefel. 2013. TouchViz: A Case Study Comparing Two Interfaces for Data Analytics on Tablets. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 2301--2310.
[21]
Alex Endert, Christopher Andrews, Yueh Hua Lee, and Chris North. 2011. Visual encodings that support physical navigation on large displays. In Proceedings of Graphics Interface. Canadian Human-Computer Communications Society, 103--110.
[22]
Amir Hossein Hajizadeh, Melanie Tory, and Rock Leung. 2013. Supporting awareness through collaborative brushing and linking of tabular data. IEEE transactions on visualization and computer graphics 19, 12 (2013), 2189--2197.
[23]
Edward T. Hall. 1966. The hidden dimension. (1966).
[24]
Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: enabling and understanding cross-device interaction. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 2773--2782.
[25]
Christian Holz and Patrick Baudisch. 2013. Fiberio: A Touchscreen That Senses Fingerprints. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, 41--50.
[26]
Petra Isenberg, Pierre Dragicevic, Wesley Willett, Anastasia Bezerianos, and Jean-Daniel Fekete. 2013. Hybrid-Image Visualization for Large Viewing Environments. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2346--2355.
[27]
Petra Isenberg, Niklas Elmqvist, Jean Scholtz, Daniel Cernea, Kwan-Liu Ma, and Hans Hagen. 2011. Collaborative visualization: Definition, challenges, and research agenda. Information Visualization 10, 4 (2011), 310--326.
[28]
Mikkel R. Jakobsen and Kasper Hornbæk. 2013. Interactive Visualizations on Large and Small Displays: The Interrelation of Display Size, Information Space, and Scale. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2336--2345.
[29]
Mikkel R. Jakobsen and Kasper Hornbæk. 2014. Up close and personal. ACM Transactions on Computer-Human Interaction 21, 2 (2014), 1--34.
[30]
Mikkel R. Jakobsen and Kasper Hornbæk. 2015. Is Moving Improving?: Some Effects of Locomotion in Wall-Display Interaction. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 4169--4178.
[31]
Keiko Katsuragawa, Krzysztof Pietroszek, James R. Wallace, and Edward Lank. 2016. Watchpoint: Freehand Pointing with a Smartwatch in a Ubiquitous Display Environment. In Proceedings of the ACM Conference on Advanced Visual Interfaces. ACM, 128--135.
[32]
Jungsoo Kim, Jiasheng He, Kent Lyons, and Thad Starner. 2007. The Gesture Watch: A Wireless Contact-free Gesture based Wrist Interface. In Proceedings of the IEEE Symposium on Wearable Computers. IEEE, 15--22.
[33]
Ulrike Kister, Konstantin Klamka, Christian Tominski, and Raimund Dachselt. 2017. GraSp: Combining Spatially-aware Mobile Devices and a Display Wall for Graph Visualization and Interaction. Computer Graphics Forum 36, 3 (2017).
[34]
Ulrike Kister, Patrick Reipschläger, Fabrice Matulic, and Raimund Dachselt. 2015. BodyLenses: Embodied Magic Lenses and Personal Territories for Wall Displays. In Proceedings of the 2015 ACM International Conference on Interactive Tabletops & Surfaces. ACM, 117--126.
[35]
Ricardo Langner, Tom Horak, and Raimund Dachselt. 2017. VisTiles: Coordinating and Combining Co-located Mobile Devices for Visual Data Exploration. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2017).
[36]
Ricardo Langner, Ulrich von Zadow, Tom Horak, Annett Mitschick, and Raimund Dachselt. 2016. Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work. Springer International Publishing, 75--96.
[37]
Gierad Laput, Robert Xiao, Xiang 'Anthony' Chen, Scott E. Hudson, and Chris Harrison. 2014. Skin Buttons: Cheap, Small, Low-powered and Clickable Fixed-icon Laser Projectors. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, 389--394.
[38]
Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, and Eric Lecolinet. 2017. CoReach: Cooperative Gestures for Data Manipulation on Wall-sized Displays. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 6730--6741.
[39]
Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, Eric Lecolinet, and Wendy E. Mackay. 2014. Effects of display size and navigation type on a classification task. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 4147--4156.
[40]
Narges Mahyar and Melanie Tory. 2014. Supporting communication and coordination in collaborative sensemaking. IEEE transactions on visualization and computer graphics 20, 12 (2014), 1633--1642.
[41]
Nicolai Marquardt and Saul Greenberg. 2012. Informing the Design of Proxemic Interactions. IEEE Pervasive Computing 11, 2 (2012), 14--23.
[42]
Will McGrath, Brian Bowman, David McCallum, Juan David Hincapié-Ramos, Niklas Elmqvist, and Pourang Irani. 2012. Branch-explore-merge: Facilitating Real-time Revision Control in Collaborative Visual Exploration. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, 235--244.
[43]
Sundar Murugappan, Vinayak, Niklas Elmqvist, and Karthik Ramani. 2012. Extended multitouch: recovering touch posture and differentiating users using a depth camera. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, 487--496.
[44]
Jerome Pasquero, Scott J. Stobbe, and Noel Stonehouse. 2011. A Haptic Wristwatch for Eyes-free Interactions. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 3257--3266.
[45]
Arnaud Prouzeau, Anastasia Bezerianos, and Olivier Chapuis. 2017. Evaluating Multi-User Selection for Exploring Graph Topology on Wall-Displays. IEEE Transactions on Visualization and Computer Graphics 23, 8 (2017), 1936--1951.
[46]
Khairi Reda, Andrew E. Johnson, Michael E. Papka, and Jason Leigh. 2015. Effects of Display Size and Resolution on User Behavior and Insight Acquisition in Visual Exploration. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 2759--2768.
[47]
Jun Rekimoto. 2001. GestureWrist and GesturePad: unobtrusive wearable interaction devices. In Proceedings of the IEEE International Symposium on Wearable Computers. IEEE, 21--27.
[48]
Jonathan C. Roberts. 2007. State of the Art: Coordinated & Multiple Views in Exploratory Visualization. In Proceedings of the International Conference on Coordinated and Multiple Views in Exploratory Visualization. IEEE, 61--71.
[49]
Ramik Sadana and John Stasko. 2016. Expanding Selection for Information Visualization Systems on Tablet Devices. In Proceedings of the ACM Conference on Interactive Surfaces and Spaces. ACM, 149--158.
[50]
Ben Shneiderman. 1996. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In Proceedings of the IEEE Symposium on Visual Languages. IEEE, 336--343.
[51]
Martin Spindler, Christian Tominski, Heidrun Schumann, and Raimund Dachselt. 2010. Tangible views for information visualization. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, 157--166.
[52]
Matthew Tobiasz, Petra Isenberg, and Sheelagh Carpendale. 2009. Lark: Coordinating Co-located Collaboration with Information Visualization. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009), 1065--1072.
[53]
Ulrich von Zadow, Wolfgang Büschel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls. In Proceedings of the ACM Conference on Interactive Tabletops and Surfaces. ACM, 129--138.
[54]
Ulrich von Zadow, Patrick Reipschläger, Daniel Bösel, Anita Sellent, and Raimund Dachselt. 2016. YouTouch! Low-Cost User Identification at an Interactive Display Wall. In Proceedings of the ACM Conference on Advanced Visual Interfaces. ACM, 144--151.
[55]
Mark Weiser. 1991. The computer for the 21st Century. Scientific American 265, 3 (1991), 94--104.
[56]
Dirk Wenig, Johannes Schöning, Alex Olwal, Mathias Oben, and Rainer Malaka. 2017. WatchThru: Expanding Smartwatch Displays with Mid-air Visuals and Wrist-worn Augmented Reality. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 716--721.
[57]
Gerard Wilkinson, Ahmed Kharrufa, Jonathan Hook, Bradley Pursglove, Gavin Wood, Hendrik Haeuser, Nils Y. Hammerla, Steve Hodges, and Patrick Olivier. 2016. Expressy: Using a Wrist-worn Inertial Measurement Unit to Add Expressiveness to Touch-based Interactions. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 2832--2844.
[58]
Ji Soo Yi, Youn ah Kang, and John Stasko. 2007. Toward a Deeper Understanding of the Role of Interaction in Information Visualization. IEEE Transactions on Visualization and Computer Graphics 13, 6 (2007), 1224--1231.
[59]
Xin Yi, Chun Yu, Weijie Xu, Xiaojun Bi, and Yuanchun Shi. 2017. COMPASS: Rotational Keyboard on Non-Touch Smartwatches. In Proceedings of the ACM Conference on Human Factors in Computing Systems. ACM, 705--715.

Cited By

View all
  • (2024)The Elephant in the Room: Expert Experiences Designing, Developing and Evaluating Data Visualizations on Large DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981398:ISS(301-329)Online publication date: 24-Oct-2024
  • (2024)Enhancing Mobile Interaction: Practical Insights from Smartphone and Smartwatch IntegrationAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680451(1-9)Online publication date: 21-Sep-2024
  • (2024)Glanceable Data Visualizations for Older Adults: Establishing Thresholds and Examining Disparities Between Age GroupsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642776(1-17)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
    April 2018
    8489 pages
    ISBN:9781450356206
    DOI:10.1145/3173574
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 April 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Badges

    • Honorable Mention

    Author Tags

    1. cross-device interaction
    2. data exploration
    3. large display
    4. multi-display environment
    5. smartwatch
    6. visual analysis

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    CHI '18
    Sponsor:

    Acceptance Rates

    CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)236
    • Downloads (Last 6 weeks)40
    Reflects downloads up to 11 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)The Elephant in the Room: Expert Experiences Designing, Developing and Evaluating Data Visualizations on Large DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981398:ISS(301-329)Online publication date: 24-Oct-2024
    • (2024)Enhancing Mobile Interaction: Practical Insights from Smartphone and Smartwatch IntegrationAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680451(1-9)Online publication date: 21-Sep-2024
    • (2024)Glanceable Data Visualizations for Older Adults: Establishing Thresholds and Examining Disparities Between Age GroupsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642776(1-17)Online publication date: 11-May-2024
    • (2024)Natural Language Generation for Visualizations: State of the Art, Challenges and Future DirectionsComputer Graphics Forum10.1111/cgf.15266Online publication date: 30-Oct-2024
    • (2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
    • (2024)Talk to the Wall: The Role of Speech Interaction in Collaborative Visual AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345633531:1(941-951)Online publication date: 9-Sep-2024
    • (2024)Eliciting Multimodal and Collaborative Interactions for Data Exploration on Large Vertical DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332315030:2(1624-1637)Online publication date: 1-Feb-2024
    • (2024)Semi-Automatic Layout Adaptation for Responsive Multiple-View Visualization DesignIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324035630:7(3798-3812)Online publication date: Jul-2024
    • (2024)User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large DisplayIEEE Access10.1109/ACCESS.2024.340487612(78657-78679)Online publication date: 2024
    • (2024)Making maps & visualizations for mobile devices: A research agenda for mobile-first and responsive cartographic designJournal of Location Based Services10.1080/17489725.2023.2251423(1-71)Online publication date: 3-Apr-2024
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media