More Web Proxy on the site http://driver.im/

research-article

Data-driven interaction techniques for improving navigation of educational videos

Authors:

Shang-Wen (Daniel) Li,

Krzysztof Z. Gajos,

Robert C. MillerAuthors Info & Claims

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

Pages 563 - 572

https://doi.org/10.1145/2642918.2647389

Published: 05 October 2014 Publication History

Abstract

With an unprecedented scale of learners watching educational videos on online platforms such as MOOCs and YouTube, there is an opportunity to incorporate data generated from their interactions into the design of novel video interaction techniques. Interaction data has the potential to help not only instructors to improve their videos, but also to enrich the learning experience of educational video watchers. This paper explores the design space of data-driven interaction techniques for educational video navigation. We introduce a set of techniques that augment existing video interface widgets, including: a 2D video timeline with an embedded visualization of collective navigation traces; dynamic and non-linear timeline scrubbing; data-enhanced transcript search and keyword summary; automatic display of relevant still frames next to the video; and a visual summary representing points with high learner activity. To evaluate the feasibility of the techniques, we ran a laboratory user study with simulated learning tasks. Participants rated watching lecture videos with interaction data to be efficient and useful in completing the tasks. However, no significant differences were found in task performance, suggesting that interaction data may not always align with moment-by-moment information needs during the tasks.

Supplementary Material

suppl.mov (uistf3327-file3.mp4)

Supplemental video

Download
36.66 MB

References

[1]

Al-Hajri, A., Miller, G., Fong, M., and Fels, S. S. Visualization of personal history for video navigation. In CHI '14 (2014).

Digital Library

[2]

Alexander, J., Cockburn, A., Fitchett, S., Gutwin, C., and Greenberg, S. Revisiting read wear: Analysis, design, and evaluation of a footprints scrollbar. In CHI '09 (2009), 1665--1674.

Digital Library

[3]

Arman, F., Depommier, R., Hsu, A., and Chiu, M.-Y. Content-based browsing of video sequences. In MULTIMEDIA '94 (1994), 97--103.

Digital Library

[4]

Baudisch, P., Cutrell, E., Hinckley, K., and Eversole, A. Snap-and-go: Helping users align objects without the modality of traditional snapping. In CHI '05 (2005), 301--310.

Digital Library

[5]

Blanch, R., Guiard, Y., and Beaudouin-Lafon, M. Semantic pointing: Improving target acquisition with control-display ratio adaptation. In CHI '04 (2004), 519--526.

Digital Library

[6]

Bostock, M., Ogievetsky, V., and Heer, J. D3 data-driven documents. Visualization and Computer Graphics, IEEE Transactions on 17, 12 (2011), 2301--2309.

Digital Library

[7]

Carlier, A., Charvillat, V., Ooi, W. T., Grigoras, R., and Morin, G. Crowdsourced automatic zoom and scroll for video retargeting. In Multimedia '10 (2010), 201--210.

Digital Library

[8]

Chi, P.-Y. P., Liu, J., Linder, J., Dontcheva, M., Li, W., and Hartmann, B. Democut: generating concise instructional videos for physical demonstrations. In UIST '13, ACM (2013).

Digital Library

[9]

Chorianopoulos, K. Collective intelligence within web video. Human-centric Computing and Information Sciences 3, 1 (2013), 10.

[10]

Dieberger, A., Dourish, P., Höök, K., Resnick, P., and Wexelblat, A. Social navigation: Techniques for building more usable systems. Interactions 7, 6 (Nov. 2000), 36--45.

Digital Library

[11]

Ding, W., and Marchionini, G. A study on video browsing strategies. Tech. rep., College Park, MD, USA, 1997.

Digital Library

[12]

Grossman, T., Matejka, J., and Fitzmaurice, G. Chronicle: capture, exploration, and playback of document workflow histories. In UIST '10 (2010).

Digital Library

[13]

Guo, P. J., Kim, J., and Rubin, R. How video production affects student engagement: An empirical study of mooc videos. In L@S '14 (2014), 41--50.

Digital Library

[14]

Hill, W. C., Hollan, J. D., Wroblewski, D., and McCandless, T. Edit wear and read wear. In CHI '92 (1992), 3--9.

Digital Library

[15]

Hou, X., and Zhang, L. Saliency detection: A spectral residual approach. In CVPR '07 (2007), 1--8.

[16]

Hurst, A., Mankoff, J., Dey, A. K., and Hudson, S. E. Dirty desktops: Using a patina of magnetic mouse dust to make common interactor targets easier to select. In UIST '07 (2007), 183--186.

Digital Library

[17]

Hurst, W., Gotz, G., and Jarvers, P. Advanced user interfaces for dynamic video browsing. In MULTIMEDIA '04 (2004), 742--743.

Digital Library

[18]

Jackson, D., Nicholson, J., Stoeckigt, G., Wrobel, R., Thieme, A., and Olivier, P. Panopticon: A parallel video overview system. In UIST '13 (2013), 123--130.

Digital Library

[19]

Jansen, M., Heeren, W., and van Dijk, B. Videotrees: Improving video surrogate presentation using hierarchy. In CBMI 2008, IEEE (June 2008), 560--567.

[20]

Kim, J., Guo, P. J., Seaton, D. T., Mitros, P., Gajos, K. Z., and Miller, R. C. Understanding in-video dropouts and interaction peaks in online lecture videos. In L@S '14 (2014), 31--40.

Digital Library

[21]

Kim, J., Nguyen, P., Weir, S., Guo, P., Gajos, K., and Miller, R. Crowdsourcing step-by-step information extraction to enhance existing how-to videos. In CHI '14 (2014).

Digital Library

[22]

Li, F. C., Gupta, A., Sanocki, E., He, L.-w., and Rui, Y. Browsing digital video. In CHI '00 (2000), 169--176.

Digital Library

[23]

Marcus, A., Bernstein, M. S., Badar, O., Karger, D. R., Madden, S., and Miller, R. C. Twitinfo: aggregating and visualizing microblogs for event exploration. In CHI '11 (2011), 227--236.

Digital Library

[24]

Masui, T., Kashiwagi, K., and Borden, IV, G. R. Elastic graphical interfaces to precise data manipulation. In CHI '95 (1995), 143--144.

Digital Library

[25]

Matejka, J., Grossman, T., and Fitzmaurice, G. Swift: Reducing the effects of latency in online video scrubbing. In CHI '12 (2012), 637--646.

Digital Library

[26]

Matejka, J., Grossman, T., and Fitzmaurice, G. Patina: Dynamic heatmaps for visualizing application usage. In CHI '13 (2013), 3227--3236.

Digital Library

[27]

Matejka, J., Grossman, T., and Fitzmaurice, G. Swifter: Improved online video scrubbing. In CHI '13 (2013), 1159--1168.

Digital Library

[28]

Mertens, R., Farzan, R., and Brusilovsky, P. Social navigation in web lectures. In HYPERTEXT '06 (2006), 41--44.

Digital Library

[29]

Monserrat, T.-J. K. P., Zhao, S., McGee, K., and Pandey, A. V. Notevideo: Facilitating navigation of blackboard-style lecture videos. In CHI '13 (2013), 1139--1148.

Digital Library

[30]

Nancel, M., and Cockburn, A. Causality: A conceptual model of interaction history. In CHI '14 (2014).

Digital Library

[31]

Nguyen, C., Niu, Y., and Liu, F. Video summagator: An interface for video summarization and navigation. In CHI '12 (2012), 647--650.

Digital Library

[32]

Nicholson, J., Huber, M., Jackson, D., and Olivier, P. Panopticon as an e-learning support search tool. In CHI '14 (2014).

Digital Library

[33]

Olsen, D. R., and Moon, B. Video summarization based on user interaction. In EuroITV '11 (2011), 115--122.

Digital Library

[34]

Pongnumkul, S., Wang, J., Ramos, G., and Cohen, M. Content-aware dynamic timeline for video browsing. In UIST '10 (2010), 139--142.

Digital Library

[35]

Ramos, G., and Balakrishnan, R. Fluid interaction techniques for the control and annotation of digital video. In UIST '03 (2003), 105--114.

Digital Library

[36]

Risko, E., Foulsham, T., Dawson, S., and Kingstone, A. The collaborative lecture annotation system (clas): A new tool for distributed learning. Learning Technologies, IEEE Transactions on 6, 1 (2013), 4--13.

Digital Library

[37]

Scott MacKenzie, I., and Riddersma, S. Effects of output display and control--display gain on human performance in interactive systems. Behavior & Information Technology 13, 5 (1994), 328--337.

[38]

Shaw, R., and Davis, M. Toward emergent representations for video. In Multimedia '05 (2005), 431--434.

Digital Library

[39]

Yew, J., Shamma, D. A., and Churchill, E. F. Knowing funny: genre perception and categorization in social video sharing. In CHI '11 (2011), 297--306.

Digital Library

Cited By

Fang JPark JKim JWang H(2024)EduLive: Re-Creating Cues for Instructor-Learners Interaction in Educational Live Streams with Learners' Transcript-Based AnnotationsProceedings of the ACM on Human-Computer Interaction10.1145/36869608:CSCW2(1-33)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686960
Nghiem CBousseau ASypesteyn MHoftijzer JAgrawala MTsandilas T(2024)STIVi: Turning Perspective Sketching Videos into Interactive TutorialsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670969(1-13)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670969
Kawamura KRekimoto J(2024)FastPerson: Enhancing Video-Based Learning through Video Summarization that Preserves Linguistic and Visual ContextsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652922(205-216)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652922
Show More Cited By

Index Terms

Data-driven interaction techniques for improving navigation of educational videos
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Understanding in-video dropouts and interaction peaks inonline lecture videos
L@S '14: Proceedings of the first ACM conference on Learning @ scale conference

With thousands of learners watching the same online lecture videos, analyzing video watching patterns provides a unique opportunity to understand how students learn with videos. This paper reports a large-scale analysis of in-video dropout and peaks in ...
Towards an educational design pattern language to support the development of open educational resources in videos for the MOOC context
PLoP '19: Proceedings of the 26th Conference on Pattern Languages of Programs

The creation and adoption of Massive Open Online Courses (MOOCs) can bring many benefits and impact on education, such as put forward diversity in education; enhance student's learning by encouraging and engaging them for lifelong learning; connect with ...
DynamicSlide: Exploring the Design Space of Reference-based Interaction Techniques for Slide-based Lecture Videos
MAHCI'18: Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface

Slide-based video is a popular format of online lecture videos. Lecture slides and narrations are complementary: while slides visually convey the main points of the lecture, narrations add detailed explanations to each item in the slide. We define a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

October 2014

722 pages

ISBN:9781450330695

DOI:10.1145/2642918

General Chair:
Hrvoje Benko
Microsoft Research, USA
,
Program Chairs:
Mira Dontcheva
Adobe, USA
,
Daniel Wigdor
University of Toronto, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '14

Sponsor:

UIST '14: The 27th Annual ACM Symposium on User Interface Software and Technology

October 5 - 8, 2014

Hawaii, Honolulu, USA

Acceptance Rates

UIST '14 Paper Acceptance Rate 74 of 333 submissions, 22%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

129
Total Citations
View Citations
1,642
Total Downloads

Downloads (Last 12 months)181
Downloads (Last 6 weeks)20

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fang JPark JKim JWang H(2024)EduLive: Re-Creating Cues for Instructor-Learners Interaction in Educational Live Streams with Learners' Transcript-Based AnnotationsProceedings of the ACM on Human-Computer Interaction10.1145/36869608:CSCW2(1-33)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686960
Nghiem CBousseau ASypesteyn MHoftijzer JAgrawala MTsandilas T(2024)STIVi: Turning Perspective Sketching Videos into Interactive TutorialsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670969(1-13)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670969
Kawamura KRekimoto J(2024)FastPerson: Enhancing Video-Based Learning through Video Summarization that Preserves Linguistic and Visual ContextsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652922(205-216)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652922
Citro TPellegrino MScarano VSpagnuolo C(2024)As a Grain of Link: How Far Should We Take Link GranularityProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3675146(223-229)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1145/3648188.3675146
Perraud RTabard AMalacria S(2024)Tutorial mismatches: investigating the frictions due to interface differences when following software video tutorialsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661511(1942-1955)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661511
Palea DVadhul GLee D(2024)Annota: Peer-based AI Hints Towards Learning Qualitative Coding at ScaleProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645168(455-470)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645168
Jin HKim J(2024)CodeTree: A System for Learnersourcing Subgoal Hierarchies in Code ExamplesProceedings of the ACM on Human-Computer Interaction10.1145/36373088:CSCW1(1-37)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637308
Wang JTang HKantor TSoltani TPopov VWang X(2024)Surgment: Segmentation-enabled Semantic Search and Creation of Visual Question and Feedback to Support Video-Based Surgery LearningProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642587(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642587
Murakami TFujita KHara KTakashima KKitamura Y(2024)SwapVid: Integrating Video Viewing and Document Exploration with Direct ManipulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642515(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642515
Chen YMorariu VTruong ALiu Z(2024)TutoAI: a cross-domain framework for AI-assisted mixed-media tutorial creation on physical tasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642443(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642443
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents