[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2556325.2566237acmconferencesArticle/Chapter ViewAbstractPublication Pagesl-at-sConference Proceedingsconference-collections
research-article

Understanding in-video dropouts and interaction peaks inonline lecture videos

Published: 04 March 2014 Publication History

Abstract

With thousands of learners watching the same online lecture videos, analyzing video watching patterns provides a unique opportunity to understand how students learn with videos. This paper reports a large-scale analysis of in-video dropout and peaks in viewership and student activity, using second-by-second user interaction data from 862 videos in four Massive Open Online Courses (MOOCs) on edX. We find higher dropout rates in longer videos, re-watching sessions (vs first-time), and tutorials (vs lectures). Peaks in re-watching sessions and play events indicate points of interest and confusion. Results show that tutorials (vs lectures) and re-watching sessions (vs first-time) lead to more frequent and sharper peaks. In attempting to reason why peaks occur by sampling 80 videos, we observe that 61% of the peaks accompany visual transitions in the video, e.g., a slide view to a classroom view. Based on this observation, we identify five student activity patterns that can explain peaks: starting from the beginning of a new material, returning to missed content, following a tutorial step, replaying a brief segment, and repeating a non-visual explanation. Our analysis has design implications for video authoring, editing, and interface design, providing a richer understanding of video learning on MOOCs.

References

[1]
Bostock, M., Ogievetsky, V., and Heer, J. D3 data-driven documents. Visualization and Computer Graphics, IEEE Transactions on 17, 12 (2011), 2301--2309.
[2]
Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., and Seaton, D. T. Studying learning in the worldwide classroom: Research into edX's first MOOC. Research and Practice in Assessment 8 (Summer 2013).
[3]
Carlier, A., Charvillat, V., Ooi, W. T., Grigoras, R., and Morin, G. Crowdsourced automatic zoom and scroll for video retargeting. In Multimedia'10, ACM (2010), 201--210.
[4]
Chorianopoulos, K. Collective intelligence within web video. Human-centric Computing and Information Sciences 3, 1 (2013), 10.
[5]
Cleveland, W. S. Lowess: A program for smoothing scatterplots by robust locally weighted regression. The American Statistician 35, 1 (1981), 54--54.
[6]
edX. edX Insights. https://github.com/edx/insights.
[7]
edX. Tracking Logs -- edX 0.1 documentation. http://data.edx.org/en/latest/internal_data_formats/tracking_logs.html.
[8]
Girgensohn, A., and Boreczky, J. Time-constrained keyframe selection technique. In Multimedia Computing and Systems, vol. 1 (1999), 756--761 vol.1.
[9]
Google. YouTube Analytics. http://www.youtube.com/yt/playbook/yt-analytics.html#details.
[10]
Guo, P. J., Kim, J., and Rubin, R. How video production affects student engagement: An empirical study of mooc videos. In Learning at Scale 2014, to appear (2014).
[11]
Hou, X., and Zhang, L. Saliency detection: A spectral residual approach. In CVPR'07 (2007), 1--8.
[12]
Jones, R., and Diaz, F. Temporal profiles of queries. ACM Transactions on Information Systems (TOIS) 25, 3 (2007), 14.
[13]
Kairam, S., Morris, M., Teevan, J., Liebling, D., and Dumais, S. Towards supporting search over trending events with social media. In ICWSM'13 (2013).
[14]
Kim, J., Nguyen, P., Weir, S., Guo, P., Gajos, K., and Miller, R. Crowdsourcing step-by-step information extraction to enhance existing how-to videos. In CHI'14, to appear, ACM (2014).
[15]
Kizilcec, R. F., Piech, C., and Schneider, E. Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In LAK'13, ACM (2013), 170--179.
[16]
Kleinberg, J. Bursty and hierarchical structure in streams. Data Mining and Knowledge Discovery 7, 4 (2003), 373--397.
[17]
Kulkarni, A., Teevan, J., Svore, K. M., and Dumais, S. T. Understanding temporal query dynamics. In WSDM'11, ACM (2011), 167--176.
[18]
Li, F. C., Gupta, A., Sanocki, E., He, L.-w., and Rui, Y. Browsing digital video. In CHI'00, ACM (2000), 169--176.
[19]
Marcus, A., Bernstein, M. S., Badar, O., Karger, D. R., Madden, S., and Miller, R. C. Twitinfo: aggregating and visualizing microblogs for event exploration. In CHI'11, ACM (2011), 227--236.
[20]
Olsen, D. R., and Moon, B. Video summarization based on user interaction. In EuroITV'11, ACM (2011), 115--122.
[21]
Risko, E., Foulsham, T., Dawson, S., and Kingstone, A. The collaborative lecture annotation system (clas): A new tool for distributed learning. Learning Technologies, IEEE Transactions on 6, 1 (2013), 4--13.
[22]
Rugg, G., and McGeorge, P. The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts. Expert Systems 14, 2 (1997), 80--93.
[23]
Seaton, D. T., Bergner, Y., Chuang, I., Mitros, P., and Pritchard, D. E. Who does what in a massive open online course? Communications of the ACM, to appear (2014).
[24]
Shaw, R., and Davis, M. Toward emergent representations for video. In Multimedia '05, ACM (2005), 431--434.
[25]
Smoliar, S., and Zhang, H. Content based video indexing and retrieval. MultiMedia, IEEE 1, 2 (1994), 62--72.
[26]
Wand, M. Fast computation of multivariate kernel estimators. Journal of Computational and Graphical Statistics 3, 4 (1994), 433--445.
[27]
Wickham, H. Bin-summarise-smooth: a framework for visualising large data. Tech. rep., had.co.nz, 2013.
[28]
Wistia. Wistia Product Features. http://wistia.com/product#analyze.
[29]
Yew, J., Shamma, D. A., and Churchill, E. F. Knowing funny: genre perception and categorization in social video sharing. In CHI'11, ACM (2011), 297--306.

Cited By

View all
  • (2024)Algerian secondary school students' preferences for the use of YouTube in their informal learningEducational Technology Quarterly10.55056/etq.6972024:2(120-134)Online publication date: 20-Jun-2024
  • (2024)The Teaching Mode Design and Effect Evaluation Method of Animation Course From the Perspective of Big DataInternational Journal of Web-Based Learning and Teaching Technologies10.4018/IJWLTT.34352219:1(1-20)Online publication date: 21-Jun-2024
  • (2024)Individual learning paths mastering teachers’ professional visionFrontiers in Education10.3389/feduc.2024.13050739Online publication date: 1-Feb-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
L@S '14: Proceedings of the first ACM conference on Learning @ scale conference
March 2014
234 pages
ISBN:9781450326698
DOI:10.1145/2556325
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 March 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. in-video dropout
  2. interaction peaks
  3. mooc
  4. online education
  5. peak detection.
  6. video analysis

Qualifiers

  • Research-article

Conference

L@S 2014
Sponsor:
L@S 2014: First (2014) ACM Conference on Learning @ Scale
March 4 - 5, 2014
Georgia, Atlanta, USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)205
  • Downloads (Last 6 weeks)26
Reflects downloads up to 31 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Algerian secondary school students' preferences for the use of YouTube in their informal learningEducational Technology Quarterly10.55056/etq.6972024:2(120-134)Online publication date: 20-Jun-2024
  • (2024)The Teaching Mode Design and Effect Evaluation Method of Animation Course From the Perspective of Big DataInternational Journal of Web-Based Learning and Teaching Technologies10.4018/IJWLTT.34352219:1(1-20)Online publication date: 21-Jun-2024
  • (2024)Individual learning paths mastering teachers’ professional visionFrontiers in Education10.3389/feduc.2024.13050739Online publication date: 1-Feb-2024
  • (2024)IDENTIFYING BEHAVIORAL PATTERNS IN MOOC VIDEO ENGAGEMENT USING CLUSTERING APPROACHEğitim Teknolojisi Kuram ve Uygulama10.17943/etku.1367188Online publication date: 13-Feb-2024
  • (2024)Can Crowdsourcing Platforms Be Useful for Educational Research?Proceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636897(416-425)Online publication date: 18-Mar-2024
  • (2024)Analyzing Student Attention and Acceptance of Conversational AI for Math Learning: Insights from a Randomized Controlled TrialProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636895(836-842)Online publication date: 18-Mar-2024
  • (2024)SwapVid: Integrating Video Viewing and Document Exploration with Direct ManipulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642515(1-13)Online publication date: 11-May-2024
  • (2024) Happy facial expressions and mouse pointing enhance EFL vocabulary learning from instructional videos British Journal of Educational Technology10.1111/bjet.13515Online publication date: 14-Aug-2024
  • (2024)Video Visualization Profile Analysis in Online CoursesIEEE Transactions on Education10.1109/TE.2024.339629667:4(629-638)Online publication date: Aug-2024
  • (2024)Facilitated learning or technical distraction? Sociologically exploring online university learningTechnology, Pedagogy and Education10.1080/1475939X.2023.229411733:2(219-234)Online publication date: 9-Jan-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media