Article

Synchronization of lecture videos and electronic slides by video text analysis

Authors:

Feng Wang,

Chong-Wah Ngo,

Ting-Chuen PongAuthors Info & Claims

MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia

Pages 315 - 318

https://doi.org/10.1145/957013.957080

Published: 02 November 2003 Publication History

Get Access

Abstract

An essential goal of structuring lecture videos captured in live presentation is to provide a synchronized view of video clips and electronic slides. This paper presents an automatic approach to match video clips and slides based on the analysis of text embedded in lecture videos. We describe a method to reconstruct high-resolution video texts from multiple keyframes for robust OCR recognition. A two-stage matching algorithm based on the title and content similarity measures between video clips and slides is also proposed.

References

[1]

G. D. Abowd et. al., "Teaching and Learning as Multimedia Authoring: The Classroom 2000 Project," ACM Multimedia, pp. 187--198, 2000.

Digital Library

Google Scholar

[2]

H. Aradhye et. al., "Study of Embedded Font Context and Kernel Space Methods for Improved Videotext Recognition," IBM Research Report RC 22064, 2001.

Google Scholar

[3]

X. Chen et. al., "Automatic Detection of Signs with Affine Transformation," IEEE. WACV, Dec, 2002.

Digital Library

Google Scholar

[4]

S. G. Deshpande & J.-N. Hwang, "A Real-time Interactive Virtual Classroom Multimedia Distance Learning System," IEEE Trans on Multimedia, vol. 3, no. 4, pp. 432--444, 2001.

Digital Library

Google Scholar

[5]

D. Phung, S. Venkatesh & C. Dorai, "High Level Segmentation of Instructional Videos Based on Content Density," ACM Multimedia, 2002.

Digital Library

Google Scholar

[6]

L. He et. al., "Auto-Summarization of Audio-Video Presentations," ACM Multimedia, pp. 489--498, 1999.

Digital Library

Google Scholar

[7]

S. X. Ju et. al, "Summarization of Videotaped Presentations: Automatic Analysis of Motion and Gesture," IEEE Trans on CSVT, vol. 8, no. 5, pp. 686--696, 1998.

Digital Library

Google Scholar

[8]

T. F. S. -Mahmood, "Indexing for topics in videos using foils," Int. Conf. CVPR, pp. 312--319, 2000.

Google Scholar

[9]

S. Mukhopadhyay & B. Smith, "Passive Capture and Structuring of Lectures," ACM Multimedia, 1999.

Digital Library

Google Scholar

[10]

C. W. Ngo, T. C. Pong & T. S. Huang, "Detection of Slide Transition for Topic Indexing," Proc. ICME, 2002.

Google Scholar

[11]

L. A. Rowe & J. M. Gonzlez, "BMRC Lecture Browser," http://bmrc.berkeley.edu/frame/projects/lb/index.html

Google Scholar

[12]

E. Ukkonen, "Algorithms for Approximate String Matching," Information and Control, 100--118, 1985.

Digital Library

Google Scholar

[13]

OmniPage Pro 12, http://www.scansoft.com/omnipage/

Google Scholar

Cited By

View all

Murakami TFujita KHara KTakashima KKitamura Y(2024)SwapVid: Integrating Video Viewing and Document Exploration with Direct ManipulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642515(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642515
Shivakumara PAlaei APal U(2021)Mining text from natural scene and video images: A surveyWIREs Data Mining and Knowledge Discovery10.1002/widm.142811:6Online publication date: 24-Aug-2021
https://doi.org/10.1002/widm.1428
Ciurez MMihaescu MGimanez MHeras SPalanca JJulian V(2019)Automatic Categorization of Educational Videos According to Learning Styles2019 International Conference on Software, Telecommunications and Computer Networks (SoftCOM)10.23919/SOFTCOM.2019.8903601(1-6)Online publication date: Sep-2019
https://doi.org/10.23919/SOFTCOM.2019.8903601
Show More Cited By

Index Terms

Synchronization of lecture videos and electronic slides by video text analysis
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
        Video summarization

Recommendations

Replacing traditional classroom lectures with lecture videos: an experience report
EduSymp '12: Proceedings of the 8th edition of the Educators' Symposium

Lecture videos are slides enhanced with the audio recording of the lecturer's talk. Such lecture videos offer numerous advantages to the students as well as to the lecturers themselves. The former may organize their studies in a more flexible way by ...
Synchronization Method for Improving Temporal Harmony of Music and Video Clips
ACIT-CSI '15: Proceedings of the 2015 3rd International Conference on Applied Computing and Information Technology/2nd International Conference on Computational Science and Intelligence

This paper focuses on temporal harmony of music and video clips. The method for producing a synchronized audiovisual material is proposed. Change points of the direction of the moving object are decided as synchronization points of video clips. The ...
Synchronization and fluctuation of rhythm in musical cooperative performance
HCII'11: Proceedings of the 14th international conference on Human-computer interaction: design and development approaches - Volume Part I

A live musical performance gives us better impression than recorded music heard from a portable music player. From player's point of view, live performance also gives better impression than playing music with metronome or recorded music. Thus, the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia

November 2003

670 pages

ISBN:1581137222

DOI:10.1145/957013

General Chairs:
Lawrence Rowe
University of California, Berkeley
,
Harrick Vin
University of Texas, Austin
,
Program Chairs:
Thomas Plagemann
University of Oslo
,
Prashant Shenoy
University of Massachusetts, Amherst
,
John R. Smith
IBM T.J. Watson Research Center

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM03

Sponsor:

MM03: 2003 11th Annual ACM International Conference on Multimedia

November 2 - 8, 2003

CA, Berkeley, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
690
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Murakami TFujita KHara KTakashima KKitamura Y(2024)SwapVid: Integrating Video Viewing and Document Exploration with Direct ManipulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642515(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642515
Shivakumara PAlaei APal U(2021)Mining text from natural scene and video images: A surveyWIREs Data Mining and Knowledge Discovery10.1002/widm.142811:6Online publication date: 24-Aug-2021
https://doi.org/10.1002/widm.1428
Ciurez MMihaescu MGimanez MHeras SPalanca JJulian V(2019)Automatic Categorization of Educational Videos According to Learning Styles2019 International Conference on Software, Telecommunications and Computer Networks (SoftCOM)10.23919/SOFTCOM.2019.8903601(1-6)Online publication date: Sep-2019
https://doi.org/10.23919/SOFTCOM.2019.8903601
Garber SPrakash AMoran NAlterman MDi Lillo AStorer J(2017)A two tier approach to chalkboard video lecture summary2017 IEEE Frontiers in Education Conference (FIE)10.1109/FIE.2017.8190536(1-9)Online publication date: Oct-2017
https://doi.org/10.1109/FIE.2017.8190536
Liu ZLi KShen LAn P(2017)Sparse Time-Varying Graphs for Slide Transition Detection in Lecture VideosImage and Graphics10.1007/978-3-319-71607-7_50(567-576)Online publication date: 30-Dec-2017
https://doi.org/10.1007/978-3-319-71607-7_50
Li KWang JWang HDai Q(2015)Structuring Lecture Videos by Automatic Projection Screen Localization and AnalysisIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2014.236113337:6(1233-1246)Online publication date: 1-Jun-2015
https://doi.org/10.1109/TPAMI.2014.2361133
Zhu XGoldwater SManning C(2011)A normalized-cut alignment model for mapping hierarchical semantic structures onto spoken documentsProceedings of the Fifteenth Conference on Computational Natural Language Learning10.5555/2018936.2018960(210-218)Online publication date: 23-Jun-2011
https://dl.acm.org/doi/10.5555/2018936.2018960
He A(2011)An Understanding Information Management System for a Real-Time Interactive Distance Education EnvironmentDistance Education Environments and Emerging Software Systems10.4018/978-1-60960-539-1.ch014(233-243)Online publication date: 2011
https://doi.org/10.4018/978-1-60960-539-1.ch014
Revertera JSokhn MMugellini EKhaled O(2011)SMAC: Smart Multimedia Archiving for ConferencesAdvances in Intelligent Web Mastering – 310.1007/978-3-642-18029-3_15(143-152)Online publication date: 2011
https://doi.org/10.1007/978-3-642-18029-3_15
Zhu XCherry CPenn GJoshi AHuang CJurafsky D(2010)Imposing hierarchical browsing structures onto spoken documentsProceedings of the 23rd International Conference on Computational Linguistics: Posters10.5555/1944566.1944743(1550-1557)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1944566.1944743
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Replacing traditional classroom lectures with lecture videos: an experience report

Synchronization Method for Improving Temporal Harmony of Music and Video Clips

Synchronization and fluctuation of rhythm in musical cooperative performance