[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3126594.3126661acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article
Public Access

AutoDub: Automatic Redubbing for Voiceover Editing

Published: 20 October 2017 Publication History

Abstract

Redubbing is an extensively used technique to correct errors in voiceover recordings. It involves re-recording a part of a voiceover, identifying the corresponding section of audio in the original recording that needs to be replaced, and using low level audio tools to replace the audio. Although this sequence of steps can be performed using traditional audio editing tools, the process can be tedious when dealing with long voiceover recordings and prohibitively difficult for users not familiar with such tools. To address this issue, we present AutoDub, a novel system for redubbing voiceover recordings. Using our system, a user simply needs to re-record the part of the voiceover that needs to be replaced. Our system automatically locates the corresponding part in the original recording and performs the low level audio processing to replace it. The system can be easily incorporated in any existing sophisticated audio editor or can be employed as a functionality in an audio-guided user interface. User studies involving participation from novice, knowledgeable and expert users indicate that our tool is preferred to a traditional audio editor based redubbing approach by all categories of users due to its faster and easier redubbing capabilities.

Supplementary Material

suppl.mov (uistf4623-file3.mp4)
Supplemental video

References

[1]
Francois G. Germain, Gautham J. Mysore, and Takako Fujioka. 2016. Equalization matching of speech recordings in real-world environments. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 609--613.
[2]
Meinard Muller. 2007. Dynamic Time Warping. Springer Berlin Heidelberg, 69--84.
[3]
Gautham J Mysore. 2015. Can we automatically transform speech recorded on common consumer devices in real-world environments into professional production quality speech?--a dataset, insights, and challenges. IEEE Signal Processing Letters 22, 8 (2015), 1006--1010.
[4]
Lawrence R. Rabiner and Biing-Hwang Juang. 1993. Fundamentals of Speech Recognition. Prentice-Hall, Inc.
[5]
Lawrence R. Rabiner and Ronald W. Schafer. 1978. Digital processing of speech signals. N.J. Prentice-Hall.
[6]
Steve Rubin, Floraine Berthouzoz, Gautham J. Mysore, and Maneesh Agrawala. 2015. Capture-Time Feedback for Recording Scripted Narration. In UIST, Celine Latulipe, Bjoern Hartmann, and Tovi Grossman (Eds.). ACM, 191--199.
[7]
Steve Rubin, Floraine Berthouzoz, Gautham J. Mysore, Wilmot Li, and Maneesh Agrawala. 2013. Content-based tools for editing audio stories. In UIST, Shahram Izadi, Aaron J. Quigley, Ivan Poupyrev, and Takeo Igarashi (Eds.). ACM, 113--122.
[8]
Francis Rumsey. 2008. Digital Audio Recording Formats and Editing Principles. Springer NY, 703--729.
[9]
Pascal Scalart and Jose V. Filho. 1996. Speech enhancement based on a priori signal to noise estimation. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 629--632.
[10]
K. Vertanen and P. O. Kristensson. 2009. Automatic selection of recognition errors by respeaking the intended text. In 2009 IEEE Workshop on Automatic Speech Recognition Understanding. 130--135.
[11]
K. Vertanen and P. O. Kristensson. 2010. Getting it right the second time: Recognition of spoken corrections. In 2010 IEEE Spoken Language Technology Workshop. 289--294.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
October 2017
870 pages
ISBN:9781450349819
DOI:10.1145/3126594
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. dynamic time warping
  2. overdub
  3. redubbing
  4. voiceover

Qualifiers

  • Research-article

Funding Sources

Conference

UIST '17

Acceptance Rates

UIST '17 Paper Acceptance Rate 73 of 324 submissions, 23%;
Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25
The 38th Annual ACM Symposium on User Interface Software and Technology
September 28 - October 1, 2025
Busan , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 301
    Total Downloads
  • Downloads (Last 12 months)66
  • Downloads (Last 6 weeks)10
Reflects downloads up to 16 Dec 2024

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media