More Web Proxy on the site http://driver.im/

research-article

User-assisted video stabilization

Authors:

Aseem Agarwala,

Maneesh Agrawala,

Ravi RamamoorthiAuthors Info & Claims

EGSR '14: Proceedings of the 25th Eurographics Symposium on Rendering

Pages 61 - 70

https://doi.org/10.1111/cgf.12413

Published: 25 June 2014 Publication History

Abstract

We present a user-assisted video stabilization algorithm that is able to stabilize challenging videos when state-of-the-art automatic algorithms fail to generate a satisfactory result. Current methods do not give the user any control over the look of the final result. Users either have to accept the stabilized result as is, or discard it should the stabilization fail to generate a smooth output. Our system introduces two new modes of interaction that allow the user to improve the unsatisfactory stabilized video. First, we cluster tracks and visualize them on the warped video. The user ensures that appropriate tracks are selected by clicking on track clusters to include or exclude them. Second, the user can directly specify how regions in the output video should look by drawing quadrilaterals to select and deform parts of the frame. These user-provided deformations reduce undesirable distortions in the video. Our algorithm then computes a stabilized video using the user-selected tracks, while respecting the user-modified regions. The process of interactively removing user-identified artifacts can sometimes introduce new ones, though in most cases there is a net improvement. We demonstrate the effectiveness of our system with a variety of challenging hand held videos.

References

[1]

{BAAR12} Bai J., Agarwala A., Agrawala M., Ramamoorthi R.: Selectively de-animating video. ACM Transactions on Graphics (2012). 4

Digital Library

[2]

{BAAR13} Bai J., Agarwala A., Agrawala M., Ramamoorthi R.: Automatic cinemagraph portraits. Computer Graphics Forum (EGSR 2013) (2013). 4

Digital Library

[3]

{BETVG08} Bay H., Ess A., Tuytelaars T., Van Gool L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110, 3 (June 2008), 346--359. 3

Digital Library

[4]

{BM10} Brox T., Malik J.: Object segmentation by long term analysis of point trajectories. In European Conference on Computer Vision (ECCV) (Sept. 2010), Lecture Notes in Computer Science, Springer. 3

Digital Library

[5]

{BS97} Bronshtein I. N., Semendyayev K. A.: Handbook of Mathematics (3rd Ed.). Springer-Verlag, London, UK, UK, 1997. 7

Digital Library

[6]

{CR09} Cheriyadat A., Radke R. J.: Non-negative matrix factorization of partial track data for motion segmentation. In ICCV (2009), pp. 865--872. 3, 4, 5

[7]

{EV09} Elhamifar E., Vidal R.: Sparse subspace clustering. In In CVPR (2009). 3

[8]

{FB81} Fischler M. A., Bolles R. C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6 (June 1981), 381--395. 2, 4

Digital Library

[9]

{FRP09} Fradet M., Robert P., Pérez P.: Clustering point trajectories with various life-spans. In Proceedings of the 2009 Conference for Visual Media Production (Washington, DC, USA, 2009), CVMP '09, IEEE Computer Society, pp. 7--14. 3

Digital Library

[10]

{GF12} Goldstein A., Fattal R.: Video stabilization using epipolar geometry. ACM Trans. Graph. 32, 5 (2012). 2

Digital Library

[11]

{GKCE12} Grundmann M., Kwatra V., Castro D., Essa I.: Calibration-free rolling shutter removal. In International Conference on Computational Photography {Best Paper} (2012). 2, 8

[12]

{GKE11} Grundmann M., Kwatra V., Essa I.: Auto-directed video stabilization with robust l1 optimal camera paths. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011) (2011). 2, 8

Digital Library

[13]

{GL07} Gleicher M. L., Liu F.: Re-cinematography: Improving the camera dynamics of casual video. In Proceedings of the 15th International Conference on Multimedia (New York, NY, USA, 2007), MULTIMEDIA '07, ACM, pp. 27--36. 2

Digital Library

[14]

{GZ79} Gabriel K. R., Zamir S.: Lower Rank Approximation of Matrices by Least Squares with Any Choice of Weights. Technometrics 21, 4 (1979), 489--498. 5

[15]

{HZ04} Hartley R. I., Zisserman A.: Multiple View Geometry in Computer Vision, second ed. Cambridge University Press, ISBN: 0521540518, 2004. 2

Digital Library

[16]

{KJBL11} Karpenko A., Jacobs D., Baek J., Levoy M.: Digital video stabilization and rolling shutter correction using gyroscopes. In In Stanford CS Tech Report (2011). 2

[17]

{LGJA09} Liu F., Gleicher M., Jin H., Agarwala A.: Content-preserving warps for 3d video stabilization. ACM Trans. Graph. 28, 3 (July 2009), 44:1--44:9. 2, 3, 8

Digital Library

[18]

{LGW^*11} Liu F., Gleicher M., Wang J., Jin H., Agarwala A.: Subspace video stabilization. ACM Trans. Graph. 30, 1 (Feb. 2011), 4:1--4:10. 2, 8

Digital Library

[19]

{LYTS13} Liu S., Yuan L., Tan P., Sun J.: Bundled camera paths for video stabilization. ACM Trans. Graph. 32, 4 (July 2013), 78:1--78:10. 1, 2, 3, 4, 7

Digital Library

[20]

{MOT^*06} Matsushita Y., Ofek E., Tang X., Member S., yeung Shum H.: Full-frame video stabilization with motion inpainting. IEEE Trans. Patt. Anal. Mach. Intell (2006), 1150--1163. 2

Digital Library

[21]

{RTVM10} Rao S., Tron R., Vidal R., Ma Y.: Motion segmentation in the presence of outlying, incomplete, or corrupted trajectories. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 10 (2010), 1832--1845. 3

Digital Library

[22]

{Sun12} Sun J.: Video stabilization with a depth camera. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Washington, DC, USA, 2012), CVPR '12, IEEE Computer Society, pp. 89--95. 2

Digital Library

[23]

{SZJA09} Smith B., Zhang L., Jin H., Agarwala A.: Light field video stabilization. In Computer Vision, 2009 IEEE 12th International Conference on (Sept 2009), pp. 341--348. 2

[24]

{WLHL13} Wang Y.-S., Liu F., Hsu P.-S., Lee T.-Y.: Spatially and temporally optimized video stabilization. IEEE Transactions on Visualization and Computer Graphics 19, 8 (Aug. 2013), 1354--1361. 2

Digital Library

Cited By

Choi JKweon I(2020)Deep Iterative Frame Interpolation for Full-frame Video StabilizationACM Transactions on Graphics10.1145/336355039:1(1-9)Online publication date: 16-Jan-2020
https://dl.acm.org/doi/10.1145/3363550
Kang KCho S(2019)Interactive and automatic navigation for 360° video playbackACM Transactions on Graphics10.1145/3306346.332304638:4(1-11)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3323046
Liu SLi MZhu SZeng B(2017)CodingFlowIEEE Transactions on Image Processing10.1109/TIP.2017.269775926:7(3291-3302)Online publication date: 1-Jul-2017
https://dl.acm.org/doi/10.1109/TIP.2017.2697759
Show More Cited By

Index Terms

User-assisted video stabilization
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Graphics recognition and interpretation
2. Computing methodologies
  1. Computer graphics

Recommendations

Video stabilization using epipolar geometry

We present a new video stabilization technique that uses projective scene reconstruction to treat jittered video sequences. Unlike methods that recover the full three-dimensional geometry of the scene, this model accounts for simple geometric relations ...
A hybrid method for video stabilization and retargeting
ICIMCS '13: Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service

Both video stabilization and retargeting are important post processing techniques for film production. In many cases, we need to stabilize the shaky handhold video and adapt it to target displays with different resolutions and aspect ratios. Video ...
Exponential stability and stabilisation of fuzzy time-varying delay systems

This article presents new exponential stability and stabilisation conditions for Takagi-Sugeno fuzzy time-varying delay systems. Based on an improved Lyapunov-Krasovskii functional, the exponential stability and stabilisation conditions are derived in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

EGSR '14: Proceedings of the 25th Eurographics Symposium on Rendering

June 2014

162 pages

Program Chairs:
Wojciech Jarosz
Disney Research Zürich
,
Pieter Peers
College of William & Mary

Sponsors

NVIDIA
CNRS: Centre National De La Rechercue Scientifique
SOLIDANGLE: SOLID ANGLE
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 25 June 2014

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Choi JKweon I(2020)Deep Iterative Frame Interpolation for Full-frame Video StabilizationACM Transactions on Graphics10.1145/336355039:1(1-9)Online publication date: 16-Jan-2020
https://dl.acm.org/doi/10.1145/3363550
Kang KCho S(2019)Interactive and automatic navigation for 360° video playbackACM Transactions on Graphics10.1145/3306346.332304638:4(1-11)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3323046
Liu SLi MZhu SZeng B(2017)CodingFlowIEEE Transactions on Image Processing10.1109/TIP.2017.269775926:7(3291-3302)Online publication date: 1-Jul-2017
https://dl.acm.org/doi/10.1109/TIP.2017.2697759
Liu SXu BDeng CZhu SZeng BGabbouj M(2017)A Hybrid Approach for Near-Range Video StabilizationIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.255658727:9(1922-1933)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1109/TCSVT.2016.2556587
Jacob GDas SBatra DBrown MNatarajan V(2016)Video stabilization by procrustes analysis of trajectoriesProceedings of the Tenth Indian Conference on Computer Vision, Graphics and Image Processing10.1145/3009977.3009989(1-8)Online publication date: 18-Dec-2016
https://dl.acm.org/doi/10.1145/3009977.3009989

View Options

View options

Media

Figures

Other

Tables

View Table of Contents