More Web Proxy on the site http://driver.im/

research-article

Geodesic Video Stabilization in Transformation Space

Authors:

Xiao-Quan Chen,

Hua HuangAuthors Info & Claims

IEEE Transactions on Image Processing, Volume 26, Issue 5

Pages 2219 - 2229

https://doi.org/10.1109/TIP.2017.2676354

Published: 01 May 2017 Publication History

Abstract

We present a novel formulation of video stabilization in the space of geometric transformations. With the setting of the Riemannian metric, the optimized smooth path is cast as the geodesics on the Lie group embedded in transformation space. While solving the geodesics has a closed-form expression in a certain space, path smoothing can be easily implemented by using geometric interpolation, rather than optimizing any space-time energy function. Specially, by using the geodesic solution in the space of rigid transformations, our approach even gains speedup \(10\times \) faster than state-of-the-art methods for path smoothing and motion compensation, and guarantees no extra distortion drawn into the stabilized frames. The experiments demonstrate the efficiency and effectiveness of our algorithm on stabilizing a variety of shaky videos.

References

[1]

Y. Matsushita, E. Ofek, X.-O. Tang, and H.-Y. Shum, “Full-frame video stabilization,” in Proc. CVPR, 2005, pp. 50–57.

Digital Library

[2]

B.-Y. Chen, K.-Y. Lee, W.-T. Huang, and J.-S. Lin, “Capturing intention-based full-frame video stabilization,” Comput. Graph. Forum, vol. Volume 27, no. Issue 7, pp. 1805–1814, 2008.

[3]

G. Puglisi and S. Battiato, “A robust image alignment algorithm for video stabilization purposes,” IEEE Trans. Circuits Syst. Video Technol., vol. Volume 21, no. Issue 10, pp. 1390–1400, 2011.

Digital Library

[4]

K.-Y. Lee, Y.-Y. Chuang, B.-Y. Chen, and M. Ouhyoung, “Video stabilization using robust feature trajectories,” in Proc. ICCV, 2009, pp. 1397–1404.

[5]

A. Goldstein and R. Fattal, “Video stabilization using epipolar geometry,” ACM Trans. Graph., vol. Volume 31, no. Issue 5, pp. 126:1–126:10, 2012.

Digital Library

[6]

Y.-S. Wang, F. Liu, P.-S. Hsu, and T.-Y. Lee, “Spatially and temporally optimized video stabilization,” IEEE Trans. Vis. Comput. Graphics, vol. Volume 19, no. Issue 8, pp. 1354–1361, 2013.

Digital Library

[7]

M. Grundmann, V. Kwatra, and I. Essa, “Auto-directed video stabilization with robust <inline-formula><tex-math notation=LaTeX>$L_{1}$</tex-math></inline-formula> optimal camera paths,” in Proc. CVPR, 2011, pp. 225–232.

Digital Library

[8]

S.-C. Liu, L. Yuan, P. Tan, and J. Sun, “Bundled camera paths for video stabilization,” ACM Trans. Graph., vol. Volume 32, no. Issue 4, pp. 78:1–78:10, 2013.

Digital Library

[9]

F. Liu, M. Gleicher, H.-L. Jin, and A. Agarwala, “Content-preserving warps for 3D video stabilization,” ACM Trans. Graph., vol. Volume 28, no. Issue 3, pp. 44:1–44:9, 2009.

Digital Library

[10]

F.-L. Zhang, J. Wang, H. Zhao, R. Martin, and S.-M. Hu, “Simultaneous camera path optimization and distraction removal for improving amateur video,” IEEE Trans. Image Process., vol. Volume 24, no. Issue 12, pp. 5982–5994, 2015.

[11]

Z. Zhu, R. R. Martin, R. Pepperell, and A. Burleigh, “3D modeling and motion parallax for improved videoconferencing,” Comput. Vis. Media, vol. Volume 2, no. Issue 2, pp. 131–142, 2016.

[12]

G.-F. Zhang, W. Hua, X.-Y. Qin, Y.-L. Shao, and H.-J. Bao, “Video stabilization based on a 3D perspective camera model,” Vis. Comput., vol. Volume 25, no. Issue 11, pp. 997–1008, 2009.

Digital Library

[13]

Z.-H. Zhou, H.-L. Jin, and Y. Ma, “Plane-based content-preserving warps for video stabilization,” in Proc. CVPR, Jun. 2013, pp. 2299–2306.

Digital Library

[14]

S.-C. Liu, Y.-T. Wang, L. Yuan, J.-J. Bu, P. Tan, and J. Sun, “Video stabilization with a depth camera,” in Proc. CVPR, 2012, pp. 89–95.

Digital Library

[15]

C. Jia and B. L. Evans, “Constrained 3D rotation smoothing via global manifold regression for video stabilization,” IEEE Trans. Signal Process., vol. Volume 62, no. Issue 13, pp. 3293–3304, 2014.

Digital Library

[16]

F. Liu, M. Gleicher, J. Wang, H.-L. Jin, and A. Agarwala, “Subspace video stabilization,” ACM Trans. Graph., vol. Volume 30, no. Issue 1, pp. 4:1–4:10, 2011.

Digital Library

[17]

M. Grundmann, V. Kwatra, D. Castro, and I. Essa, “Calibration-free rolling shutter removal,” in Proc. ICCP, 2012, pp. 1–8.

[18]

L. Zhang, Q.-K. Xu, and H. Huang, “A global approach to fast video stabilization,” IEEE Trans. Circuits Syst. Video Technol., vol. Volume 27, no. Issue 2, pp. 225–235, 2017.

Digital Library

[19]

Z.-Q. Wang, L. Zhang, and H. Huang, “Mulitplane video stabilization,” Comput. Graph. Forum, vol. Volume 32, no. Issue 7, pp. 265–273, 2013.

[20]

S.-C. Liu, L. Yuan, P. Tan, and J. Sun, “Steadyflow: Spatially smooth optical flow for video stabilization,” in Proc. CVPR, June. 2014.

Digital Library

[21]

K. Nishi and T. Onda, “Evaluation system for camera shake and image stabilizer,” in Proc. ICME, Jul. 2010, pp. 926–931.

[22]

S. Helgason, Differential Geometry, Lie Groups, and Symmetric Spaces . San Diego, CA, USA: Academic, 1978.

[23]

R. M. Murray, Z. Li, and S. S. Sastry, A Mathematical Introduction to Robotic Manipulation . Boca Raton, FL, USA: CRC Press, 1994.

Digital Library

[24]

E. Zacur, M. Bossa, and S. Olmos, “Left-invariant riemannian geodesics on spatial transformation groups,” SIAM J. Imag. Sci., vol. Volume 7, no. Issue 3, pp. 1503–1557, 2014.

[25]

S. Leonardos, C. Allen-Blanchette, and J. Gallier, “The exponential map for the group of similarity transformations and applications to motion interpolation,” in Proc. ICRA, May 2015, pp. 377–382.

[26]

N. Joshi, W. Kienzle, M. Toelle, M. Uyttendaele, and M. F. Cohen, “Real-time hyperlapse creation via optimal frame selection,” ACM Trans. Graph., vol. Volume 34, no. Issue 4, pp. 63:1–63:9, 2015.

Digital Library

[27]

S. M. Seitz and C. R. Dyer, “View-invariant analysis of cyclic motion,” Int. J. Comput. Vis., vol. Volume 25, no. Issue 3, pp. 231–251, 1997.

Digital Library

[28]

M. Calonder, V. Lepetit, M. Ozuysal, T. Trzcinski, C. Strecha, and P. Fua, “BRIEF: Computing a local binary descriptor very fast,” IEEE Trans. Pattern Anal. Mach. Intell., vol. Volume 34, no. Issue 7, pp. 1281–1298, 2012.

Digital Library

[29]

R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision . Cambridge, U.K.: Cambridge Univ. Press, 2004.

Digital Library

[30]

Y. Zhang, Y.-L. Tang, and K.-L. Cheng, “Efficient video cutout by paint selection,” Comput. Sci. Technol., vol. Volume 30, no. Issue 3, pp. 467–477, 2015.

Cited By

Zhang LHuang H(2023)Image Stitching With Manifold OptimizationIEEE Transactions on Multimedia10.1109/TMM.2022.316183925(3469-3482)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3161839
Li CSong LChen SXie RZhang W(2023)Deep Online Video Stabilization Using IMU SensorsIEEE Transactions on Multimedia10.1109/TMM.2022.314242925(2047-2060)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3142429
Wang YHuang QJiang CLiu JShang MMiao Z(2023)Video stabilizationNeurocomputing10.1016/j.neucom.2022.10.008516:C(205-230)Online publication date: 7-Jan-2023
https://dl.acm.org/doi/10.1016/j.neucom.2022.10.008
Show More Cited By

Recommendations

Elastic Geodesic Paths in Shape Space of Parameterized Surfaces

This paper presents a novel Riemannian framework for shape analysis of parameterized surfaces. In particular, it provides efficient algorithms for computing geodesic paths which, in turn, are important for comparing, matching, and deforming surfaces. ...
Computing geodesic spectra of surfaces
SPM '07: Proceedings of the 2007 ACM symposium on Solid and physical modeling

Surface classification is one of the most fundamental problems in geometric modeling. Surfaces can be classified according to their conformal structures. In general, each topological equivalent class has infinite conformally equivalent classes.

This ...
The shape space of discrete orthogonal geodesic nets

Discrete orthogonal geodesic nets (DOGs) are a quad mesh analogue of developable surfaces. In this work we study continuous deformations on these discrete objects. Our main theoretical contribution is the characterization of the shape space of DOGs for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Image Processing

IEEE Transactions on Image Processing Volume 26, Issue 5

May 2017

492 pages

ISSN:1057-7149

Issue’s Table of Contents

Copyright © 2017.

Publisher

IEEE Press

Publication History

Published: 01 May 2017

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang LHuang H(2023)Image Stitching With Manifold OptimizationIEEE Transactions on Multimedia10.1109/TMM.2022.316183925(3469-3482)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3161839
Li CSong LChen SXie RZhang W(2023)Deep Online Video Stabilization Using IMU SensorsIEEE Transactions on Multimedia10.1109/TMM.2022.314242925(2047-2060)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3142429
Wang YHuang QJiang CLiu JShang MMiao Z(2023)Video stabilizationNeurocomputing10.1016/j.neucom.2022.10.008516:C(205-230)Online publication date: 7-Jan-2023
https://dl.acm.org/doi/10.1016/j.neucom.2022.10.008
Lee DYoo JCho KKim BIm GNoh J(2022)PopStageACM Transactions on Graphics10.1145/3550454.355546741:6(1-13)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555467
Roberto e Souza MMaia HPedrini H(2022)Survey on Digital Video Stabilization: Concepts, Methods, and ChallengesACM Computing Surveys10.1145/349452555:3(1-37)Online publication date: 3-Feb-2022
https://dl.acm.org/doi/10.1145/3494525
Xu YZhang JMaybank STao D(2022)DUT: Learning Video Stabilization by Simply Watching Unstable VideosIEEE Transactions on Image Processing10.1109/TIP.2022.318288731(4306-4320)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1109/TIP.2022.3182887
Xu YZhang QZhang JTao D(2022)Attentive Cascaded Pyramid Network for Online Video StabilizationArtificial Intelligence10.1007/978-3-031-20497-5_2(18-29)Online publication date: 27-Aug-2022
https://dl.acm.org/doi/10.1007/978-3-031-20497-5_2
Zhang LZheng QHuang H(2019)Intrinsic Motion Stability Assessment for Video StabilizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.281720925:4(1681-1692)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1109/TVCG.2018.2817209
Huang HWei XZhang L(2019)Encoding Shaky Videos by Integrating Efficient Video StabilizationIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2018.283347629:5(1503-1514)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1109/TCSVT.2018.2833476

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents