[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

Camera array calibration for light field acquisition

  • Research Article
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

Light field cameras are becoming popular in computer vision and graphics, with many research and commercial applications already having been proposed. Various types of cameras have been developed with the camera array being one of the ways of acquiring a 4D light field image using multiple cameras. Camera calibration is essential, since each application requires the correct projection and ray geometry of the light field. The calibrated parameters are used in the light field image rectified from the images captured by multiple cameras. Various camera calibration approaches have been proposed for a single camera, multiple cameras, and a moving camera. However, although these approaches can be applied to calibrating camera arrays, they are not effective in terms of accuracy and computational cost. Moreover, less attention has been paid to camera calibration of a light field camera. In this paper, we propose a calibration method for a camera array and a rectification method for generating a light field image from the captured images. We propose a two-step algorithm consisting of closed form initialization and nonlinear refinement, which extends Zhang’s well-known method to the camera array. More importantly, we introduce a rigid camera constraint whereby the array of cameras is rigidly aligned in the camera array and utilize this constraint in our calibration. Using this constraint, we obtained much faster and more accurate calibration results in the experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Levoy M, Hanrahan P. Light field rendering. In: Proceedings of the ACM Conference on Computer Graphics. 1996, 31–42

    Google Scholar 

  2. Ng R, Levoy M, Brédif M, Duval G, Horowitz M, Hanrahan P. Light Field Photography with a Hand-Held Plenoptic Camera. Computer Science Technical Report CSTR, 2005

    Google Scholar 

  3. Vaish V, Levoy M, Szeliski R, Zitnick C L, Kang S B. Reconstructing occluded surfaces using synthetic apertures: stereo, focus and robust measures. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2006, 2331–2338

    Google Scholar 

  4. Seitz S M, Curless B, Diebel J, Scharstein D, Szeliski R S. A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2006, 519–528

    Google Scholar 

  5. Wetzstein G, Roodnick D, Heidrich W, Raskar R. Refractive shape from light field distortion. In: Proceedings of IEEE International Conference on Computer Vision. 2011, 1180–1186

    Google Scholar 

  6. Maeno K, Nagahara H, Shimada A, Taniguchi R. Light field distortion feature for transparent object recognition. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2013, 2786–2793

    Google Scholar 

  7. Wilburn B, Joshi N, Vaish V, Talvala E V E, Antunez E, Barth A, Adams A, Levoy M, Horowitz M. High performance imaging using large camera arrays. ACM Transactions on Graphics, 2005, 24(3): 765–776

    Article  Google Scholar 

  8. Zhang Z. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(11): 1330–1334

    Article  Google Scholar 

  9. Ueshiba T, Tomita F. Plane-based calibration algorithm for multicamera systems via factorization of homography matrices. In: Proceedings of IEEE International Conference on Computer Vision. 2003, 966–973

    Chapter  Google Scholar 

  10. Snavely N, Seitz S M, Szeliski R. Modeling the world from internet photo collections. International Journal of Computer Vision, 2008, 80: 189–210

    Article  Google Scholar 

  11. Bok Y, Jeon H G, Kweon I S. Geometric calibration of micro-lensbased light-field cameras using line features. In: Proceedings of European Conference on Computer Vision. 2014, 8694: 47–61

    Google Scholar 

  12. Dansereau D G, Pizarro O, Williams S B. Decoding, calibration and rectification for lenselet-based plenoptic cameras. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2013, 1027–1034

    Google Scholar 

  13. Cho D, Lee M, Kim S, Tai Y W. Modeling the calibration pipeline of the lytro camera for high quality light-field image reconstruction. In: Proceedings of IEEE International Conference on Computer Vision. 2013

    Google Scholar 

  14. Tsai R Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal of Robotics and Automation, 1987, 3: 323–344

    Article  Google Scholar 

  15. Vaish V, Wilburn B, Joshi N, Levoy M. Using plane + parallax for calibrating dense camera arrays. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1). 2004, 2–9

    Google Scholar 

  16. Svoboda T, Martinec D, Pajdla T. A convenient multi-camera selfcalibration for virtual environments. PRESENCE: Teleoperators and Virtual Environments, 2005, 14(4): 407–422

    Article  Google Scholar 

  17. Loop C, Zhang Z. Computing rectifying homographies for stereo vision. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1999, 125–131

    Google Scholar 

  18. Fusiello A, Trucco E, Verri A. A compact algorithm for rectification of stereo pairs. Machine Vision and Applications, 2000, 12(1): 16–22

    Article  Google Scholar 

  19. Deng K, Wang L, Lin Z, Feng T, Deng Z. Correction and rectification of light fields. Computers & Graphics, 2003, 27(2): 169–177

    Article  Google Scholar 

  20. Fukushima N, Yendo T, Fujii T, Tanimoto M. A novel rectification method for two-dimensional camera array by parallelizing locus of feature points. in: International Workshop on Advanced Image Technology. 2008, B5–1

    Google Scholar 

  21. Heikkila J, Silven O. A four-step camera calibration procedure with implicit image correction. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1997, 1106–1112

    Chapter  Google Scholar 

  22. Wei G Q, Ma S D. Implicit and explicit camera calibration: Theory and experiments. IEEE Transactions of Pattern Analysis and Machine Intelligence, 1994, 16(5): 469–480

    Article  Google Scholar 

  23. Levenberg K. A method for the solution of certain non-linear problems in least squares. Quarterly Journal of Applied Mathmatics, 1944, II(2): 164–168

    MathSciNet  Google Scholar 

  24. Marquardt D W. An algorithm for least-squares estimation of nonlinear parameters. SIAM Journal on Applied Mathematics, 1963, 11(2): 431–441

    Article  MATH  MathSciNet  Google Scholar 

  25. Ihm I, Park S, Lee R K. Rendering of spherical light fields. In: Proceedings of the 5th Pacific Conference On Computer Graphics And Applications. 1997, 59–68

    Google Scholar 

  26. Georgiev T, Lumsdaine A. Focused plenoptic camera and rendering. Journal of Electronic Imaging, 2010, 19(2)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Information Science and Electrical Engineering, Kyushu University, Fukuoka, 819-0395, Japan

    Yichao Xu, Kazuki Maeno, Hajime Nagahara & Rin-ichiro Taniguchi

Authors
  1. Yichao Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kazuki Maeno
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hajime Nagahara
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rin-ichiro Taniguchi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yichao Xu.

Additional information

Yichao Xu received his BE from Beijing Electronic Science and Technology Institute, China in 2007, and his ME from University of Chinese Academy of Sciences, China in 2010. He is currently a PhD candidate at Kyushu University, Japan. His research interests are computational photography and computer vision.

Kazuki Maeno received his ME from Kyushu University, Japan in 2013. He is currently working for Panasonic System Networks Company, Limited.

Hajime Nagahara received his BE and ME in Electrical and Electronic Engineering from Yamaguchi University, Japan in 1996 and 1998, respectively, and PhD in System Engineering from Osaka University, Japan in 2001. He was a research associate of the Japan Society for the Promotion of Science between 2001 and 2003. He was an assistant professor at the Graduate School of Engineering Science, Osaka University from 2003 to 2010. He was a visiting associate professor at CREA University of Picardie Jules Verns, France in 2005. He was a visiting Researcher at Columbia University, America, from 2007 to 2008. Since 2010, he has been an associate professor in the Faculty of Information Science and Electrical Engineering at Kyushu University, Japan. Computational photography, computer vision, and virtual reality are his research areas. He received an ACM Virtual Reality Software and Technology Honorable Mention Award in 2003 and an Information Processing Society of Japan Nagao Special Researcher Award in 2012.

Rin-ichiro Taniguchi received his BE, ME, and DE from Kyushu University, Japan in 1978, 1980, and 1986, respectively. Since 1996, he has been a Professor in the Graduate School of Information Science and Electrical Engineering, Kyushu University. His current research interests include computer vision, image processing, and parallel and distributed computation of vision-related applications.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, Y., Maeno, K., Nagahara, H. et al. Camera array calibration for light field acquisition. Front. Comput. Sci. 9, 691–702 (2015). https://doi.org/10.1007/s11704-015-4237-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11704-015-4237-4

Keywords

Search

Navigation