Abstract
This paper proposes a real-time (performance of at least 30 fps for full-HD video) Depth-Image-based Rendering (DIBR) approach for stereoscopic 3DTV using OpenCL. Many stereoscopic 3DTV, multi-view, and Free-view-point TV (FTV) technologies have been based on DIBR, aiming at saving bandwidth, and to allow for user adaptation in the client-side. Unlike related work, this paper uses OpenCL for all the DIBR steps, including the re-projection in the virtual views (which is commonly performed using OpenGL, even when implemented in GPGPUs). The use of OpenCL-only can, in some cases, outperform the OpenGL z-testing performance. Two execution models have been implemented (per-line parallel, and per-pixel parallel) and tested against standard video-plus-depth test sequences to show the approach performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Dufaux, F., Pesquet-Popescu, B., Cagnazzo, M. (eds.): Emerging technologies for 3D video: creation, coding, transmission, and rendering. John Wiley & Sons Inc., Chichester (2013)
Müller, K., Merkle, P., Wiegand, T.: 3-D Video Representation Using Depth Maps. Proc. IEEE 99, 643–656 (2011)
Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In: Proc SPIE, vol. 5291, pp. 93–104 (2004)
Zhu, C., Zhao, Y., Yu, L., Tanimoto, M. (eds.): 3D-TV System with Depth-Image-Based Rendering. Springer, New York (2013)
Tanimoto, M.: FTV: Free-viewpoint Television. Signal Process. Image Commun. 27, 555–570 (2012)
Guillemot, C., Le Meur, O.: Image Inpainting: Overview and Recent Advances. IEEE Signal Process. Mag. 31, 127–144 (2014)
Tian, D., Lai, P.-L., Lopez, P., Gomila, C.: View synthesis techniques for 3D video. In: Proc SPIE, vol. 7443, pp. 74430T–74430T–11 (2009)
Zhao, Y., Zhu, C., Yu, L.: Virtual View Synthesis and Artifact Reduction Techniques. In: Zhu, C., Zhao, Y., Yu, L., Tanimoto, M. (eds.) 3D-TV System with Depth-Image-Based Rendering, pp. 145–167. Springer, New York (2013)
Owens, J.D., Luebke, D., Govindaraju, N., Harris, M., Krüger, J., Lefohn, A.E., Purcell, T.J.: A Survey of general-purpose computation on graphics hardware. Computer Graphics Forum, 80–113 (2007)
Munshi, A.: OpenCL programming guide. Addison-Wesley, Upper Saddle River (2012)
Park, Y.K., Jung, K., Oh, Y., Lee, S., Kim, J.K., Lee, G., Lee, H., Yun, K., Hur, N., Kim, J.: Depth-image-based rendering for 3DTV service over T-DMB. Signal Process: Image Commun. 24, 122–136 (2009)
Fan, Y.-C., Chi, T.-C.: The Novel Non-Hole-Filling Approach of Depth Image Based Rendering. In: 3DTV Conference: The True Vision-Capture. Transmission and Display of 3D Video, pp. 325–328. IEEE (2008)
Vázquez, C., Tam, W.J., Speranza, F.: Stereoscopic imaging: filling disoccluded areas in depth image-based rendering. In: Javidi, B., Okano, F., Son, J.-Y. (eds.) Proc. SPIE, p. 63920D–63920D–12 (2006)
Azzari, L., Battisti, F., Gotchev, A.: Comparative analysis of occlusion-filling techniques in depth image-based rendering for 3D videos. In: Proceedings of the 3rd Workshop on Mobile Video Delivery, pp. 57–62. ACM (2010)
Chen, W.-Y., Chang, Y.-L., Chiu, H.-K., Chien, S.-Y., Chen, L.-G.: Real-time depth image based rendering hardware accelerator for advanced three dimensional television system. In: 2006 IEEE International Conference on Multimedia and Expo., pp. 2069–2072. IEEE (2006)
Bondarev, E., Zinger, S., De With, P.H.N.: Performance-efficient architecture for free-viewpoint 3DTV receiver. In: 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE), pp. 65–66. IEEE (2010)
Lee, M.-H., Park, I.K.: Accelerating depth image-based rendering using GPU. In: Gunsel, B., Jain, A.K., Tekalp, A.M., Sankur, B. (eds.) MRCS 2006. LNCS, vol. 4105, pp. 562–569. Springer, Heidelberg (2006)
Rogmans, S., Lu, J., Lafruit, G.: A scalable end-to-end optimized real-time image-based rendering framework on graphics hardware. In: 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, pp. 129–132. IEEE (2008)
Shin, H.-C., Kim, Y.-J., Park, H., Park, J.-I.: Fast view synthesis using GPU for 3D display. IEEE Trans. on Consum. Electron. 54, 2068–2076 (2008)
Shin, I., Ho, Y.: GPU Parallel Programming for Real-time Stereoscopic Video Generation. In: International Conference on Electronics, Information, and Communication, pp. 315–318 (2010)
Rogmans, S., Dumont, M., Lafruit, G., Bekaert, P.: Migrating real-time depth image-based rendering from traditional to next-gen GPGPU. In: 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, pp. 1–4. IEEE (2009)
Wang, L.-H., Zhang, J., Yao, S.-J., Li, D.-X., Zhang, M.: GPU Based Implementation of 3DTV System. In: Sixth International Conference on Image and Graphics (ICIG), pp. 847–851. IEEE (2011)
Xu, K., Ji, X., Wang, R., Dai, Q.: Parallel implementation of depth-image-based rendering. In: IC3D, pp. 1–4. IEEE (2011)
Do, L., Bravo, G., Zinger, S., de With, P.H.: GPU-accelerated Real-time Free-viewpoint DIBR for 3DTV. IEEE Trans. on. Consum. Electron 58, 633–640 (2012)
Zheng, Z., An, P., Zhao, B., Zhang, Z.: Real-Time Rendering Based on GPU for Binocular Stereo System. In: Zhang, W., Yang, X., Xu, Z., An, P., Liu, Q., Lu, Y. (eds.) IFTC 2012. CCIS, vol. 331, pp. 492–499. Springer, Heidelberg (2012)
Günther, C., Kanzok, T., Linsen, L., Rosenthal, P.: A GPGPU-based Pipeline for Accelerated Rendering of Point Clouds. J. WSCG 21, 153–162 (2013)
Domañski, M., Grajek, T., Klimaszewski, K., Kurc, M., Stankiewicz, O., Stankowski, J., Wegner, K.: Poznan multiview video test sequences and camera parameters. ISOIEC JTC1SC29WG11 MPEG. M17050 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
de Albuquerque Azevedo, R.G., Ismério, F., Raposo, A.B., Soares, L.F.G. (2014). Real-Time Depth-Image-Based Rendering for 3DTV Using OpenCL. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2014. Lecture Notes in Computer Science, vol 8887. Springer, Cham. https://doi.org/10.1007/978-3-319-14249-4_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-14249-4_10
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14248-7
Online ISBN: 978-3-319-14249-4
eBook Packages: Computer ScienceComputer Science (R0)