Development of Semi-Automatic Methodology for Extraction of Depth for 2D-to-3D Conversion
Pages 373 - 378
Abstract
Recently, stereoscopic image/video conversion has been most demanding as it has a great stereo video experience. This paper presents the development of the methodology for generation of the depth map used for stereoscopic view. Normally, Stereoscopic conversion involves two steps: generation of depth map and generation of two left and right view using estimated depth. This paper focus for the generation of the depth map as a second step is well known. The estimation of the depth map is a difficult task. This paper uses a fusion of monocular cues as motion, Aerial Perspective cue(AP), Linear Perspective cue(LP), and Defocus cue to estimate the depth. The experimental results show that generation of the depth map is very close to the real depth map. Thus, the algorithm can apply for 2D-to-3D conversion in 3D displays. This algorithm tested in different conditions such as the sequence of camera motion and multiple objects, static cameras, and background as stationary, a highly dynamic foreground and with less motion as background, and motion is in behind the foreground.
References
[1]
Zhebin Zhang,Chen Zhou, "Interactive Sterescopic Video Conversio", IEEE Transaction on Circuits and Systems for Video Technology, Vol. 6, Jan. 2013
[2]
Yeong-KangLai,Yu-FanLai,Ying-Chang Chen, "An effective Hubrid Depth-Generation Algorithm for 2D-to-3D Conversion in 3DDisplays", Journals of display technology, Vol. 9, no. 3, March 2013.
[3]
Chung-Te Li,Yei-Chieh Lai," Brain-inspired framework for fusion of multiple depth cues, accepted for publ.,IEEE journal,2012.
[4]
I. A. Ideses, L. P. Yaroslavsky, B. Fishbain, and R. Vistuch, "3D from compressed 2D video," in Proc. SPIE: Stereoscopic Displays and Applications XIV, vol. 6490, 64901C, 2007.
[5]
Shaojie Zhuo and Terence Sim, "Recovering Depth from a Single Defocued Image", Pattern Recognition, 2011.
[6]
P. Favaro and S. Soatto, "A geometric approach to shape from defocus," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 406-417,2006.
[7]
J. Park and C. Kim, "Extracting focused object from low depth-of-field image sequences," in Proc. SPIE Visual Communications and Image Processing, vol. 6077, pp. 607710-1--607710-8, Jan. 2006.
[8]
W. J. Tarn, A. S. Yee, J. Ferreira, S. Tariq, and F. Speranza, "Stereoscopic image rendering based on depth maps created from blur and edge information," in Proc. SPIE: Stereoscopic Displays and Applications XII, vol. 5664, pp. 104--115,2005.
[9]
W. J. Tarn, C. Vázquez, and F. Speranza, "Three-dimensional TV: A novel method for generating surrogate depth maps using color information," in Proc. SPIE: Stereoscopic Displays and Applications XX, vol. 7237, 2009.
[10]
Lian Zhang, Carlos Vazquez,and Sebastian Knorr, "3DTV Content Cration:Automatic 2D-to-3D Video Conversion,"IEEE Trans. on broadcasting, Vol.57, No.2, June 2011.
[11]
Janusz Lonrad,Meng Wang, "Learning --based, automatic 2D-to-3D image and Video Conversion, "accepted for publication in IEEE journals,2013.
[12]
J.Elder,S.Zucker,"Local scalecontrol for edge detection and blur estimation", IEEE Trans.Pattern Anal. Mach.Intell.20(7),19998,699--716.
[13]
S. Bae, F. Durand, "Defocus magnification", Proc.Eurographics, 2007,pp. 571--579
[14]
Y.W.Tai,M.S.Brown, "Single image defocus map estimation using local contrast prior, Proc ICIP, 2009.
[15]
Diego Cheda, "Monocular depth cues in computer applicaation", PhD Thesis,2012.
[16]
Q.Wei, "Converting 2D to 3D:A Survey",Research Assignment,2012
[17]
Rafael C. Gonzalez. Richard E, M, Woods, Pearson education, "Digital Image Processing", 2009.
[18]
S.Jayram,McGraw Education, "Digital Image Processing", 2013
[19]
M. Dimiccoli, J. Morel, and P. Salembier, "Monocular Depth by Nonlinear Diffusion," Indian Conf. Comput. Vision, Graphics & Image Process., pp. 95--102, 2008
[20]
A.Criminisi, "Single-View Metrology: Algorithms and Applications," in DAGM Symp. on Pattern Recognit., pp. 224--239,2002
[21]
S. Battiato, S. Curti, M. La Cascia, M. Tortora, and E. Scordato, "Depth Map Generation by Image Classification," in Soc. of Photo-Opt. Instrum. Eng. Conf.Ser., vol. 5302, 2004, pp. 95--104.
[22]
G. Wang, Z. Hu, F. Wu, and H. Tsui, "Single View Metrology from Scene Constraints," Image Vision Comput., vol. 23, no. 9, pp. 831--840, 2005.
[23]
J. Huang and B. Cowan, "Simple 3D Reconstruction of Single Indoor Imagewith Perspective Cues," in Can. Conf. on Comput. and Rob. Vision, 2009, pp. 140--147.
[24]
H. Chen and T. Liu, "Finding Familiar Objects and their Depth from a Single Image," in IEEE Int. Conf. Image Proc, 2007, pp. 389--392.
[25]
A. Torralba and A. Oliva, "Depth Estimation from Image Structure," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1226--1238, 2002.
[26]
K. He, J. Sun, and X. Tang, "Single Image Haze Removal Using Dark Channel Prior," in IEEE Conf. Comput. Vision and Pattern Recognit., 2009, pp. 1956--1963.
[27]
D. Hoiem, A. Efros, and M. Hebert, "Automatic Photo Pop-Up," ACM Trans.on Graphics, vol. 24, no. 3, pp. 577--584, 2005.
[28]
A. Saxena, M. Sun, and A. Ng, "Make3D: Learning 3D Scene Structure from a Single Still Image," IEEE Trans. Pattern Anal. Mack Intell, vol. 31, no. 5,pp. 824--840, 2009.
[29]
V. Nedovic, A. Smeulders, A. Redert, and J. M. Geusebroek, "Stages As Models of Scene Geometry," IEEE Trans. Pattern Anal. Mack Intell., vol. 32, no. 9,pp. 1673--1687, 2010.
[30]
M. Dimiccoli, J. Morel, and P. Salembier, "Monocular Depth by Nonlinear Diffusion," Indian Conf. Comput. Vision, Graphics & Image Process., pp. 95--102, 2008.
[31]
Baoping Li,Long Ye, "Multi-cue Fusion Based Depth Map generation from 2D video Frames",Journals of Information & Computational Scoences, 2015
[32]
Sung-Fang Tsai,Chao-Chung Cheng, "A Real-Time 1080p 2D-to-3D Video Conversion System," IEEE Transaction on Consumer Electronics, Vol.57,No.2,May 2011.
[33]
C.L. Zitnick, S.B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation," ACM SIGGRAPH and ACM Trans. on Graphics, Los Angeles, CA, Aug. 2004, pp. 600--608.
[34]
C. T. E. R. Hewage, S. T. Worrall, S. Dogan, S. Villette, A. M. Kondoz, Quality evaluation of color plus depth map-based stereoscopic video, IEEE J. Selected Topics in Signal Process., Vol. 3,No. 2, Apr. 2009, 304--318
[35]
"Methodology for the Subjective assessment of the quality of television pictures," International Telecom union/ITU Radio Communication Sector,ITU-R BT.500-13, 2012
Recommendations
Efficient and high speed depth-based 2D to 3D video conversion
Stereoscopic video is the new era in video viewing and has wide applications such as medicine, satellite imaging and 3D Television. Such stereo content can be generated directly using S3D cameras. However, this approach requires expensive setup and ...
Gradient-based 2D-to-3D Conversion for Soccer Videos
MM '15: Proceedings of the 23rd ACM international conference on MultimediaA wide spread adoption of 3D videos and technologies is hindered by the lack of high-quality 3D content. One promising solution to address this problem is to use automated 2D-to-3D conversion. However, current conversion methods, while general, produce ...
Depth estimation for semi-automatic 2D to 3D conversion
MM '12: Proceedings of the 20th ACM international conference on MultimediaThe conversion of monoscopic footage into stereoscopic or multiview content is a difficult and time consuming task. A number of semi-automatic methods have been developed to speed up the process and provide some control to the user. However these ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
February 2017
545 pages
ISBN:9781450348171
DOI:10.1145/3055635
Copyright © 2017 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- Southwest Jiaotong University
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 24 February 2017
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICMLC 2017
ICMLC 2017: 2017 the 9th International Conference on Machine Learning and Computing
February 24 - 26, 2017
Singapore, Singapore
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 70Total Downloads
- Downloads (Last 12 months)10
- Downloads (Last 6 weeks)0
Reflects downloads up to 07 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in