Hierarchical frame structure based interactive video object cutout
Authors: 
Mingang Chen, Rui Hou, Lizhuang Ma, Yan GaoAuthors Info & Claims
Pages 287 - 292
Abstract
Video object cutout aims to extract homogenous objects from background in a video clip, which is a key process in many video processing fields, such as video compositing, video stylized rendering and so on. In this paper, we present a novel video cutout method by matching hierarchical structure of video frames. We first segment each frame by mean shift and construct hierarchical structure as a tree in preprocess stage. We then require user's interaction to label objects in a key frame. We further model video segmentation as matching hierarchical structure of frame and proposed an inter-frame matching algorithm. Experimental results show that our method can achieve desirable video segmentation results.
References
[1]
Bai, X., Wang, J., Simons, D., and Sapiro, G. 2009. Video snapcut: Robust video object cutout using localized claasifiers. ACM Transactions on Graphics 28, 3 (July), 243--248.
[2]
Chuang, Y., Agarwala, A., Curless, B., Salesin, D., and Szeliski, R. 2002. Video matting of complex scenes. ACM Transactions on Graphics 21, 3 (July), 243--248.
[3]
Collomosse, J., Rowntree, D., and Hall, P. 2005. Stroke surfaces: Temporally coherent artistic animations from video. IEEE Transactions on Visualiztion and Computer Graphics 11, 4 (July/August), 540--549.
[4]
Comaniciu, D., and Meer, P. 2002. Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 5 (May), 603--619.
[5]
Comaniciu, D. 2002. Image segmentation using clustering with saddle point detection. In Proceedings of International Conference on Image Processing, ICIP.
[6]
DeMenthon, D. 2002. Spatio-temporal segmentation of video by hierarchical mean shift analysis. In Proceedings of the Statistical Methods in Video Processing Workshop, Monash Univ. Copenhagen, Denmark.
[7]
Li, Y., Sun, J., and Shum, H. 2005. Video object cut and paste. ACM Transactions on Graphics 24, 3 (July), 595--600.
[8]
Paris, S., and Durand, F. 2007. A topological approach to hierarchical segmentation using mean shift. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 1978--1985.
[9]
Wang, J., Thiesson, B., Xu, Y., and Cohen, M. 2004. Image and video segmentation by anisotropic kernel mean shift. In Proceedings of European Conference on Computer Vision, ECCV.
[10]
Wang, J., Xu, Y., Shum, H., Agrawala, M., and Cohen, M. 2004. Video tooning. ACM Transactions on Graphics 23, 3 (July), 574--583.
[11]
Wang, J., Bhat, P., Colburn, R., Agrawala, M., and Cohen, M. 2005. Interactive video cutout. ACM Transactions on Graphics 24, 3 (July), 585--594.
Index Terms
- Hierarchical frame structure based interactive video object cutout
Recommendations
Interactive video cutout
We present an interactive system for efficiently extracting foreground objects from a video. We extend previous min-cut based image segmentation techniques to the domain of video with four new contributions. We provide a novel painting-based user ...
Discontinuity-aware video object cutout
Existing video object cutout systems can only deal with limited cases. They usually require detailed user interactions to segment real-life videos, which often suffer from both inseparable statistics (similar appearance between foreground and background)...
Video object cut and paste
In this paper, we present a system for cutting a moving object out from a video clip. The cutout object sequence can be pasted onto another video or a background image. To achieve this, we first apply a new 3D graph cut based segmentation approach on ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2011
617 pages
ISBN:9781450310604
DOI:10.1145/2087756
- General Chairs:
- Zhi-Qiang Liu,
- Joaquim Jorge,
- Zhigeng Pan,
- Program Chairs:
- Xiaopeng Zhang,
- Oscar Kin-Chung Au,
- Weiming Dong
Copyright © 2011 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
- VT Committee of the China Society of Image and Graphics
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 December 2011
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
VRCAI '11
Sponsor:
VRCAI '11: The 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
December 11 - 12, 2011
Hong Kong, China
Acceptance Rates
Overall Acceptance Rate 51 of 107 submissions, 48%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 81Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 19 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in