Search web images using objects, backgrounds and conditions
Authors: 
Jiemi Zhang, Chenxia Wu, Deng CaiAuthors Info & Claims
Pages 933 - 936
Abstract
As the volumes of web images have grown rapidly in the last decade, Content-Based Image Retrieval (CBIR) has attracted substantial interests as an effective tool to manage the images. Most existing CBIR systems focus on the object in the image, while ignoring the conditions (day/night, sunny/rain, etc) and the backgrounds, both of which are very helpful to meet the user's information need. To overcome this shortcoming, in this paper, we present a novel CBIR system depending on a novel query formulation considering three aspects: Object, Background and Condition. Specifically, we design a user-friendly interface to help the user formulate a query. The interface can allow the user to give the percentage, relative position and size of each object in the background. Moreover, a corresponding effective ranking method is proposed to return the desirable search results. Experimental results demonstrate that our proposed system improves the searching performance and the user experience compared with the existing searching systems.
References
[1]
D. Cai, X. He, and J. Han. Spectral regression: A unified subspace learning framework for content-based image retrieval. In Proceedings of the 15th ACM International Conference on Multimedia, pages 403--412, 2007.
[2]
D. Cai, X. He, W.-Y. Ma, J.-R. Wen, and H. Zhang. Organizing WWW images based on the analysis of page layout and web link structure. In Proceedings of the 2004 IEEE International Conference on Multimedia and Expo, pages 113--116, 2004.
[3]
T. Chen, M.-M. Cheng, P. Tan, A. Shamir, and S.-M. Hu. Sketch2photo: Internet image montage. ACM Transactions on Graphics, 28(5), 2009.
[4]
O. Chum, J. Philbin, J. Sivic, M. Isard, and A. Zisserman. Total recall: Automatic query expansion with a generative feature model for object retrieval. In ICCV, 2007.
[5]
D. Dueck and B. J. Frey. Non-metric affinity propagation for unsupervised image categorization. In ICCV, 2007.
[6]
X. He, D. Cai, J.-R. Wen, W.-Y. Ma, and H.-J. Zhang. Clustering and searching www images using link and page layout analysis. ACM Transactions on Multimedia Computing, Communications and Applications, 3(1), 2007.
[7]
X. He, W. Min, D. Cai, and K. Zhou. Laplacian optimal design for image retrieval. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 119--126, 2007.
[8]
K. Jarvelin and J. Kekalainen. Ir evaluation methods for retrieving highly relevant documents. In SIGIR 2000.
[9]
E. P. X. Li-Jia Li, Hao Su and L. Fei-Fei. Object bank: A high-level image representation for scene classification & semantic feature sparsification. In NIPS, 2010.
[10]
T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H.-Y. Shum. Learning to detect a salient object. IEEE Trans. Pattern Anal. Mach. Intell., 33(2), 2011.
[11]
Y. Liu, T. Mei, and X.-S. Hua. Crowdreranking: exploring multiple search engines for visual search reranking. In SIGIR, 2009.
[12]
K. Mikolajczyk and C. Schmid. Scale & affine invariant interest point detectors. IJCV, 60(1), 2004.
[13]
J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Object retrieval with large vocabularies and fast spatial matching. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2007.
[14]
A. Quattoni and A. Torralba. Recognizing indoor scenes. CVPR, 2009.
[15]
B. C. Russell, A. Torralba, K. P. Murphy, and W. T. Freeman. Labelme: A database and web-based tool for image annotation. IJCV, 77(1--3), 2008.
[16]
C. Schmid. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In CVPR, 2006.
[17]
H. Xu, J. Wang, X.-S. Hua, and S. Li. Image search by concept map. In SIGIR, 2010.
[18]
R. Yan. Learning query-class dependent weights in automatic video retrieval. In ACM Multimedia, 2004.
[19]
Z.-J. Zha, L. Yang, T. Mei, M. Wang, and Z. Wang. Visual query suggestion. In ACM Multimedia, 2009.
Index Terms
- Search web images using objects, backgrounds and conditions
Recommendations
Contextual relevance feedback in web information retrieval
IIiX: Proceedings of the 1st international conference on Information interaction in contextIn this paper, we present an alternative approach to the problem of contextual relevance feedback in web-based information retrieval. Our approach utilises a rich contextual model that exploits a user's implicit and explicit data. Each user's implicit ...
Improving Retrieval Quality Using Pseudo Relevance Feedback in Content-Based Image Retrieval
SIGIR '16: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information RetrievalThe increased availability of image capturing devices has enabled collections of digital images to rapidly expand in both size and diversity. This has created a constantly growing need for efficient and effective image browsing, searching, and retrieval ...
An implicit relevance feedback method for CBIR with real-time eye tracking
Relevance feedback is an efficient approach to improve the performance of content-based image retrieval systems, and implicit relevance feedback approaches, which gather users' feedback by biometric devices (e.g. eye tracker), have extensively ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2012
1584 pages
ISBN:9781450310895
DOI:10.1145/2393347
- General Chairs:
- Noboru Babaguchi,
- Kiyoharu Aizawa,
- John Smith,
- Program Chairs:
- Shin'ichi Satoh,
- Thomas Plagemann,
- Xian-Sheng Hua,
- Rong Yan
Copyright © 2012 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 October 2012
Check for updates
Author Tags
Qualifiers
- Poster
Conference
MM '12
Sponsor:
Acceptance Rates
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 147Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in