research-article

Search-based relevance association with auxiliary contextual cues

Authors:

Winston H. HsuAuthors Info & Claims

MM '13: Proceedings of the 21st ACM international conference on Multimedia

Pages 393 - 396

https://doi.org/10.1145/2502081.2508127

Published: 21 October 2013 Publication History

Get Access

Abstract

In this work, we target at solving the Bing challenge provided by Microsoft. The task is to design an effective and efficient measurement of query terms in describing the images (image-query pairs) crawled from the web. We observe that the provided image-query pairs (e.g., text-based image retrieval results) are usually related to their surrounding text; however, the relationship between image content seems to be ignored. Hence, we attempt to integrate the visual information for better ranking results. In addition, we found that plenty of query terms are related to people (e.g., celebrity) and user might have similar queries (click logs) in the search engine. Therefore, in this work, we propose a relevance association by investigating the effectiveness of different auxiliary contextual cues (i.e., face, click logs, visual similarity). Experimental results show that the proposed method can have 16% relative improvement compared to the original ranking results. Especially, for people-related queries, we can further have 45.7% relative improvement.

References

[1]

B. J. Frey and D. Dueck. Clustering by passing messages between data points. Science, 2007.

Google Scholar

[2]

W. H. Hsu et al. Video search reranking via information bottleneck principle. ACM MM, 2006.

Digital Library

Google Scholar

[3]

H. Jégou et al. Aggregating local image descriptors into compact codes. IEEE TPAMI, Sept. 2012.

Digital Library

Google Scholar

[4]

W. Liu et al. Noise resistant graph ranking for improved web image search. In CVPR, 2011.

Digital Library

Google Scholar

[5]

J. Lu et al. Image search results refinement via outlier detection using deep contexts. In CVPR, 2012.

Google Scholar

[6]

H. Ma et al. Bridging the semantic gap between image contents and tags. IEEE TMM, 12(5):462--473, 2010.

Digital Library

Google Scholar

[7]

N. Morioka and J. Wang. Robust visual reranking via sparsity and ranking constraints. In ACM MM, 2011.

Digital Library

Google Scholar

[8]

T. Ojala et al. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE TPAMI, 24(7):971--987, 2002.

Digital Library

Google Scholar

[9]

Omron. Okao vision. 2008. http://www.omron.com/r_d/vision/01.html.

Google Scholar

[10]

L. Page et al. The pagerank citation ranking: Bringing order to the web. Technical report, 1999.

Google Scholar

[11]

J. Philbin et al. Object retrieval with large vocabularies and fast spatial matching. In CVPR07.

Google Scholar

[12]

J. Sivic et al. Video Google: A text retrieval approach to object matching in videos. In ICCV, 2003.

Digital Library

Google Scholar

Cited By

View all

Zhao PMiao QLi HLiu RQuan YSong J(2023)Refined probability distribution module for fine-grained visual categorizationNeurocomputing10.1016/j.neucom.2022.10.004518(533-544)Online publication date: Jan-2023
https://doi.org/10.1016/j.neucom.2022.10.004
Dong JLi XXu D(2018)Cross-Media Similarity Evaluation for Web Image Retrieval in the WildIEEE Transactions on Multimedia10.1109/TMM.2018.279624820:9(2371-2384)Online publication date: 1-Sep-2018
https://dl.acm.org/doi/10.1109/TMM.2018.2796248
Wu FLu XSong JYan SZhang ZRui YZhuang Y(2016)Learning of Multimodal Representations With Random Walks on the Click GraphIEEE Transactions on Image Processing10.1109/TIP.2015.250740125:2(630-642)Online publication date: 1-Feb-2016
https://dl.acm.org/doi/10.1109/TIP.2015.2507401
Show More Cited By

Index Terms

Search-based relevance association with auxiliary contextual cues
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

Relevance Feedback and Learning in Content-Based Image Search

A major bottleneck in content-based image retrieval (CBIR) systems or search engines is the large gap between low-level image features used to index images and high-level semantic contents of images. One solution to this bottleneck is to apply relevance ...
Content-Based re-ranking of text-based image search results
ECIR'13: Proceedings of the 35th European conference on Advances in Information Retrieval

This article presents a method for re-ranking images retrieved by classical search engine using key words for entering queries. This method uses the visual content of the images and it is based on the idea that the relevant images should be similar to ...
Improving Diversity in Image Search via Supervised Relevance Scoring
ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval

Results returned by commercial image search engines should include relevant and diversified depictions of queries in order to ensure good coverage of users' information needs. While relevance has drastically improved in recent years, diversity is still ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MM '13: Proceedings of the 21st ACM international conference on Multimedia

October 2013

1166 pages

ISBN:9781450324045

DOI:10.1145/2502081

General Chairs:
Alejandro (Alex) Jaimes
Yahoo!, Spain
,
Nicu Sebe
University of Trento, Italy
,
Nozha Boujemaa
INRIA, France
,
Program Chairs:
Daniel Gatica-Perez
IDIAP & EPFL, Switzerland
,
David A. Shamma
Yahoo!, USA
,
Marcel Worring
University of Amsterdam, The Netherlands
,
Roger Zimmermann
National University of Singapore, Singapore

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '13

Sponsor:

SIGMM

MM '13: ACM Multimedia Conference

October 21 - 25, 2013

Barcelona, Spain

Acceptance Rates

MM '13 Paper Acceptance Rate 47 of 235 submissions, 20%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
472
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhao PMiao QLi HLiu RQuan YSong J(2023)Refined probability distribution module for fine-grained visual categorizationNeurocomputing10.1016/j.neucom.2022.10.004518(533-544)Online publication date: Jan-2023
https://doi.org/10.1016/j.neucom.2022.10.004
Dong JLi XXu D(2018)Cross-Media Similarity Evaluation for Web Image Retrieval in the WildIEEE Transactions on Multimedia10.1109/TMM.2018.279624820:9(2371-2384)Online publication date: 1-Sep-2018
https://dl.acm.org/doi/10.1109/TMM.2018.2796248
Wu FLu XSong JYan SZhang ZRui YZhuang Y(2016)Learning of Multimodal Representations With Random Walks on the Click GraphIEEE Transactions on Image Processing10.1109/TIP.2015.250740125:2(630-642)Online publication date: 1-Feb-2016
https://dl.acm.org/doi/10.1109/TIP.2015.2507401
Dong JLi XLiao SXu JXu DDu XZhou XSmeaton ATian QBulterman DShen HMayer-Patel KYan S(2015)Image Retrieval by Cross-Media Relevance FusionProceedings of the 23rd ACM international conference on Multimedia10.1145/2733373.2809929(173-176)Online publication date: 13-Oct-2015
https://dl.acm.org/doi/10.1145/2733373.2809929
Sarafis IDiou CDelopoulos A(2015)Building effective SVM concept detectors from clickthrough data for large-scale image retrievalInternational Journal of Multimedia Information Retrieval10.1007/s13735-015-0080-54:2(129-142)Online publication date: 19-Mar-2015
https://doi.org/10.1007/s13735-015-0080-5
O'Hare NKompatsiaris Y(2014)The Multimedia Grand Challenge 2013IEEE MultiMedia10.1109/MMUL.2014.1821:1(90-94)Online publication date: 2014
https://doi.org/10.1109/MMUL.2014.18
Zhongwen Xu Yi Yang Kassim AShuicheng Yan (2014)Cross-media relevance mining for evaluating text-based image search engine2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)10.1109/ICMEW.2014.6890606(1-4)Online publication date: Jul-2014
https://doi.org/10.1109/ICMEW.2014.6890606
Hua XMing Ye Jin Li (2014)Mining knowledge from clicks: MSR-Bing image retrieval challenge2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)10.1109/ICMEW.2014.6890598(1-4)Online publication date: Jul-2014
https://doi.org/10.1109/ICMEW.2014.6890598

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Relevance Feedback and Learning in Content-Based Image Search

Content-Based re-ranking of text-based image search results

Improving Diversity in Image Search via Supervised Relevance Scoring