Article

Learning and inferring a semantic space from user's relevance feedback for image retrieval

Authors:

Hongjiang ZhangAuthors Info & Claims

MULTIMEDIA '02: Proceedings of the tenth ACM international conference on Multimedia

Pages 343 - 346

https://doi.org/10.1145/641007.641080

Published: 01 December 2002 Publication History

Get Access

Abstract

As current methods for content-based retrieval are incapable of capturing the semantics of images, we experiment with using spectral methods to infer a semantic space from user's relevance feedback, so the system will gradually improve its retrieval performance through accumulated user interactions. In addition to the long-term learning process, we also model the traditional approaches to query refinement using relevance feedback as a short-term learning process. The proposed short- and long-term learning frameworks have been integrated into an image retrieval system. Experimental results on a large collection of images have shown the effectiveness and robustness of our proposed algorithms.

References

[1]

Dagan, I., Karov, Y., and Roth, D. "Mistaken-driven learning in text categorization," Proc of the second conf. on empirical methods in natural language processing, pp. 55--63, 1997.

Google Scholar

[2]

Littlestone, N., "Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm," Machine Learning 2(4), pp. 285--318, 1988.

Digital Library

Google Scholar

[3]

Salton, G. and McGill, M., "Introduction to modern information retrieval," McGraw-Hill, New York, 1983.

Digital Library

Google Scholar

[4]

He, Xiaofei, Ma, W.-Y., King, O., Li, M., Zhang, H.J., "Learning and inferring a semantic space from user's relevance feedback for image retrieval," Microsoft Technical Report, MSR-TR-2002-62, Microsoft Research. Apr. 2002.

Digital Library

Google Scholar

[5]

Vapnik, V., "The nature of statistical learning theory," Springer, New York, 1995.

Digital Library

Google Scholar

[6]

Ma, W.-Y. and Zhang, H.J., Content-based image indexing and retrieval, Handbook of Multimedia Computing, Chapter 11, CRC Press, 1999.

Google Scholar

Cited By

View all

Subramanian BPaul AKim JChee K(2022)Metrics Space and NormScientific Programming10.1155/2022/19113452022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/1911345
Squicciarini ACaragea CBalakavi R(2017)Toward Automated Online Photo PrivacyACM Transactions on the Web10.1145/298364411:1(1-29)Online publication date: 3-Apr-2017
https://dl.acm.org/doi/10.1145/2983644
Alzubaidi M(2016)A new strategy for bridging the semantic gap in image retrievalInternational Journal of Computational Science and Engineering10.1504/IJCSE.2017.08117414:1(27-43)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1504/IJCSE.2017.081174
Show More Cited By

Recommendations

Relevance feedback methods for logo and trademark image retrieval on the web
SAC '06: Proceedings of the 2006 ACM symposium on Applied computing

Relevance feedback is the state-of-the-art approach for adjusting query results to the needs of the users. This work extends the existing framework of image retrieval with relevance feedback on the Web by incorporating text and image content into the ...
Relative Relevance Feedback in Image Retrieval
ICME '12: Proceedings of the 2012 IEEE International Conference on Multimedia and Expo

We propose a relative relevance feedback method for image retrieval systems. Relevance feedback is an effective method to modify a user's query by selecting relevant and irrelevant items in the search result. However, users cannot always find exactly ...
The effect of low-level image features on pseudo relevance feedback

Relevance feedback (RF) is a technique popularly used to improve the effectiveness of traditional content-based image retrieval systems. However, users must provide relevant and/or irrelevant images as feedback for their queries, which is a tedious ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MULTIMEDIA '02: Proceedings of the tenth ACM international conference on Multimedia

December 2002

683 pages

ISBN:158113620X

DOI:10.1145/641007

Conference Chair:
Lawrence Rowe
UC Berkeley
,
General Chair:
Bernard Merialdo
Institut EURECOM
,
Program Chairs:
Max Muhlhauser
TU Darmstadt
,
Keith Ross
Institut EURECOM
,
Nevenka Dimitrova
Phillips Research

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM02

Sponsor:

MM02: ACM Multimedia 2002

December 1 - 6, 2002

Juan-les-Pins, France

Acceptance Rates

MULTIMEDIA '02 Paper Acceptance Rate 46 of 330 submissions, 14%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
622
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Subramanian BPaul AKim JChee K(2022)Metrics Space and NormScientific Programming10.1155/2022/19113452022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/1911345
Squicciarini ACaragea CBalakavi R(2017)Toward Automated Online Photo PrivacyACM Transactions on the Web10.1145/298364411:1(1-29)Online publication date: 3-Apr-2017
https://dl.acm.org/doi/10.1145/2983644
Alzubaidi M(2016)A new strategy for bridging the semantic gap in image retrievalInternational Journal of Computational Science and Engineering10.1504/IJCSE.2017.08117414:1(27-43)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1504/IJCSE.2017.081174
Kasai TTakano K(2016)Design of Sketch-Based Image Search UI for Finger Gesture2016 10th International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS)10.1109/CISIS.2016.140(516-521)Online publication date: Jul-2016
https://doi.org/10.1109/CISIS.2016.140
Sugimura HTsukiji HKumada MIiba TTakano K(2016)A Sketch-Based User Interface for Image Search Using Sample PhotosHuman Interface and the Management of Information: Information, Design and Interaction10.1007/978-3-319-40349-6_34(361-370)Online publication date: 21-Jun-2016
https://doi.org/10.1007/978-3-319-40349-6_34
Squicciarini ACaragea CBalakavi RFerres LRossi GAlmeida VHerder E(2014)Analyzing images' privacy for the modern webProceedings of the 25th ACM conference on Hypertext and social media10.1145/2631775.2631803(136-147)Online publication date: 1-Sep-2014
https://dl.acm.org/doi/10.1145/2631775.2631803
Yang CPeng JFeng XFan J(2014)Integrating bilingual search results for automatic junk image filteringMultimedia Tools and Applications10.1007/s11042-012-1051-y70:2(661-688)Online publication date: 1-May-2014
https://dl.acm.org/doi/10.1007/s11042-012-1051-y
Huang Y(2013)Hypergraph Based Visual Segmentation and RetrievalImage Processing10.4018/978-1-4666-3994-2.ch019(345-362)Online publication date: 2013
https://doi.org/10.4018/978-1-4666-3994-2.ch019
Belattar KMostefai S(2013)CBIR using Relevance Feedback: Comparative analysis and major challenges2013 5th International Conference on Computer Science and Information Technology10.1109/CSIT.2013.6588798(317-325)Online publication date: Mar-2013
https://doi.org/10.1109/CSIT.2013.6588798
Sumadhi THemalatha MGopalan KThampi S(2012)Towards improving automatic image annotation using improvised fractal SMOTE approachProceedings of the International Conference on Advances in Computing, Communications and Informatics10.1145/2345396.2345511(704-709)Online publication date: 3-Aug-2012
https://dl.acm.org/doi/10.1145/2345396.2345511
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Relevance feedback methods for logo and trademark image retrieval on the web

Relative Relevance Feedback in Image Retrieval

The effect of low-level image features on pseudo relevance feedback