More Web Proxy on the site http://driver.im/

article

A unified image retrieval framework on local visual and semantic concept-based feature spaces

Authors:

Md. Mahmudur Rahman,

Prabir Bhattacharya,

Bipin C. DesaiAuthors Info & Claims

Journal of Visual Communication and Image Representation, Volume 20, Issue 7

Pages 450 - 462

https://doi.org/10.1016/j.jvcir.2009.06.001

Published: 01 October 2009 Publication History

Abstract

This paper presents a learning-based unified image retrieval framework to represent images in local visual and semantic concept-based feature spaces. In this framework, a visual concept vocabulary (codebook) is automatically constructed by utilizing self-organizing map (SOM) and statistical models are built for local semantic concepts using probabilistic multi-class support vector machine (SVM). Based on these constructions, the images are represented in correlation and spatial relationship-enhanced concept feature spaces by exploiting the topology preserving local neighborhood structure of the codebook, local concept correlation statistics, and spatial relationships in individual encoded images. Finally, the features are unified by a dynamically weighted linear combination of similarity matching scheme based on the relevance feedback information. The feature weights are calculated by considering both the precision and the rank order information of the top retrieved relevant images of each representation, which adapts itself to individual searches to produce effective results. The experimental results on a photographic database of natural scenes and a bio-medical database of different imaging modalities and body parts demonstrate the effectiveness of the proposed framework.

References

[1]

Smeulders, A., Worring, M., Santini, S., Gupta, A. and Jain, R., Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. v22. 1349-1380.

Digital Library

[2]

Rui, Y., Huang, T.S. and Chang, S.F., Image retrieval: current techniques, promising directions and open issues. J. Vis. Comm. Image Rep. v10. 39-62.

Digital Library

[3]

W. Niblack, R. Barber, W. Equitz, M. Flickner, E. Glasman, D. Petkovic, P. Yanker, C. Faloutsos, The QBIC project: querying images by content using color, texture, and shape, in: Proceedings of the SPIE'93, Storage and Retrieval for Image and Video Databases, pp. 173-187.

[4]

Carson, C., Belongie, S., Greenspan, H. and Malik, J., Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. v24 i8. 1026-1038.

[5]

Wang, J.Z., Li, J. and Wiederhold, G., SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries. IEEE Trans. Pattern Anal. Mach. Intell. v23 i9. 947-963.

[6]

John, P.E., Towards intelligent image retrieval. Pattern Recognit. v35. 3-14.

[7]

M. Szummer, R.W. Picard, Indoor-outdoor image classification, in: Proceedings of the IEEE International Workshop on Content-based Access of Image and Video Databases, 1998, pp. 42-51.

[8]

Vailaya, A., Figueiredo, M., Jain, A. and Zhang, H.J., Image classification for content-based indexing. IEEE Trans. Image Process. v10 i1. 117-130.

[9]

C. Town, D. Sinclair, Content-based image retrieval using semantic visual categories, Technical report, 2000.14, AT&T Research, Cambridge, 2000.

[10]

P. Duygulu, K. Barnard, N. Freitas, D. Forsyth, Object recognition as machine translation: learning a lexicon for a fixed image vocabulary, in: Proceedings of the Seventh European Conference on Computer Vision, 2002, pp. 97-112.

Digital Library

[11]

L. Zhu, A. Zhang, A. Rao, R. Srihari, Keyblock: an approach for content-based image retrieval, in: Proceedings of ACM Multimedia, 2000, pp. 157-166.

[12]

Jing, F., Li, M., Zhang, H.J. and Zhang, B., An efficient and effective region-based image retrieval framework. IEEE Trans. Image Process. v13. 699-709.

Digital Library

[13]

J.H. Lim, Explicit query formulation with visual keywords, in: Proceedings of the Eighth ACM International Conference on Multimedia, 2000, pp. 407-412.

[14]

Chang, E., Kingshy, G., Sychay, G. and Gang, W., CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines. IEEE Trans. Circuits Syst. Video Technol. v13. 26-38.

Digital Library

[15]

Vogel, J. and Schiele, B., Semantic modeling of natural scenes for content-based image retrieval. Int. J. Comput. Vis. v72 i2. 133-157.

[16]

Zhou, X.S. and Huang, T.S., Relevance feedback for image retrieval: a comprehensive review. Multimedia Syst. v8 i6. 536-544.

[17]

R.W. Picard, T.P. Minka, M. Szummer, Modeling user subjectivity in image libraries, in: Proceedings of the IEEE International Conference on Image Processing, 1996, pp. 777-780.

[18]

Rui, Y. and Huang, T.S., Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Circuits Syst. Video Technol. v8 i5. 644-655.

[19]

S. Tong, E. Chang, Support vector machine active learning for image retrieval, in: Proceedings of the Ninth ACM International Conference on Multimedia, 2001, pp. 107-118.

[20]

Kohonen, T., Self-Organizing Maps. 1997. second ed. Springer-Verlag, Heidelberg.

[21]

Laaksonen, J., Koskela, M. and Oja, E., PicSOM: self-organizing image retrieval with MPEG-7 content descriptors. IEEE Trans. Neural Netw. v13 i4. 841-853.

[22]

Vapnik, V., Statistical Learning Theory. 1998. Wiley, New York.

[23]

Yates, R.B. and Neto, B.R., Modern Information Retrieval. 1999. Addison Wesley.

[24]

M.M. Rahman, B.C. Desai, P. Bhattacharya, Visual keyword-based image retrieval using correlation-enhanced latent semantic indexing, similarity matching & query expansion in inverted index, in: Proceedings of the International Database Engineering & Applications Symposium (IDEAS'06), 2006, pp. 201-208.

Digital Library

[25]

Haralick, R.M., Shanmugam, K. and Dinstein, I., Textural features for image classification. IEEE Trans. Syst. Man Cybern. v3. 610-621.

[26]

Chang, S.F., Sikora, T. and Puri, A., Overview of the MPEG-7 standard. IEEE Trans. Circuits Syst. Video Technol. v11. 688-695.

Digital Library

[27]

Sclaroff, S., Cascia, M.L., Sethi, S. and Taycher, L., Unifying textual and visual cues for content-based image retrieval on the world wide web. Comput. Vision Image Understand. v75. 86-98.

Digital Library

[28]

Vesanto, J., SOM-based data visualization methods. Intell. Data Anal. v3 i2. 111-126.

[29]

G.G. Yen, W. Zheng, Ranked centroid projection: a data visualization approach for self-organizing maps, in: Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN'05), 2005, pp. 1587-1592.

[30]

Fukunaga, K., Introduction to Statistical Pattern Recognition. 1990. second ed. Academic Press.

[31]

Wu, T.F., Lin, C.J. and Weng, R.C., Probability estimates for multi-class classification by pairwise coupling. J. Mach. Learn. Res. v5. 975-1005.

Digital Library

[32]

Hsu, C.W. and Lin, C.J., A comparison of methods for multi-class support vector machines. IEEE Trans. Neural Netw. v13 i2. 415-425.

[33]

Vogt, C.C. and Cottrell, G.W., Fusion via a linear combination of scores. Inf. Retrieval. v1. 151-173.

Digital Library

[34]

M. Grubinger, P. Clough, H. M&#252;ller, T. Deselears, The IAPR-TC12 benchmark: a new evaluation resource for visual information systems, in: International Workshop OntoImage2006 Language Resources for Content-Based Image Retrieval, 2006, pp. 1323.

[35]

H. M&#252;eller, T. Deselaers, T.M. Lehmann, P. Clough, E. Kim, W. Hersh, Overview of the ImageCLEFmed 2006 medical retrieval and annotation tasks, in: Seventh Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Proceedings of LNCS, vol. 4730, 2007, pp. 595-608.

[36]

C.C. Chang, C.J. Lin, LIBSVM: a library for support vector machines. Software available at <http://www.csie.ntu.edu.tw/cjlin/libsvm>, 2001.

Cited By

Seetharaman KSathiamoorthy S(2016)A unified learning framework for content based medical image retrieval using a statistical modelJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2014.10.00628:1(110-124)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1016/j.jksuci.2014.10.006
Rahman M(2016)A soft image representation approach by exploiting local neighborhood structure of self-organizing map (SOM)Soft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-015-1675-820:7(2759-2769)Online publication date: 1-Jul-2016
https://dl.acm.org/doi/10.1007/s00500-015-1675-8
Desai BDesai BToyama M(2015)Technological SingularitiesProceedings of the 19th International Database Engineering & Applications Symposium10.1145/2790755.2790769(10-22)Online publication date: 13-Jul-2015
https://dl.acm.org/doi/10.1145/2790755.2790769
Show More Cited By

A unified image retrieval framework on local visual and semantic concept-based feature spaces
1. Information systems
  1. Information retrieval

Recommendations

A Unified Log-Based Relevance Feedback Scheme for Image Retrieval

Relevance feedback has emerged as a powerful tool to boost the retrieval performance in content-based image retrieval (CBIR). In the past, most research efforts in this field have focused on designing effective algorithms for traditional relevance ...
Interactive content-based image retrieval using relevance feedback

Database search engines are generally used in a one-shot fashion in which a user provides query information to the system and, in return, the system provides a number of database instances to the user. A relevance feedback system allows the user to ...
A query expansion framework in image retrieval domain based on local and global analysis

We present an image retrieval framework based on automatic query expansion in a concept feature space by generalizing the vector space model of information retrieval. In this framework, images are represented by vectors of weighted concepts similar to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Visual Communication and Image Representation

Journal of Visual Communication and Image Representation Volume 20, Issue 7

October, 2009

67 pages

ISSN:1047-3203

Issue’s Table of Contents

Copyright © Elsevier Inc. © 2009.

Publisher

Academic Press, Inc.

United States

Publication History

Published: 01 October 2009

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Seetharaman KSathiamoorthy S(2016)A unified learning framework for content based medical image retrieval using a statistical modelJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2014.10.00628:1(110-124)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1016/j.jksuci.2014.10.006
Rahman M(2016)A soft image representation approach by exploiting local neighborhood structure of self-organizing map (SOM)Soft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-015-1675-820:7(2759-2769)Online publication date: 1-Jul-2016
https://dl.acm.org/doi/10.1007/s00500-015-1675-8
Desai BDesai BToyama M(2015)Technological SingularitiesProceedings of the 19th International Database Engineering & Applications Symposium10.1145/2790755.2790769(10-22)Online publication date: 13-Jul-2015
https://dl.acm.org/doi/10.1145/2790755.2790769
Peng JLei LYang B(2012)Image Retrieval based on HSV Feature and Regional Shannon EntropyInternational Journal of Software Science and Computational Intelligence10.4018/jssci.20120401044:2(64-80)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.4018/jssci.2012040104
Dwivedi GDas SRakshit SVora MSamanta S(2012)SLAR (simultaneous localization and recognition) framework for smart CBIRProceedings of the First Indo-Japan conference on Perception and Machine Intelligence10.1007/978-3-642-27387-2_35(277-287)Online publication date: 12-Jan-2012
https://dl.acm.org/doi/10.1007/978-3-642-27387-2_35
Kaliciak LWang JSong DZhang PHou Y(2011)Contextual image annotation via projection and quantum theory inspired measurement for integration of text and visual featuresProceedings of the 5th international conference on Quantum interaction10.5555/2074824.2074855(217-222)Online publication date: 26-Jun-2011
https://dl.acm.org/doi/10.5555/2074824.2074855
Lei LWang TPeng JYang B(2011)Image Dimensionality Reduction Based on the Intrinsic Dimension and Parallel Genetic AlgorithmInternational Journal of Cognitive Informatics and Natural Intelligence10.4018/jcini.20110401065:2(97-112)Online publication date: 1-Apr-2011
https://dl.acm.org/doi/10.4018/jcini.2011040106

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents