Abstract
This paper presents an approach for image annotation propagation to images which have no annotations. In some specific domains, the assumption that visual similarity implies (partial) semantic similarity can be made. For instance, in medical imaging, two images of the same anatomic part in a given modality have a very similar appearance. In the proposed approach, a conceptual indexing phase extracts concepts from texts; a visual similarity between images is computed and then combined with conceptual text indexing. Annotation propagation driven by prior knowledge on the domain is finally performed. Domain knowledge used is a meta-thesaurus for both indexing and annotations propagation. The proposed approach has been applied on the imageCLEF medical image collection.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Clough, P., Muller, H., Deselaers, T., Grubinger, M., Lehmanna, T., Jensen, J., Hersh, W.: Cross-language retrieval in image collections (imageclef). In: Working Notes for the CLEF 2005 Workshop (2005)
Monay, F., Gatica-Perez, D.: On image auto-annotation with latent space models. In: Rowe, L.A., Vin, H.M., Plagemann, T., Shenoy, P.J., Smith, J.R. (eds.) ACM Multimedia, pp. 275–278. ACM, New York (2003)
Li, J., Wang, J.Z.: Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Trans. Pattern Anal. Mach. Intell. 25, 1075–1088 (2003)
Hare, J.S., Lewis, P.H.: Saliency-based models of image content and their application to auto-annotation by semantic propagation. In: Proceedings of the Second European Semantic Web Conference (ESWC 2005), Heraklion, Crete (2005)
Iyengar, G., Duygulu, P., Feng, S., Ircing, P., Khudanpur, S.P., Klakow, D., Krause, M.R., Manmatha, R., Nock, H.J., Petkova, D., Pytlik, B., Virga, P.: Joint visualtext modeling for automatic retrieval of multimedia documents. In: MULTIMEDIA 2005: Proceedings of the 13th annual ACM international conference on Multimedia, pp. 21–30. ACM Press, New York (2005)
Xu, J., Croft, W.: Improving the effectiveness of informational retrieval with local context analysis. ACM Transaction on Information System 18, 79–112 (2000)
Aronson, A.R.: Effective mapping of biomedical text to the umls metathesaurus: the metamap program. In: Proc. AMIA Symp., pp. 17–21 (2001)
Maillot, N., Thonnat, M., Boucher, A.: Towards ontology-based cognitive vision. Mach. Vis. Appl. 16, 33–40 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chevallet, JP., Maillot, N., Lim, JH. (2006). Concept Propagation Based on Visual Similarity. In: Ng, H.T., Leong, MK., Kan, MY., Ji, D. (eds) Information Retrieval Technology. AIRS 2006. Lecture Notes in Computer Science, vol 4182. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11880592_40
Download citation
DOI: https://doi.org/10.1007/11880592_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45780-0
Online ISBN: 978-3-540-46237-8
eBook Packages: Computer ScienceComputer Science (R0)