Abstract
As the proliferation of available and useful images on the web grows, novel methods and effective techniques are needed to retrieve these images in an efficient manner. Currently major commercial search engines utilize a process known as Annotation Based Image Retrieval (ABIR) to execute search requests focused on image retrieval. The ABIR technique primarily relies on the textual information associated with an image to complete the search and retrieval process. Using the game of cricket as the domain, we describe a benchmarking study that evaluates the effectiveness of three popular search engines in executing image-based searches. Second, we present details of an empirical study aimed at quantifying the impact of inter-human variability of the annotations on the effectiveness of search engines. Both these efforts are aimed at better understanding the challenges with image search and retrieval methods that purely rely on ad hoc annotations provided by the humans.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Kidambi, P., Narayanan, S.: A human computer integrated approach for content based image retrieval. In: Proceedings of the 12th WSEAS International Conference on Computers, Recent Advances in Computer Engineering, pp. 691–696 (2008)
Yates, B., Neto, R.: Modern Information Retrieval. ACM Press, New York (1999)
Witten, I.H., Moffat, A., Bell, T.: Managing Gigabytes: Compressing and Indexing documents and images. Morgan Kaufmann Publishers, San Francisco (1999)
Kuralenok, I.E., Nekrestyanov, I.S.: Evaluation of Text Retrieval Systems. Programming and Computer Software 28(4), 226–242 (2002)
Text Retrieval Conference (TREC) National Institute of Standards and Technology (NIST) and S. Department of Defense (1992), http://trec.nist.gov/
Inoue, M.: On the need for annotation-based information retrieval. Information Retrieval in Context. In: SIGIR IRiX Workshop, pp. 44–49 (2004)
Choi, Y., Rasmussen, E.M.: Users’ relevance criteria in image retrieval in American history. Information Processing & Management 38(5), 695–726 (2002)
Hughes, A., Wilkens, T., Wildemuth, B., Marchionini, G.: Text or pictures? An eyetracking study of how people view digital video surrogates. In: Proceedings of the International Conference on Image and Video Retrieval, pp. 271–280 (2003)
Chen, Y., Wang, J.Z.: Image categorization by learning and reasoning with regions. Journal of Machine Learning Research 5, 913–939 (2004)
del Bimbo, A.: Visual Information Retrieval. Morgan Kaufmann, Los Altos (1999)
Liu, Y., Zhang, D., Lu, G., Ma, W.: A survey of content-based image retrieval with high-level semantics. Pattern Recognition 40(1), 262–282 (2007)
Hyvönen, E., Styrman, A., Saarela, S.: Ontology-based image retrieval. In: Proceedings of XML Finland Conference, pp. 27–51 (2002)
Hanbury, A.: A survey of methods for image annotation. Journal of Visual Languages & Computing (19), 617–627 (2008)
Ahn, L.V., Dabbish, L.: Labeling images with a computer game. In: Proceedings of ACM CHI, pp. 319–326 (2004)
Hernon, et al.: Evaluation and Library Decision Making. Alex Publishing (1990)
Meadow, et al.: Text Information Retrieval Systems. Library and Information Science series. Elsevier publications, Amsterdam (1999)
Hersh, W.: Information Retrieval – A Health Care perspective. Springer publications, Heidelberg (1995)
Lancaster, et al.: Information Retrieval Today. Information Resource Press (1993)
Smith, J.R.: Image Retrieval Evaluation. In: IEEE Workshop on Content-Based Access of Image and Video Libraries, vol. 21, pp. 112–113 (1998)
Cooper, W.S.: Expected Search Length – A single measure of retrieval effectiveness based on weak ordering action of retrieval systems. Journal of the American Society for Information Science 19, 30–41 (1968)
Cakir, E., Bahceci, H., Bitirim, Y.: An Evaluation of Major Image Search Engines on Various Query Topics. In: The Third International Conference on Internet Monitoring and Protection, pp. 161–165. IEEE Computer Society, Los Alamitos (2008)
Broder, A.: A Taxonomy of web search. SIGIR Forum 36(2), 3–10 (2002)
Enser, P.G.B., McGregor, C.: Analysis of Visual Information Retrieval Queries. British Library Research, and Development Report 6104 (1993)
Nielsen Search Rankings (2009), http://www.nielsen-online.com/pr/pr_090616.pdf
Lu, et al.: Performance Evaulation of Desktop Search Engines. In: IEEE International Conference on Information Reuse and Integration, pp. 110–115 (2007)
Endsley, M., Kiris, E.: The out-of-the-loop performance problem and level of control in automation. Human Factors 37, 381–394 (1995)
Thackray, R., Touchtone, R.: Detection efficiency on an air-traffic control monitoring task with and without computer aiding. Aviation Space and Environmental Medicine 60, 744–748 (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kidambi, P., Fendley, M., Narayanan, S. (2011). Performance of Annotation-Based Image Retrieval. In: Fong, S. (eds) Networked Digital Technologies. NDT 2011. Communications in Computer and Information Science, vol 136. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22185-9_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-22185-9_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22184-2
Online ISBN: 978-3-642-22185-9
eBook Packages: Computer ScienceComputer Science (R0)