demonstration

Automatic image captioning from the web for GPS photographs

Authors:

Xin Fan,

Robert GaizauskasAuthors Info & Claims

MIR '10: Proceedings of the international conference on Multimedia information retrieval

Pages 445 - 448

https://doi.org/10.1145/1743384.1743463

Published: 29 March 2010 Publication History

Get Access

Abstract

Increasing quantities of images are indexed by GPS coordinates. However, it is difficult to search within such pictures. In this paper, we propose a solution to automatically generate captions (including place name, keywords and summary) from the web content based on image location information. The richer descriptions have great potential to help image organisation, indexing and search. The solution is realised through the synergetic techniques from Geographic Information System, Web IR and multi-document summarisation.

References

[1]

Abdelmoty, A. I., Smart, P. and Jones, C. B. Building place ontologies for the semantic web: issues and approaches. the 4th ACM workshop on Geographical information retrieval (Lisbon, Portugal, Nov. 2007)

Digital Library

Google Scholar

[2]

Aker, A. and Gaizauskas, R. Summary Generation for Toponym-Referenced Images using Object Type Language Models. the RANLP 2009 (2009)

Google Scholar

[3]

Croft., F. S. a. W. A general language model for information retrieval. Proc. of the eighth international conference on Information and knowledge management (New York, NY, 1999), 316--321.

Digital Library

Google Scholar

[4]

Deschacht, K. and Moens, M. F. Text Analysis for Automatic Image Annotation. Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (Prague, Czech Republic, June 2007), 1000--1007.

Google Scholar

[5]

Purves, R. S., Edwardes, A. and Sanderson, M. Describing the where - improving image annotation and search through geography. Proceedings of the workshop on Metadata Mining for Image Understanding (Madeira, Portugal, Jan 2008)

Google Scholar

[6]

Salton, G. and Buckley, C. Term-weighting approaches in automatic text retrieval. Information Processing and Management, 24, 5 1988, 513--523.

Digital Library

Google Scholar

[7]

Tomko, M., Purves, R. S., Hall, M. M. and Smart, P. Tripod Deliverable 6.2: Report and Prototype for Enriching Geo-referenced Images with Spatial Data. EU FP6 Project no. 045335 TRIPOD (TRI-Partite multimedia Object Description), Jun. 2009.

Google Scholar

Cited By

View all

Chen YChen FCooper MJoshi D(2016)Using business-aware latent topics for image captioning in social media2016 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2016.7552912(1-6)Online publication date: Jul-2016
https://doi.org/10.1109/ICME.2016.7552912
Chen ZZhang XXu YWang X(2016)POM: Power efficient multi-view video streaming over multi-antenna wireless systems2016 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2016.7552911(1-6)Online publication date: Jul-2016
https://doi.org/10.1109/ICME.2016.7552911
Aker AFan XSanderson MGaizauskas R(2012)Investigating summarization techniques for geo-tagged image indexingProceedings of the 34th European conference on Advances in Information Retrieval10.1007/978-3-642-28997-2_44(472-475)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.1007/978-3-642-28997-2_44
Show More Cited By

Index Terms

Automatic image captioning from the web for GPS photographs
1. Information systems
  1. Information retrieval
    1. Document representation
    2. Search engine architectures and scalability
      1. Search engine indexing
2. Theory of computation
  1. Semantics and reasoning
    1. Program reasoning
      1. Abstraction

Recommendations

Exploring the Incorporation of Opinion Polarity for Abstractive Multi-document Summarisation
Advances in Information Retrieval
Abstract
Abstractive multi-document summarisation (MDS) remains a challenging task. Part of the problem is the question as to how to preserve a document’s polarity in the summary. We propose an opinion polarity attention model for MDS, which incorporates a ...
Web-scale image search by color sketch
MM '11: Proceedings of the 19th ACM international conference on Multimedia

Most existing image search engines rely on the associated texts or tags with images to index and retrieval images, which results in limited ability on searching images with visual requirement. In this demonstration, we present an image search system, ...
Web image retrieval systems with automatic web image annotating techniques

Due to the popularity of digital cameras and web authors'enriching the visual aesthetics, the number of web images is growing in an uncontrolled speed. The images in the World Wide Web are becoming a large image library for browsing. It is an important ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MIR '10: Proceedings of the international conference on Multimedia information retrieval

March 2010

600 pages

ISBN:9781605588155

DOI:10.1145/1743384

General Chairs:
James Z. Wang
The Pennsylvania State University, USA
,
Nozha Boujemaa
INRIA, France
,
Program Chairs:
Nuria Oliver Ramirez
Telefonica Research, Spain
,
Apostol Natsev
IBM Research, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 March 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

MIR '10

Sponsor:

SIGMM

MIR '10: International Conference on Multimedia Information Retrieval

March 29 - 31, 2010

Pennsylvania, Philadelphia, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
245
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chen YChen FCooper MJoshi D(2016)Using business-aware latent topics for image captioning in social media2016 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2016.7552912(1-6)Online publication date: Jul-2016
https://doi.org/10.1109/ICME.2016.7552912
Chen ZZhang XXu YWang X(2016)POM: Power efficient multi-view video streaming over multi-antenna wireless systems2016 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2016.7552911(1-6)Online publication date: Jul-2016
https://doi.org/10.1109/ICME.2016.7552911
Aker AFan XSanderson MGaizauskas R(2012)Investigating summarization techniques for geo-tagged image indexingProceedings of the 34th European conference on Advances in Information Retrieval10.1007/978-3-642-28997-2_44(472-475)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.1007/978-3-642-28997-2_44
Plaza LLloret EAker A(2010)Improving automatic image captioning using text summarization techniquesProceedings of the 13th international conference on Text, speech and dialogue10.5555/1887176.1887200(165-172)Online publication date: 6-Sep-2010
https://dl.acm.org/doi/10.5555/1887176.1887200
Aker AGaizauskas RHajič J(2010)Generating image descriptions using dependency relational patternsProceedings of the 48th Annual Meeting of the Association for Computational Linguistics10.5555/1858681.1858808(1250-1258)Online publication date: 11-Jul-2010
https://dl.acm.org/doi/10.5555/1858681.1858808
Plaza LLloret EAker A(2010)Improving Automatic Image Captioning Using Text Summarization TechniquesText, Speech and Dialogue10.1007/978-3-642-15760-8_22(165-172)Online publication date: 2010
https://doi.org/10.1007/978-3-642-15760-8_22

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Exploring the Incorporation of Opinion Polarity for Abstractive Multi-document Summarisation

Web-scale image search by color sketch

Web image retrieval systems with automatic web image annotating techniques