More Web Proxy on the site http://driver.im/

article

NeTra: a toolbox for navigating large image databases

Authors:

B. S. ManjunathAuthors Info & Claims

Multimedia Systems, Volume 7, Issue 3

Pages 184 - 198

https://doi.org/10.1007/s005300050121

Published: 01 May 1999 Publication History

Abstract

We present here an implementation of NeTra, a prototype image retrieval system that uses color, texture, shape and spatial location information in segmented image regions to search and retrieve similar regions from the database. A distinguishing aspect of this system is its incorporation of a robust automated image segmentation algorithm that allows object- or region-based search. Image segmentation significantly improves the quality of image retrieval when images contain multiple complex objects. Images are segmented into homogeneous regions at the time, of ingest into the database, and image attributes that represent each of these regions are computed. In addition to image segmentation, other important components of the system include an efficient color representation, and indexing of color, texture, and shape features for fast search and retrieval. This representation allows the user to compose interesting queries such as "retrieve all images that contain regions that have the color of object A, texture of object B, shape of object C, and lie in the upper of the image", where the individual objects could be regions belonging to different images. A Java-based web implementation of NeTra is available at http://vivaldi.ece.ucsb.edu/Netra.

References

[1]

1. Arbter K, Snyder WE, Burkhardt H, Hirzinger G (1990) Application of affine-invariant Fourier descriptors to recognition of 3D objects. IEEE Trans Pattern Anal Machine Intell 12:640-647

Digital Library

[2]

2. Ashley J, Barber R, Flickner MD, Hafner JL, Lee D, Niblack W, Petkovic D (1995) Automatic and semiautomatic methods for image annotation and retrieval in QBIC. Proc SPIE (Storage and Retrieval for Image and Video Databases III) 2420:24-35

[3]

3. Bach JR, Fuller C, Gupta A, Hampapur A, Horowitz B, Humphrey R, Jain RC, Shu C (1996) Virage image search engine: an open framework for image management. Proc SPIE (Storage and Retrieval for Image and Video Databases IV) 2670:76-87

[4]

4. Carson C, Ogle VE (1996) Storage and retrieval of feature data for a very large online image collection. IEEE Comput Soc Bull Techn Comm Data Eng 19(4)

[5]

5. Carson C, Belongie S, Greenspan H, Malik J (1997) Region-based Image Querying. In: 1EEE Workshop on Content-Based Access of Image and Video Libraries, June 1997, Puerto Rico, San Juan, pp. 42-49

[6]

6. Delanoy RL (1995) Toolkit for image mining: user-trainable search tools. Lincoln Lab J 8(2): 145-160

[7]

7. Dubois SR, Glanz FH (1986) An autoregressive model approach to two-dimensional shape classification. IEEE Trans Pattern Anal Mach Intell 8: 55-66

Digital Library

[8]

8. Gersho A, Gray RM(1992) Vector Quantization and Signal Compression. Kluwer Academic, Dordrecht

[9]

9. Guttman A (1984) R-trees: a dynamic index structure for spatial searching. ACM Proc. Int. Conf. Manag. Data, June 1984, pp 47-57

[10]

10. Hafner J, et al. (1995) Efficient color histogram indexing for quadratic form distance functions. IEEE Trans Pattern Anal Mach Intell 17(7): 729-736

Digital Library

[11]

11. Huang Q et al. (1995) Foreground/background segmentation of color images by integration of multiple cues. In: IEEE Int. Conf. on Image Processing, Vol. 1. October 1995, Washington, DC, pp 246-249

[12]

12. Kauppinen H, Seppnäen T, Pietikänen M (1995) An experimental comparison of autoregressive and Fourier-based descriptors in 2D shape classification. IEEE Trans Pattern Anal Mach Intell 17(2): 201- 207

Digital Library

[13]

13. Niblack W, Barber R, Equitz W, Flickner M, et al. (1993) The QBIC project: querying images by content using color, texture, and shape. Proc SPIE (Storage and Retrieval for Image and Video Databases) 1908:173-187

[14]

14. Ma WY. Manjunath BS (1996) A texture thesaurus for browsing large aerial photographs. Journal of the American Society for Information Science, vol. 49, no. 7. 1998, pp 633-648

[15]

15. Ma WY, Manjunath BS (1996) Texture features and learning similarity. In: IEEE Int. Conf. on Computer Vision and Pattern Recognition, June 1996, San Francisco, Calif., pp 425-430

[16]

16. Ma WY. Manjunath BS (1997) Edge flow: a framework of boundary detection and image segmentation. IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp 744-749, Puerto Rico, June 1997

[17]

17. Manjunath BS, Ma WY (1996) Texture features for browsing and retrieval of image data. IEEE Trans Pattern Anal Mach Intell 18(8): 837-842

Digital Library

[18]

18. Manjunath BS, Ma WY (1996) Browsing large satellite and aerial photographs. IEEE Int. Conf. on Image Processing, Vol. 2, September 1996, Lausanne, Switzerland., pp 765-768

[19]

19. Minka TP, Picard RW (1995) Interactive learning using a society of models. Technical Report No. 349, MIT Media Laboratory, Cambridge, Mass.

[20]

20. Pentland A, Picard RW, Sclaroff S (1994) Photobook: tools for content based manipulation of image databases. Proc. SPIE (Storage and Retrieval for Image and Video Databases II) 2185: 34-47

[21]

21. Persoon E, Fu K (1977) Shape discrimination using Fourier descriptors. IEEE Trans Syst Man Cybern 7:170-179

[22]

22. Rubner Y, Guibas LJ, Tomasi C (1997) The earth mover's distance, multi-dimensional scaling, and color-based image retrieval. In: Proc. of the APRA Image Understanding Workshop, May 1997, pp 661-668

[23]

23. Rui Y, Huang TS, Mehrotra S, Ortega M (1997) A relevance feedback architecture in content-based multimedia information retrieval systems. In: IEEE Workshop on Content-Based Access of Image and Video Libraries. June 1997, Puerto Rico, pp 82-89

[24]

24. Samet H (1984) The quadtree and related hierarchical data structures. ACM Comput Surv 16(2): 187-260

Digital Library

[25]

25. Sekita I. Kurita T, Otsu N (1992) Complex autoregressive model for shape recognition. IEEE Trans Pattern Anal Mach Intell 14:489-496

Digital Library

[26]

26. Slater D, Healey G (1996) The illumination-invariant recognition of 3D objects using local color invariants. IEEE Trans Pattern Anal Mach Intell 18(2): 206-210

Digital Library

[27]

27. Smith JR, Chang SF (1996) Local color and texture extraction and spatial query. In: IEEE Int. Conf. on Image Processing, Vol. 3, September 1996. Lausanne, Switzerland, pp 1011-1014

[28]

28. Smith JR, Chang SF (1996) VisualSEEk: a fully automated content-based image query system. ACM Multimedia, November 1996, Boston, Mass.

[29]

29. Smith TR (1996) A digital library for geographically referenced materials. IEEE Computer Society Press, pp 54-60

[30]

30. Swain MJ, Ballard DH (1991) Color indexing. Int J Comput Vision 7(1): 11-32

Digital Library

[31]

31. Stricker M, Orengo M (1995) Similarity of color images. Proc SPIE (Conf. on Storage and Retrieval for Image and Video Databases II1) 2420: 381-392

[32]

32. Van Otterloo PJ (1991) A Contour-Oriented Approach to Shape Analysis. Prentice Hall, Englewood Cliffs, N.J.

[33]

33. White DA, Iain R (1996) Similarity indexing with the SS-tree. In: Proc. 12th IEEE Int. Conf. on Data Engineering, February 1996, New Orleans. La., pp 516-523

Digital Library

[34]

34. Wyszecki G, Stiles WS (1982) Color Science. John Wiley & Sons, New York

[35]

35. Zahn CT, Roskies RZ (1972) Fourier descriptors for plane closed curves. IEEE Trans Comput 21(3): 269-281

Digital Library

Cited By

Ren YLi QLiu WLi LGuan W(2022)Semantics characterization for eye shapes based on directional triangle-area curve clusteringMultimedia Tools and Applications10.1007/s11042-019-7659-478:18(25373-25406)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/s11042-019-7659-4
Bedi ASunkaria R(2021)Local Tetra-Directional Pattern–A New Texture Descriptor for Content-Based Image RetrievalPattern Recognition and Image Analysis10.1134/S105466182004005730:4(578-592)Online publication date: 14-Jan-2021
https://dl.acm.org/doi/10.1134/S1054661820040057
Sarwar AMehmood ZSaba TQazi KAdnan AJamal H(2020)A novel method for content-based image retrieval to improve the effectiveness of the bag-of-words model using a support vector machineJournal of Information Science10.1177/016555151878282545:1(117-135)Online publication date: 18-Jun-2020
https://dl.acm.org/doi/10.1177/0165551518782825
Show More Cited By

Index Terms

NeTra: a toolbox for navigating large image databases
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Image segmentation
        Video segmentation
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics
    1. Image manipulation
2. Information systems
  1. Information retrieval
    1. Document representation
    2. Information retrieval query processing
  2. Information systems applications
    1. Multimedia information systems
      1. Multimedia databases

Recommendations

NeTra: a toolbox for navigating large image databases
ICIP '97: Proceedings of the 1997 International Conference on Image Processing (ICIP '97) 3-Volume Set-Volume 1 - Volume 1

We present an implementation of NeTra, a prototype image retrieval system that uses color texture, shape and spatial location information in segmented image database. A distinguishing aspect of this system is its incorporation of a robust automated ...
Image retrieval by using texture and shape correlated hand crafted features

Content-based image retrieval (CBIR) has become one of the trending areas of research in computer vision. In this paper, consonance on hue, saturation, and intensity is used by applying inter-channel voting between them. Diagonally symmetric pattern (DSP) ...
An Image Retrieval using combined approach Wavelets and Local Binary Pattern
ICIA-16: Proceedings of the International Conference on Informatics and Analytics

With the invent of Internet and the availability of efficient image capturing devices such as image scanners, digital cameras and high capacity public networks, cheap storage; the volume of digital images is increasing exponentially. This created a need ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Multimedia Systems

Multimedia Systems Volume 7, Issue 3

Special issue on video content based retrieval

May 1999

79 pages

ISSN:0942-4962

Editors:
P. Venkat Rangan
Univ. of California at San Diego, La Jolla
,
Domenico Ferrari
Univ. Cattolica, Piacenza, Italy
,
Ralf Guido Herrtwich
DaimlerChrysler AG Resear & Technology, Berlin, Germany
,
A. Desai Narasimhalu
Kent Ridge Digital Labs, Singapore
,
Simone Santini

Issue’s Table of Contents

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 May 1999

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

72
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ren YLi QLiu WLi LGuan W(2022)Semantics characterization for eye shapes based on directional triangle-area curve clusteringMultimedia Tools and Applications10.1007/s11042-019-7659-478:18(25373-25406)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/s11042-019-7659-4
Bedi ASunkaria R(2021)Local Tetra-Directional Pattern–A New Texture Descriptor for Content-Based Image RetrievalPattern Recognition and Image Analysis10.1134/S105466182004005730:4(578-592)Online publication date: 14-Jan-2021
https://dl.acm.org/doi/10.1134/S1054661820040057
Sarwar AMehmood ZSaba TQazi KAdnan AJamal H(2020)A novel method for content-based image retrieval to improve the effectiveness of the bag-of-words model using a support vector machineJournal of Information Science10.1177/016555151878282545:1(117-135)Online publication date: 18-Jun-2020
https://dl.acm.org/doi/10.1177/0165551518782825
Jeena Jacob ISrinivasagan KEbby Darney PJayapriya K(2020)Deep learned Inter-Channel Colored Texture Pattern: a new chromatic-texture descriptorPattern Analysis & Applications10.1007/s10044-019-00780-923:1(239-251)Online publication date: 1-Feb-2020
https://dl.acm.org/doi/10.1007/s10044-019-00780-9
(2019)Content-based image retrievalInternational Journal of Computational Vision and Robotics10.5555/3319238.33192409:1(14-38)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.5555/3319238.3319240
Zhou YWang JChi ZMorimoto CPfeiffer T(2018)Content-based image retrieval based on eye-trackingProceedings of the Workshop on Communication by Gaze Interaction10.1145/3206343.3206353(1-7)Online publication date: 15-Jun-2018
https://dl.acm.org/doi/10.1145/3206343.3206353
Khokher ATalwar R(2017)A fast and effective image retrieval scheme using color-, texture-, and shape-based histogramsMultimedia Tools and Applications10.1007/s11042-016-4096-576:20(21787-21809)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.1007/s11042-016-4096-5
Pandey SKhanna PYokota H(2016)A semantics and image retrieval system for hierarchical image databasesInformation Processing and Management: an International Journal10.1016/j.ipm.2015.12.00552:4(571-591)Online publication date: 1-Jul-2016
https://dl.acm.org/doi/10.1016/j.ipm.2015.12.005
Rami HBelmerhnia LDrissi El Maliani AEl Hassouni M(2016)Texture retrieval using mixtures of generalized Gaussian distribution and Cauchy-Schwarz divergence in wavelet domainImage Communication10.1016/j.image.2016.01.00542:C(45-58)Online publication date: 1-Mar-2016
https://dl.acm.org/doi/10.1016/j.image.2016.01.005
Tsai MAggarwal CHuang TCarterette BDiaz FCastillo CMetzler D(2014)Ranking in heterogeneous social mediaProceedings of the 7th ACM international conference on Web search and data mining10.1145/2556195.2556254(613-622)Online publication date: 24-Feb-2014
https://dl.acm.org/doi/10.1145/2556195.2556254
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents