Abstract
Image descriptor is a critical issue for most image classification problems. Low-level image descriptors based on Gabor filters, SIFT and HOG features have exhibited good image representation for many applications. However, these descriptors are not appropriate for image classification and need to be converted into appropriate representations. This process can be performed by applying two operations of coding and pooling. In coding operation, an appropriate codebook is learned and better adapted from training data, while pooling operation summarizes the coded features over larger regions. Several methods of coding and pooling schemes have been proposed in the literature. In this paper, self-organizing map (SOM) is employed to learn a topologically adapted codebook instead of the well-known k-means algorithm. In addition, a new non-negative sparse coding technique for SOM is also proposed and tested. The new sparse coding method utilizes Non-negative Least Squares (NNLS) optimization to best reconstruct every input pattern using K-best-matching codewords. Experimental results using Caltech-101 database show the effectiveness of the proposed method compared with other state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Aly, S.: Learning invariant local image descriptor using convolutional mahalanobis self-organizing map. Neurocomputing 142, 239–247 (2014)
Aly, S., Shimada, A., Tsuruta, N., Taniguchi, R.I.: Robust face recognition using multiple self-organized gabor features and local similarity matching. In: 2010 20th International Conference on Pattern Recognition (ICPR), pp. 2909–2912. IEEE (2010)
Aly, S., Tsuruta, N., Taniguchi, R.I., Shimada, A.: Visual feature extraction using variable map-dimension hypercolumn model. In: IEEE International Joint Conference on Neural Networks, IJCNN 2008 (IEEE World Congress on Computational Intelligence), pp. 845–851. IEEE (2008)
Boureau, Y.L., Bach, F., LeCun, Y., Ponce, J.: Learning mid-level features for recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2559–2566. IEEE (2010)
Chang, C.C., Lin, C.J.: Libsvm: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST) 2(3), 27 (2011)
Cireşan, D., Meier, U., Masci, J., Schmidhuber, J.: Multi-column deep neural network for traffic sign classification. Neural Networks 32, 333–338 (2012)
Coates, A., Karpathy, A., Ng, A.Y.: Emergence of object-selective features in unsupervised feature learning. In: NIPS, vol. 25, pp. 2690–2698 (2012)
Coates, A., Ng, A.Y.: The importance of encoding versus training with sparse coding and vector quantization. In: Proceedings of the 28th International Conference on Machine Learning (ICML 2011), pp. 921–928 (2011)
Coates, A., Ng, A.Y.: Learning feature representations with k-means. In: Montavon, G., Orr, G.B., Müller, K.-R. (eds.) NN: Tricks of the Trade, 2nd edn. LNCS, vol. 7700, pp. 561–580. Springer, Heidelberg (2012)
Coates, A., Ng, A.Y., Lee, H.: An analysis of single-layer networks in unsupervised feature learning. In: International Conference on Artificial Intelligence and Statistics, pp. 215–223 (2011)
Csurka, G., Dance, C., Fan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV, vol. 1, pp. 1–2 (2004)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 886–893. IEEE (2005)
Fei-Fei, L., Fergus, R., Perona, P.: Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. Computer Vision and Image Understanding 106(1), 59–70 (2007)
Kohonen, T.: Essentials of the self-organizing map. Neural Networks 37(0), 52–65 (2013)
Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2169–2178. IEEE (2006)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Olshausen, B.A., Field, D.J.: Sparse coding with an overcomplete basis set: A strategy employed by v1? Vision Research 37(23), 3311–3325 (1997)
Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., Gong, Y.: Locality-constrained linear coding for image classification. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3360–3367. IEEE (2010)
Yang, J., Yu, K., Gong, Y., Huang, T.: Linear spatial pyramid matching using sparse coding for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 1794–1801. IEEE (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Aly, S. (2014). Learning Hierarchical Features Using Sparse Self-organizing Map Coding for Image Classification. In: Hassanien, A.E., Tolba, M.F., Taher Azar, A. (eds) Advanced Machine Learning Technologies and Applications. AMLTA 2014. Communications in Computer and Information Science, vol 488. Springer, Cham. https://doi.org/10.1007/978-3-319-13461-1_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-13461-1_31
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-13460-4
Online ISBN: 978-3-319-13461-1
eBook Packages: Computer ScienceComputer Science (R0)