Abstract
Local binary pattern (LBP) is a multi-applicable texture descriptor applied in machine vision. Despite its outstanding abilities in revealing textural properties of image, it is sensitive to noise, due to its thresholding mechanism. To make LBP robust against noise, a directional thresholded LBP (DTLBP) is developed in this article which applies the directional neighboring pixels average values for thresholding. Applying this type of thresholding in addition to reducing noise, due to using the information of neighboring pixels with bigger radii, increases efficiency in extracting features. The DTLBP is able to be combined with other descriptors like completed LBP (CLBP) and local ternary pattern (LTP) which improves their functionality against noise. To evaluate the functionality of DTLBP, four known datasets including Outex (TC10), CUReT, UIUC and UMD are tested. Numerous and extensive experiments on these datasets with different kinds of noises indicate this newly developed descriptor’s efficiency, with or without incremental white Gaussian and Gaussian blur noises. The proposed descriptor is compared with its available state of the art counterparts. The results show that the combination of DTLBP with CLBP descriptors provide the best classification accuracy in the experiments, which confirms the efficiency and robustness of the proposed descriptor when extracting features from noisy and raw images.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Ahmed, F., Hossain, E.: Automated facial expression recognition using gradient-based ternary texture patterns. Chin. J. Eng. (2013). https://doi.org/10.1155/2013/831747
Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)
Bashar, F., Khan, A., Ahmed, F., Kabir, M.H.: Robust facial expression recognition based on median ternary pattern (MTP). In: International Conference on Electrical Information and Communication Technology (EICT), pp. 1–5. IEEE (2014)
Brahnam, S., Jain, L.C., Nanni, L., Lumini, A., et al.: Local Binary Patterns: New Variants and Applications. Springer, Berlin (2016)
Brodatz, P.: Textures: A Photographic Album for Artists and Designers. Dover Publications, New York (1966)
Bruna, J., Mallat, S.: Invariant scattering convolution networks. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1872–1886 (2013)
Chan, T.H., Jia, K., Gao, S., Lu, J., Zeng, Z., Ma, Y.: PCANet: a simple deep learning baseline for image classification? IEEE Trans. Image Process. 24(12), 5017–5032 (2015)
Dana, K.J., Van Ginneken, B., Nayar, S.K., Koenderink, J.J.: Reflectance and texture of real-world surfaces. ACM Trans. Graph. (TOG) 18(1), 1–34 (1999)
Doshi, N.P., Schaefer, G.: A comprehensive benchmark of local binary pattern algorithms for texture retrieval. In: 21st International Conference on Pattern Recognition (ICPR), pp. 2760–2763. IEEE (2012)
Fernández, A., Álvarez, M.X., Bianconi, F.: Texture description through histograms of equivalent patterns. J. Math. Imaging Vis. 45(1), 76–102 (2013)
Guo, Z., Wang, X., Zhou, J., You, J.: Robust texture image representation by scale selective local binary patterns. IEEE Trans. Image Process. 25(2), 687–699 (2016)
Guo, Z., Zhang, L., Zhang, D.: A completed modeling of local binary pattern operator for texture classification. IEEE Trans. Image Process. 19(6), 1657–1663 (2010)
Hafiane, A., Seetharaman, G., Zavidovique, B.: Median binary pattern for textures classification. In: International Conference Image Analysis and Recognition, pp. 387–398. Springer (2007)
Heikkila, M., Pietikainen, M.: A texture-based method for modeling the background and detecting moving objects. IEEE Trans. Pattern Anal. Mach. Intell. 28(4), 657–662 (2006)
Heikkilä, M., Pietikäinen, M., Schmid, C.: Description of interest regions with center-symmetric local binary patterns. In: Computer Vision, Graphics and Image Processing, pp. 58–69. Springer (2006)
Heikkilä, M., Pietikäinen, M., Schmid, C.: Description of interest regions with local binary patterns. Pattern Recognit. 42(3), 425–436 (2009)
Jin, H., Liu, Q., Lu, H., Tong, X.: Face detection using improved LBP under Bayesian framework. In: Third International Conference on Image and Graphics (ICIG’04), pp. 306–309. IEEE (2004)
Juefei-Xu, F., Boddeti, V.N., Savvides, M.: Local binary convolutional neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4284–4293. IEEE (2017)
Kandaswamy, U., Schuckers, S.A., Adjeroh, D.: Comparison of texture analysis schemes under nonideal conditions. IEEE Trans. Image Process. 20(8), 2260–2275 (2011)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Lazebnik, S., Schmid, C., Ponce, J.: A sparse texture representation using local affine regions. IEEE Trans. Pattern Anal. Mach. Intell. 27(8), 1265–1278 (2005)
Li, C., Zhou, W., Yuan, S.: Iris recognition based on a novel variation of local binary pattern. Vis. Comput. 31(10), 1419–1429 (2015)
Lin, X., Zhao, C., Pan, W.: Towards accurate binary convolutional neural network. In: Advances in Neural Information Processing Systems, pp. 345–353 (2017)
Liu, L., Chen, J., Fieguth, P., Zhao, G., Chellappa, R., Pietikainen, M.: From BoW to CNN: two decades of texture representation for texture classification. Int. J. Comput. Vis. 127(1), 74–109 (2019)
Liu, L., Fieguth, P., Guo, Y., Wang, X., Pietikäinen, M.: Local binary features for texture classification: taxonomy and experimental study. Pattern Recognit. 62, 135–160 (2017)
Liu, L., Lao, S., Fieguth, P.W., Guo, Y., Wang, X., Pietikäinen, M.: Median robust extended local binary pattern for texture classification. IEEE Trans. Image Process. 25(3), 1368–1381 (2016)
Mallikarjuna, P., Fritz, M., Targhi, A.T., Hayman, E., Caputo, B., Eklundh, J.: The kth-tips and kth-tips2 databases (2006)
Nanni, L., Brahnam, S., Lumini, A.: A local approach based on a local binary patterns variant texture descriptor for classifying pain states. Expert Syst. Appl. 37(12), 7888–7894 (2010)
Nanni, L., Lumini, A., Brahnam, S.: Local binary patterns variants as texture descriptors for medical image analysis. Artif. Intell. Med. 49(2), 117–125 (2010)
Ojala, T., Maenpaa, T., Pietikainen, M., Viertola, J., Kyllonen, J., Huovinen, S.: Outex-new framework for empirical evaluation of texture analysis algorithms. In: Proceedings of 16th International Conference on Pattern Recognition, vol. 1, pp. 701–706. IEEE (2002)
Ojala, T., Pietikainen, M., Kyllonen, J.: Gray level cooccurrence histograms via learning vector quantization. Proc. Scand. Conf. Image Anal. 1, 103–108 (1999)
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)
Pietikäinen, M., Hadid, A., Zhao, G., Ahonen, T.: Computer Vision Using Local Binary Patterns, vol. 40. Springer, Berlin (2011)
Pietikäinen, M., Zhao, G.: Two decades of local binary patterns: a survey. In: Advances in Independent Component Analysis and Learning Machines, pp. 175–210. Elsevier (2015)
Rivera, A.R., Castillo, J.R., Chae, O.: Local directional texture pattern image descriptor. Pattern Recognit. Lett. 51, 94–100 (2015)
Rivera, A.R., Castillo, J.R., Chae, O.O.: Local directional number pattern for face analysis: face and expression recognition. IEEE Trans. Image Process. 22(5), 1740–1752 (2013)
Ryu, J., Hong, S., Yang, H.S.: Sorted consecutive local binary pattern for texture classification. IEEE Trans. Image Process. 24(7), 2254–2265 (2015)
Shang, J., Chen, C., Pei, X., Liang, H., Tang, H., Sarem, M.: A novel local derivative quantized binary pattern for object recognition. Vis. Comput. 33(2), 221–233 (2017)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Song, K., Yan, Y., Zhao, Y., Liu, C.: Adjacent evaluation of local binary pattern for texture classification. J. Vis. Commun. Image Represent. 33, 323–339 (2015)
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1–9 (2015)
Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19(6), 1635–1650 (2010)
Trefnỳ, J., Matas, J.: Extended set of local binary patterns for rapid object detection. In: Computer Vision Winter Workshop, pp. 1–7 (2010)
Turan, C., Lam, K.M.: Histogram-based local descriptors for facial expression recognition (FER): a comprehensive study. J. Vis. Commun. Image Represent. 55, 331–341 (2018)
Varma, M., Zisserman, A.: A statistical approach to material classification using image patch exemplars. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 2032–2047 (2009)
Xu, Y., Yang, X., Ling, H., Ji, H.: A new texture descriptor using multifractal analysis in multi-orientation wavelet pyramid. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 161–168. IEEE (2010)
Zhang, J., Marszałek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: a comprehensive study. Int. J. Comput. Vis. 73(2), 213–238 (2007)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Tabatabaei, S.M., Chalechale, A. Noise-tolerant texture feature extraction through directional thresholded local binary pattern. Vis Comput 36, 967–987 (2020). https://doi.org/10.1007/s00371-019-01704-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-019-01704-8