[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Log in

Log-Gabor directional region entropy adaptive guided filtering for multispectral pansharpening

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The fusion of multispectral (MS) image and panchromatic (PAN) image, also known as MS pansharpening, has become an important research field in remote sensing image processing. However, the MS pansharpening method based on detailed information injection has two problems that have not been well solved: one is how to extract as many effective texture details from the PAN as possible, and the second is how to effectively inject these texture details into the MS, that is, how to avoid spectral distortion while maximizing the spatial resolution of the MS. To address these problems, in this paper, a novel log-Gabor directional region entropy adaptive guided filtering algorithm is proposed for MS pansharpening. The innovations are as follows. (1) A directional region entropy measurement index in the log-Gabor transform domain is defined to measure the strength of local texture structural information. (2) A directional region entropy guided image filtering (DEGIF) model is proposed, which overcomes the halo effect of the local region filtering model and improves the accuracy of extracting textural details to a certain extent. (3) A decision supervision template with information injection and an adaptive weighting scheme based on gradient entropy are constructed. The former ensures the accuracy of the information injection location, and the latter prevents distorting the spectral information after the textural details are injected. (4) A new MS pansharpening scheme is proposed, which can effectively improve the spatial resolution of the fused image while maintaining its spectral property. The results of comparative experiments show the superiorities of the proposed algorithm with regard to other state-of-the-art MS pansharpening approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Huang ZH et al (2020) Joint analysis and weighted synthesis sparsity priors for simultaneous denoising and destriping optical remote sensing images. IEEE Trans Geosci Remote Sens 58(10):6958–6982

    Article  Google Scholar 

  2. Huang ZH et al (2022) Luminance learning for remotely sensed image enhancement guided by weighted least squares. IEEE Geosci Remote Sens Lett 19:1–5. https://doi.org/10.1109/LGRS.2021.3093935

    Article  Google Scholar 

  3. Liu T, Li YF, Liu H, Zhang Z, Liu S (2019) Risir: rapid infrared spectral imaging restoration model for industrial material detection in intelligent video systems. IEEE Trans Industr Inform. https://doi.org/10.1109/TII.2019.2930463

  4. Gomes V, Queiroz GR, Ferreira KR (2020) An overview of platforms for big earth observation data management and analysis. Remote Sens 12(8):1253–1277

    Article  Google Scholar 

  5. Ha G, Misi P, Rasti B, Yokoya N et al (2019) Multisource and multitem poral data fusion in remote sensing: a comprehensive review of the state of the art. IEEE Geosci Remote Sens Mag 7(1):6–39

    Article  Google Scholar 

  6. Chuvieco E (2020) Sensors and remote sensing satellites. CRC press, New York

    Book  Google Scholar 

  7. Alparone L, Aiazzi B, Baronti S, Garzelli A (2015) Remote sensing image fusion. CRC press, New York

    Book  Google Scholar 

  8. Pohl C, Van G, John L (2017) Remote sensing image fusion: a practical guide. CRC press, New York

    Google Scholar 

  9. Liu H et al (2022) Mfdnet: collaborative poses perception and matrix fisher distribution for head pose estimation. IEEE Trans Multimedia. https://doi.org/10.1109/TMM.2021.3081873

  10. Liu T, Wang J, Yang B, Wang X (2021) Ngdnet: nonuniform gaussianlabel distribution learning for infrared head pose estimation. Neurocomputing 436(4):210–220

    Article  Google Scholar 

  11. Liu TT, Liu H, Li YF, Chen ZZ, Zhang ZL, Liu S (2020) Flexible ftirspectral imaging enhancement for industrial robot infrared vision sensing. IEEE Trans Industr Inform 16(1):544–554

    Article  Google Scholar 

  12. Liu H, Yan LX, Chang Y, Fang HZ, Zhang TX (2013) Spectral deconvolution and feature extraction with robust adaptive tikhonov regularization. IEEE Trans Instrum Meas 62(2):315–327

    Article  Google Scholar 

  13. Li ZF, Liu H, Zhang ZL, Liu TT, Xiong NN (2021) Learning knowledge graph embedding with heterogeneous relation attention networks. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2021.3055147

  14. Siok K, Ewiak I, Jenerowicz A (2020) Multi-sensor fusion: a simulation approach to pansharpening aerial and satellite images. Sensors 20(24):7100–7117

    Article  Google Scholar 

  15. Meng X, Xiong Y, Shao F et al (2021) A large-scale benchmark data set for evaluating pansharpening performance: overview and implementation. IEEE Geosci Remote Sens Mag 9(1):18–52

    Article  Google Scholar 

  16. Kaur G, Saini KS, Singh D et al (2021) A comprehensive study on computational pansharpening techniques for remote sensing images. Arch Comput Methods Eng 28(2):4961–4978

    Article  MathSciNet  Google Scholar 

  17. Amolins L, Zhang Y, Dare P (2007) Wavelet based image fusion techniques: an troduction, review and comparison. ISPRS J Photogramm Remote Sens 62(4):249–263

    Article  Google Scholar 

  18. Amro I, Mateos J (2010) Multispectral image pansharpening based on the contourlet transform. Inf Opt Photonics 206(1):247–261

    Article  Google Scholar 

  19. Amro I, Mateos J (2013) General shearlet pansharpening method using bayesian inference. 2013 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA), Poznan, Poland, pp 231–235

  20. Upla KP, Gajjar PP, Joshi MV (2013) Pan-sharpening based on nonsubsampled contourlet transform detail extraction. 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), Jodhpur, India, pp 1–4

  21. Wang XH, Bai SF, Li Z, Song RX, Tao JZ (2019) The pan and ms image pansharpening algorithm based on adaptive neural network and sparse representation in the nsst domain. IEEE Access 7(4):52508–52521

    Article  Google Scholar 

  22. Carper W, Lillesand T, Kiefer R (2021) The use of intensity-hue-saturation transformations for merging spot panchromatic and multispectral image data. Photogramm Eng Remote Sensing 56(4):459–467

    Google Scholar 

  23. Tu T, Su S, Shyu H, Huang P (2001) A new look at ihs-like image fusion methods. Inf Fusion 2(3):177–186

    Article  Google Scholar 

  24. Aiazzi B, Baronti S, Selva M (2007) Improving componentsubstitution pansharpening through multivariate regression ofms +pan data. IEEE Trans Geosci Remote Sens 45(10):3230–3239

    Article  Google Scholar 

  25. Rahmani S, Strait M, Merkurjev D, Moeller M, Wittman T (2010) An adaptive IHS pan-sharpening method. IEEE Geosci Remote Sens Lett 7(4):746–750

    Article  Google Scholar 

  26. Gabor D (1946) Theory of communication. J Inst Electr Eng Jpn 93(3):429–457

    Google Scholar 

  27. Li TT, Liu H, Chen ZZ, Lesgold AM (2018) Fast blind instrument function estimation method for industrial infrared spectrometers. IEEE Trans Industr Inform 14(12):5268–5277

    Google Scholar 

  28. Liu H et al (2019) Disr: Deep infrared spectral restoration algorithm for robot sensing and intelligent visual tracking systems. 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China, pp 8012–8017

  29. Daugman J (1985) Uncertainty relation for resolution in space, spatial frequency and orientation optimized by two-dimensionalvisual cortical filter. J Opt Soc Am 2(7):1160–1169

    Article  Google Scholar 

  30. Daugman J (1988) Complete discrete 2-d gabor transforms by neural networks for image analysis and compression. IEEE Trans Acoustics Speech Signal Process 36(7):1169–1179

    Article  MATH  Google Scholar 

  31. Lei Y, Wang M, Sun T et al (2005) The study of edge detection of cerebrovascular image based on gabor filter. 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, pp 5295–5297

  32. Field D (1987) Relations between the statistics of natural images and the response properties of cortical cells. J Opt Soc Am 4(12):2379–2394

    Article  Google Scholar 

  33. He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Softw Eng 35(6):1397–1409

    Google Scholar 

  34. Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. The 1998 IEEE international conference on computer vision(ECCV), Bombay, India, pp 568–580

  35. Ren L, Pan Z, Cao J et al (2001) Infrared and visible image fusion based on edge-preserving guided filter and infrared feature decomposition. Signal Process 186:108–108. https://doi.org/10.1016/j.sigpro.2021.108108

    Article  Google Scholar 

  36. Liu S, Hu Q, Tong X, Xia J et al (2020) A multi-scale superpixel-guided filter feature extraction and selection approach for classification of very high-resolution remotely sensed imagery. Remote Sens 12(5):862–880

    Article  Google Scholar 

  37. Li Z, Zheng J, Zhu Z et al (2015) Weighted guided image filtering. IEEE Trans Image Process 24(1):120–129

    Article  MathSciNet  MATH  Google Scholar 

  38. Easley G, Labate D, Lim W (2008) Sparse directional image representations using the discrete shearlet transform. Appl Comput Harmon Anal 25(1):25–46

    Article  MathSciNet  MATH  Google Scholar 

  39. Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  40. Zhao W, Xu Z, Zhao J (2015) Gradient entropy metric and p-laplace diffusion constraint-based algorithm for noisy multispectral image fusion. Inf Fusion 27(1):138–149

    Google Scholar 

  41. Lolli S, Alparone L, Garzelli A, Vivone G (2017) Haze correction for contrast-based multispectral pansharpening. IEEE Geosci Remote Sens Lett 14(127):2255–2259

    Article  Google Scholar 

  42. Vivone G, Dalla Mura M, Garzelli A, Restaino R et al (2021) A new benchmark based on recent advances in multispectral pansharpening: revisiting pansharpening with classical and emerging pansharpening methods. IEEE Geosci Remote Sens Mag 9(1):53–81

    Article  Google Scholar 

  43. Restaino R, Vivone G, Dalla Mura M, Chanussot J (2016) Fusion of multispectral and panchromatic images based on morphological operators. IEEE Trans Image Process 25(6):2882–2895

    Article  MathSciNet  MATH  Google Scholar 

  44. Vivone G, Simoes M, Dalla Mura M, Restaino R et al (2015) Pansharpening based on semiblind deconvolution. IEEE Trans Geosci Remote Sens 53(4):1997–2010

    Article  Google Scholar 

  45. Vivone G (2019) Robust band-dependent spatial-detail approaches for panchromatic sharpening. IEEE Trans Geosci Remote Sens 57(9):6421–6433

    Article  Google Scholar 

  46. Wang X, Bai S, Li Z, Sui Y, Tao J (2021) The pan and ms image fusion algorithm based on adaptive guided filtering and gradient information regulation. Inf Sci 245(2):381–402

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

This research has been funded by the National Natural Science Foundation of China (Grant Nos. 41971388 and 41671439), and the Innovation Team Support Program of Liaoning Higher Education Department (Grant No. LT2017013).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Xianghai Wang or Chuanming Song.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, X., Mu, Z., Bai, S. et al. Log-Gabor directional region entropy adaptive guided filtering for multispectral pansharpening. Appl Intell 53, 8256–8274 (2023). https://doi.org/10.1007/s10489-022-03931-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03931-4

Keywords

Navigation