Abstract
The fusion of multispectral (MS) image and panchromatic (PAN) image, also known as MS pansharpening, has become an important research field in remote sensing image processing. However, the MS pansharpening method based on detailed information injection has two problems that have not been well solved: one is how to extract as many effective texture details from the PAN as possible, and the second is how to effectively inject these texture details into the MS, that is, how to avoid spectral distortion while maximizing the spatial resolution of the MS. To address these problems, in this paper, a novel log-Gabor directional region entropy adaptive guided filtering algorithm is proposed for MS pansharpening. The innovations are as follows. (1) A directional region entropy measurement index in the log-Gabor transform domain is defined to measure the strength of local texture structural information. (2) A directional region entropy guided image filtering (DEGIF) model is proposed, which overcomes the halo effect of the local region filtering model and improves the accuracy of extracting textural details to a certain extent. (3) A decision supervision template with information injection and an adaptive weighting scheme based on gradient entropy are constructed. The former ensures the accuracy of the information injection location, and the latter prevents distorting the spectral information after the textural details are injected. (4) A new MS pansharpening scheme is proposed, which can effectively improve the spatial resolution of the fused image while maintaining its spectral property. The results of comparative experiments show the superiorities of the proposed algorithm with regard to other state-of-the-art MS pansharpening approaches.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Huang ZH et al (2020) Joint analysis and weighted synthesis sparsity priors for simultaneous denoising and destriping optical remote sensing images. IEEE Trans Geosci Remote Sens 58(10):6958–6982
Huang ZH et al (2022) Luminance learning for remotely sensed image enhancement guided by weighted least squares. IEEE Geosci Remote Sens Lett 19:1–5. https://doi.org/10.1109/LGRS.2021.3093935
Liu T, Li YF, Liu H, Zhang Z, Liu S (2019) Risir: rapid infrared spectral imaging restoration model for industrial material detection in intelligent video systems. IEEE Trans Industr Inform. https://doi.org/10.1109/TII.2019.2930463
Gomes V, Queiroz GR, Ferreira KR (2020) An overview of platforms for big earth observation data management and analysis. Remote Sens 12(8):1253–1277
Ha G, Misi P, Rasti B, Yokoya N et al (2019) Multisource and multitem poral data fusion in remote sensing: a comprehensive review of the state of the art. IEEE Geosci Remote Sens Mag 7(1):6–39
Chuvieco E (2020) Sensors and remote sensing satellites. CRC press, New York
Alparone L, Aiazzi B, Baronti S, Garzelli A (2015) Remote sensing image fusion. CRC press, New York
Pohl C, Van G, John L (2017) Remote sensing image fusion: a practical guide. CRC press, New York
Liu H et al (2022) Mfdnet: collaborative poses perception and matrix fisher distribution for head pose estimation. IEEE Trans Multimedia. https://doi.org/10.1109/TMM.2021.3081873
Liu T, Wang J, Yang B, Wang X (2021) Ngdnet: nonuniform gaussianlabel distribution learning for infrared head pose estimation. Neurocomputing 436(4):210–220
Liu TT, Liu H, Li YF, Chen ZZ, Zhang ZL, Liu S (2020) Flexible ftirspectral imaging enhancement for industrial robot infrared vision sensing. IEEE Trans Industr Inform 16(1):544–554
Liu H, Yan LX, Chang Y, Fang HZ, Zhang TX (2013) Spectral deconvolution and feature extraction with robust adaptive tikhonov regularization. IEEE Trans Instrum Meas 62(2):315–327
Li ZF, Liu H, Zhang ZL, Liu TT, Xiong NN (2021) Learning knowledge graph embedding with heterogeneous relation attention networks. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2021.3055147
Siok K, Ewiak I, Jenerowicz A (2020) Multi-sensor fusion: a simulation approach to pansharpening aerial and satellite images. Sensors 20(24):7100–7117
Meng X, Xiong Y, Shao F et al (2021) A large-scale benchmark data set for evaluating pansharpening performance: overview and implementation. IEEE Geosci Remote Sens Mag 9(1):18–52
Kaur G, Saini KS, Singh D et al (2021) A comprehensive study on computational pansharpening techniques for remote sensing images. Arch Comput Methods Eng 28(2):4961–4978
Amolins L, Zhang Y, Dare P (2007) Wavelet based image fusion techniques: an troduction, review and comparison. ISPRS J Photogramm Remote Sens 62(4):249–263
Amro I, Mateos J (2010) Multispectral image pansharpening based on the contourlet transform. Inf Opt Photonics 206(1):247–261
Amro I, Mateos J (2013) General shearlet pansharpening method using bayesian inference. 2013 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA), Poznan, Poland, pp 231–235
Upla KP, Gajjar PP, Joshi MV (2013) Pan-sharpening based on nonsubsampled contourlet transform detail extraction. 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), Jodhpur, India, pp 1–4
Wang XH, Bai SF, Li Z, Song RX, Tao JZ (2019) The pan and ms image pansharpening algorithm based on adaptive neural network and sparse representation in the nsst domain. IEEE Access 7(4):52508–52521
Carper W, Lillesand T, Kiefer R (2021) The use of intensity-hue-saturation transformations for merging spot panchromatic and multispectral image data. Photogramm Eng Remote Sensing 56(4):459–467
Tu T, Su S, Shyu H, Huang P (2001) A new look at ihs-like image fusion methods. Inf Fusion 2(3):177–186
Aiazzi B, Baronti S, Selva M (2007) Improving componentsubstitution pansharpening through multivariate regression ofms +pan data. IEEE Trans Geosci Remote Sens 45(10):3230–3239
Rahmani S, Strait M, Merkurjev D, Moeller M, Wittman T (2010) An adaptive IHS pan-sharpening method. IEEE Geosci Remote Sens Lett 7(4):746–750
Gabor D (1946) Theory of communication. J Inst Electr Eng Jpn 93(3):429–457
Li TT, Liu H, Chen ZZ, Lesgold AM (2018) Fast blind instrument function estimation method for industrial infrared spectrometers. IEEE Trans Industr Inform 14(12):5268–5277
Liu H et al (2019) Disr: Deep infrared spectral restoration algorithm for robot sensing and intelligent visual tracking systems. 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China, pp 8012–8017
Daugman J (1985) Uncertainty relation for resolution in space, spatial frequency and orientation optimized by two-dimensionalvisual cortical filter. J Opt Soc Am 2(7):1160–1169
Daugman J (1988) Complete discrete 2-d gabor transforms by neural networks for image analysis and compression. IEEE Trans Acoustics Speech Signal Process 36(7):1169–1179
Lei Y, Wang M, Sun T et al (2005) The study of edge detection of cerebrovascular image based on gabor filter. 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, pp 5295–5297
Field D (1987) Relations between the statistics of natural images and the response properties of cortical cells. J Opt Soc Am 4(12):2379–2394
He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Softw Eng 35(6):1397–1409
Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. The 1998 IEEE international conference on computer vision(ECCV), Bombay, India, pp 568–580
Ren L, Pan Z, Cao J et al (2001) Infrared and visible image fusion based on edge-preserving guided filter and infrared feature decomposition. Signal Process 186:108–108. https://doi.org/10.1016/j.sigpro.2021.108108
Liu S, Hu Q, Tong X, Xia J et al (2020) A multi-scale superpixel-guided filter feature extraction and selection approach for classification of very high-resolution remotely sensed imagery. Remote Sens 12(5):862–880
Li Z, Zheng J, Zhu Z et al (2015) Weighted guided image filtering. IEEE Trans Image Process 24(1):120–129
Easley G, Labate D, Lim W (2008) Sparse directional image representations using the discrete shearlet transform. Appl Comput Harmon Anal 25(1):25–46
Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Zhao W, Xu Z, Zhao J (2015) Gradient entropy metric and p-laplace diffusion constraint-based algorithm for noisy multispectral image fusion. Inf Fusion 27(1):138–149
Lolli S, Alparone L, Garzelli A, Vivone G (2017) Haze correction for contrast-based multispectral pansharpening. IEEE Geosci Remote Sens Lett 14(127):2255–2259
Vivone G, Dalla Mura M, Garzelli A, Restaino R et al (2021) A new benchmark based on recent advances in multispectral pansharpening: revisiting pansharpening with classical and emerging pansharpening methods. IEEE Geosci Remote Sens Mag 9(1):53–81
Restaino R, Vivone G, Dalla Mura M, Chanussot J (2016) Fusion of multispectral and panchromatic images based on morphological operators. IEEE Trans Image Process 25(6):2882–2895
Vivone G, Simoes M, Dalla Mura M, Restaino R et al (2015) Pansharpening based on semiblind deconvolution. IEEE Trans Geosci Remote Sens 53(4):1997–2010
Vivone G (2019) Robust band-dependent spatial-detail approaches for panchromatic sharpening. IEEE Trans Geosci Remote Sens 57(9):6421–6433
Wang X, Bai S, Li Z, Sui Y, Tao J (2021) The pan and ms image fusion algorithm based on adaptive guided filtering and gradient information regulation. Inf Sci 245(2):381–402
Acknowledgments
This research has been funded by the National Natural Science Foundation of China (Grant Nos. 41971388 and 41671439), and the Innovation Team Support Program of Liaoning Higher Education Department (Grant No. LT2017013).
Author information
Authors and Affiliations
Corresponding authors
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wang, X., Mu, Z., Bai, S. et al. Log-Gabor directional region entropy adaptive guided filtering for multispectral pansharpening. Appl Intell 53, 8256–8274 (2023). https://doi.org/10.1007/s10489-022-03931-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-022-03931-4