Abstract
High spatial resolution multispectral (HMS) images can provide sufficient information for researchers to analyze the potential disasters in the living environment. However, an original multispectral (MS) image is with low-space-resolution and high-spectrum-resolution, while an original panchromatic (PAN) image has the opposite property. Pansharpening aims at obtaining HMS image by retaining spectrum of the MS image and injecting details of the PAN image simultaneously. In this paper, we present a new pansharpening method. First, we use a bilateral filter (BF) to obtain the low-frequency-component (LFC) of PAN and MS images, respectively. Then the high-frequency-component (HFC) of PAN and MS images are readily obtained. Second, an adaptive intensity-hue-saturation (AIHS) based method is applied to generate the HFC of intensity. Finally, a dual-scale guided image filter (GIF) is utilized to calculate the difference between HFC of intensity and PAN to get the detail images. And then, these detail images are injected into the original MS image to achieve the HMS image. The proposed method is applied into testing various satellite data sets, and performs better effect on both visual quality and objective indictors than the existing methods.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Aiazzi B, Alparone L, Barducci A, Baronti S, Pippi I (1999) Multispectral fusion of multisensor image data by the generalized Laplacian pyramid. In: Geoscience and Remote Sensing Symposium, 1999. IGARSS’99 Proceedings. IEEE 1999 International, 1999. IEEE, pp 1183–1185
Aiazzi B, Baronti S, Selva M (2007) Improving component substitution pansharpening through multivariate regression of MS $+ $ Pan data. IEEE Trans Geosci Remote Sens 45(10):3230–3239
Alparone L, Wald L, Chanussot J, Thomas C, Gamba P, Bruce LM (2007) Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest. IEEE Trans Geosci Remote Sens 45(10):3012–3021
Alparone L, Aiazzi B, Baronti S, Garzelli A, Nencini F, Selva M (2008) Multispectral and panchromatic data fusion assessment without reference. Photogram Eng Remote Sensing 74(2):193–200
Chen H-T, Eddy D, Chen R-L, Chou C-L (2016) Speed-adaptive street view image generation using driving video recorder. In: Multimedia and Expo (ICME), 2016 IEEE International Conference on, 2016. IEEE, pp 1–6
Choi M, Kim RY, Nam M-R, Kim HO (2005) Fusion of multispectral and panchromatic satellite images using the curvelet transform. IEEE Geosci Remote Sens Lett 2(2):136–140
Ferster CJ, Coops NC (2016) Integrating volunteered smartphone data with multispectral remote sensing to estimate forest fuels. Int J Digital Earth 9(2):171–196
Garzelli A, Nencini F, Capobianco L (2008) Optimal MMSE pan sharpening of very high resolution multispectral images. IEEE Trans Geosci Remote Sens 46(1):228–236
Gebru T, Krause J, Wang Y, Chen D, Deng J, Aiden EL, Fei-Fei L (2017) Using deep learning and google street view to estimate the demographic makeup of the us. arXiv preprint arXiv:170206683
Ghassemian H (2016) A review of remote sensing image fusion methods. Information Fusion 32:75–89
He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409
Jameel A, Riaz MM, Ghafoor A (2016) Guided filter and IHS-based pan-sharpening. IEEE Sens J 16(1):192–194
Javidnia H, Corcoran P (2017) Real-time automotive street-scene mapping through fusion of improved stereo depth and fast feature detection algorithms. In: Consumer Electronics (ICCE), 2017 IEEE International Conference on, 2017. IEEE, pp 225–228
Jian L, Yang X, Zhou Z, Zhou K, Liu K (2018) Multi-scale image fusion through rolling guidance filter. Future Gen Comput Syst 83:310–325
Jin B, Kim G, Cho NI (2014) Wavelet-domain satellite image fusion based on a generalized fusion equation. J Appl Remote Sens 8(1):080599
Kalpoma KA, Kawano K, Kudoh J-i (2013) IKONOS image fusion process using steepest descent method with bi-linear interpolation. Int J Remote Sens 34(2):505–518
Kaplan NH, Erer I (2014) Bilateral filtering-based enhanced pansharpening of multispectral satellite images. IEEE Geosci Remote Sens Lett 11(11):1941–1945
Leung Y, Liu J, Zhang J (2014) An improved adaptive intensity–hue–saturation method for the fusion of remote sensing images. IEEE Geosci Remote Sens Lett 11(5):985–989
Liu J, Liang S (2016) Pan-sharpening using a guided filter. Int J Remote Sens 37(8):1777–1800
Miao Z, Shi W, Samat A, Lisini G, Gamba P (2016) Information fusion for urban road extraction from VHR optical satellite images. IEEE J Select Topics Appl Earth Obs Remote Sens 9(5):1817–1829
Nunez J, Otazu X, Fors O, Prades A, Pala V, Arbiol R (1999) Multiresolution-based image fusion with additive wavelet decomposition. IEEE Trans Geosci Remote Sens 37(3):1204–1211
Rahmani S, Strait M, Merkurjev D, Moeller M, Wittman T (2010) An adaptive IHS pan-sharpening method. IEEE Geosci Remote Sens Lett 7(4):746–750
Simone G, Farina A, Morabito FC, Serpico SB, Bruzzone L (2002) Image fusion techniques for remote sensing applications. Inf Fusion 3(1):3–15
Song Y, Wu W, Liu Z, Yang X, Liu K, Lu W (2016) An adaptive pansharpening method by using weighted least squares filter. IEEE Geosci Remote Sens Lett 13(1):18–22
Sun J, Jiang Y, Zeng S (2006) A study of PCA image fusion techniques on remote sensing. In: International conference on space information technology, 2006. International Society for Optics and Photonics, p 59853X
Tao F, Yang X, Wu W, Liu K, Zhou Z, Liu Y (2018) Retinex-based image enhancement framework by using region covariance filter. Soft Comput 22(5):1399–1420
Thomas C, Ranchin T, Wald L, Chanussot J (2008) Synthesis of multispectral images to high spatial resolution: a critical review of fusion methods based on remote sensing physics. IEEE Trans Geosci Remote Sens 46(5):1301–1312
Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: Computer Vision, 1998. Sixth International Conference on, 1998. IEEE, pp 839–846
Tu T, Su S-C, Shyu H-C, Huang PS (2001) A new look at IHS-like image fusion methods, Information
Upla KP, Gajjar PP, Joshi MV (2013) Pan-sharpening based on Non-subsampled Contourlet Transform detail extraction. In: Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), 2013 Fourth National Conference on, 2013. IEEE, pp 1–4
Wald L (2000) Quality of high resolution synthesised images: is there a simple criterion? In: Third conference” Fusion of Earth data: merging point measurements, raster maps and remotely sensed images”, 2000. SEE/URISCA, pp 99–103
Wang Z, Bovik AC (2002) A universal image quality index. IEEE Signal Process Lett 9(3):81–84
Wu W, Yang X, Liu K, Liu Y, Yan B (2016) A new framework for remote sensing image super-resolution: sparse representation-based method by processing dictionaries with multi-type features. J Syst Architect 64:63–75
Yang Y, Wan W, Huang S, Yuan F, Yang S, Que Y (2016) Remote sensing image fusion based on adaptive IHS and multiscale guided filter. IEEE Access 4:4573–4582
Yuhas RH, Goetz AF, Boardman JW (1992) Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm
Zhang Y (2004) Understanding image fusion. Photogramm Eng Remote Sens 70(6):657–661
Acknowledgements
The research in our paper is sponsored by National Natural Science Foundation of China (Nos. 61701327, 61711540303, 61473198), also is supported by the Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD) Fund, Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology (CICAEET) Fund.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Jian, L., Yang, X., Wu, W. et al. Pansharpening using a guided image filter based on dual-scale detail extraction. J Ambient Intell Human Comput 15, 1849–1863 (2024). https://doi.org/10.1007/s12652-018-0866-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-018-0866-4