[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN109472747A - A kind of deep learning method of microwave remote sensing image speckle noise reduction - Google Patents

A kind of deep learning method of microwave remote sensing image speckle noise reduction Download PDF

Info

Publication number
CN109472747A
CN109472747A CN201811213563.3A CN201811213563A CN109472747A CN 109472747 A CN109472747 A CN 109472747A CN 201811213563 A CN201811213563 A CN 201811213563A CN 109472747 A CN109472747 A CN 109472747A
Authority
CN
China
Prior art keywords
dscnn
network
remote sensing
speckle noise
microwave remote
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811213563.3A
Other languages
Chinese (zh)
Inventor
王龙刚
魏梦麟
李廉林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Peking University
Original Assignee
Peking University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University filed Critical Peking University
Priority to CN201811213563.3A priority Critical patent/CN109472747A/en
Publication of CN109472747A publication Critical patent/CN109472747A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10032Satellite or aerial image; Remote sensing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

The invention proposes a kind of deep learning methods of microwave remote sensing image speckle noise reduction;DsCNN network proposed by the present invention is constructed using residual error network module series system, and coherent speckle noise classification processing reduces coherent speckle noise removal difficulty, overcomes DsCNN network too deep the problem of leading to trained difficulty increase;DsCNN network sample data set proposed by the present invention is originated from open source software, existing microwave remote sensing open source image data set can be overcome few, the high disadvantage of procurement cost with Free Acquisition adequate sample data set;DsCNN network proposed by the present invention is in removal coherent speckle noise meanwhile, it is capable to keep target texture feature;DsCNN network proposed by the present invention is driven based on sample, is reduced coherent speckle noise modeling difficulty, is improved coherent speckle noise modeling accuracy;DsCNN network processes speed proposed by the present invention is fast, meets the needs of processing large scale microwave remote sensing image speckle noise reduction task in real time.

Description

A kind of deep learning method of microwave remote sensing image speckle noise reduction
Technical field
The present invention relates to microwave remote sensing technical field of image processing, and in particular to a kind of micro- using deep learning network implementations The method of wave remote sensing images speckle noise reduction.
Background technique
Microwave remote sensing technique has many advantages, such as round-the-clock, round-the-clock, multi-angle of view, multi-frequency, multipolarization, and electromagnetism Wave signal has stronger penetration power, it can be found that hiding target with tracking, thus is widely used in various military and civilians Scene.Compared with natural image, microwave remote sensing image is often accompanied by a large amount of coherent speckle noises, significantly reduces microwave remote sensing The resolution ratio of image causes certain difficulty to further realize the application such as edge detection, image segmentation, target identification.Microwave Remote sensing images, especially SAR (Synthetic Aperture Radar) image, coherent speckle noise are typical multiplicative noise, It generates along with SAR image and is existed.Compared with additive noise, multiplicative noise is more difficult to handle.
In the past few decades, researcher proposes a large amount of microwave remote sensing image speckle noise reduction methods.Often The method of microwave remote sensing image speckle noise reduction includes: Lee filtering method, Frost filtering method, the filtering side Kuan Method, Gamma MAP filtering method, FANS filtering method, BM-3D filtering method etc..These filtering methods pass through to sliding window Interior microwave remote sensing image data carries out local shape factor, inhibits coherent speckle noise, improves microwave remote sensing picture quality.But These methods face two big challenges: whether the parameter (1) counted in sliding window is reliable;(2) whether coherent speckle noise model Reliably.And these methods successively extract characteristics of image using sliding window, reduce image processing speed, are not possible to meet real-time Handle large scale microwave remote sensing image speckle noise reduction task.
The forming process of microwave remote sensing image coherent speckle noise is extremely complex, it is difficult to carry out essence to it with simple mathematical model Really modeling, thus speckle noise reduction method treatment effect is undesirable at present.The deep learning method of sample driving then has Powerful non-linear expression's ability, image processor GPU (Graphics Processing Unit) accelerate deep learning side Method processing speed provides new approaches to explore microwave remote sensing image speckle noise reduction.
Summary of the invention
In order to solve above-mentioned key technology difficulty, the invention proposes a kind of depths of microwave remote sensing image speckle noise reduction Spend learning method;The present invention passes through building DsCNN (Despeckle using Convolutional Neural Networks) Network realizes the Accurate Model to multiplicative noise, and then realizes processing large scale microwave remote sensing image speckle noise reduction in real time Task.
The deep learning method of microwave remote sensing image speckle noise reduction of the present invention the following steps are included:
1) DsCNN network is constructed;
2) DsCNN network training and test sample data set are generated;
3) training DsCNN network;
4) DsCNN network implementations microwave remote sensing image speckle noise reduction is utilized;
DsCNN network uses residual error network ResNet (Residual Network) block coupled in series form structure in step 1) It builds, realizes the classification processing of coherent speckle noise;
DsCNN network activation function is all made of Tanh in step 1), and microwave remote sensing data value field is compressed to [0,1], Accelerate DsCNN network convergence;
DsCNN network convolutional layer fill pattern uses " same " in step 1).
DsCNN network does not contain pond layer, full articulamentum in step 1);
DsCNN network uses the end-to-end processing of pixel to pixel formula in step 1);
Loss function is using mean square error MSE (Mean Squared Error) and total variation TV (Total in step 1) Variation the form) combined, as shown in formula (1):
Ltotal=Lmse+ρLTV (1)
Wherein ρ indicates weight factor, is used for balanced mean square error loss function LmseWith total variation loss function LTVBetween Significance level;Wherein LmseAnd LTVIt can be expressed as formula 2 and formula 3:
Wherein W indicates that image lateral coordinates element number, H indicate image longitudinal coordinate element number;W indicates that image is lateral W-th of element, h indicate longitudinal h-th of the element of image;YW, hAnd XW, hRespectively indicate outputting and inputting for DsCNN network;Table Show the denoising image of DsCNN network output;Indicate the DsCNN network of Complete Convergence;LmseImage is made an uproar with nothing after guaranteeing denoising Error is minimum between acoustic image;LTVImage after guaranteeing denoising has better texture features;
Training sample is originated from the colour optics remote sensing images over the ground of Google Earth in step 2), by by colourama It learns remote sensing images and is converted to the gray scale remote sensing images with multiplicative noise, realize the realistic simulation to true microwave remote sensing image, it is low Cost generates a large amount of DsCNN network sample data sets.
Advantages of the present invention:
The invention proposes a kind of deep learning methods of microwave remote sensing image speckle noise reduction;The present invention has as follows Advantage:
1, DsCNN network is constructed using residual error network module series system, and coherent speckle noise classification processing can reduce phase Dry spot noise remove difficulty, and can overcome the problems, such as to train difficulty to increase caused by the DsCNN network number of plies is too deep;
2, DsCNN network sample data set is originated from open source Google Earth software, can be with Free Acquisition adequate sample number According to collection, overcome existing microwave remote sensing image open source data set few, the high disadvantage of procurement cost;
3, DsCNN network is in removal coherent speckle noise meanwhile, it is capable to keep target texture feature;
4, DsCNN network processes speed is fast, meets processing large scale microwave remote sensing image speckle noise reduction task in real time Demand;
5, DsCNN network is driven based on sample, is reduced coherent speckle noise modeling difficulty, is improved coherent speckle noise modeling Precision;
Detailed description of the invention
Fig. 1 is DsCNN schematic network structure;
Fig. 2 is DsCNN network sample data set product process schematic diagram;
Fig. 3 is the speckle noise reduction result schematic diagram that DsCNN network is directed to training sample data collection;
Fig. 4 is the speckle noise reduction result schematic diagram that DsCNN network is directed to test sample data set;
Fig. 5 is that different speckle noise reduction methods are directed to identical SAR image speckle noise reduction comparative result figure;
Fig. 6 is the speckle noise reduction Comparative result that different speckle noise reduction methods are directed to three groups of zonule SAR images Figure.
Specific embodiment
With reference to the accompanying drawing, by specific embodiment, the present invention is further explained.
The deep learning method of the present embodiment microwave remote sensing image speckle noise reduction the following steps are included:
1) DsCNN network is constructed:
As shown in Figure 1, DsCNN network is made of two residual error network modules;Each residual error network module includes four layers of volume Product neural net layer and quick articulamentum (shortcut) are constituted;Convolutional neural networks layer includes matrix convolution Conv, batch standard Change BN and activation primitive Tanh to operate;Shortcut layers of realization identical transformation are added by matrix and are realized;Input picture is 256 The image containing coherent speckle noise of × 256 pixels;Export the noise-free picture that image is corresponding 256 × 256 pixel;L1-L7 The convolution kernel size of layer convolutional layer is 3 × 3, and convolution kernel number is 64;L8 layers of convolution kernel size is 3 × 3, convolution kernel number It is 1.
2) DsCNN network training and test sample data set are generated:
As shown in Fig. 2, the crawl of colour optics remote sensing images is in open source software Google Earth;Gray processing is carried out to image Processing generates greyscale optical remote sensing images;Multiplicative noise is added on greyscale optical remote sensing images, then corresponding contain can be generated There is the emulation microwave remote sensing image of multiplicative noise, multiplicative noise variance is set as 0.2 in this example;It will be imitative containing multiplicative noise True microwave remote sensing image random division is the image of 256 × 256 pixels, then it is grey with the noiseless of corresponding 256 × 256 pixel It spends remote sensing image and constitutes one group of sample data;The symbiosis of this example is at 3400 groups of sample data sets, including 3000 groups of instructions Practice sample data set, 200 groups of verifying sample data sets and 200 groups of test sample data sets.
3) training DsCNN network:
DsCNN network uses adaptability moments estimation optimization method in this example;DsCNN network training every batch of inputs 16 groups Sample data;DsCNN network training amounts to iteration 100 times;DsCNN e-learning rate Initialize installation is 0.0002, decaying The factor is set as 0.1;Weight factor ρ is set as 0.000002 in loss function;Fig. 3 is to export after DsCNN network completes training Training sample data collection part denoising result;Fig. 4 is that the part of the test sample data set of DsCNN network output denoises knot Fruit;A indicates that network inputs image, b indicate noise-free picture in Fig. 3 and Fig. 4;C indicates that network exports image, that is, schemes after denoising Picture.As can be seen from figs. 3 and 4 the coherent speckle noise of DsCNN network output image is had compared with DsCNN network inputs image Effect inhibits, and target texture is clear, and picture quality is significantly promoted;
Introduce Y-PSNR PSNR (Peak Signal to Noise Ratio) and structuring index of similarity (structural similarity index, be abbreviated as SSIM) Lai Hengliang picture quality.Wherein structuring index of similarity can To indicate are as follows:
Wherein a and b respectively indicates image and noise-free picture to be assessed.For image a,Wherein P Indicate pictorial element number, p indicates p-th of element.Above-mentioned definition is for image b It is applicable in.C1And C2It is a small constant, such as 0.01.SSIM value is bigger, table Show that the similitude of two images is bigger.SSIM maximum value is 1, is indicated identical.
As shown in Table 1, DsCNN network training and test sample collection output image are better than input picture, and PSNR and SSIM refer to Number is greatly improved.
PSNR the and SSIM index of table 1:DsCNN network training and test sample collection output image
4) DsCNN network implementations microwave remote sensing image speckle noise reduction is utilized
As shown in Fig. 5 (a), two width SAR images are originated from the shooting of TerraSAR-X and TanDEM-X spaceborne radar not Island image near Singapore in the same time.Two width SAR images are 9984 × 5888 pixels.Introduce equivalent more view indexes (ENL:Equivalent Number of Looks) measures SAR image quality, as shown in formula 5:
Wherein K indicates the total number of sliding window, μkWithRespectively indicate the mean value and variance of pixel in k-th of sliding window. ENL index is bigger, then shows that picture quality is higher.
B indicates FANS method speckle noise reduction result in Fig. 5 and Fig. 6;C indicates BM-3D method speckle noise reduction knot Fruit;D indicates DsCNN network speckle noise reduction result;SAR image compares figure b in figure d and figure c image texture details is more clear Clear, coherent speckle noise is more preferably inhibited;As shown in Table 2, the ENL index for scheming d is maximum, i.e., picture quality is best.It can by table 3 Know, handle the SAR image of same scale, FANS method needs 1400 seconds, and BM-3D method needs 600 seconds, and DsCNN method is only Need 10 seconds or so;Therefore DsCNN method meets handles large scale microwave remote sensing image speckle noise reduction task in real time Demand.
SAR image ENL index contrast table in table 2: Fig. 6
Table 3: SAR image distinct methods operation time contrast table in reconstruct image 5
It is finally noted that the purpose for publicizing and implementing example is to help to further understand the present invention, but this field Technical staff be understood that without departing from the spirit and scope of the invention and the appended claims, it is various replacement and repair It is all possible for changing.Therefore, the present invention should not be limited to embodiment disclosure of that, and the scope of protection of present invention is to weigh Subject to the range that sharp claim defines.

Claims (6)

1. it is characterized by comprising following steps for a kind of deep learning method of microwave remote sensing image speckle noise reduction:
1) DsCNN network is constructed;
2) DsCNN network training and test sample data set are generated;
3) training DsCNN network;
4) DsCNN network implementations microwave remote sensing image speckle noise reduction is utilized.
2. the deep learning method of microwave remote sensing image speckle noise reduction according to claim 1 it is characterized in that, DsCNN network realizes coherent speckle noise classification processing using the series connection building of residual error network module.
3. the deep learning method of microwave remote sensing image speckle noise reduction according to claim 1 it is characterized in that, DsCNN network activation function is all made of Tanh, and microwave remote sensing value data is compressed to [0,1], accelerates DsCNN network convergence.
4. the deep learning method of microwave remote sensing image speckle noise reduction according to claim 1 it is characterized in that, DsCNN network does not contain pond layer, and convolutional layer fill pattern uses " same ".
5. the deep learning method of microwave remote sensing image speckle noise reduction according to claim 1 it is characterized in that, DsCNN network uses the end-to-end training of pixel to pixel formula.
6. the deep learning method of microwave remote sensing image speckle noise reduction according to claim 1 is it is characterized in that, benefit Generate simulation sample data set with open source software: colour optics remote sensing images are grabbed in open source software, to colour optics remote sensing figure As carrying out gray processing processing, and multiplicative noise is added, generates the emulation microwave remote sensing image containing multiplicative noise.
CN201811213563.3A 2018-10-18 2018-10-18 A kind of deep learning method of microwave remote sensing image speckle noise reduction Pending CN109472747A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811213563.3A CN109472747A (en) 2018-10-18 2018-10-18 A kind of deep learning method of microwave remote sensing image speckle noise reduction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811213563.3A CN109472747A (en) 2018-10-18 2018-10-18 A kind of deep learning method of microwave remote sensing image speckle noise reduction

Publications (1)

Publication Number Publication Date
CN109472747A true CN109472747A (en) 2019-03-15

Family

ID=65664162

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811213563.3A Pending CN109472747A (en) 2018-10-18 2018-10-18 A kind of deep learning method of microwave remote sensing image speckle noise reduction

Country Status (1)

Country Link
CN (1) CN109472747A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111266A (en) * 2019-04-08 2019-08-09 西安交通大学 A kind of approximate information pass-algorithm improved method based on deep learning denoising
CN111932467A (en) * 2020-07-13 2020-11-13 东软医疗系统股份有限公司 Image processing method and device
CN112926448A (en) * 2021-02-24 2021-06-08 重庆交通大学 SAR image classification method with stable fluctuation of speckle pattern
CN116228609A (en) * 2023-05-10 2023-06-06 中国人民解放军国防科技大学 Radar image speckle filtering method and device based on zero sample learning
CN116430347A (en) * 2023-06-13 2023-07-14 成都实时技术股份有限公司 Radar data acquisition and storage method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106846253A (en) * 2017-02-14 2017-06-13 深圳市唯特视科技有限公司 A kind of image super-resolution rebuilding method based on reverse transmittance nerve network
CN107644401A (en) * 2017-08-11 2018-01-30 西安电子科技大学 Multiplicative noise minimizing technology based on deep neural network
CN108629746A (en) * 2018-04-24 2018-10-09 华中科技大学 A kind of radar map image patch based on associated loss convolutional neural networks is made an uproar suppressing method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106846253A (en) * 2017-02-14 2017-06-13 深圳市唯特视科技有限公司 A kind of image super-resolution rebuilding method based on reverse transmittance nerve network
CN107644401A (en) * 2017-08-11 2018-01-30 西安电子科技大学 Multiplicative noise minimizing technology based on deep neural network
CN108629746A (en) * 2018-04-24 2018-10-09 华中科技大学 A kind of radar map image patch based on associated loss convolutional neural networks is made an uproar suppressing method

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111266A (en) * 2019-04-08 2019-08-09 西安交通大学 A kind of approximate information pass-algorithm improved method based on deep learning denoising
CN110111266B (en) * 2019-04-08 2021-07-13 西安交通大学 Approximate information transfer algorithm improvement method based on deep learning denoising
CN111932467A (en) * 2020-07-13 2020-11-13 东软医疗系统股份有限公司 Image processing method and device
CN112926448A (en) * 2021-02-24 2021-06-08 重庆交通大学 SAR image classification method with stable fluctuation of speckle pattern
CN112926448B (en) * 2021-02-24 2022-06-14 重庆交通大学 SAR image classification method with stable fluctuation of speckle pattern
CN116228609A (en) * 2023-05-10 2023-06-06 中国人民解放军国防科技大学 Radar image speckle filtering method and device based on zero sample learning
CN116430347A (en) * 2023-06-13 2023-07-14 成都实时技术股份有限公司 Radar data acquisition and storage method
CN116430347B (en) * 2023-06-13 2023-08-22 成都实时技术股份有限公司 Radar data acquisition and storage method

Similar Documents

Publication Publication Date Title
CN109472747A (en) A kind of deep learning method of microwave remote sensing image speckle noise reduction
Zhang et al. Hybrid noise removal in hyperspectral imagery with a spatial–spectral gradient network
CN108898560B (en) Core CT image super-resolution reconstruction method based on three-dimensional convolutional neural network
CN110120020A (en) A kind of SAR image denoising method based on multiple dimensioned empty residual error attention network
CN107525588B (en) Rapid reconstruction method of dual-camera spectral imaging system based on GPU
CN111062880A (en) Underwater image real-time enhancement method based on condition generation countermeasure network
CN109902715B (en) Infrared dim target detection method based on context aggregation network
CN103873743A (en) Video de-noising method based on structure tensor and Kalman filtering
CN108573479A (en) The facial image deblurring and restoration methods of confrontation type network are generated based on antithesis
CN107316004A (en) Space Target Recognition based on deep learning
CN107563433A (en) A kind of infrared small target detection method based on convolutional neural networks
CN103679216B (en) Method for detecting infrared small/weak targets based on space-time sparse representation
CN108447113B (en) Impulse type intensity correlation three-dimensional imaging method based on deep learning model
CN103295241A (en) Frequency domain significance target detection method based on Gabor wavelet
CN107784628A (en) A kind of super-resolution implementation method based on reconstruction optimization and deep neural network
CN110070539A (en) Image quality evaluating method based on comentropy
CN107563397A (en) Cloud cluster method for calculation motion vector in a kind of satellite cloud picture
CN112163998A (en) Single-image super-resolution analysis method matched with natural degradation conditions
Wen et al. Learning flipping and rotation invariant sparsifying transforms
CN104217430A (en) Image significance detection method based on L1 regularization
Zhang et al. A novel data augmentation method for sar image target detection and recognition
ZhiPing et al. A new generative adversarial network for texture preserving image denoising
CN102722878A (en) SAR (synthetic aperture radar) image despeckle method based on target extraction and PPB (probabilistic patch-based filter) algorithm
CN114863164B (en) Target recognition model construction method for small target super-resolution reconstructed image
Zhou et al. Image denoising based on dual-tree complex wavelet transform and convolutional neural network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190315

WD01 Invention patent application deemed withdrawn after publication