[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3471261.3471269acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicmsspConference Proceedingsconference-collections
research-article

Pyramid Attention Generative Adversarial Network for Image Compressed Sensing

Published: 06 September 2021 Publication History

Abstract

The single image compressed sensing method has developed from the traditional model-based to the neural network such as generative adversarial network (GAN), which proves that the GAN-based method has better reconstruction quality and lower computational complexity. However, there are still difficulties in insufficient feature extraction in GAN that affect the quality of reconstruction. To solve the problem, this paper proposes an improved GAN-based CS model: Pyramid Attention-based GAN (PAGAN) for compressed sensing reconstruction with intra- & inter- attention mechanism. PAGAN reconstructs images from recurrent multiple sampled data and the proposed intra- & inter- attention-based generated network with different scale pyramid layers to enhance the multi-scale feature extraction and residual high-frequency feature transmission, which further improve the image resolution and the reconstruction quality and further enable CS reconstruction with flexible resolutions by combining multiple layers of the generated network. Experimental results on multiple public dataset show that PAGAN provides 3.12dB PSNR, and improves the average SSIM by 33.20%, compared with traditional and data-driven benchmark methods. It shows that the reconstructed image quality of the proposed method is superior to the previous methods.

References

[1]
Becker, S., Bobin, J., Cands, E.J.: Nesta: A fast and accurate first-order method for sparse recovery. SIAM Journal on Imaging Sciences 4(1), 1–39 (2011)
[2]
Metzler, C., Mousavi, A., Baraniuk, R.: Learned d-amp: Principled neural network based compressive image recovery. In: NIPS, pp. 1772–1783 (2017).
[3]
Blumensath, T., Davies, M.E.: Iterative hard thresholding for compressed sensing. Applied and Computational Harmonic Analysis 27(3), 265 – 274 (2009)
[4]
Huggins, P.S., Zucker, S.W.: Greedy basis pursuit. TSP 55(7), 3760–3772 (2007)
[5]
Tropp, J.A., Gilbert, A.C.: Signal recovery from random measurements via orthogonal matching pursuit. TIT 53(12), 4655–4666 (2007)
[6]
Dong, W., Shi, G., Li, X., Ma, Y., Huang, F.: Compressive sensing via nonlocal low-rank regularization. TIP 23(8), 3618–3632 (2014)
[7]
Li, C., Yin, W., Zhang, Y.: An efficient augmented Lagrangian method with applications to total variation minimization. Computational Optimization and Applications 56(3), 507–530 (2013)
[8]
Li, Lixiang., "Overview of Compressed Sensing: Sensing Model, Reconstruction Algorithm, and Its Applications." Applied Sciences 10.17(2020):5909.
[9]
Yan Shen, Jing Liu, Evaluating optical properties of real photonic crystal fibers with compressed sensing based on non-subsampled contourlet transform, Infrared Physics & Technology, 85:266-272, 2017. https://doi.org/10.1016/j.infrared.2017.04.004
[10]
Yan Shen, Qing Liu, Wavelet-Based Total Variation and Nonlocal Similarity Model for Image Denoising, IEEE Signal Processing Letters, 24(6):877-881, 2017.
[11]
Yan Shen, Ying Chen, Improved Anscombe transformation and total variation for denosing of lowlight Infrared images, Infrared Physics & Technology, 93: 192-198, 2018.
[12]
Kulkarni, K., Lohit, S., Turaga, P., Kerviche, R., Ashok, A.: Reconnet: Noniterative reconstruction of images from compressively sensed measurements. In: CVPR, pp. 449–458 (2016)
[13]
Mousavi, A., Baraniuk, R.G.: Learning to invert: Signal recovery via deep convolutional networks. In: ICASSP, pp. 2272–2276 (2017)
[14]
Shi, W, "Image Compressed Sensing Using Convolutional Neural Network." IEEE Transactions on Circuits and Systems for Video Technology (2019).
[15]
Sun, Yubao, "Learning image compressed sensing with sub-pixel convolutional generative adversarial network." Pattern Recognition 98 (2020): 107051.
[16]
Su, Yueming, and Qiusheng Lian. "iPiano-Net: Nonconvex optimization inspired multi-scale reconstruction network for compressed sensing." Signal Processing: Image Communication 89 (2020): 115989.
[17]
Bora, A., Jalal, A., Price, E., Dimakis, A.G.: Compressed sensing using generative models. In: ICML, pp. 537–546 (2017).
[18]
Schulter, S., Leistner, C., Bischof, H.: Fast and accurate image upscaling with super-resolution forests. In: CVPR, pp. 3791–3799 (2015)
[19]
Muqeet A, Iqbal M T B, Bae S. HRAN: Hybrid Residual Attention Network for Single Image Super-Resolution[J]. IEEE Access, 2019, 7: 137020-137029.
[20]
Bo Cheng, Shiai Cui, and Ting Li, "Tensor Locality Preserving Projections Based Urban Building Areas Extraction from High-Resolution SAR Images," Vol. 7, No. 4, pp. 291-296, November, 2016.
[21]
Bo Cheng, Shiai Cui, and Ting Li, "Tensor Locality Preserving Projections Based Urban Building Areas Extraction from High-Resolution SAR Images," Vol. 7, No. 4, pp. 291-296, November, 2016.
[22]
Junghoon Seo, Taewon Yoon, Jinwoo Kim, and Kin Choong Yow, "One-to-one Example-based Automatic Image Coloring Using Deep Convolutional Generative Adversarial Network," Vol. 8, No. 2, pp. 80-85, May, 2017.
[23]
Thuong Le-Tien, Tuan Nguyen-Thanh, Hanh-Phan Xuan, Giang Nguyen-Truong, and Vinh Ta-Quoc, "Deep Learning Based Approach Implemented to Image Super-Resolution," Journal of Advances in Information Technology, Vol. 11, No. 4, pp. 209-216, November 2020.
[24]
Mohammed Mustafa Siddeq, "Using Sequential Search Algorithm with Single level Discrete Wavelet Transform for Image Compression (SSA-W)," Journal of Advances in Information Technology, Vol. 3, No. 4, pp. 236-249, November, 2012.
[25]
Masaji Tanaka, Toshiaki Kaneeda" A Method of Reconstructing 3D Models from Sketches by Extracting Features, Vol. 5, No. 3, pp. 74-78, August, 2014.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICMSSP '21: Proceedings of the 2021 6th International Conference on Multimedia Systems and Signal Processing
May 2021
67 pages
ISBN:9781450390378
DOI:10.1145/3471261
© 2021 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 September 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Attention Mechanism
  2. Compressed Sensing,Reconstruction
  3. Pyramid Attention Generative Adversarial Network

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICMSSP 2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 40
    Total Downloads
  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)1
Reflects downloads up to 12 Dec 2024

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media