[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3571600.3571636acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicvgipConference Proceedingsconference-collections
research-article

Novel Complex AUTOMAP for Accelerated MRI

Published: 12 May 2023 Publication History

Abstract

Accelerated MR imaging refers to diagnostic-quality image reconstruction using undersampled MR sensor data (k-space). This involves acquiring fewer samples than Nyquist’s criterion for reconstruction, thereby speeding up the MR acquisition process, which is crucial. However undersampled k-space leads to artifact-prone images, which need to be rectified. Data-driven, deep-learning based approaches, such as AUTOMAP (Automated Transform by Manifold Approximation) and other architectures like U-net, have been popular in solving the problem of accelerated MRI. These afore-mentioned architectures have the drawback that they process the complex k-space data as tuples of real data using real arithmetic, processing it differently than it should be according to complex arithmetic. In this paper, we propose a modification of AUTOMAP that explores preservation of the complex-valued structure of the k-space, which we henceforth call Complex AUTOMAP. The objective is to learn the function that reconstructs diagnostic-quality images from undersampled k-space using complex arithmetic. We introduce the novel complex dense layer and use it along with complex convolutional layers, complex transpose-convolutional layers and complex-valued activation functions to create an end-to-end deep neural network adapted for complex-valued data. The novel complex dense layer also helps to reduce the bottleneck w.r.t the memory required in the dense layers in the AUTOMAP architecture, thus accomplishing training using 50% lesser GPU resources. The performance of the Complex AUTOMAP is evaluated on a Shepp Logan phantom and two publicly-available k-space MRI datasets. Comparison of obtained results with those on AUTOMAP are also presented. The proposed Complex AUTOMAP achieves comparable performance as AUTOMAP with respect to standard metrics SSIM, PSNR and NRMSE, with 33% fewer parameters than AUTOMAP.

Supplementary Material

Camera ready full paper (icvgip22-36.zip)

References

[1]
2022. phantominator 0.6.4. https://pypi.org/project/phantominator/
[2]
Igor Aizenberg, Dmitriy V. Paliy, Jacek M. Zurada, and Jaakko T. Astola. 2008. Blur Identification by Multilayer Neural Network Based on Multivalued Neurons. Trans. Neur. Netw. 19, 5 (may 2008), 883–898. https://doi.org/10.1109/TNN.2007.914158
[3]
A.Y.H. Al-Nuaimi, Md. Faijul Amin, and Kazuyuki Murase. 2012. Enhancing MP3 encoding by utilizing a predictive Complex-Valued Neural Network. In The 2012 International Joint Conference on Neural Networks (IJCNN). 1–6. https://doi.org/10.1109/IJCNN.2012.6252535
[4]
Sindi Amilia, Mahmud Dwi Sulistiyo, and Retno Novi Dayawati. 2015. Face image-based gender recognition using complex-valued neural network. In 2015 3rd International Conference on Information and Communication Technology (ICoICT). 201–206. https://doi.org/10.1109/ICoICT.2015.7231422
[5]
Mohammad Barr. 2020. A Novel Technique for Segmentation of High Resolution Remote Sensing Images Based on Neural Networks. Neural Process. Lett. 52, 1 (aug 2020), 679–692. https://doi.org/10.1007/s11063-020-10280-1
[6]
Nevio Benvenuto, Michele Marchesi, Francesco Piazza, and Aurelio Uncini. 1991. Non linear satellite radio links equalized using blind neural networks. In [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing. 1521–1524 vol.3. https://doi.org/10.1109/ICASSP.1991.150526
[7]
Soumick Chatterjee, Chompunuch Sarasaen, Alessandro Sciarra, Mario Breitkopf, Steffen Oeltze-Jafra, Andreas Nürnberger, and Oliver Speck. 2021. Going beyond the image space: undersampled MRI reconstruction directly in the k-space using a complex valued residual neural network.
[8]
Elizabeth K. Cole, Joseph Y. Cheng, John M. Pauly, and Shreyas S. Vasanawala. 2020. Analysis of Deep Complex-Valued Convolutional Neural Networks for MRI Reconstruction. arXiv. https://doi.org/10.48550/ARXIV.2004.01738
[9]
Muneer Ahmad Dedmari, Sailesh Conjeti, Santiago Estrada, Phillip Ehses, Tony Stöcker, and Martin Reuter. 2018. Complex Fully Convolutional Neural Networks for MR Image Reconstruction. ArXiv abs/1807.03343(2018).
[10]
Jingkun Gao, Bin Deng, Yuliang Qin, Hongqiang Wang, and Xiang Li. 2019. Enhanced Radar Imaging Using a Complex-Valued Convolutional Neural Network. IEEE Geoscience and Remote Sensing Letters 16, 1 (2019), 35–39. https://doi.org/10.1109/LGRS.2018.2866567
[11]
Miroslav Hagara and Adam Hlavatovic. 2009. Video segmentation based on Pratt’s figure of merit. In 2009 19th International Conference Radioelektronika. 91–94. https://doi.org/10.1109/RADIOELEK.2009.5158758
[12]
Akira Hirose and Shotaro Yoshida. 2012. Generalization Characteristics of Complex-Valued Feedforward Neural Networks in Relation to Signal Coherence. IEEE Transactions on Neural Networks and Learning Systems 23, 4(2012), 541–551. https://doi.org/10.1109/TNNLS.2012.2183613
[13]
Akira Hirose and Shotaro Yoshida. 2012. Generalization Characteristics of Complex-Valued Feedforward Neural Networks in Relation to Signal Coherence. IEEE Transactions on Neural Networks and Learning Systems 23, 4(2012), 541–551. https://doi.org/10.1109/TNNLS.2012.2183613
[14]
Gao Huang, Zhuang Liu, and Kilian Q. Weinberger. 2017. Densely Connected Convolutional Networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017), 2261–2269.
[15]
Yan Hui and Michael R. Smith. 1995. MRI reconstruction from truncated data using a complex domain backpropagation neural network. In IEEE Pacific Rim Conference on Communications, Computers, and Signal Processing. Proceedings. 513–516. https://doi.org/10.1109/PACRIM.1995.519582
[16]
Ken Kreutz-Delgado. 2009. The Complex Gradient Operator and the CR-Calculus. (06 2009).
[17]
Ya Le and Xuan S. Yang. 2015. Tiny ImageNet Visual Recognition Challenge.
[18]
Dong Liang, Jing Cheng, Ziwen Ke, and Leslie Ying. 2020. Deep Magnetic Resonance Image Reconstruction: Inverse Problems Meet Neural Networks. IEEE Signal Processing Magazine 37, 1 (2020), 141–151. https://doi.org/10.1109/MSP.2019.2950557
[19]
Minami Miyauchi, Masatoshi Seki, Akira Watanabe, and Arata Miyauchi. 1993. Interpretation of optical flow through complex neural network. In New Trends in Neural Computation, José Mira, Joan Cabestany, and Alberto Prieto (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 645–650.
[20]
Alan V. Oppenheim and Jae S. Lim. 1981. The importance of phase in signals. Proc. IEEE 69, 5 (1981), 529–541. https://doi.org/10.1109/PROC.1981.12022
[21]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. In MICCAI.
[22]
Andy Sarroff. May 2018. Complex Neural Networks for Audio. Dartmouth College, Hanover, New Hampshire.
[23]
Ronghua Shang, Guangguang Wang, Michael A. Okoth, and Licheng Jiao. 2019. Complex-Valued Convolutional Autoencoder and Spatial Pixel-Squares Refinement for Polarimetric SAR Image Classification. Remote Sensing 11, 5 (2019). https://doi.org/10.3390/rs11050522
[24]
Guangji Shi, M.M. Shanechi, and P. Aarabi. 2006. On the importance of phase in human speech recognition. IEEE Transactions on Audio, Speech, and Language Processing 14, 5(2006), 1867–1874. https://doi.org/10.1109/TSA.2005.858512
[25]
Roberto Souza, Oeslle Lucena, Julia Garrafa, David Gobbi, Marina Saluzzi, Simone Appenzeller, Letícia Rittner, Richard Frayne, and Roberto Lotufo. 2018. An open, multi-vendor, multi-field-strength brain MR dataset and analysis of publicly available skull stripping methods agreement. NeuroImage 170(2018), 482–494. https://doi.org/10.1016/j.neuroimage.2017.08.021 Segmenting the Brain.
[26]
Chiheb Trabelsi, Olexa Bilaniuk, Ying Zhang, Dmitriy Serdyuk, Sandeep Subramanian, Joao Felipe Santos, Soroush Mehri, Negar Rostamzadeh, Yoshua Bengio, and Christopher J Pal. 2018. Deep Complex Networks. In International Conference on Learning Representations. https://openreview.net/forum?id=H1T2hmZAb
[27]
Hirofumi Tsuzuki, Mauricio Kugler, Susumu Kuroyanagi, and Akira Iwata. 2013. An Approach for Sound Source Localization by Complex-Valued Neural Network. IEICE Transactions on Information and Systems E96.D, 10(2013), 2257–2265. https://doi.org/10.1587/transinf.E96.D.2257
[28]
Bhavya Vasudeva, Puneesh Deora, Saumik Bhattacharya, and Pyari Mohan Pradhan. 2020. Co-VeGAN: Complex-Valued Generative Adversarial Network for Compressive Sensing MR Image Reconstruction. ArXiv abs/2002.10523(2020).
[29]
Shanshan Wang, Taohui Xiao, Qiegen Liu, and Hairong Zheng. 2021. Deep learning for fast MR imaging: A review for learning reconstruction from incomplete k-space data. Biomed. Signal Process. Control. 68 (2021), 102579.
[30]
Zhou Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4 (2004), 600–612. https://doi.org/10.1109/TIP.2003.819861
[31]
Yan Yang, Jian Sun, Huibin Li, and Zongben Xu. 2020. ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing. IEEE Transactions on Pattern Analysis and Machine Intelligence 42, 3(2020), 521–538. https://doi.org/10.1109/TPAMI.2018.2883941
[32]
Jure Zbontar, Florian Knoll, Anuroop Sriram, Matthew Muckley, Mary Bruno, Aaron Defazio, Marc Parente, Krzysztof Geras, Joe Katsnelson, Hersh Chandarana, Zizhao Zhang, Michal Drozdzal, Adriana Romero, Michael Rabbat, Pascal Vincent, James Pinkerton, Duo Wang, Nafissa Yakubova, Erich Owens, and Tullie Murrell. 2018. fastMRI: An Open Dataset and Benchmarks for Accelerated MRI. (11 2018).
[33]
Junming Zhang and Yan Wu. 2017. A New Method for Automatic Sleep Stage Classification. IEEE Transactions on Biomedical Circuits and Systems 11, 5 (2017), 1097–1110. https://doi.org/10.1109/TBCAS.2017.2719631
[34]
Bo Zhu, Jeremiah Zhe Liu, Bruce R. Rosen, and Matthew S. Rosen. 2018. Image reconstruction by domain-transform manifold learning. Nature 555(2018), 487–492.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICVGIP '22: Proceedings of the Thirteenth Indian Conference on Computer Vision, Graphics and Image Processing
December 2022
506 pages
ISBN:9781450398220
DOI:10.1145/3571600
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 May 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. AUTOMAP
  2. Complex-valued Neural Network
  3. MRI Reconstruction

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICVGIP'22

Acceptance Rates

Overall Acceptance Rate 95 of 286 submissions, 33%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 28
    Total Downloads
  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)2
Reflects downloads up to 24 Dec 2024

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media