[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Light&fast generative adversarial network for high-fidelity CT image synthesis of liver tumor

Published: 01 September 2024 Publication History

Abstract

Background and objective:

Hepatocellular carcinoma is a common disease with high mortality. Through deep learning methods to analyze HCC CT, the screening classification and prognosis model of HCC can be established, which further promotes the development of computer-aided diagnosis and treatment in the treatment of HCC. However, there are significant challenges in the actual establishment of HCC auxiliary diagnosis model due to data imbalance, especially for rare subtypes of HCC and underrepresented demographic groups. This study proposes a GAN model aimed at overcoming these obstacles and improving the accuracy of HCC auxiliary diagnosis.

Methods:

In order to generate liver and tumor images close to the real distribution. Firstly, we construct a new gradient transfer sampling module to improve the lack of texture details and excessive gradient transfer parameters of the deep model; Secondly, we construct an attention module with spatial and cross-channel feature extraction ability to improve the discriminator’s ability to distinguish images; Finally, we design a new loss function for liver tumor imaging features to constrain the model to approach the real tumor features in iterations.

Results:

In qualitative analysis, the images synthetic by our method closely resemble the real images in liver parenchyma, blood vessels, tumors, and other parts. In quantitative analysis, the optimal results of FID, PSNR, and SSIM are 75.73, 22.77, and 0.74, respectively. Furthermore, our experiments establish classification models for imbalanced data and enhanced data, resulting in an increase in accuracy rate by 21%–34%, an increase in AUC by 0.29 - 0.33, and an increase in specificity to 0.89.

Conclusion:

Our solution provides a variety of training data sources with low cost and high efficiency for the establishment of classification or prognostic models for imbalanced data.

Graphical abstract

Display Omitted

Highlights

The Skip-Layer Channel UnSampling Excitation (SCSE) module is utilized to precisely extract liver tumor features by mapping high-level features to low-level representations.
The Adaptive Efficient Group Attention (AEG) focuses on the intricate details of the tumor regions in the discriminator, thereby enhancing its ability to distinguish genuine images while minimizing an increase in parameters.
The GLCM-based loss function emphasizes the texture, shape, and grayscale attributes of the liver and tumor regions, accelerating the model’s convergence towards identifying authentic liver tumor signatures in CT scans.

References

[1]
Shamsolmoali P., et al., Image synthesis with adversarial networks: A comprehensive survey and case studies, Inf. Fusion 72 (2021) 126–146,.
[2]
Chuquicusma M.J., et al., How to fool radiologists with generative adversarial networks?, in: A Visual Turing Test for Lung Cancer Diagnosis, in: Proc. IEEE Int. Symp. Biomed. Imaging, 2018, pp. 240–244,.
[3]
Frid-Adar M., Diamant I., Klang E., Amitai M., Goldberger J., Greenspan H., GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification, Neurocomputing 321 (2018) 321–331,.
[4]
Bowles C., et al., Gan augmentation: Augmenting training data using generative adversarial networks, 2018,.
[5]
Xiuyan L., Ruzhi Z., Qi W., Xiaojie D., Jianming W., Lung electrical impedance tomography based on improved generative adversarial network, web and big data, 2023, pp. 138–150.
[6]
Jinzhi Z., et al., Liver CT image tumor segmentation algorithm based on GAN-DAUnet, Chinese J. Phys. 40 (8) (2023) 971–976,.
[7]
Kim N., et al., Realistic chest X-ray image synthesis via generative network with stochastic memristor array for machine learning-based medical diagnosis, Adv. Funct. Mater. (2024),. [Online published].
[8]
Long N.M.H., Chung W.-Y., Reconstruction of corrupted photoplethysmography signals using recursive generative adversarial networks, IEEE Trans. Instrum. Meas. 73 (2024) 1–15,.
[9]
Defu Q., Yuhu C., Xuesong W., Improved generative adversarial network for retinal image super-resolution, Comput. Methods Programs Biomed. 225 (2022),.
[10]
Massimo S., Francesco B., Federica V., DermoCC-GAN: A new approach for standardizing dermatological images using generative adversarial networks, Comput. Methods Programs Biomed. 225 (2022),.
[11]
Gan Z., Subasi A., Promoting accuracy in low-magnification histopathology grading: With augmentation and multi-dilation model, Biomed. Signal Process. Control. 86 (2023),.
[12]
Qian Wan, Wenhui G., Yanjiang W., SGBGAN: minority class image generation for class-imbalanced datasets, Mach. Vis. Appl. 35 (2024),.
[13]
Yang L., Conditional generative adversarial networks (CGAN) for abnormal vibration of aero engine analysis, in: 2020 IEEE 2nd International Conference on Civil Aviation Safety and Information Technology, 2020, pp. 724–728,.
[14]
Zhang H., et al., Self-attention generative adversarial networks, In Int. Conf. Mach. Learn. (2019) 7354–7363. arXiv:1805.08318.
[15]
Zhu J.-Y., Park T., Isola P., Efros A.A., Unpaired image-to-image translation using cycle-consistent adversarial networks, in: 2017 IEEE International Conference on Computer Vision, 2017, pp. 2242–2251,.
[16]
Chen X., Yan D., Rein H., John S., Ilya S., Abbeel P., InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets, Neural Inf. Process. Syst. (2016).
[17]
Brock A., Jeff D., Karen S., Large scale GAN training for high fidelity natural image synthesis, 2018, ArXiv abs/1809.11096.
[18]
Karras T., Laine S., Aila T., A style-based generator architecture for generative adversarial networks, Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. (2019) 4396–4405,.
[19]
Karras T., et al., Analyzing and improving the image quality of StyleGAN, Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. (2020) 8107–8116,.
[20]
Karras T., et al., Alias-free generative adversarial networks, Adv. Neural Inf. Process. Syst. 34 (2021) 852–863. arXiv:2106.12423.
[21]
Jinzhi Z., Zhen H., et al., Liver CT image tumor segmentation algorithm based on GAN-DAUnet, Chinese J. Phys. 40 (2023) 971–976,.
[22]
Caie X., Dandan N., Bingyan W., Mingyang W., Honghua G., Two-stage anomaly detection for positive samples and small samples based on generative adversarial networks, Multimed. Tools. Appl. 82 (2023),.
[23]
Yingao L., Fei Y., Yidong Y., A partial convolution generative adversarial network for lesion synthesis and enhanced liver tumor segmentation, J. Appl. Clin. Med. Phys. 24 (4) (2023) 13927,.
[24]
Qianmu X., Zhao L., End-to-end 3D liver CT image synthesis from vasculature using a multi-task conditional generative adversarial network, Appl. Sci. 11 (2023) 6784,.
[25]
Yang Y., et al., Spatial attention-guided generative adversarial network for synthesizing contrast-enhanced computed tomography images, in: 2023 45 Th Annual International Conference of the IEEE Engineering in Medicine Biology Society, 2023, pp. 1–4,.
[26]
Yang P., et al., Four-dimensional cone beam CT imaging using a single routine scan via deep learning, IEEE Trans. Med. Imaging 42 (5) (2023) 1495–1508,.
[27]
Renao Y., Unpaired virtual histological staining using prior-guided generative adversarial networks, Comput. Med. Imaging Graph. 105 (2023),.
[28]
Lingyu C., et al., Anatomy preserving GAN for realistic simulation of intraoperative liver ultrasound images, Comput. Methods Programs Biomed. (2023),.
[29]
Sébastien M., et al., Generative adversarial networks (GAN)-based data augmentation of rare liver cancers: The SFR 2021 artificial intelligence data challenge, Diagn. Interv. Imaging. 104 (1) (2023) 43–48,.
[30]
Jin H., Zhang Y., Chen W., Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentation, Knowl.-Based Syst. 250 (2022),.
[31]
Hong J., Chun-Ho Yu S., Chen W., Unsupervised domain adaptation for cross-modality liver segmentation via joint adversarial learning and self-learning, Appl. Soft Comput. 121 (2022),.
[32]
Su H., Attention-guided cascaded network with pixel-importance-balance loss for retinal vessel segmentation, Front. Cell Dev. Biol. 11 (2023),.
[33]
Li S., Zhao S., Zhang Y., Hong J., Chen W., Source-free unsupervised adaptive segmentation for knee joint MRI, Biomed. Signal Process. Control 92 (2024),.
[34]
Ioffe S., Szegedy C., Batch normalization: accelerating deep network training by reducing internal covariate shift, Proc. 32th Int. Conf. Mach. Learn., 2015, pp. 448–456. arXiv:1502.03167.
[35]
Xiao J., et al., Tiny object detection with context enhancement and feature purification, Expert Syst. Appl. 211 (2023),.
[36]
Patrick B., et al., The liver tumor segmentation benchmark (LiTS), Med. Image Anal. 84 (2019),.
[37]
S. Amber L., et al. A large annotated medical image dataset for the development and evaluation of segmentation algorithms, arXiv:1902.09063.
[38]
Liu B., et al., Towards faster and stabilized gan training for high-fidelity few-shot image synthesis, Proc. Int. Conf. Learn. Represent. (2021) arXiv.2101.04775.
[39]
Kong L., Lian C., Huang D., li Z., Hu Y., Zhou Q., Breaking the dilemma of medical image-to-image translation, Neural Inf. Process. Syst. (2021) arXiv:2110.06465.
[40]
Ge N., Liu Y., Xu X., Zhang X., Jiang M., A fast generative adversarial network for high-fidelity optical coherence tomography image synthesis, Photonics 9 (12) (2022) 944,.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computer Methods and Programs in Biomedicine
Computer Methods and Programs in Biomedicine  Volume 254, Issue C
Sep 2024
544 pages

Publisher

Elsevier North-Holland, Inc.

United States

Publication History

Published: 01 September 2024

Author Tags

  1. Generative adversarial network
  2. Liver tumor
  3. Classification
  4. CT

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media