Abstract
The three-dimensional information in CT scans reveals notorious findings in the medical context, also for detecting symptoms of COVID-19 in chest CT scans. However, due to the lack of availability of large-scale datasets in 3D, the use of attention-based models in this field is proven to be difficult. With transfer learning, this work tackles this problem, investigating the performance of a pre-trained TimeSformer model, which was originally developed for video classification, on COVID-19 classification of three-dimensional chest CT scans. The attention-based model outperforms a DenseNet baseline. Furthermore, we propose three new attention schemes for TimeSformer improving the accuracy of the model by 1.5% and reducing runtime by almost 25% compared to the original attention scheme.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ardakani, A.A., Kanafi, A.R., Acharya, U.R., Khadem, N., Mohammadi, A.: Application of deep learning technique to manage covid- 19 in routine clinical practice using CT images: results of 10 convolutional neural networks. Computers in biology and medicine 121 (2020)
Bertasius, G., Wang, H., Torresani, L.: Is space-time attention all you need for video understanding? In: ICML, vol. 2, p. 4 (2021)
Dosovitskiy, A., Beyer, L., Kolesnikov, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
He, X., et al.: Benchmarking deep learning models and automated model design for covid-19 detection with chest CT scans. MedRxiv (2021)
Hatamizadeh, A., Tang, Y., Nath, V., et al.: Unetr: transformers for 3D medical image segmentation. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 574–584 (2022)
Hsu, C.-C., Chen, G.-L., Wu, M.-H.: Visual transformer with statistical test for covid-19 classification. arXiv preprint arXiv:2107.05334 (2021)
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)
Kollias, D., Arsenos, A., Soukissian, L., Kollias, S.: Mia-cov19d: Covid-19 detection through 3-D chest CT image analysis. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 537–544 (2021)
Li, L., Qin, L., Xu, Z., et al.: Using artificial intelligence to detect COVID-19 and community-acquired pneumonia based on pulmonary CT: evaluation of the diagnostic accuracy. Radiology 296(2), 65–71 (2020)
Mishra, A.K., Das, S.K., Roy, P.: Bandyopadhyay, S.: Identifying covid19 from chest CT images: a deep convolutional neural networks based approach. J. Healthcare Eng. (2020)
Pham, T.D.: A comprehensive study on classification of COVID-19 on computed tomography with pretrained convolutional neural networks. Sci. Rep. 10(1), 1–8 (2020)
Shakouri, S., et al.: Covid19-CT-dataset: an open-access chest CT image repository of 1000+ patients with confirmed covid-19 diagnosis. BMC Res Notes (2021)
Shamshad, F., et al.: Transformers in medical imaging: a survey. arXiv preprint arXiv:2201.09873 (2022)
Shin, Y., Eo, T., Rha, H., et al.: Digestive Organ Recognition in Video Capsule Endoscopy Based on Temporal Segmentation Network. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds.) MICCAI 2022. LNCS, vol. 13437, pp. 136–146. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-16449-1_14
Woolson, R.F.: Wilcoxon signed-rank test. Wiley encyclopedia of clinical trials, 1–3 (2007)
Zhang, K., Liu, X., Shen, J., et al.: Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of covid-19 pneumonia using computed tomography. Cell 181(6), 1423–1433 (2020)
Zhang, L., Wen, Y.: A transformer-based framework for automatic covid19 diagnosis in chest CTs. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 513–518 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Hartmann, K., Hortal, E. (2023). COVID-19 Diagnosis in 3D Chest CT Scans with Attention-Based Models. In: Juarez, J.M., Marcos, M., Stiglic, G., Tucker, A. (eds) Artificial Intelligence in Medicine. AIME 2023. Lecture Notes in Computer Science(), vol 13897. Springer, Cham. https://doi.org/10.1007/978-3-031-34344-5_27
Download citation
DOI: https://doi.org/10.1007/978-3-031-34344-5_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-34343-8
Online ISBN: 978-3-031-34344-5
eBook Packages: Computer ScienceComputer Science (R0)