[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Semi-supervised Learning for Segmentation of Bleeding Regions in Video Capsule Endoscopy

Published: 27 February 2024 Publication History

Abstract

In the realm of modern diagnostic technology, video capsule endoscopy (VCE) is a standout for its high efficacy and non-invasive nature in diagnosing various gastrointestinal (GI) conditions, including obscure bleeding. Importantly, for the successful diagnosis and treatment of these conditions, accurate recognition of bleeding regions in VCE images is crucial. While deep learning-based methods have emerged as powerful tools for the automated analysis of VCE images, they often demand large training datasets with comprehensive annotations. Acquiring these labeled datasets tends to be time-consuming, costly, and requires significant domain expertise. To mitigate this issue, we have embraced a semi-supervised learning (SSL) approach for the bleeding regions segmentation within VCE. By adopting the ‘Mean Teacher’ method, we construct a student U-Net equipped with an scSE attention block, alongside a teacher model of the same architecture. These models’ parameters are alternately updated throughout the training process. We use the Kvasir-Capsule dataset for our experiments, which encompasses various GI bleeding conditions. Notably, we develop the segmentation annotations for this dataset ourselves. The findings from our experiments endorse the efficacy of the SSL-based segmentation strategy, demonstrating its capacity to reduce reliance on large volumes of annotations for model training, without compromising on the accuracy of identification.

References

[1]
T. Aoki, A. Yamada, Y. Kato, H. Saito, A. Tsuboi, A. Nakada, R. Niikura, M. Fujishiro, S. Oka, S. Ishihara, et al., Automatic detection of blood content in capsule endoscopy images based on a deep convolutional neural network, Journal of gastroenterology and hepatology 35 (2020) 1196–1200.
[2]
V. Badrinarayanan, A. Kendall, R. Cipolla, Segnet: A deep convolutional encoder-decoder architecture for image segmentation, IEEE transactions on pattern analysis and machine intelligence 39 (2017) 2481–2495.
[3]
L. Bai, T. Chen, Y. Wu, A. Wang, M. Islam, H. Ren, arXiv preprint, 2023.
[4]
L. Bai, M. Islam, L. Seenivasan, H. Ren, arXiv preprint, 2023.
[5]
L. Bai, L. Wang, T. Chen, Y. Zhao, H. Ren, Transformer-based disease identification for small-scale imbalanced capsule endoscopy dataset, Electronics 11 (2022) 2747.
[6]
A. Chaurasia, E. Culurciello, Linknet: Exploiting encoder representations for efficient semantic segmentation, 2017 IEEE visual communications and image processing (VCIP) (2017) 1–4.
[7]
H. Che, S. Chen, H. Chen, Image quality-aware diagnosis via meta-knowledge co-embedding, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 19819–19829.
[8]
A. Chebli, A. Djebbar, H.F. Marouani, Semi-supervised learning for medical application: A survey, in: 2018 International Conference on Applied Smart Systems (ICASS), IEEE, 2018, pp. 1–9.
[9]
D.K. Iakovidis, A. Koulaouzidis, Software for enhanced video capsule endoscopy: challenges for essential progress, Nature Reviews Gastroenterology & Hepatology 12 (2015) 172–186.
[10]
G. Iddan, G. Meron, A. Glukhovsky, P. Swain, Wireless capsule endoscopy, Nature 405 (2000) 417. 417.
[11]
X. Jia, M.Q.H. Meng, Gastrointestinal bleeding detection in wireless capsule endoscopy images using handcrafted and cnn features, in: 2017 39th annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC),, IEEE, 2017, pp. 3154–3157.
[12]
G. Litjens, T. Kooi, B.E. Bejnordi, A.A.A. Setio, F. Ciompi, M. Ghafoorian, J.A. Van Der Laak, B. Van Ginneken, C.I. Sánchez, A survey on deep learning in medical image analysis, Medical image analysis 42 (2017) 60–88.
[13]
A. Mustafa, R.K. Mantiuk, Transformation consistency regularization–a semi-supervised paradigm for image-to-image translation, in: Computer Vision–ECCV 2020: 16th European Conference, Springer, 2020, pp. 599–615. August 23–28, 2020, Proceedings.
[14]
A. Oliver, A. Odena, C.A. Rafel, E.D. Cubuk, I. Goodfellow, Realistic evaluation of deep semi-supervised learning algorithms, Advances in neural information processing systems 31 (2018).
[15]
A. Paszke, A. Chaurasia, S. Kim, E. Culurciello, Enet: A deep neural network architecture for real-time semantic segmentation, arXiv preprint (2016) arXiv:1606.02147.
[16]
J. Peng, G. Estrada, M. Pedersoli, C. Desrosiers, Deep co-training for semi-supervised image segmentation, Pattern Recognition 107 (2020).
[17]
A. Postgate, A. Haycock, S. Thomas-Gibson, A. Fitzpatrick, P. Bassett, S. Preston, B.P. Saunders, C. Fraser, Computer-aided learning in capsule endoscopy leads to improvement in lesion recognition ability, Gastrointestinal endoscopy 70 (2009) 310–316.
[18]
O. Ronneberger, P. Fischer, T. Brox, U-net: Convolutional networks for biomedical image segmentation, in: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Springer, 2015, pp. 234–241. October 5-9, 2015.
[19]
A.G. Roy, N. Navab, C. Wachinger, Concurrent spatial and channel ‘squeeze & excitation'in fully convolutional networks, in: Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Springer, 2018, pp. 421–429. September 16-20, 2018.
[20]
P.H. Smedsrud, V. Thambawita, S.A. Hicks, H. Gjestang, O.O. Nedrejord, E. Næss, H. Borgli, D. Jha, T.J.D. Berstad, S.L. Eskeland, et al., Kvasir-capsule, a video capsule endoscopy dataset, Scientifc Data 8 (2021) 142.
[21]
S. Soffer, E. Klang, O. Shimon, N. Nachmias, R. Eliakim, S. Ben-Horin, U. Kopylov, Y. Barash, Deep learning for wireless capsule endoscopy: a systematic review and meta-analysis, Gastrointestinal endoscopy 92 (2020) 831–839.
[22]
A. Tarvainen, H. Valpola, Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results, Advances in neural information processing systems 30 (2017).
[23]
A. Torralba, B.C. Russell, J. Yuen, Labelme: Online image annotation and applications, Proceedings of the IEEE 98 (2010) 1467–1484.
[24]
Y. Wu, R. Du, J. Feng, S. Qi, H. Pang, S. Xia, W. Qian, Deep cnn for copd identification by multi-view snapshot integration of 3d airway tree and lung field, Biomedical Signal Processing and Control 79 (2023).
[25]
Y. Wu, S. Qi, Y. Sun, S. Xia, Y. Yao, W. Qian, A vision transformer for emphysema classification using ct images, Physics in Medicine & Biology 66 (2021).
[26]
Y. Wu, S. Zhao, S. Qi, J. Feng, H. Pang, R. Chang, L. Bai, M. Li, S. Xia, W. Qian, et al., Two-stage contextual transformer-based convolutional neural network for airway extraction from ct images, arXiv preprint (2022) arXiv:2212.07651.
[27]
Q. Xie, M.T. Luong, E. Hovy, Q.V. Le, Self-training with noisy student improves imagenet classification, in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 10687–10698.
[28]
X. Yan, S. Hu, Y. Mao, Y. Ye, H. Yu, Deep multi-view learning methods: A review, Neurocomputing 448 (2021) 106–129.
[29]
Y. Zhang, L. Bai, L. Liu, H. Ren, M.Q.H. Meng, Deep reinforcement learning-based control for stomach coverage scanning of wireless capsule endoscopy, in: 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO), IEEE, 2022, pp. 01–06.
[30]
S. Zhao, Y. Wu, M. Tong, Y. Yao, W. Qian, S. Qi, Cot-xnet: contextual transformer with xception network for diabetic retinopathy grading, Physics in Medicine & Biology 67 (2022).

Index Terms

  1. Semi-supervised Learning for Segmentation of Bleeding Regions in Video Capsule Endoscopy
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image Procedia Computer Science
          Procedia Computer Science  Volume 226, Issue C
          2023
          158 pages
          ISSN:1877-0509
          EISSN:1877-0509
          Issue’s Table of Contents

          Publisher

          Elsevier Science Publishers B. V.

          Netherlands

          Publication History

          Published: 27 February 2024

          Author Tags

          1. Bleeding regions segmentation
          2. Medical image segmentation
          3. Semi-supervised learning
          4. Video capsule endoscopy

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • 0
            Total Citations
          • 0
            Total Downloads
          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 13 Dec 2024

          Other Metrics

          Citations

          View Options

          View options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media