Unsupervised domain adaptation with local structure preservation for colon histopathological image classification
Pages 1129 - 1142
Abstract
The histopathological image classification method, based on deep learning, can be used to assist pathologists in cancer recognition in colon histopathology. The popularization of automatic and accurate histopathological image classification methods in this way is of great significance. However, smaller medical institutions with limited medical resources may lack colon histopathology image training sets with reliable labeled information; thus they may be unable to meet the needs of deep learning for many labeled training samples. Therefore, in this paper, the colon histopathological image set with rich label information from a certain medical institution is taken as the source domain; the colon histopathological image set from a smaller medical institution with limited medical resources is taken as the target domain. Considering the potential differences between histopathological images obtained by different institutions, this paper proposes a classification learning framework, namely unsupervised domain adaptation with local structure preservation for colon histopathological image classification, which can learn an adaptive classifier by performing distribution alignment and preserving intra-domain local structure to predict the labels of the colon histopathological images from institutions with lower medical resources. Extensive experiments demonstrate that the proposed framework shows significant improvement in accuracy and specificity of colon histopathological images without reliable labeled information compared to models without unsupervised domain adaptation. Specifically, in an affiliated hospital in Fuyang City, Anhui Province, the classification accuracy of benign and malignant colon histopathological images reaches 96.21%. The results of comparative experiments also show promising classification performance of our method in comparison with other unsupervised domain adaptation methods.
References
[1]
Bray F. et al. Global cancer statistics: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries, CA Cancer J Clinicians 71(3) (2021), 209–249.
[2]
Siegel R.L., Miller K.D. and Jemal A., Cancer statistics, CA: Cancer J Clinicians 70(1) (2020), 7–30.
[3]
Litjens G. Journal of Intelligent A survey on deep learning in medical image analysis, Med Image Anal 42 (2017), 60–88.
[4]
Subha K.J., Rajavel R. and Paulchamy B., Improved ensemble deep learning based retinal disease detection using image processing, Journal of Intelligent & Fuzzy Systems 45(1) (2023), 1119–1130.
[5]
Iqbal S. and Qureshi A.N., Deep-Hist: Breast cancer diagnosis through histopathological images using convolution neural network, &, Fuzzy Systems 43(1) (2022), 1347–1364.
[6]
Sarwinda D., Bustamam A., Paradisa R.H., Argyadiva T., Mangunwardoyo W. Analysis of deep feature extraction for colorectal cancer detection, in Proc. Int. Conf. Informatics and Computational Sciences (ICICoS), 2020, pp. 1–5.
[7]
Masud M., Sikder N., Nahid A.A., Bairagi A.K. and AlZain M.A., A machine learning approach to diagnosing lung and colon cancer using a deep learning-based classification framework, Sensors 21(3) (2021), 748.
[8]
Bayramoglu N., Heikkilä J. Transfer learning for cell nuclei classification in histopathology images, in Proc ECCV, Amsterdam, Netherlands: Springer, 2016, pp. 532–539.
[9]
Riasatian A. et al. Fine-Tuning and training of densenet for histopathology image representation using TCGA diagnostic slides, Med Image Anal 70 (2021), 102032.
[10]
Daume H. and Marcu D., Domain adaptation for statistical classifiers, J Artif Intell Res 26 (2006), 101–126.
[11]
Pan S.J., Tsang I.W., Kwok J.T. and Yang Q., Domain adaptation via transfer component analysis, IEEE Trans Neural Netw 22(2) (2011), 199–210.
[12]
Xu Y., Lang H., Niu L. and Ge C., Discriminative adaptation regularization framework-based transfer learning for ship classification in SAR images, IEEE Geosci Remote Sens Lett 16(11) (2019), 1786–1790.
[13]
Liu Y., Kang K., Huang Y., Wang K. and Yang G., Unsupervised domain adaptation semantic segmentation for remote-sensing images via covariance attention, IEEE Geoscience and Remote Sensing Letters 19 (2022), 6513205.
[14]
Koehler S. et al. Unsupervised domain adaptation from axial to short-axis multi-slice cardiac MR images by incorporating pretrained task networks, IEEE Trans Med Imag 40(10) (2021), 2939–2953.
[15]
Cao Y., Long M., Wang J. Unsupervised domain adaptation with distribution matching machines, in Proc AAAI Conf Artif Intell, 2018, pp. 2795–2802.
[16]
Fernando B., Habrard A., Sebban M., Tuytelaars T. Unsupervised visual domain adaptation using subspace alignment, in Proc IEEE Int Conf Comput Vis, 2013, pp. 2960–2967.
[17]
Gopalan R., Li R., Chellappa R. Domain adaptation for object recognition: An unsupervised approach, in Proc IEEE Int Conf Comput Vis, 2011, pp. 999–1006.
[18]
Gopalan R., Li R. and Chellappa R., Unsupervised adaptation across domain shifts by generating intermediate data representations, IEEE Trans Pattern Anal Mach Intell 36(11) (2014), 2288–2302.
[19]
Gong B., Shi Y., Sha F., Grauman K. Geodesic flow kernel for unsupervised domain adaptation, in Proc IEEE Conf ComputVisPattern Recognit (CVPR), 2012, pp. 2066–2073.
[20]
Courty N., Flamary R., Tuia D. Domain adaptation with regularized optimal transport, in Proc Joint Eur Conf Mach Learn Knowl Discovery Databases, 2014, pp. 274–289.
[21]
Courty N., Flamary R., Tuia D. and Rakotomamonjy A., Optimal transport for domain adaptation, IEEE Trans Pattern Anal Mach Intell 39(9) (2017), 1853–1865.
[22]
Long M., Wang J., Ding G., Sun J., Yu P.S. Transfer feature learning with joint distribution adaptation, in Proc IEEE Int Conf Comput Vis, 2013, pp. 2200–2207.
[23]
Wang Z., Du B. and Guo Y., Domain adaptation with neural embedding matching, IEEE Trans Neural Netw Learn Syst 31(7) (2020), 2387–2397.
[24]
Meng M., Lan M., Yu J., Wu J. and Liu L., Dual-level adaptive and discriminative knowledge transfer for cross-domain recognition, IEEE Trans Multimedia 25 (2022), 2266–2279.
[25]
Long M., Wang J., Ding G., Pan S.J. and Yu P.S., Adaptation regularization: A general framework for transfer learning, IEEE Trans Knowl Data Eng 26(5) (2014), 1076–1089.
[26]
Xiao T., Liu P., Zhao W., Liu H. and Tang X., Structure preservation and distribution alignment in discriminative transfer subspace learning, Neurocomputing 337 (2019), 218–234.
[27]
He K., Zhang X., Ren S., Sun J. Deep residual learning for image recognition, in Proc IEEE Conf Comput Vis Pattern Recognit (CVPR), 2016, pp. 770–778.
[28]
Srinidhi C.L., Ciga O. and Martel A.L., Deep neural network models for computational histopathology: A survey, Med Image Anal 67 (2020), 101813.
[29]
Brancati N., Frucci M., Riccio D. Multi-classification of breast cancer histology images by using a fine-tuning strategy, in Proc Int Conf Image Anal Recognit, Cham, Switzerland: Springer, 2018, pp. 771–778.
[30]
Kieffer B., Babaie M., Kalra S., Tizhoosh H.R. Convolutional neural networks for histopathology image classification: Training vs. using pre-trained networks, in Proc 7th Int Conf Image Process Theory Tools Appl (IPTA), IEEE, 2017, pp. 1–6.
[31]
Awan R., Koohbanani N.A., Shaban M., Lisowska A., Rajpoot N. Context-aware learning using transferable features for classification of breast cancer histology images, in Proc Int Conf Image Anal Recognit, Cham, Switzerland: Springer, 2018, pp. 788–795.
[32]
Wang P. et al. Cross-task extreme learning machine for breast cancer image classification with deep convolutional features, Biomed Signal Process Control 57 (2020), 101789.
[33]
Abu Al-Haija Q., Adebanjo A. Breast cancer diagnosis in histopathological images using ResNet-50 convolutional neural network, in Proc IEEE Int IOT Electron Mechatron Conf (IEMTRONICS), IEEE, 2020, pp. 96–102.
[34]
Celik Y., Talo M., Yildirim O., karabatak M. and Acharya U.R., Automated invasive ductal carcinoma detection based using deep transfer learning with whole-slide images, Pattern Recogn Lett 133 (2020), 232–239.
[35]
Hekler A et al. Pathologist-level classification of histopathological melanoma images with deep neural networks, Eur J Cancer 115 (2019), 79–83.
[36]
Gretton A., Borgwardt K., Rasch M., Schölkopf B., Smola A.J. kernel method for the two-sample-problem, in Proc NIPS, 2006, pp. 513–520.
[37]
Tian Y., Li B. K-Nearest Neighbor based local distribution alignment, in Proc Int Conf Intell Comput, 2022, pp. 470–480.
[38]
Li L., Yang J., Kong X. and Ma Y., Discriminative transfer feature learning based on robust-centers, Neurocomputing 500 (2022), 39–57.
[39]
Khan G.A., Hu J., Li T., Diallo B. and Wang H., Multi-view clustering for multiple manifold learning via concept factorization, Digital Signal Processing 40 (2023), 104118.
[40]
Diallo B., Hu J., Li T., Khan G.A., Liang X. and Wang H., Auto-attention mechanism for multi-view, deep embedding clustering, Pattern Recognition 143 (2023), 109764.
[41]
Wang J., Chen Y., Feng W., Yu H., Huang M. and Yang Q., Transfer learning with dynamic distribution adaptation, (1), ACM Transactions on Intelligent Systems and Technology (TIST) 11 (2020), 1–25.
[42]
Schölkopf B., Herbrich R., Smola A.J. A generalized representer theorem, in Proc Annu Conf Comput Learning Theory, 2001, pp. 416–426.
[43]
He X., Niyogi P. Locality preserving projections, in Proc NIPS, 2004, pp. 153–160.
[44]
Masud M., Sikder N., Nahid A.A., Bairagi A.K. and AlZain M.A., A machine learning approach to diagnosing lung and colon cancer using a deep learning-based classification framework, Sensors 21(3) (2021), 748.
[45]
Macenko M. et al. A method for normalizing histology slides for quantitative analysis, in Proc IEEE Int Symp Biomed Imag From Nano Macro, 2009, pp. 1107–1110.
[46]
Zhang J., Li W., Ogunbona P. Joint geometrical and statistical alignment for visual domain adaptation, in Proc IEEE Conf Comput Vis Pattern Recognit (CVPR), 2017, pp. 5150–5158
[47]
Wang W., Shen Z., Li D., Zhong P. and Chen Y., Probability-based graph embedding cross-domain and class discriminative feature learning, IEEE Trans Image Proc 32 (2022), 72–87.
[48]
Long M., Cao Y., Wang J., Jordan M.I. Learning transferable features with deep adaptation networks, in Proc Int Conf Mach Learn, 2015, pp. 97–105.
[49]
Long M., Zhu H., Wang J., Jordan M.I. Deep transfer learning with joint adaptation networks, in Proc Int Conf Mach Learn, 2017, pp. 2208–2217.
[50]
Long M., Cao Z., Wang J., Jordan M.I. Conditional adversarial domain adaptation, in Proc NIPS, 2018, pp. 1647–1657.
[51]
Li S., Xie B., Lin Q., Liu C.H., Huang G. and Wang G., Generalized domain conditioned adaptation network, IEEE Trans Pattern Anal Mach Intell 44(8) (2022), 4093–4109.
Recommendations
DACTransNet: A Hybrid CNN-Transformer Network for Histopathological Image Classification of Pancreatic Cancer
Artificial IntelligenceAbstractAutomated and accurate classification of histopathological images of pancreatic cancer can lead to higher survival rates for more pancreatic cancer patients in the clinic. However, there are very scarce existing studies for pancreatic cancer, and ...
Colon cancer diagnosis and staging classification based on machine learning and bioinformatics analysis
AbstractAdvanced metastasis of colon cancer makes it more difficult to treat colon cancer. Finding the markers of colon cancer (Colon Cancer) can diagnose the stage of cancer in time and improve the prognosis with timely treatment. This paper uses gene ...
Highlights- Machine learning analysis combined with bioinformatics analysis to screen for markers.
- Random forests perform best in both colon cancer and colon cancer staging diagnosis.
- The accuracy of colon cancer diagnosis is greater than 98%.
Machine learning-based lung and colon cancer detection using deep feature extraction and ensemble learning
AbstractCancer is a fatal disease caused by a combination of genetic diseases and a variety of biochemical abnormalities. Lung and colon cancer have emerged as two of the leading causes of death and disability in humans. The histopathological detection ...
Highlights- A hybrid ensemble model to efficiently identify lung and colon cancer is introduced.
- Anticipated deep feature extraction to extract features from cancer datasets.
- An ensemble strategy is evolved to build a robust detection model.
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© 2024 – IOS Press. All rights reserved.
Publisher
IOS Press
Netherlands
Publication History
Published: 10 January 2024
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 17 Jan 2025