Abstract
Recently, multi-modal breast cancer survival prediction (MBCSP) has been widely researched and made huge progress. However, most existing MBCSP methods usually overlook the structural information among patients. While certain studies may address structural information, they often ignore the abundant semantic information within multi-modal data, despite its significant impact on the efficacy of cancer survival prediction. Herein, we propose a novel method for breast cancer survival prediction, termed graph convolutional networks based multi-modal data integration for breast cancer survival prediction (GMBS). In essence, GMBS firstly defines a series multi-modal fusion module to integrate diverse patient data modalities, yielding robust initial embeddings. Subsequently, GMBS introduces a patient-patient graph construction module, aiming to delineate inter-patient relationships effectively. Lastly, GMBS incorporates a Graph Convolutional Network framework to harness the intricate structural information encoded within the constructed graph. Extensive experiments on two well-known MBCSP datasets demonstrate the superior performance of GMBS method compared to representative baseline methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Han, B., Zheng, R., Zeng, H., Wang, S., Sun, K., Chen, R., et al.: Cancer incidence and mortality in china, 2022. J. National Cancer Center 4(1), 47–53 (2024)
Lukasiewicz, S., Czeczelewski, M., Forma, A., Baj, J., Sitarz, R., Stanis lawek, A.: Breast cancer—epidemiology, risk factors, classification, prognostic markers, and current treatment strategies—an updated review. Cancers 13(17), 4287 (2021)
Arya, N., Saha, S.: Multi-modal advanced deep learning architectures for breast cancer survival prediction. Knowl.-Based Syst. 221, 106965 (2021)
Sun, D., Wang, M., Li, A.: A multimodal deep neural network for human breast cancer prognosis prediction by integrating multi-dimensional data. IEEE/ACM Trans. Comput. Biol. Bioinf. 16(3), 841–850 (2019)
Sun, Y., Goodison, S., Li, J., Liu, L., et al.: Improved breast cancer prognosis through the combination of clinical and genetic markers. Bioinformatics 23(1), 30–37 (2007)
Van De Vijver, M.J., He, Y.D., et al.: A gene-expression signature as a predictor of survival in breast cancer. N. Engl. J. Med. 347(25), 1999–2009 (2002)
Gao, J., Lyu, T., Xiong, F., Wang, J., Ke, W., Li, Z.: Predicting the survival of cancer patients with multimodal graph neural network. IEEE/ACM Trans. Comput. Biol. Bioinf. 19(2), 699–709 (2021)
Guo, W., Liang, W., Deng, Q., Zou, X.: A multimodal affinity fusion network for predicting the survival of breast cancer patients. Front. Genet. 12 (2021)
Sun, D., Li, A., Tang, B., Wang, M.: Integrating genomic data and pathological images to effectively predict breast cancer clinical outcome. Comput. Methods Programs Biomed. 161, 45–53 (2018)
Sun, W., Cai, Z., Li, Y., Liu, F., Fang, S., et al.: Data processing and text mining technologies on electronic medical records: a review. J. Healthcare Eng, 2018 (2018)
Arya, N., Saha, S.: Multi-modal classification for human breast cancer prognosis prediction: proposal of deep-learning based stacked ensemble model. IEEE/ACM Trans. Comput. Biol. Bioinf. 19(2), 1032–1041 (2020)
Arya, N., Mathur, A., Saha, S.: Proposal of svm utility kernel for breast cancer survival estimation. IEEE/ACM Trans. Comput. Biol. Bioinf. 20(2), 1372–1383 (2022)
Palmal, S., Arya, N., Saha, S., Tripathy, S.: A multi-modal graph convolutional network for predicting human breast cancer prognosis. In: International Conference on Neural Information Processing, pp. 187–198. Springer (2022)
Kipf, T.N., Welling, M.: Variational graph auto-encoders. CoRR abs/1611.07308 (2016)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, 24–26 April 2017, Conference Track Proceedings. OpenReview.net (2017)
Ma, T., Chen, J., et al.: Constrained generation of semantically valid graphs via regularizing variational autoencoders. Adv. Neural Inform. Process. Syst. 31 (2018)
Perozzi, B., Al-Rfou, R., Skiena, S.: Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 701–710 (2014)
Chen, R.J., Lu, M.Y., Wang, J., Williamson, D.F., Rodig, S.J., et al.: Pathomic fusion: an integrated framework for fusing histopathology and genomic features for cancer diagnosis and prognosis. IEEE Trans. Med. Imaging 41(4), 757–770 (2020)
Subramanian, I., Verma, S., et al.: Multi-omics data integration, interpretation, and its application. Bioinform. Biol. Insights 14, 1177932219899051 (2020)
Ramírez-Gallego, S., Lastra, I., Martínez-Rego, D., et al.: Fast-mrmr: Fast minimum redundancy maximum relevance algorithm for high-dimensional big data. Int. J. Intell. Syst. 32(2), 134–152 (2017). https://doi.org/10.1002/int.21833
Liu, H., Kurc, T.: Deep learning for survival analysis in breast cancer with whole slide image data. Bioinformatics 38(14), 3629–3637 (2022)
Li, R., Wu, X., Li, A., Wang, M.: HFBSurv: hierarchical multimodal fusion with factorized bilinear models for cancer survival prediction. Bioinformatics 38(9), 2587–2594 (2022)
Wu, L., Cui, P., Pei, J., Zhao, L.: Graph Neural Networks: Foundations, Frontiers, and Applications. Springer Singapore (2022)
Palmal, S., Arya, N., Saha, S., Tripathy, S.: Breast cancer survival prognosis using the graph convolutional network with choquet fuzzy integral. Sci. Rep. 13(1), 14757 (2023)
Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. In: 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, 7–9 May 2015, Conference Track Proceedings (2015), http://arxiv.org/abs/1412.6980
Wei, Y., Su, Y.: Using machine learning and rna to enhance the efficacy of anti-tumor immunotherapy. Evol. Intel. 16(5), 1555–1563 (2023)
Howard, F.M., Dolezal, J., et al.: The impact of site-specific digital histology signatures on deep learning model accuracy and bias. Nat. Commun. 12(1), 4423 (2021)
Tharwat, A.: Classification assessment methods. Applied computing and informatics 17(1), 168–192 (2020)
Jefferson, M.F., Pendleton, N., Lucas, S.B., Horan, M.A.: Comparison of a genetic algorithm neural network with logistic regression for predicting outcome after surgery for patients with nonsmall cell lung carcinoma. Cancer: Interdisciplinary Inter. J. Am. Cancer Soc. 79(7), 1338–1342 (1997)
Nguyen, C., Wang, Y., Nguyen, H.N.: Random forest classifier combined with feature selection for breast cancer diagnosis and prognostic. J. Biomed. Sci. Eng. 06(05) (2013)
Xu, X., Zhang, Y., Zou, L., Wang, M., Li, A.: A gene signature for breast cancer prognosis using support vector machine. In: 2012 5th International Conference on Biomedical Engineering and Informatics, pp. 928–931. IEEE (2012)
Acknowledgments
This study was funded by the National Natural Science Foundation (NNSF) of China (No. 22074122) and the Fundamental Research Funds for the Central Universities (No. SWU-KT22029), China.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Hu, H., Liang, W., Zou, X., Zou, X. (2024). Graph Convolutional Networks Based Multi-modal Data Integration for Breast Cancer Survival Prediction. In: Huang, DS., Zhang, Q., Guo, J. (eds) Advanced Intelligent Computing in Bioinformatics. ICIC 2024. Lecture Notes in Computer Science(), vol 14881. Springer, Singapore. https://doi.org/10.1007/978-981-97-5689-6_8
Download citation
DOI: https://doi.org/10.1007/978-981-97-5689-6_8
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5688-9
Online ISBN: 978-981-97-5689-6
eBook Packages: Computer ScienceComputer Science (R0)