Abstract
In recent years, the rapid development of spatial transcriptome technology has fundamentally transformed our understanding of gene expression regulation within complex biological systems. However, the widespread application of spatial transcriptome technology in large-scale studies is hindered by its high cost and complexity. An economical alternative involves utilizing artificial intelligence to predict gene expression information from entire slices of histological images stained with hematoxylin and eosin (H &E). Nevertheless, existing methods fall short in extracting profound information from pathological images. In this paper, we propose STco, a multi-modal contrastive learning framework which comprehensively integrates multi-modal information, including histological images, gene expression features of spots, positional information of spots, and methods for aggregating gene expression. We utilized spatial transcriptomics data from two different tumors generated by the 10 times Genomics platform: human HER2 positive breast cancer (HER2+) and human cutaneous squamous cell carcinoma (cSCC) datasets. The experimental results demonstrate the superiority of STco compared to other methods in predicting gene expression profiles from histological images. Additionally, STco has proven its capability to interpret cancer-specific highly expressed genes. Our code is available at https://github.com/shizhiceng/STco.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Moses, L., Pachter, L.: Museum of spatial transcriptomics. Nat. Methods 19(5), 534–546 (2022)
Li, X., Min, W., Wang, S., Wang, C., Xu, T.: stMCDI: masked conditional diffusion model with graph neural network for spatial transcriptomics data imputation (2024). arXiv preprint. arXiv:2403.10863
Sun, S., et al.: Statistical analysis of spatial expression patterns for spatially resolved transcriptomic studies. Nat. Methods 17(2), 193–200 (2020)
Waylen, L.N., Nim, H.T., Martelotto, L.G., Ramialison, M.: From whole-mount to single-cell spatial assessment of gene expression in 3D. Commun. Biol. 3(1), 602–613 (2020)
Crosetto, N., Bienko, M., Van Oudenaarden, A.: Spatially resolved transcriptomics and beyond. Nat. Rev. Genet. 16(1), 57–66 (2015)
Moor, A.E., Itzkovitz, S.: Spatial transcriptomics: paving the way for tissue-level systems biology. Curr. Opin. Biotechnol. 46, 126–133 (2017)
Schmauch, B., et al.: A deep learning model to predict RNA-seq expression of tumours from whole slide images. Nat. Commun. 11(1), 3877–3892 (2020)
He, B., et al.: Integrating spatial gene expression and breast tumour morphology via deep learning. Nat. Biomed. Eng. 4(8), 827–834 (2020)
Pang, M., Su, K., Li, M.: Leveraging information in spatial transcriptomics to predict super-resolution gene expression from histology images in tumors. bioRxiv 1–31 (2021)
Zeng, Y., et al.: Spatial transcriptomics prediction from histology jointly through transformer and graph neural networks. Briefings Bioinform. 23(5), bbac297 (2022)
Xie, R., et al.: Spatially resolved gene expression prediction from histology images via bi-modal contrastive learning. Adv. Neural Inf. Process. Syst. 36 (2024)
Jia, V., Liu, J., Chen, L., Zhao, T., Wang, Y.: THItoGene: a deep learning method for predicting spatial transcriptomics from histological images. Briefings Bioinform. 25(1), bbad464 (2024)
Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. ICLR 1–22 (2021)
Xu, K., Li, C., Tian, Y., Sonobe, T., Kawarabayashi, K.I., Jegelka, S.: Representation learning on graphs with jumping knowledge networks. In: International Conference On Machine Learning, pp. 5453–5462. PMLR, 2018
Andersson, A., et al.: Spatial deconvolution of HER2-positive breast cancer delineates tumor-associated cell type interactions. Nat. Commun. 12(1), 6012 (2021)
Ji, A.L., et al.: Multimodal analysis of composition and spatial architecture in human squamous cell carcinoma. Cell 182(2), 497–514 (2020)
Radford, A., et al.: Learning transferable visual models from natural language supervision. In: International Conference on Machine Learning, pp. 8748–8763. PMLR, 2021
Hu, J., et al.: Deciphering tumor ecosystems at super resolution from spatial transcriptomics with tesla. Cell Syst. 14(5), 404–417 (2023)
Cohen, I., et al.: Pearson correlation coefficient. Noise Reduction Speech Proc. pp. 1–4 (2009). https://doi.org/10.1007/978-3-642-00296-0_5
Rand, W.M.: Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66(336), 846–850 (1971)
Jin, X., Zhu, L., Cui, Z., Tang, J., Xie, M., Ren, G.: Elevated expression of GNAS promotes breast cancer cell proliferation and migration via the PI3K/AKT/SNAIL1/E-cadherin axis. Clin. Transl. Oncol. 21, 1207–1219 (2019)
Wang, Y., Hui, X., Zhu, B., Qiu, Z., Lin, Z.: Systematic identification of the key candidate genes in breast cancer stroma. Cell. Mol. Biol. Lett. 23, 1–15 (2018)
Schroeder, B., et al.: Fatty acid synthase (FASN) regulates the mitochondrial priming of cancer cells. Cell Death Dis. 12(11), 977–987 (2021)
Schmidt, M., et al.: Prognostic impact of immunoglobulin kappa C (IGKC) in early breast cancer. Cancers, 13(1–14), 3626–3639 (2021)
Acknowledgements
The work was supported in part by the National Natural Science Foundation of China (No. 62262069), in part by the Yunnan Talent Development Program - Youth Talent Project and the Yunnan Fundamental Research Projects under Grant (No. 202201AT070469).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Shi, Z., Zhu, F., Wang, C., Min, W. (2024). Spatial Gene Expression Prediction from Histology Images with STco. In: Peng, W., Cai, Z., Skums, P. (eds) Bioinformatics Research and Applications. ISBRA 2024. Lecture Notes in Computer Science(), vol 14954. Springer, Singapore. https://doi.org/10.1007/978-981-97-5128-0_8
Download citation
DOI: https://doi.org/10.1007/978-981-97-5128-0_8
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5127-3
Online ISBN: 978-981-97-5128-0
eBook Packages: Computer ScienceComputer Science (R0)