Applications of artificial intelligence in the analysis of histopathology images of gliomas: a review

Applications of AI


  • Ostrom, Q. T. et al. CBTRUS statistical report: primary brain and other central nervous system tumors diagnosed in the United States in 2016—2020. Neuro-Oncol 25, iv1–iv99 (2023).

    Article 
    PubMed 

    Google Scholar 

  • Weller, M. et al. Glioma. Nat. Rev. Dis. Primer 1, 15017 (2015).

    Article 

    Google Scholar 

  • Yang, K. et al. Glioma targeted therapy: insight into future of molecular approaches. Mol. Cancer 21, 39 (2022).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Stupp, R. et al. Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. N. Engl. J. Med. 352, 987–996 (2005).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Hegi, M. E. et al. MGMT gene silencing and benefit from temozolomide in glioblastoma. N. Engl. J. Med. 352, 997–1003 (2005).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Louis, D. N. et al. The 2021 WHO classification of tumors of the central nervous system: a summary. Neuro-Oncol 23, 1231–1251 (2021).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Horbinski, C., Berger, T., Packer, R. J. & Wen, P. Y. Clinical implications of the 2021 edition of the WHO classification of central nervous system tumours. Nat. Rev. Neurol. 18, 515–529 (2022).

    Article 
    PubMed 

    Google Scholar 

  • Echle, A. et al. Deep learning in cancer pathology: a new generation of clinical biomarkers. Br. J. Cancer 124, 686–696 (2021).

    Article 
    PubMed 

    Google Scholar 

  • Shmatko, A., Ghaffari Laleh, N., Gerstung, M. & Kather, J. N. Artificial intelligence in histopathology: enhancing cancer research and clinical oncology. Nat. Cancer 3, 1026–1038 (2022).

    Article 
    PubMed 

    Google Scholar 

  • van der Laak, J., Litjens, G. & Ciompi, F. Deep learning in histopathology: the path to the clinic. Nat. Med. 27, 775–784 (2021).

    Article 
    PubMed 

    Google Scholar 

  • Zhang, P. et al. Effective nuclei segmentation with sparse shape prior and dynamic occlusion constraint for glioblastoma pathology images. J. Med. Imaging 6, 017502 (2019).

    Article 

    Google Scholar 

  • Li, X., Wang, Y., Tang, Q., Fan, Z. & Yu, J. Dual U-Net for the segmentation of overlapping glioma nuclei. IEEE Access 7, 84040–84052 (2019).

    Article 

    Google Scholar 

  • Kurc, T. et al. Segmentation and classification in digital pathology for glioma research: challenges and deep learning approaches. Front. Neurosci. 14, 27 (2020).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Xu, Y. et al. Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features. BMC Bioinformatics 18, 281 (2017).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Fukuma, K., Surya Prasath, V. B., Kawanaka, H., Aronow, B. J. & Takase, H. A study on feature extraction and disease stage classification for Glioma pathology images. In 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) 2150–2156 https://doi.org/10.1109/FUZZ-IEEE.2016.7737958 (2016).

  • Kalra, S. et al. Pan-cancer diagnostic consensus through searching archival histopathology images using artificial intelligence. Npj Digit. Med. 3, 1–15 (2020).

    Article 

    Google Scholar 

  • Winkelmaier, G., Koch, B., Bogardus, S., Borowsky, A. D. & Parvin, B. Biomarkers of tumor heterogeneity in glioblastoma multiforme cohort of TCGA. Cancers 15, 2387 (2023).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Yuan, M. et al. Image-based subtype classification for glioblastoma using deep learning: prognostic significance and biologic relevance. JCO Clin. Cancer Inform. 8, e2300154, https://doi.org/10.1200/CCI.23.00154 (2024).

    Article 
    PubMed 

    Google Scholar 

  • Liu, X.-P. et al. Clinical significance and molecular annotation of cellular morphometric subtypes in lower-grade gliomas discovered by machine learning. Neuro-Oncol 25, 68–81 (2023).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Song, J. et al. Enhancing spatial transcriptomics analysis by integrating image-aware deep learning methods. in Biocomputing 2024 450–463 (WORLD SCIENTIFIC, 2023). https://doi.org/10.1142/9789811286421_0035.

  • Zadeh Shirazi, A. et al. A deep convolutional neural network for segmentation of whole-slide pathology images identifies novel tumour cell-perivascular niche interactions that are associated with poor survival in glioblastoma. Br. J. Cancer 125, 337–350 (2021).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Zheng, Y., Carrillo-Perez, F., Pizurica, M., Heiland, D. H. & Gevaert, O. Spatial cellular architecture predicts prognosis in glioblastoma. Nat. Commun. 14, 4122 (2023).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Luo, J., Pan, M., Mo, K., Mao, Y. & Zou, D. Emerging role of artificial intelligence in diagnosis, classification and clinical management of glioma. Semin. Cancer Biol. 91, 110–123 (2023).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Zadeh Shirazi, A. et al. The application of deep convolutional neural networks to brain cancer images: a survey. J. Pers. Med. 10, 224 (2020).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Sotoudeh, H. et al. Artificial intelligence in the management of glioma: era of personalized medicine. Front. Oncol. 9, 768 (2019).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Philip, A. K., Samuel, B. A., Bhatia, S., Khalifa, S. A. M. & El-Seedi, H. R. Artificial intelligence and precision medicine: a new frontier for the treatment of brain tumors. Life 13, 24 (2023).

    Article 
    CAS 

    Google Scholar 

  • Jin, W. et al. Artificial intelligence in glioma imaging: challenges and advances. J. Neural Eng. 17, 021002 (2020).

    Article 
    PubMed 

    Google Scholar 

  • Cè, M. et al. Artificial intelligence in brain tumor imaging: a step toward personalized medicine. Curr. Oncol. 30, 2673–2701 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Liu, Y. & Wu, M. Deep learning in precision medicine and focus on glioma. Bioeng. Transl. Med. 8, e10553 (2023).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Bhatele, K. R. & Bhadauria, S. S. Machine learning application in Glioma classification: review and comparison analysis. Arch. Comput. Methods Eng. 29, 247–274 (2022).

    Article 

    Google Scholar 

  • Muhammad, K., Khan, S., Ser, J. D. & Albuquerque, V. H. C. Deep learning for multigrade brain tumor classification in smart healthcare systems: a prospective survey. IEEE Trans. Neural Netw. Learn. Syst. 32, 507–522 (2021).

    Article 
    PubMed 

    Google Scholar 

  • Zhao, R. & Krauze, A. Survival prediction in gliomas: current state and novel approaches. Exon Publ. 151–169 https://doi.org/10.36255/exonpublications.gliomas.2021.chapter9 (2021).

  • Alleman, K. et al. Multimodal deep learning-based prognostication in glioma patients: a systematic review. Cancers 15, 545 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Wijethilake, N. et al. Glioma survival analysis empowered with data engineering—a survey. IEEE Access 9, 43168–43191 (2021).

    Article 

    Google Scholar 

  • Faust, K. et al. Integrating morphologic and molecular histopathological features through whole slide image registration and deep learning. Neuro-Oncol. Adv. 4, vdac001 (2022).

    Article 

    Google Scholar 

  • Pytlarz, M., Wojnicki, K., Pilanc, P., Kaminska, B. & Crimi, A. Deep learning glioma grading with the tumor microenvironment analysis protocol for comprehensive learning, discovering, and quantifying microenvironmental features. J. Imaging Inform. Med. https://doi.org/10.1007/s10278-024-01008-x (2024).

  • McLendon, R. et al. Comprehensive genomic characterization defines human glioblastoma genes and core pathways. Nature 455, 1061–1068 (2008).

    Article 
    CAS 

    Google Scholar 

  • Brennan, C. W. et al. The somatic genomic landscape of glioblastoma. Cell 155, 462–477 (2013).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • The Cancer Genome Atlas Research Network. Comprehensive, Integrative Genomic Analysis of Diffuse Lower-Grade Gliomas. N. Engl. J. Med. 372, 2481–2498 (2015).

  • Mobadersany, P. et al. Predicting cancer outcomes from histology and genomics using convolutional networks. Proc. Natl. Acad. Sci. 115, E2970–E2979 (2018).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Hewitt, K. J. et al. Direct image to subtype prediction for brain tumors using deep learning. Neuro-Oncol. Adv. 5, vdad139 (2023).

    Article 

    Google Scholar 

  • Nasrallah, M. P. et al. Machine learning for cryosection pathology predicts the 2021 WHO classification of glioma. Med 4, 526–540.e4 (2023).

    Article 
    PubMed 

    Google Scholar 

  • Wang, W. et al. Neuropathologist-level integrated classification of adult-type diffuse gliomas using deep learning from whole-slide pathological images. Nat. Commun. 14, 6359 (2023).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Im, S. et al. Classification of diffuse glioma subtype from clinical-grade pathological images using deep transfer learning. Sensors 21, 3500 (2021).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Li, Z. et al. Vision transformer-based weakly supervised histopathological image analysis of primary brain tumors. iScience 26, 105872 (2023).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Shi, L. et al. Contribution of whole slide imaging-based deep learning in the assessment of intraoperative and postoperative sections in neuropathology. Brain Pathol 33, e13160 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Hou, L. et al. Patch-based convolutional neural network for whole slide tissue image classification. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2424–2433 https://doi.org/10.1109/CVPR.2016.266 (2016).

  • Jin, L. et al. Artificial intelligence neuropathologist for glioma classification using deep learning on hematoxylin and eosin stained slide images and molecular markers. Neuro-Oncol 23, 44–52 (2021).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Jose, L. et al. Artificial intelligence–assisted classification of gliomas using whole slide images. Arch. Pathol. Lab. Med. 147, 916–924 (2022).

    Article 

    Google Scholar 

  • Wang, X., Price, S. & Li, C. Multi-task Learning of Histology and Molecular Markers for Classifying Diffuse Glioma. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 (eds. Greenspan, H. et al.) 551–561 (Springer Nature Switzerland, Cham, 2023). https://doi.org/10.1007/978-3-031-43990-2_52.

  • Hsu, W.-W. et al. A weakly supervised deep learning-based method for glioma subtype classification using WSI and mpMRIs. Sci. Rep. 12, 6111 (2022).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Wang, X. et al. Combining radiology and pathology for automatic glioma classification. Front. Bioeng. Biotechnol. 10, 841958 (2022).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Mallya, M. & Hamarneh, G. Deep multimodal guidance for medical image classification. in Medical Image Computing and Computer Assisted Intervention—MICCAI 2022 (eds. Wang, L., Dou, Q., Fletcher, P. T., Speidel, S. & Li, S.) 298–308 (Springer Nature Switzerland, 2022). https://doi.org/10.1007/978-3-031-16449-1_29.

  • Kim, G. J., Lee, T., Ahn, S., Uh, Y. & Kim, S. H. Efficient diagnosis of IDH-mutant gliomas: 1p/19qNET assesses 1p/19q codeletion status using weakly-supervised learning. Npj Precis. Oncol. 7, 1–9 (2023).

    Google Scholar 

  • Ma, Y. et al. Histopathological auxiliary system for brain tumour (HAS-Bt) based on weakly supervised learning using a WHO CNS5-style pipeline. J. Neurooncol. 163, 71–82 (2023).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Jin, L. et al. A multi-center performance assessment for automated histopathological classification and grading of glioma using whole slide images. iScience 26, 108041 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Mousavi, H. S., Monga, V., Rao, G. & Rao, A. U. K. Automated discrimination of lower and higher grade gliomas based on histopathological image analysis. J. Pathol. Inform. 6, 15 (2015).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Wang, X. et al. Machine learning models for multiparametric glioma grading with quantitative result interpretations. Front. Neurosci. 12, 1046 (2019).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Mohan, G. et al. Intelligent framework for brain tumor grading using advanced feature analysis. Comput. Methods Biomech. Biomed. Eng. Imaging Vis. 11, 485–503 (2023).

    Article 

    Google Scholar 

  • Rathore, S., Niazi, T., Iftikhar, M. A. & Chaddad, A. Glioma grading via analysis of digital pathology images using machine learning. Cancers 12, 578 (2020).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Barker, J., Hoogi, A., Depeursinge, A. & Rubin, D. L. Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles. Med. Image Anal. 30, 60–71 (2016).

    Article 
    PubMed 

    Google Scholar 

  • Reza, S. M. S. & Iftekharuddin, K. M. Glioma grading using cell nuclei morphologic features in digital pathology images. in Medical Imaging 2016: Computer-Aided Diagnosis 9785 735–740 (SPIE, 2016).

  • Pei, L., Jones, K. A., Shboul, Z. A., Chen, J. Y. & Iftekharuddin, K. M. Deep neural network analysis of pathology images with integrated molecular data for enhanced glioma classification and grading. Front. Oncol. 11, 668694 (2021).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Truong, A. H., Sharmanska, V., Limbӓck-Stanic, C. & Grech-Sollars, M. Optimization of deep learning methods for visualization of tumor heterogeneity and brain tumor grading through digital pathology. Neuro-Oncol. Adv. 2, vdaa110 (2020).

    Article 

    Google Scholar 

  • Ertosun, M. G. & Rubin, D. L. Automated grading of gliomas using deep learning in digital pathology images: a modular approach with ensemble of convolutional neural networks. AMIA. Annu. Symp. Proc. 2015, 1899–1908 (2015).

    PubMed 
    PubMed Central 

    Google Scholar 

  • Su, F. et al. Annotation-free glioma grading from pathological images using ensemble deep learning. Heliyon 9, e14654 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Momeni, A., Thibault, M. & Gevaert, O. Deep Recurrent Attention Models for Histopathological Image Analysis. 438341 Preprint at https://doi.org/10.1101/438341 (2018).

  • Zhao, Y. et al. Computational pathology for prediction of isocitrate dehydrogenase gene mutation from whole slide images in adult patients with diffuse glioma. Am. J. Pathol. 194, 747–758, https://doi.org/10.1016/j.ajpath.2024.01.009 (2024).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Qiu, L. et al. Hierarchical multimodal fusion framework based on noisy label learning and attention mechanism for cancer classification with pathology and genomic features. Comput. Med. Imaging Graph. 104, 102176 (2023).

    Article 
    PubMed 

    Google Scholar 

  • Chen, R. J. et al. Pathomic fusion: an integrated framework for fusing histopathology and genomic features for cancer diagnosis and prognosis. IEEE Trans. Med. Imaging 41, 757–770 (2022).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Xing, X. et al. Discrepancy and gradient-guided multi-modal knowledge distillation for pathological glioma grading. in Medical Image Computing and Computer Assisted Intervention—MICCAI 2022 (eds. Wang, L., Dou, Q., Fletcher, P. T., Speidel, S. & Li, S.) 636–646 (Springer Nature Switzerland, 2022). https://doi.org/10.1007/978-3-031-16443-9_61.

  • Saldanha, O. L. et al. Self-supervised attention-based deep learning for pan-cancer mutation prediction from histopathology. Npj Precis. Oncol. 7, 1–5 (2023).

    Google Scholar 

  • Loeffler, C. M. L. et al. Predicting mutational status of driver and suppressor genes directly from histopathology with deep learning: a systematic study across 23 solid tumor types. Front. Genet. 12, 806386 (2022).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Liu, S. et al. Isocitrate dehydrogenase (IDH) status prediction in histopathology images of gliomas using deep learning. Sci. Rep. 10, 7733 (2020).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Wang, D. et al. Automated machine-learning framework integrating histopathological and radiological information for predicting IDH1 mutation status in glioma. Front. Bioinforma. 1, 718697 (2021).

    Article 

    Google Scholar 

  • Jiang, S., Zanazzi, G. J. & Hassanpour, S. Predicting prognosis and IDH mutation status for patients with lower-grade gliomas using whole slide images. Sci. Rep. 11, 16849 (2021).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Liechty, B. et al. Machine learning can aid in prediction of IDH mutation from H&E-stained histology slides in infiltrating gliomas. Sci. Rep. 12, 22623 (2022).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Gorlia, T. et al. Nomograms for predicting survival of patients with newly diagnosed glioblastoma: prognostic factor analysis of EORTC and NCIC trial 26981-22981/CE.3. Lancet Oncol 9, 29–38 (2008).

    Article 
    PubMed 

    Google Scholar 

  • Nalisnik, M. et al. Interactive phenotyping of large-scale histology imaging data with HistomicsML. Sci. Rep. 7, 14588 (2017).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Arslan, S. et al. A systematic pan-cancer study on deep learning-based prediction of multi-omic biomarkers from routine pathology images. Commun. Med. 4, 1–15 (2024).

    Article 

    Google Scholar 

  • Luo, C., Yang, J., Liu, Z. & Jing, D. Predicting the recurrence and overall survival of patients with glioma based on histopathological images using deep learning. Front. Neurol. 14, 1100933 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Baheti, B. et al. Detecting Histologic & Clinical Glioblastoma Patterns of Prognostic Relevance. Preprint at https://doi.org/10.48550/arXiv.2302.00669 (2023).

  • Zhang, Y., Li, A., He, J. & Wang, M. A Novel MKL method for GBM prognosis prediction by integrating histopathological image and multi-omics data. IEEE J. Biomed. Health Inform. 24, 171–179 (2020).

    Article 
    PubMed 

    Google Scholar 

  • Powell, R. T. et al. Identification of histological correlates of overall survival in lower grade gliomas using a bag-of-words paradigm: a preliminary analysis based on hematoxylin & eosin stained slides from the lower grade glioma cohort of the cancer genome atlas. J. Pathol. Inform. 8, 9 (2017).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Zadeh Shirazi, A. et al. DeepSurvNet: deep survival convolutional network for brain cancer survival rate classification based on histopathological images. Med. Biol. Eng. Comput. 58, 1031–1045 (2020).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Liu, P., Fu, B., Ye, F., Yang, R. & Ji, L. DSCA: a dual-stream network with cross-attention on whole-slide image pyramids for cancer prognosis. Expert Syst. Appl. 227, 120280 (2023).

    Article 

    Google Scholar 

  • Wang, Z. et al. Surformer: an interpretable pattern-perceptive survival transformer for cancer survival prediction from histopathology whole slide images. Comput. Methods Programs Biomed. 241, 107733 (2023).

    Article 
    PubMed 

    Google Scholar 

  • Chen, R. J. et al. Multimodal co-attention transformer for survival prediction in gigapixel whole slide images. In 4015–4025 (2021).

  • Zhu, X., Yao, J., Zhu, F. & Huang, J. WSISA: making survival prediction from whole slide histopathological images. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 6855–6863 https://doi.org/10.1109/CVPR.2017.725 (2017).

  • Klemm, F. et al. Interrogation of the microenvironmental landscape in brain tumors reveals disease-specific alterations of immune cells. Cell 181, 1643–1660.e17 (2020).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Cordell, E. C., Alghamri, M. S., Castro, M. G. & Gutmann, D. H. T lymphocytes as dynamic regulators of glioma pathobiology. Neuro-Oncol 24, 1647–1657 (2022).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Zhu, X., Yao, J. & Huang, J. Deep convolutional neural network for survival analysis with pathological images. In 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) 544–547 https://doi.org/10.1109/BIBM.2016.7822579 (2016).

  • Li, R., Yao, J., Zhu, X., Li, Y. & Huang, J. Graph CNN for survival analysis on whole slide pathological images. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2018 (eds. Frangi, A. F., Schnabel, J. A., Davatzikos, C., Alberola-López, C. & Fichtinger, G.) 174–182 (Springer International Publishing, 2018). https://doi.org/10.1007/978-3-030-00934-2_20.

  • Chen, R. J. et al. Whole slide images are 2D point clouds: context-aware survival prediction using patch-based graph convolutional networks. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 (eds. de Bruijne, M. et al.) 339–349 (Springer International Publishing, 2021). https://doi.org/10.1007/978-3-030-87237-3_33.

  • Jiang, S., Suriawinata, A. A. & Hassanpour, S. MHAttnSurv: multi-head attention for survival prediction using whole-slide pathology images. Comput. Biol. Med. 158, 106883 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Carmichael, I. et al. Incorporating intratumoral heterogeneity into weakly-supervised deep learning models via variance pooling. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2022 (eds. Wang, L., Dou, Q., Fletcher, P. T., Speidel, S. & Li, S.) 387–397 (Springer Nature Switzerland, 2022). https://doi.org/10.1007/978-3-031-16434-7_38.

  • Chunduru, P., Phillips, J. J. & Molinaro, A. M. Prognostic risk stratification of gliomas using deep learning in digital pathology images. Neuro-Oncol. Adv. 4, vdac111 (2022).

    Article 

    Google Scholar 

  • Chen, R. J. et al. Pan-cancer integrative histology-genomic analysis via multimodal deep learning. Cancer Cell 40, 865–878.e6 (2022).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Braman, N. et al. Deep Orthogonal Fusion: Multimodal Prognostic Biomarker Discovery Integrating Radiology, Pathology, Genomic, and Clinical Data. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 (eds. de Bruijne, M. et al.) 667–677 (Springer International Publishing, Cham, 2021). https://doi.org/10.1007/978-3-030-87240-3_64.

  • Xing, X. et al. A multi-scale graph network with multi-head attention for histopathology image diagnosisn. In Proceedings of the MICCAI Workshop on Computational Pathology 227–235 (PMLR, 2021).

  • Krebs, O., Agarwal, S. & Tiwari, P. Self-supervised deep learning to predict molecular markers from routine histopathology slides for high-grade glioma tumors. In Medical Imaging 2023: Digital and Computational Pathology 12471 1247102 (SPIE, 2023).

  • He, K., Zhang, X., Ren, S. & Sun, J. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 770–778. https://doi.org/10.1109/CVPR.2016.90 (2016).

  • Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. 3rd International Conference on Learning Representations (ICLR 2015) (2015).

  • Huang, G., Liu, Z., Van Der Maaten, L. & Weinberger, K. Q. Densely Connected Convolutional Networks. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2261–2269. https://doi.org/10.1109/CVPR.2017.243 (2017).

  • Tan, M. & Le, Q. V. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. Preprint at https://doi.org/10.48550/arXiv.1905.11946 (2020).

  • Szegedy, C. et al. Going deeper with convolutions. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 1–9. https://doi.org/10.1109/CVPR.2015.7298594 (2015).

  • Krizhevsky, A., Sutskever, I. & Hinton, G. E. ImageNet Classification with Deep Convolutional Neural Networks. In Advances in Neural Information Processing Systems 25 (Curran Associates, Inc., 2012).

  • Yang, P. et al. CS-CO: a hybrid self-supervised visual representation learning method for H&E-stained histopathological images. Med. Image Anal. 81, 102539 (2022).

    Article 
    PubMed 

    Google Scholar 

  • Lu, M. et al. SMILE: sparse-attention based multiple instance contrastive learning for glioma sub-type classification using pathological images. In Proceedings of the MICCAI Workshop on Computational Pathology 159–169 (PMLR, 2021).

  • Zhang, L. et al. Mutual Contrastive Low-rank Learning to Disentangle Whole Slide Image Representations for Glioma Grading. Preprint at https://doi.org/10.48550/arXiv.2203.04013 (2022).

  • Cheerla, A. & Gevaert, O. Deep learning with multimodal representation for pancancer prognosis prediction. Bioinformatics 35, i446–i454 (2019).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Jiang, S., Hondelink, L., Suriawinata, A. A. & Hassanpour, S. Masked pre-training of transformers for histology image analysis. J. Pathol. Inform. 100386 https://doi.org/10.1016/j.jpi.2024.100386 (2024).

  • Chitnis, S. R. et al. Domain-Specific Pre-training Improves Confidence in Whole Slide Image Classification. In 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) 1–4. https://doi.org/10.1109/EMBC40787.2023.10340659 (2023).

  • Suman, S. & Prasanna, P. Muti-stage attention-based network for brain tumor subtype classification. In Medical Imaging 2022: Digital and Computational Pathology 12039 272–276 (SPIE, 2022).

  • He, Y., Duan, L., Dong, G., Chen, F. & Li, W. Computational pathology-based weakly supervised prediction model for MGMT promoter methylation status in glioblastoma. Front. Neurol. 15, 1345687 (2024).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Kleppe, A. et al. Designing deep learning studies in cancer diagnostics. Nat. Rev. Cancer 21, 199–211 (2021).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Howard, F. M. et al. The impact of site-specific digital histology signatures on deep learning model accuracy and bias. Nat. Commun. 12, 4423 (2021).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Howard, F. M., Kather, J. N. & Pearson, A. T. Multimodal deep learning: an improvement in prognostication or a reflection of batch effect? Cancer Cell 41, 5–6 (2023).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Homeyer, A. et al. Recommendations on compiling test datasets for evaluating artificial intelligence solutions in pathology. Mod. Pathol. 35, 1759–1769 (2022).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Brindha, V., Jayashree, P., Karthik, P. & Manikandan, P. Tumor grading model employing geometric analysis of histopathological images with characteristic nuclei dictionary. Comput. Biol. Med. 149, 106008 (2022).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Yonekura, A., Kawanaka, H., Prasath, V. B. S., Aronow, B. J. & Takase, H. Automatic disease stage classification of glioblastoma multiforme histopathological images using deep convolutional neural network. Biomed. Eng. Lett. 8, 321–327 (2018).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Blokker, M. et al. Fast intraoperative histology-based diagnosis of gliomas with third harmonic generation microscopy and deep learning. Sci. Rep. 12, 11334 (2022).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Chen, R. J. et al. Towards a general-purpose foundation model for computational pathology. Nat. Med. 30, 850–862 (2024).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Lu, M. Y. et al. A visual-language foundation model for computational pathology. Nat. Med. 30, 863–874 (2024).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Lu, M. Y. et al. A Foundational Multimodal Vision Language AI Assistant for Human Pathology. Preprint at https://doi.org/10.48550/arXiv.2312.07814 (2023).

  • Grenko, C. M. et al. Towards population-based histologic stain normalization of glioblastoma. In Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries (eds. Crimi, A. & Bakas, S.) 44–56 (Springer International Publishing, Cham, 2020). https://doi.org/10.1007/978-3-030-46640-4_5.

  • Madusanka, N., Jayalath, P., Fernando, D., Yasakethu, L. & Lee, B.-I. Impact of H&E stain normalization on deep learning models in cancer image classification: performance, complexity, and trade-offs. Cancers 15, 4144 (2023).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Bai, B. et al. Deep learning-enabled virtual histological staining of biological samples. Light Sci. Appl. 12, 57 (2023).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Hölscher, D. L. et al. Next-generation morphometry for pathomics-data mining in histopathology. Nat. Commun. 14, 470 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Hao, J., Kosaraju, S. C., Tsaku, N. Z., Song, D. H. & Kang, M. PAGE-Net: interpretable and integrative deep learning for survival analysis using histopathological images and genomic data. in Biocomputing 2020 355–366 (WORLD SCIENTIFIC, 2019). https://doi.org/10.1142/9789811215636_0032.

  • Chen, L. et al. Predicting the likelihood of an isocitrate dehydrogenase 1 or 2 mutation in diagnoses of infiltrative glioma. Neuro-Oncol 16, 1478–1483 (2014).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Dosovitskiy, A. et al. An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale. Preprint at https://doi.org/10.48550/arXiv.2010.11929 (2021).

  • Ker, J., Bai, Y., Lee, H. Y., Rao, J. & Wang, L. Automated brain histology classification using machine learning. J. Clin. Neurosci. 66, 239–245 (2019).

    Article 
    PubMed 

    Google Scholar 

  • Chen, T., Kornblith, S., Norouzi, M. & Hinton, G. A Simple Framework for Contrastive Learning of Visual Representations. In Proceedings of the 37th International Conference on Machine Learning 1597–1607 (PMLR, 2020).

  • Ghaffari Laleh, N. et al. Benchmarking weakly-supervised deep learning pipelines for whole slide classification in computational pathology. Med. Image Anal. 79, 102474 (2022).

    Article 
    PubMed 

    Google Scholar 

  • Ilse, M., Tomczak, J. & Welling, M. Attention-based Deep Multiple Instance Learning. In Proceedings of the 35th International Conference on Machine Learning 2127–2136 (PMLR, 2018).

  • Lu, M. Y. et al. Data-efficient and weakly supervised computational pathology on whole-slide images. Nat. Biomed. Eng. 5, 555–570 (2021).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Boehm, K. M., Khosravi, P., Vanguri, R., Gao, J. & Shah, S. P. Harnessing multimodal data integration to advance precision oncology. Nat. Rev. Cancer 22, 114–126 (2022).

    Article 
    CAS 
    PubMed 

    Google Scholar 

  • Lipkova, J. et al. Artificial intelligence for multimodal data integration in oncology. Cancer Cell 40, 1095–1110 (2022).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Wang, L.-B. et al. Proteogenomic and metabolomic characterization of human glioblastoma. Cancer Cell 39, 509–528.e20 (2021).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Roetzer-Pejrimovsky, T. et al. The digital brain tumour atlas, an open histopathology resource. Sci. Data 9, 55 (2022).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Puchalski, R. B. et al. An anatomic transcriptional atlas of human glioblastoma. Science 360, 660–663 (2018).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Bakas, S. et al. The University of Pennsylvania glioblastoma (UPenn-GBM) cohort: advanced MRI, clinical, genomics, & radiomics. Sci. Data 9, 453 (2022).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Elazab, N., Gab-Allah, W. A. & Elmogy, M. A multi-class brain tumor grading system based on histopathological images using a hybrid YOLO and RESNET networks. Sci. Rep. 14, 4584 (2024).

    Article 
    CAS 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Yin, X. et al. Deep synergetic spiking neural P systems for the overall survival time prediction of glioblastoma patients. Expert Syst. Appl. 245, 123032 (2024).

    Article 

    Google Scholar 

  • Dai, J. et al. Hypergraph-based spiking neural P systems for predicting the overall survival time of glioblastoma patients. Expert Syst. Appl. 215, 119234 (2023).

    Article 

    Google Scholar 

  • Rathore, S., Iftikhar, M. A. & Mourelatos, Z. Prediction of overall survival and molecular markers in gliomas via analysis of digital pathology images using deep learning. Preprint at https://doi.org/10.48550/arXiv.1909.09124 (2019).

  • Zheng, H., Momeni, A., Cedoz, P.-L., Vogel, H. & Gevaert, O. Whole slide images reflect DNA methylation patterns of human tumors. Npj Genomic Med 5, 1–10 (2020).

    Article 

    Google Scholar 

  • Tang, B., Li, A., Li, B. & Wang, M. CapSurv: capsule network for survival analysis with whole slide pathological images. IEEE Access 7, 26022–26030 (2019).

    Article 

    Google Scholar 

  • Liu, P., Ji, L., Ye, F. & Fu, B. AdvMIL: adversarial multiple instance learning for the survival analysis on whole-slide images. Med. Image Anal. 91, 103020 (2024).

    Article 
    PubMed 

    Google Scholar 



  • Source link

    Leave a Reply

    Your email address will not be published. Required fields are marked *