InterFeat: a pipeline for finding interesting scientific features

Machine Learning


  • Marshall, B. J., Armstrong, J. A., McGechie, D. B. & Clancy, R. J. Attempt to fulfil Koch’s postulates for pyloric Campylobacter. Med. J. Aust. 142, 436–439. https://doi.org/10.5694/j.1326-5377.1985.tb113443.x (1985).

    Google Scholar 

  • Cade, J. F. & Malhi, G. S. Cade’s lithium. Acta Neuropsychiatrica 19, 125–126 (2007).

    Google Scholar 

  • Tong, S., Mao, K., Huang, Z., Zhao, Y. & Peng, K. Automating psychological hypothesis generation with AI: when large language models meet causal graph. Hum. Soc. Sci. Commun. 11, 1–14 (2024).

    Google Scholar 

  • Spangler, S. et al. Automated hypothesis generation based on mining scientific literature. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, 1877–1886 (ACM, New York New York USA, 2014). https://doi.org/10.1145/2623330.2623667.

  • Henry, S. & McInnes, B. T. Literature Based Discovery: Models, methods, and trends. J. Biomed. Inform. 74, 20–32 (2017).

    Google Scholar 

  • Swanson, D. R. Fish Oil, Raynaud’s Syndrome, and Undiscovered Public Knowledge. Perspect. Biol. Med. 30, 7–18 (1986).

    Google Scholar 

  • Voytek, J. B. & Voytek, B. Automated cognome construction and semi-automated hypothesis generation. J. Neurosci. Methods 208, 92–100 (2012).

  • Wang, Q., Downey, D., Ji, H. & Hope, T. SciMON: Scientific Inspiration Machines Optimized for Novelty (2024). arXiv:2305.14259 [cs] version: 7.

  • Moreau, E., Hardiman, O., Heverin, M. & O’Sullivan, D. Literature-Based Discovery beyond the ABC paradigm: a contrastive approach https://doi.org/10.1101/2021.09.22.461375v1 (2021).

    Google Scholar 

  • Ofer, D. & Linial, M. OTRec: deep learning recommender for prospective druggable disease–target associations (2025). https://doi.org/10.64898/2025.12.21.695803v1.

  • Ofer, D., Kaufman, H. & Linial, M. What’s next? Forecasting scientific research trends. Heliyon 10, e23781 (2024).

    Google Scholar 

  • Zhao, B.-W. et al. A geometric deep learning framework for drug repositioning over heterogeneous information networks. Brief. Bioinf. 23, bbac384. https://doi.org/10.1093/bib/bbac384 (2022).

  • Zhou, Y., Liu, H., Srivastava, T., Mei, H. & Tan, C. Hypothesis Generation with Large Language Models. In Proceedings of the 1st Workshop on NLP for Science (NLP4Science), 117–139 (2024). arXiv:2404.04326 [cs].

  • Sybrandt, J., Carrabba, A., Herzog, A. & Safro, I. Are Abstracts Enough for Hypothesis Generation? arXiv:1804.05942 [cs] (2018).

  • Qi, B. et al. Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation (2024). arXiv:2407.08940 [cs].

  • Brodeur, P. G. et al. Superhuman performance of a large language model on the reasoning tasks of a physician (2024). arXiv:2412.10849 [cs].

  • Matsumoto, N. et al. KRAGEN: a knowledge graph-enhanced RAG framework for biomedical problem solving using large language models. Bioinformatics40, btae353. https://doi.org/10.1093/bioinformatics/btae353 (2024).

  • Liévin, V., Hother, C. E., Motzfeldt, A. G. & Winther, O. Can large language models reason about medical questions? Patterns 5 (2024).

  • Shringarpure, S. S. et al. Large language models identify causal genes in complex trait. GWAS https://doi.org/10.1101/2024.05.30.24308179v1 (2024).

    Google Scholar 

  • Ofer, D. & Linial, M. Automated annotation of disease subtypes. J. Biomed. Inform. 154, 104650 (2024).

    Google Scholar 

  • Dahl, R. The Great Automatic Grammatizator and Other Stories (Puffin, 1997). Google-Books-ID: 5WbDNQAACAAJ.

  • Farquhar, S., Kossen, J., Kuhn, L. & Gal, Y. Detecting hallucinations in large language models using semantic entropy. Nature 630, 625–630 (2024).

  • Wu, J. et al. Medical Graph RAG: Towards safe medical large language model via graph retrieval-augmented generation (2024). arXiv:2408.04187.

  • Béchard, P. & Ayala, O. M. Reducing hallucination in structured outputs via Retrieval-Augmented Generation. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track), 228–238 (2024). arXiv:2404.08189 [cs].

  • Jeong, D. P., Lipton, Z. C. & Ravikumar, P. LLM-Select: Feature Selection with Large Language Models (2024). arXiv:2407.02694.

  • Maor, M., Karidi, R., Davidovich, S. & Ronen, A. System and method for automatic generation of features from datasets for use in an automated machine learning process (2019). URL https://patents.google.com/patent/US10410138B2/en?inventor=Amir+Ronen.

  • Domingos, P. A few useful things to know about machine learning. Commun. ACM 55, 78 (2012).

    Google Scholar 

  • Madakkatel, I., Zhou, A., McDonnell, M. D. & Hyppönen, E. Combining machine learning and conventional statistical approaches for risk factor discovery in a large cohort study. Sci. Rep. 11, 22997 (2021).

  • Guyon, I. An Introduction to Variable and Feature Selection 1 Introduction 3, 1157–1182 (2003).

  • Breiman, L. U. o. C. Random forest, vol. 45 (1999). https://doi.org/10.1023/A:1010933404324. Publication Title: Machine Learning ISSN: 0885-6125.

  • Blum, A. L. & Langley, P. Selection of relevant features and examples in machine learning. Artif. Intell. 97, 245–271 (1997).

    Google Scholar 

  • Cohen, S., Dagan, N., Cohen-Inger, N., Ofer, D. & Rokach, L. ICU survival prediction incorporating test-time augmentation to improve the accuracy of ensemble-based models. IEEE Access9, 91584–91592 (2021).

  • Blass, I. et al. Revisiting the risk factors for endometriosis: a machine learning approach. J. Pers. Med. 12, 1114 (2022).

    Google Scholar 

  • Ofer, D. & Linial, M. ProFET: Feature engineering captures high-level protein functions. Bioinformatics (Oxford, England) (2015). URL http://bioinformatics.oxfordjournals.org/content/early/2015/07/02/bioinformatics.btv345.abstract.

  • Alaa, A. M., Bolton, T., Di Angelantonio, E., Rudd, J. H. F. & van der Schaar, M. Cardiovascular disease risk prediction using automated machine learning: A prospective study of 423,604 UK Biobank participants. PLoS ONE 14, e0213653. https://doi.org/10.1371/journal.pone.0213653 (2019) (Publisher: Public Library of Science).

    Google Scholar 

  • Michael-Pitschaze, T., Cohen, N., Ofer, D., Hoshen, Y. & Linial, M. Detecting anomalous proteins using deep representations. NAR Genom. Bioinf. 6, lqae021. https://doi.org/10.1093/nargab/lqae021 (2024).

  • Ofer, D. & Linial, M. Protein Language Models Expose Viral Immune Mimicry. Viruses17 (2025). URL https://www.mdpi.com/1999-4915/17/9/1199.

  • Lundberg, S. M. & Lee, S.-I. A Unified Approach to Interpreting Model Predictions. In Advances in Neural Information Processing Systems, vol. 30 (Curran Associates, Inc., 2017). URL https://proceedings.neurips.cc/paperspsfiles/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html.

  • Allwright, M. et al. Ranking the risk factors for Alzheimer’s disease; findings from the UK Biobank study. Aging Brain3, 100081 (2023).

  • Allwright, M., Karrasch, J. F., O’Brien, J. A., Guennewig, B. & Austin, P. J. Machine learning analysis of the UK Biobank reveals prognostic and diagnostic immune biomarkers for polyneuropathy and neuropathic pain in diabetes. Diabetes Res. Clin. Pract. 201, 110725 (2023).

    Google Scholar 

  • Lugner, M., Rawshani, A., Helleryd, E. & Eliasson, B. Identifying top ten predictors of type 2 diabetes through machine learning analysis of UK Biobank data. Scientific Reports14, 2102 (2024). URL https://www.nature.com/articles/s41598-024-52023-5. Publisher: Nature Publishing Group.

  • Glover, J. A., Ronning, R. R. & Reynolds, C. R. Handbook of creativity (Springer Science & Business Media, 2013).

  • Amabile, T. M. Creativity in context: Update to the social psychology of creativity (Routledge, 2018).

  • Silberschatz, A. & Tuzhilin, A. What makes patterns interesting in knowledge discovery systems. IEEE Trans. Knowl. Data Eng. 8, 970–974 (1996).

  • Sudlow, C. et al. UK Biobank: An open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLOS Med. 12, e1001779 (2015).

  • Hall, M. A. Correlation-based feature selection for machine learning. PhD Thesis,The University of Waikato (1999). URL https://researchcommons.waikato.ac.nz/handle/10289/15043.

  • Galli, S. Feature-engine: A Python package for feature engineering for machine learning. J. Open Source Softw. 6, 3642 (2021). https://doi.org/10.21105/joss.03642.

  • Chesnaye, N. C. et al. An introduction to inverse probability of treatment weighting in observational research. Clin. Kidney J. 15, 14–20 (2021).

    Google Scholar 

  • Bodenreider, O. The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res. 32, D267–D270. https://doi.org/10.1093/nar/gkh061 (2004).

    Google Scholar 

  • Neumann, M., King, D., Beltagy, I. & Ammar, W. ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing. Proceedings of the 18th BioNLP Workshop and Shared Task 319–327 (2019). URL https://www.aclweb.org/anthology/W19-5034. Conference Name: Proceedings of the 18th BioNLP Workshop and Shared Task Place: Florence, Italy Publisher: Association for Computational Linguistics.

  • Kilicoglu, H., Shin, D., Fiszman, M., Rosemblat, G. & Rindflesch, T. C. SemMedDB: a PubMed-scale repository of biomedical semantic predications. Bioinformatics 28, 3158–3160 (2012).

    Google Scholar 

  • Soldaini, L. QuickUMLS: a fast, unsupervised approach for medical concept extraction (2016). URL https://www.semanticscholar.org/paper/QuickUMLS%3A-a-fast%2C-unsupervised-approach-for-Soldaini/92e428bcd578f504974103f7201be21807f13615.

  • Remy, F., Demuynck, K. & Demeester, T. BioLORD: Learning Ontological Representations from Definitions (for Biomedical Concepts and their Textual Descriptions) (2022). ArXiv:2210.11892 [cs].

  • Asai, A. et al. OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs (2024). arXiv:2411.14199 [cs].

  • Aaron Grattafiori, Dubey, A., Jauhri, A. et. al. The Llama 3 Herd of Models (2024). arXiv:2407.21783 [cs].

  • Wei, J. et al. Chain-of-thought prompting elicits reasoning in large language models. In Proceedings of the 36th International Conference on Neural Information Processing Systems, NIPS ’22, 24824–24837 (Curran Associates Inc., Red Hook, NY, USA, 2022).

  • Xiong, G., Jin, Q., Lu, Z. & Zhang, A. Benchmarking Retrieval-Augmented Generation for Medicine. In Ku, L.-W., Martins, A. & Srikumar, V. (eds.) Findings of the Association for Computational Linguistics: ACL 2024, 6233–6251 (Association for Computational Linguistics,Bangkok, Thailand, 2024). URL https://aclanthology.org/2024.findings-acl.372/.

  • Madakkatel, I. & Hyppönen, E. LLpowershap: logistic loss-based automated Shapley values feature selection method. BMC Med. Res. Methodol. 24, 247. https://doi.org/10.1186/s12874-024-02370-8 (2024).

    Google Scholar 

  • Bolón-Canedo, V., Sánchez-Maroño, N. & Alonso-Betanzos, A. Feature selection for high-dimensional data. Progr. Artif. Intell. 5, 65–75. https://doi.org/10.1007/s13748-015-0080-y (2016).

    Google Scholar 

  • Singer, U., Radinsky, K. & Horvitz, E. On biases of attention in scientific discovery. Bioinformatics btaa1036 (2020). https://doi.org/10.1093/bioinformatics/btaa1036/6039114.

  • Chan, J., Chang, J. C., Hope, T., Shahaf, D. & Kittur, A. SOLVENT: A mixed initiative system for finding analogies between research papers. Proc. ACM Hum. Comput. Interact. 2, 1–21. https://doi.org/10.1145/3274300 (2018).

    Google Scholar 

  • Moreau, E., Hardiman, O., Heverin, M. & O’Sullivan, D. Mining impactful discoveries from the biomedical literature. BMC Bioinf. 25, 303 (2024).

    Google Scholar 

  • Harel, S. & Radinsky, K. Accelerating Prototype-Based Drug Discovery using Conditional Diversity Networks. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 331–339 (2018). arXiv:1804.02668 [cs].

  • Alber, D. A., Yang, Z., Alyakin, A. & et. al. Medical large language models are vulnerable to data-poisoning attacks. Nat. Med. 1–9 (2025). URL https://www.nature.com/articles/s41591-024-03445-1.

  • Peduzzi, G., Felici, A., Pellungrini, R. & Campa, D. Explainable machine learning identifies a polygenic risk score as a key predictor of pancreatic cancer risk in the UK Biobank. Digest. Liver Dis. Off. J. Ital. Soc. Gastroenterol. Ital. Assoc. Study Liver S1590–8658(24), 01100–9 (2024).

    Google Scholar 

  • Cao, C. et al. kTWAS: integrating kernel machine with transcriptome-wide association studies improves statistical power and reveals novel genes. Brief. Bioinf. 22, bbaa270 (2021). https://doi.org/10.1093/bib/bbaa270.

  • Team, G., Anil, R., Borgeaud, S. et al. Gemini: A Family of Highly Capable Multimodal Models (2025). arXiv:2312.11805 [cs].

  • Dahl, A. & Zaitlen, N. Genetic Influences on Disease Subtypes. Annu. Rev. Genomics Hum. Genet. 21, 413–435. https://doi.org/10.1146/annurev-genom-120319-095026 (2020).

    Google Scholar 

  • Nastl, V. Y. & Hardt, M. Do causal predictors generalize better to new domains? (2024). URL https://openreview.net/forum?id=U4BC0GrFAz.

  • Lin, E. W., Karakasheva, T. A., Hicks, P. D., Bass, A. J. & Rustgi, A. K. The Tumor Microenvironment in Esophageal Cancer. Oncogene 35, 5337–5349 (2016).

    Google Scholar 

  • Zhang, D. et al. Exploring the Common Genetic Underpinnings of Chronic Pulmonary Disease and Esophageal Carcinoma Susceptibility. J. Cancer 15, 3406–3417 (2024).

    Google Scholar 

  • Cahan, M. A. et al. Proton pump inhibitors reduce gallbladder function. Surg. Endosc. 20, 1364–1367 (2006).

    Google Scholar 

  • Park, S. J. et al. Antibiotic Exposure and Cardiovascular Disease Risk: A Nationwide Cohort Study. J. Am. Heart Assoc. 14, e035888 (2025).

    Google Scholar 

  • Yu, A. et al. Childhood infection burden, recent antibiotic exposure and vascular phenotypes in preschool children. PLoS ONE 18, e0290633. https://doi.org/10.1371/journal.pone.0290633 (2023).

    Google Scholar 

  • Zhu, S. et al. Long-term and recurrent antibiotic use during early life is associated with incident cardiovascular disease during adulthood. Circulation151 (2025). https://doi.org/10.1161/cir.151.suppl_1.P3159.

  • Brandes, N., Ofer, D., Peleg, Y., Rappoport, N. & Linial, M. ProteinBERT: a universal deep-learning model of protein sequence and function. Bioinformatics 38, 2102–2110. https://doi.org/10.1093/bioinformatics/btac020 (2022).

    Google Scholar 

  • Sutton, R. The bitter lesson. Incomplete Ideas (blog) 13, 38 (2019).

    Google Scholar 

  • Ofer, D., Brandes, N. & Linial, M. The language of proteins: NLP, machine learning & protein sequences. Comput. Struct. Biotechnol. J. 19, 1750–1758 (2021).

    Google Scholar 

  • Pedregosa, F. et al. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011).

  • Kraskov, A., Stögbauer, H. & Grassberger, P. Estimating mutual information. Phys. Rev. E 69, 066138. https://doi.org/10.1103/PhysRevE.69.066138 (2004) (Publisher: American Physical Society).

    Google Scholar 



  • Source link