The convergence of machine learning and data assimilation in Earth system science

Machine Learning


  • ECMWF Director-General. Machine Learning to Play Growing Role in Weather Forecasting. https://www.ecmwf.int/en/about/media-centre/news/2024/machine-learning-play-growing-role-weather-forecasting-says-dg (2024).

  • UK Met Office. Artificial Intelligence for Numerical Weather Prediction. https://www.metoffice.gov.uk/research/approach/collaboration/artificial-intelligence-for-numerical-weather-prediction (2025).

  • Sun, X. et al. A data-to-forecast machine learning system for global weather. Nat. Commun. 16, 6658 (2025).

    Article 

    Google Scholar 

  • Allen, A. et al. End-to-end data-driven weather prediction. Nature 641, 1172–1179 (2025).

    Article 

    Google Scholar 

  • Price, I. et al. Probabilistic weather forecasting with machine learning. Nature 637, 84–90 (2025).

    Article 

    Google Scholar 

  • Ben Bouallègue, Z. et al. The rise of data-driven weather forecasting: A first statistical assessment of machine learning-based weather forecasts in an operational-like context. Bull. Am. Meteorol. Soc. 105, E864–E883 (2024).

    Article 

    Google Scholar 

  • de Burgh-Day, C. O. & Leeuwenburg, T. Machine learning for numerical weather and climate modelling: a review. Geosci. Model Dev. 16, 6433–6466 (2023).

    Article 

    Google Scholar 

  • Lam, R. et al. Learning skillful medium-range global weather forecasting. Science 382, 1416–1421 (2023).

    Article 

    Google Scholar 

  • Lang, S. et al. AIFS–ECMWF’s data-driven forecasting system. Preprint at https://arxiv.org/abs/2406.01465 (2024).

  • Asch, M., Bocquet, M. & Nodet, M. Data Assimilation: Methods, Algorithms, and Applications (SIAM, 2016).

  • Bauer, P., Thorpe, A. & Brunet, G. The quiet revolution of numerical weather prediction. Nature 525, 47–55 (2015).

    Article 

    Google Scholar 

  • Arcucci, R., Zhu, J., Hu, S. & Guo, Y.-K. Deep data assimilation: integrating deep learning with data assimilation. Appl. Sci. 11, 1114 (2021).

    Article 

    Google Scholar 

  • Eyre, J., English, S. & Forsythe, M. Assimilation of satellite data in numerical weather prediction. Part I: The early years. Q J. R. Meteorol. Soc. 146, 49–68 (2020).

    Article 

    Google Scholar 

  • Eyre, J. et al. Assimilation of satellite data in numerical weather prediction. Part II: Recent years. Q. J. R. Meteorol. Soc. 148, 521–556 (2022).

    Article 

    Google Scholar 

  • Geer, A. Simultaneous inference of sea ice state and surface emissivity model using machine learning and data assimilation. J. Adv. Model. Earth Syst. 16, e2023MS004080 (2024).

    Article 

    Google Scholar 

  • Geer, A. Joint estimation of sea ice and atmospheric state from microwave imagers in operational weather forecasting. Q. J. R. Meteorol. Soc. 150, 3796–3826 (2024).

    Article 

    Google Scholar 

  • Dahoui, M. Use of Machine Learning for the Detection and Classification of Observation Anomalies. https://www.ecmwf.int/en/newsletter/174/earth-system-science/use-machine-learning-detection-and-classification (2023).

  • Bonavita, M. & Laloyaux, P. Machine learning for model error inference and correction. J. Adv. Model. Earth Syst. 12, e2020MS002232 (2020).

    Article 

    Google Scholar 

  • Raynaud, L., Brochet, C. & Moldovan, G. ML for weather prediction at Météo-France : current status and future plans, EGU General Assembly 2024, Vienna, Austria, 14–19 Apr 2024, EGU24-1675. https://doi.org/10.5194/egusphere-egu24-1675 (2024).

  • Hubbard, K. G. et al. An AI-Driven Approach to Environmental Data Fusion and Assimilation. Tech. Rep., NOAA (2021).

  • Lang, S. et al. AIFS-CRPS: ensemble forecasting using a model trained with a loss function based on the continuous ranked probability score. NPJ Artif. Intell. 2, 18 (2026).

    Article 

    Google Scholar 

  • ECMWF & partners. Anemoi: A New Framework for Forecasting Based on Machine Learning. https://www.ecmwf.int/en/about/media-centre/news/2024/anemoi-new-framework-weather-forecasting-based-machine-learning (2024).

  • Nipen, T. N. et al. Regional data-driven weather modeling with a global stretched-grid. Artif. Intell. Earth Syst. https://doi.org/10.1175/AIES-D-25-0001.1 (2025).

  • Evensen, G. The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dyn. 53, 343–367 (2003).

    Article 

    Google Scholar 

  • Liang, J., Terasaki, K. & Miyoshi, T. A machine learning approach to the observation operator for satellite radiance data assimilation. J. Meteorol. Soc. Jpn. 101, 79–95 (2023).

    Article 

    Google Scholar 

  • Chattopadhyay, A., Mustafa, M., Hassanzadeh, P., Bach, E. & Kashinath, K. Towards physics-inspired data-driven weather forecasting: integrating data assimilation with a deep spatial-transformer-based U-NET in a case study with ERA5. Geosci. Model Dev. 15, 2221–2237 (2022).

    Article 

    Google Scholar 

  • Chattopadhyay, A., Nabizadeh, E., Bach, E. & Hassanzadeh, P. Deep learning-enhanced ensemble-based data assimilation for high-dimensional nonlinear dynamical systems. J. Comput. Phys. 477, 111918 (2023).

    Article 

    Google Scholar 

  • Bocquet, M. Surrogate modelling for the climate sciences dynamics with machine learning and data assimilation. Front. Appl. Math. Stat. 9, 1133226 (2023).

    Article 

    Google Scholar 

  • Hatfield, S. et al. Building tangent-linear and adjoint models for data assimilation with neural networks. J. Adv. Model. Earth Syst. 13, e2021MS002521 (2021).

    Article 

    Google Scholar 

  • Tian, X., Holdaway, D. & Kleist, D. Evaluating machine learning weather models for data assimilation: fundamental limitations in tangent linear and adjoint properties. Geophys. Res. Lett. 53, e2025GL119402 (2026).

    Article 

    Google Scholar 

  • Slivinski, L., Whitaker, J. S., Frolov, S., Smith, T. A. & Agarwal, N. Assimilating observed surface pressure into ML weather prediction models. Geophys. Res. Lett. 52, e2024GL114396 (2025).

    Article 

    Google Scholar 

  • Bonavita, M. On some limitations of current machine learning weather prediction models. Geophys. Res. Lett. 51, e2023GL107377 (2024).

    Article 

    Google Scholar 

  • Wang, Z., Lei, L., Anderson, J. L., Tan, Z.-M. & Zhang, Y. Convolutional neural network-based adaptive localization for an ensemble Kalman filter. J. Adv. Model. Earth Syst. 15, e2023MS003642 (2023).

    Article 

    Google Scholar 

  • McCabe, M. & Brown, J. Learning to assimilate in chaotic dynamical systems. Adv. Neural Inf. Process. Syst. 34, 12237–12250 (2021).

    Google Scholar 

  • Boudier, P., Fillion, A., Gratton, S., Gürol, S. & Zhang, S. Data assimilation networks. J. Adv. Model. Earth Syst. 15, e2022MS003353 (2023).

    Article 

    Google Scholar 

  • Bach, E., Baptista, R., Luk, E. & Stuart, A. Learning optimal filters using variational inference. Preprint at https://arxiv.org/abs/2406.18066 (2025).

  • Bocquet, M. et al. Accurate deep learning-based filtering for chaotic dynamics by identifying instabilities without an ensemble. Chaos: Interdiscip. J. Nonlinear Sci. 34, 091104 (2024).

    Article 

    Google Scholar 

  • Bach, E., Baptista, R., Calvello, E., Chen, B. & Stuart, A. Learning enhanced ensemble filters. Preprint at https://arxiv.org/abs/2504.17836 (2025).

  • Keller, J. D. & Potthast, R. AI-based data assimilation: learning the functional of analysis estimation. Preprint at https://arxiv.org/abs/2406.00390 (2024).

  • Alexe, M. et al. GraphDOP: Towards skilful data-driven medium-range weather forecasts learnt and initialised directly from observations. Preprint at https://arxiv.org/abs/2412.15687 (2024).

  • Huang, L., Gianinazzi, L., Yu, Y., Dueben, P. D. & Hoefler, T. Diffda: a diffusion model for weather-scale data assimilation. Preprint at https://arxiv.org/abs/2401.05932 (2024).

  • Casas, C. Q., Arcucci, R., Wu, P., Pain, C. & Guo, Y.-K. A reduced order deep data assimilation model. Phys. D: Nonlinear Phenom. 412, 132615 (2020).

    Article 

    Google Scholar 

  • Arcucci, R., Mottet, L., Pain, C. & Guo, Y.-K. Optimal reduced space for variational data assimilation. J. Comput. Phys. 379, 51–69 (2019).

    Article 

    Google Scholar 

  • van Leeuwen, P. J., Chiu, J.-Y. C. & Yang, C.-K. K. Uncertainty quantification for deep learning. Environ. Data Sci. 4, e53 (2025).

    Article 

    Google Scholar 

  • Cheng, S. et al. Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review. IEEE/CAA J. Autom. Sin. 10, 1361–1387 (2023).

    Article 

    Google Scholar 

  • Brajard, J., Carrassi, A., Bocquet, M. & Bertino, L. Combining data assimilation and machine learning to infer unresolved scale parametrisation. Philos. Trans. R. Soc. A379 (2021).

  • Bocquet, M., Brajard, J., Carrassi, A. & Bertino, L. Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximization. Found. Data Sci. 2, 55–80 (2020).

    Article 

    Google Scholar 

  • Bocquet, M., Farchi, A. & Malartic, Q. Online learning of both state and dynamics using ensemble Kalman filters. Found. Data Sci. 3, 305–330 (2021).

    Article 

    Google Scholar 

  • Farchi, A., Bocquet, M., Laloyaux, P. & Bonavita, M. A comparison of combined data assimilation and machine learning methods for offline and online model error correction. J. Comput. Sci. 55, 101468 (2021).

    Article 

    Google Scholar 

  • Farchi, A., Chrust, M., Bocquet, M., Laloyaux, P. & Bonavita, M. Online model error correction with neural networks in the incremental 4D-Var framework. J. Adv. Model. Earth Syst. 15, e2022MS003474 (2023).

    Article 

    Google Scholar 

  • Boukabara, S.-A. et al. Leveraging modern artificial intelligence for remote sensing and NWP: Benefits and challenges. Bull. Am. Meteorol. Soc. 100, ES473–ES491 (2019).

    Article 

    Google Scholar 

  • Boukabara, S.-A. et al. Outlook for exploiting artificial intelligence in the earth and environmental sciences. Bull. Am. Meteorol. Soc. 102, E1016–E1032 (2021).

    Article 

    Google Scholar 

  • Chen, N. Stochastic Methods for Modeling and Predicting Complex Dynamical Systems: Uncertainty Quantification, State Estimation, and Reduced-Order Models (Springer International Publishing, 2023).

  • Bach, E., Baptista, R., Sanz-Alonso, D. & Stuart, A. Inverse problems and data assimilation: a machine learning approach. Preprint at https://arxiv.org/abs/2410.10523 (2024).

  • Xiao, Y. et al. Fengwu-4DVar: coupling the data-driven weather forecasting model with 4D variational assimilation. Preprint at https://arxiv.org/abs/2312.12455 (2023).

  • Selz, T. & Craig, G. C. Can artificial intelligence-based weather prediction models simulate the butterfly effect? Geophys. Res. Lett. 50, e2023GL105747 (2023).

    Article 

    Google Scholar 

  • Fablet, R. et al. Learning variational data assimilation models and solvers. J. Adv. Model. Earth Syst. 13, e2021MS002572 (2021).

    Article 

    Google Scholar 

  • Farchi, A., Chrust, M., Bocquet, M. & Bonavita, M. Development of an offline and online hybrid model for the integrated forecasting system. Q. J. R. Meteorol. Soc. 151, e4934 (2025).

    Article 

    Google Scholar 

  • Skrunes, F. K. et al. Application of deep learning to the estimation of normalization coefficients in diffusion-based covariance models. Preprint at https://arxiv.org/abs/2312.05068 (2023).

  • Scheck, L. A neural network based forward operator for visible satellite images and its adjoint. J. Quant. Spectrosc. Radiat. Transf. 276, 107841 (2021).

    Article 

    Google Scholar 

  • Abramovicz, D. et al. Bias correction for radiances using machine learning. ITSC-25 Abstracts (2025).

  • Cutraro, A. et al. Machine learning-based lightning forecast for convective resolving numerical weather prediction. In 13th Climate Informatics Conference, Zenodo (2024).

  • Malartic, Q., Farchi, A. & Bocquet, M. State, global, and local parameter estimation using local ensemble Kalman filters: Applications to online machine learning of chaotic dynamics. Q. J. R. Meteorol. Soc. 148, 2167–2193 (2022).

    Article 

    Google Scholar 

  • Goyal, A. & Bengio, Y. Inductive biases for deep learning of higher-level cognition. Proc. R. Soc. A 478, 20210068 (2022).

    Article 

    Google Scholar 

  • Li, J. et al. Deep learning in multimodal remote sensing data fusion: a comprehensive review. Int. J. Appl. Earth Obs. Geoinf. 112, 102926 (2022).

    Google Scholar 

  • Poterjoy, J. A localized particle filter for high-dimensional nonlinear systems. Monthly Weather Rev. 144, 59–76 (2016).

    Article 

    Google Scholar 

  • Geer, A. Learning Earth system models from observations: machine learning or data assimilation? Philos. Trans. R. Soc. A 379 (2021).

  • Sun, Y. Q. et al. Can AI weather models predict out-of-distribution gray swan tropical cyclones? Proc. Natl. Acad. Sci. USA 122, e2420914122 (2025).

    Article 

    Google Scholar 

  • Atkinson, J. et al. FTorch: a library for coupling PyTorch models to Fortran. J. Open Source Softw. 10, 107 (2025).

    Article 

    Google Scholar 

  • Buizza, C. et al. Data learning: Integrating data assimilation and machine learning. J. Comput. Sci. 58, 101525 (2022).

    Article 

    Google Scholar 

  • Lever, J. et al. Facing & mitigating common challenges when working with real-world data: the data learning paradigm. J. Comput. Sci. 85, 102523 (2025).

    Article 

    Google Scholar 

  • Sacco, M. A., Ruiz, J. J., Pulido, M. & Tandeo, P. Evaluation of machine learning techniques for forecast uncertainty quantification. Q. J. R. Meteorol. Soc. 148, 3470–3490 (2022).

    Article 

    Google Scholar 

  • Sacco, M. A., Pulido, M., Ruiz, J. J. & Tandeo, P. On-line machine-learning forecast uncertainty estimation for sequential data assimilation. Q. J. R. Meteorol. Soc. 150, 2937–2954 (2024).

    Article 

    Google Scholar 



  • Source link