Search NASA⌕ Search

SEARCH · Search NASA

Results for “Variational data assimilation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

13 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Hourly PM 2.5 Estimates across California from 2018 to 2023

This study presents a new data set of hourly PM 2.5 concentrations across California from 2018 to 2023 at a three-kilometer resolution. This data set was developed by assimilating observations from PurpleAir and the U.S. EPA Air Quality System monitors into wildfire smoke forecasts from the High-Resolution Rapid Refresh Smoke (HRRR-Smoke) model using the Gridpoint Statistical Interpolation (GSI) three-dimensional variational data assimilation framework. Archived forecasts of modeled wildfire smoke PM 2.5 from HRRR-Smoke create the background field for assimilation, which is then corrected using surface observations of total PM 2.5 . The resulting reanalysis from GSI provides an estimate of total PM 2.5 that minimizes error from both the observational and the model data. Validation results indicate strong performance, with monthly R 2 values ranging from 0.73 to 0.91 across the six-year data set, comparable to other PM 2.5 data sets. Case studies are presented for three major fire events, the 2018 Camp Fire, 2019 Kincade Fire, and 2020 Lightning Complex Fires to demonstrate the data set’s fidelity in resolving plume dynamics and local exposure patterns. Root-mean-squared error averaged over each month scales with average PM 2.5 concentrations, resulting in a low error under typical conditions but higher absolute errors during extreme smoke events. This is the first long-term, hourly PM 2.5 data set of its kind for California and enables the generation of subdaily exposure metrics, such as peak hourly concentrations, exceedance durations, and time-of-day exposure peaks. The novelty and strong validation of this data set make it a compelling resource for future studies on the impact and significance of subdaily PM 2.5 exposure.

PM2.5↗
DOE OSTI2025

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate FourCastNet, a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 data. Our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.

Adrian, Melissa [Univ. of Chicago, IL (United Stat↗
DOE OSTI2025

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate the Fourier Forecasting Neural Network (FourCastNet), a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 global reanalysis data from the European Centre for Medium-Range Weather Forecasts (ECMWF). Here, our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.

Data assimilation↗
DOE OSTI2025

Randomized Preconditioned Solvers for Strong Constraint 4D-Var Data Assimilation

The Strong Constraint 4D Variational (SC-4DVAR) data assimilation method is widely used in climate and weather applications. SC-4DVAR involves solving a minimization problem to compute the maximum a posteriori estimate, which we tackle using the Gauss-Newton method. The computation of the descent direction is expensive since it involves the solution of a large-scale and potentially ill-conditioned linear system, solved using the preconditioned conjugate gradient (PCG) method. Here, to address this cost, we efficiently construct scalable preconditioners using three different randomization techniques, which all rely on a certain low-rank structure involving the Gauss-Newton Hessian. The proposed techniques come with theoretical guarantees on the condition number, and at the same time, are amenable to parallelization. We also develop an adaptive approach to estimate the sketch size and choose between the reuse or recomputation of the preconditioner. We demonstrate the performance and effectiveness of our methodology on two representative model problems—the Burgers and barotropic vorticity equation—showing a drastic reduction in both the number of PCG iterations and the number of Gauss-Newton Hessian products after including the preconditioner construction cost.

Gauss-Newton↗
DOE OSTI2025

Preserving nonlinear constraints in variational flow filtering data assimilation

Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems of interest obey nonlinear physical constraints, and the corresponding dynamics is confined to a certain sub-manifold of the state space. Standard data assimilation techniques applied to such systems yield posterior states lying outside the manifold, violating the physical constraints. This work focuses on particle flow filters which use stochastic differential equations to evolve state samples from a prior distribution to samples from an observation-informed posterior distribution. The variational Fokker-Planck (VFP)—a generic particle flow filtering framework—is extended to incorporate non-linear, equality state constraints in the analysis. To this end, two algorithmic approaches that modify the VFP stochastic differential equation are discussed: (i) VFPSTAB, to inexactly preserve constraints with the addition of a stabilizing drift term, and (ii) VFPDAE, to exactly preserve constraints by treating the VFP dynamics as a stochastic differential-algebraic equation (SDAE). Additionally, an implicit-explicit time integrator is developed to evolve the VFPDAE dynamics. The strength of the proposed approach for constraint preservation in data assimilation is demonstrated on three test problems: the double pendulum, Korteweg-de-Vries, and the incompressible Navier-Stokes equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Ensemble variational Fokker-Planck methods for data assimilation

Particle flow filters solve Bayesian inference problems by smoothly transforming a set of particles into samples from the posterior distribution. Particles move in state space under the flow of an McKean-Vlasov-Itˆo process. This work introduces the Variational Fokker-Planck (VFP) framework for data assimilation, a general approach that includes previously known particle flow filters as special cases. The McKean-Vlasov-Itˆo process that transforms particles is defined via an optimal drift that depends on the selected diffusion term. It is established that the underlying probability density - sampled by the ensemble of particles - converges to the Bayesian posterior probability density. For a finite number of particles the optimal drift contains a regularization term that nudges particles toward becoming independent random variables. Based on this analysis, we derive computationally-feasible approximate regularization approaches that penalize the mutual information between pairs of particles, and avoid particle collapse. Moreover, the diffusion plays a role akin to a particle rejuvenation approach that aims to alleviate particle collapse. The VFP framework is very flexible. Different assumptions on prior and intermediate probability distributions can be used to implement the optimal drift, and localization and covariance shrinkage can be applied to alleviate the curse of dimensionality. A robust implicit-explicit method is discussed for the efficient integration of stiff McKean- Vlasov-Itˆo processes. Here, the effectiveness of the VFP framework is demonstrated on three progressively more challenging test problems, namely the Lorenz ’63, Lorenz ’96 and the quasi-geostrophic equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Benchmarking Near-Surface Winds in the HRRR Analyses Using Multisource Observations over Complex Terrain in the Southeastern United States

Wind energy plays a crucial role in sustainable power generation, yet its full potential in the southeast United States (SEUS) remains underexplored. This study advances wind resource assessment in the SEUS using existing regional modeling and multisource observations. We find that terrain complexity, influenced by orography and forest canopy, significantly impacts the accuracy of modeled wind speed. While the High-Resolution Rapid Refresh (HRRR) model effectively simulates wind profiles over flat, nonforested terrain, larger errors are produced above forest canopies, and particularly for those stands in hilly and mountainous terrain where there are no observations aloft that could be used by HRRR’s data assimilation software. Seasonal variations, e.g., changes in the leaf area index, further complicate the relationship between terrain complexity and simulation errors. Here, our findings emphasize the critical need for comprehensive wind profile measurements, extending from below the canopy to height above the canopy and through the lower planetary boundary layer, to fully quantify model performance over and near forests, and for improving wind resource assessment, planning, and management. This study provides valuable insights not only for further model development but also for future field campaign deployment with the goal of further improving our understanding of wind resources in the region.

Complex terrain↗
DOE OSTI2025

Development and evaluation of a new 4DEnVar-based weakly coupled ocean data assimilation system in E3SMv2

The development, implementation, and evaluation of a new weakly coupled ocean data assimilation (WCODA) system for the fully coupled Energy Exascale Earth System Model version 2 (E3SMv2) utilizing the four-dimensional ensemble variational (4DEnVar) method are presented in this study. The 4DEnVar method, based on the dimension-reduced projection four-dimensional variational (DRP-4DVar) approach, replaces the adjoint model with the ensemble technique, thereby reducing computational demands. Monthly mean ocean temperature and salinity data from the EN4.2.1 reanalysis are integrated into the ocean component of E3SMv2 from 1950 to 2021 with the goal of providing realistic initial conditions for decadal predictions and predictability studies. The performance of the WCODA system is assessed using various metrics, including the reduction rate of the cost function, root mean square error (RMSE) differences, correlation differences, and model biases. Results indicate that the WCODA system effectively assimilates the reanalysis data into the climate model, consistently achieving negative reduction rates of the cost function and notable improvements in RMSE and correlation across various ocean layers and regions. Significant enhancements are observed in the upper ocean layers across the majority of global ocean regions, particularly in the north Atlantic, north Pacific, and Indian Ocean. Model biases in sea surface temperature and salinity are also substantially reduced. For sea surface temperature, cold biases in the north Pacific and north Atlantic are diminished by about 1–2 °C, and warm biases in the Southern Ocean are corrected by approximately 1.5–2.5 °C. In terms of salinity, improvements are observed with bias reductions of about 0.5–1 psu in the north Atlantic and north Pacific and up to 1.5 psu in parts of the Southern Ocean. The ultimate goal of the WCODA system is to advance the predictive capabilities of E3SM for subseasonal to decadal climate predictions, thereby supporting research on strategic energy-sector policies and planning.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

An entropy-based debiasing approach to quantifying experimental coverage for novel applications of interest in the nuclear community

This manuscript proposes a novel information-theoretic approach to the quantification of experimental relevance, i.e., coverage, to achieve optimal data assimilation results for nuclear engineering applications. Specifically, this work posits the need for a new metric, called coverage (q C ) of an application’s quantity of interest, i.e., eigenvalue or power peaking for an advanced reactor concept, defined herein as the theoretically maximum achievable reduction in the quantity’s uncertainty given measurements from a pool of experiments in a manner that is independent of the data assimilation procedure employed. Currently, reduction in a quantity’s uncertainty is strongly biased by the underlying assumptions of the assimilation procedure to account for the under-determined nature of such problems and the similarity criterion employed to identify relevant experiments. To address this challenge, this work has developed a coverage metric, q C , based on mutual information, which establishes a new conceptual framework for assessing coverage, one that is independent of the model parameters and responses degree of variations in both the experimental and application domains, i.e., linear vs non-linear, and their prior uncertainty distributions, i.e., Gaussian vs. non-Gaussian. The q C is an entropic measure capable of addressing coverage for general nonlinear problems with non-Gaussian uncertainties and inclusive of the measurement uncertainties from multiple experiments. Numerical experiments from manufactured analytical problems as well as a set of benchmarks from the ICSBEP handbook are employed to demonstrate its theoretical and practical performance as compared to the c k -based experiment selection methodology, commonly employed in the neutronic community. The manuscript then employs other well-known adaptations to existing data assimilation methodologies for nonlinear and non-Gaussian problems capable of achieving the coverage posited by q C .

Bayesian data assimilation↗
DOE OSTI2026

Latent Twins

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical partial differential equations (PDEs), dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ordinary differential equations (ODEs) and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with deep operator network and forecasts with a four-dimensional variational method baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Latent Twins↗
DOE OSTI2025

Description of a novel extremophile green algae, Chlamydomonas pacifica , and its potential as a biotechnology host

We present the comprehensive characterization of a newly identified microalga, Chlamydomonas pacifica , originally isolated from a soil sample in San Diego, CA, USA. This species showcases remarkable biological versatility, including a broad pH range tolerance (6–11.5), high thermal tolerance (up to 42 °C), and salinity resilience (up to 2 % NaCl). Its amenability to genetic manipulation and sexual reproduction via mating, particularly between the two opposing strains CC-5697 & CC-5699, now publicly available through the Chlamydomonas Resource Center, underscores its potential as a biotechnological chassis. The biological assessment of C. pacifica revealed versatile metabolic capabilities, including diverse nitrogen assimilation capability, motility and phototaxis. Genomic and transcriptomic analyses identified 17,829 genes within a 121 Mb genome, featuring a GC content of 61 %. The codon usage of C. pacifica closely mirrors that of C. reinhardtii , indicating a conserved genetic architecture that supports a trend in codon preference with minor variations. Phylogenetic analyses position C. pacifica within the core-Reinhardtinia clade yet distinct from known Volvocales species. The lipidomic data revealed an abundance of triacylglycerols (TAGs), promising for biofuel applications and lipids for health-related benefits. Our investigation lays the groundwork for exploiting C. pacifica in biotechnological applications, from biofuel generation to synthesizing biodegradable plastics, positioning it as a versatile host for future bioengineering endeavors.

Alkali tolerant↗
DOE OSTI2026

Evaluating ecosystem water use efficiency under drought stress: a case study of the Helan Mountain region, northwest China

Context Water use efficiency (WUE) is a fundamental ecological indicator links carbon assimilation and water loss in terrestrial ecosystems. Understanding its responses to drought stress is essential for adaptive ecosystem management, particularly in climate-sensitive mountain landscapes. Objectives This study aimed to investigate drought-driven variations in WUE across major vegetation types in the Helan Mountain region of Northwest China. Specifically, we sought to identify dominant ecological drivers of WUE variability and to disentangle their relative importance and causal pathways. Methods We quantified WUE using the Moderate Resolution Imaging Spectroradiometer (MODIS) products and the Drought Severity Index (DSI) data from 2001 to 2020. To examine WUE – drought relationships across contrasting vegetation types, we employed a spatially explicit analytical framework integrating Random Forest (RF) modeling, partial correlation analysis, and structural equation modeling (SEM). Results Regional WUE exhibited relatively stable interannual dynamics, yet pronounced spatial heterogeneity that was strongly modulated by drought conditions. Vegetation properties, particularly Leaf Area Index (LAI) and Normalized Difference Vegetation Index (NDVI), emerged as the dominant determinants of WUE, with NDVI alone explaining over 20% of its spatial variance in forest and grassland during non-drought periods. SEM analyses revealed that climate forcing influenced WUE mainly through indirect pathways mediated by soil moisture availability and vegetation structural dynamics, rather than through direct climatic controls. Among all regulating factors, LAI acted as the central control node governing ecosystem carbon–water coupling. In contrast, short-term climatic stress, especially atmospheric demand and drought duration, exerted weak or negative direct effects on WUE. Ecosystem-specific responses were observed, with croplands mainly regulated by soil water availability, whereas forests and grasslands showed more sensitive to atmospheric drought stress. Together, these results reveal a hierarchical control framework where soil–vegetation interactions mediate climate impacts on WUE, driving strong spatial heterogeneity in drought responses across mountain landscapes. Conclusions Our findings highlight the pivotal role of indirect drought effects mediated by vegetation and soil processes in shaping ecosystem WUE. The identified soil–vegetation–climate regulatory hierarchy provides mechanistic insight into landscape–scale drought sensitivity and supports integrated modeling approaches for evaluating ecosystem resilience and sustainable management in arid mountain regions.

China↗
DOE OSTI2024

Leaf functional traits highlight phenotypic variation of two tree species in the urban environment

Urbanization is transforming landscapes globally, altering environmental conditions that affect ecosystem functioning, particularly in urban areas where trees are crucial for regulating microclimates, improving air quality, and sustaining biodiversity. This study investigates the environmental differences and tree leaf structure and morphology in urban and suburban sites in the Chicago Metropolitan Region. The leaf functional traits of Norway Maple and Little − leaved Linden were studied in three locations in the summer of 2023: an urban park (University of Illinois Chicago, Chicago, IL), a suburban park (Morton Arboretum, Lisle, IL), and a suburban residential site (Lombard, IL). The urban site had higher daytime and nighttime air, and land surface temperatures compared to the suburban sites with significant fluctuations observed across the sites. Cumulative growing degree days, a measure of potential photosynthetically active days, were also higher in the urban park than in the suburban sites between March and August. Norway Maple trees growing in the urban site displayed higher specific leaf area (SLA) and lower leaf dry matter content (LDMC) than in the suburban sites, resulting in thinner leaves. Similarly, Little−leaved Linden trees in the suburban residential site displayed higher SLA and lower LDMC than those in the suburban park. The values of gas exchange traits − namely photosynthetic assimilation, transpiration rates, and stomatal conductance − of Norway Maple were higher at the urban site compared to suburban sites as temperatures increased during the summer. Norway Maple gas exchange values decreased as the growing season progressed, as expected by ontogeny. In contrast, Little−leaved Linden maintained similar leaf gas exchange values throughout the growing season. Both species in the urban site exhibited lower instantaneous water use efficiency and reduced LDMC, suggesting greater water loss in response to elevated temperatures compared to suburban park and residential sites. Comparisons with existing global trait databases emphasize the need for localized data to accurately capture site−specific responses. Although some traits aligned with database values, others deviated significantly, underscoring the importance of comprehensive, site−specific datasets for robust ecosystem modeling and management strategies.

Cho, Ahram↗