Search NASA⌕ Search

SEARCH · Search NASA

Results for “DATA ASSIMILATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Evaluation of the Four-Dimensional Ensemble-Variational Hybrid Data Assimilation with Self-Consistent Regional Background Error Covariance for Improved Hurricane Intensity Forecasts

The feasibility of a hurricane initialization framework based on the Gridpoint Statistical Interpolation (GSI)-based four-dimensional ensemble-variational (GSI-4DEnVar) hybrid data assimilation system for the Hurricane Weather Research and Forecasting model (HWRF) model is evaluated in this study. The system considers the temporal evolution of error covariances via the use of four-dimensional ensemble perturbations that are provided by high-resolution, self-consistent HWRF ensemble forecasts. It is different from the configuration of the GSI-based three-dimensional ensemble-variational (GSI-3DEnVar) hybrid data assimilation system, similar to that used in the operational HWRF, which employs background error covariances provided by coarser-resolution global ensembles from the National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS) ensemble Kalman filtering data assimilation system. In addition, our proposed initialization framework discards the empirical intensity correction in the vortex initialization package that is employed by the GSI-3DEnVar initialization framework in operational HWRF. Data assimilation and numerical simulation experiments for Hurricanes Joaquin (2015), Patricia (2015), and Matthew (2016) are conducted during their intensity changes. The impacts of two initialization frameworks on the HWRF analyses and forecasts are compared. It is found that GSI-4DEnVar leads to a reduction in track, minimum sea level pressure (MSLP), and maximum surface wind (MSW) forecast errors in all of the HWRF simulations, compared with the GSI-3DEnVar initialization framework. With assimilating high-resolution observations within the hurricane inner-core region, GSI-4DEnVar can produce the initial hurricane intensity reasonably well without the empirical vortex intensity correction. Further diagnoses with Hurricane Joaquin indicate that GSI-4DEnVar can significantly alleviate the imbalances in the initial conditions and enhance the performance of the data assimilation and subsequent hurricane intensity and precipitation forecasts

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Convergence in simulating global soil organic carbon by structurally different models after data assimilation

Abstract Current biogeochemical models produce carbon–climate feedback projections with large uncertainties, often attributed to their structural differences when simulating soil organic carbon (SOC) dynamics worldwide. However, choices of model parameter values that quantify the strength and represent properties of different soil carbon cycle processes could also contribute to model simulation uncertainties. Here, we demonstrate the critical role of using common observational data in reducing model uncertainty in estimates of global SOC storage. Two structurally different models featuring distinctive carbon pools, decomposition kinetics, and carbon transfer pathways simulate opposite global SOC distributions with their customary parameter values yet converge to similar results after being informed by the same global SOC database using a data assimilation approach. The converged spatial SOC simulations result from similar simulations in key model components such as carbon transfer efficiency, baseline decomposition rate, and environmental effects on carbon fluxes by these two models after data assimilation. Moreover, data assimilation results suggest equally effective simulations of SOC using models following either first‐order or Michaelis–Menten kinetics at the global scale. Nevertheless, a wider range of data with high‐quality control and assurance are needed to further constrain SOC dynamics simulations and reduce unconstrained parameters. New sets of data, such as microbial genomics‐function relationships, may also suggest novel structures to account for in future model development. Overall, our results highlight the importance of observational data in informing model development and constraining model predictions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Data assimilation empowered neural network parametrizations for subgrid processes in geophysical flows

In the past couple of years, there has been a proliferation in the use of machine learning approaches to represent subgrid-scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical simulations of these flows. Despite its success for different types of flow, the online deployment of a data-driven closure model can cause instabilities and biases in modeling the overall effect of subgrid-scale processes, which in turn leads to inaccurate prediction. To tackle this issue, we exploit the data assimilation technique to correct the physics-based model coupled with the neural network as a surrogate for unresolved flow dynamics in multiscale systems. In particular, we use a set of neural network architectures to learn the correlation between resolved flow variables and the parametrizations of unresolved flow dynamics and formulate a data assimilation approach to correct the hybrid model during their online deployment. We illustrate our framework in a set of applications of the multiscale Lorenz 96 system for which the parametrization model for unresolved scales is exactly known, and the two-dimensional Kraichnan turbulence system for which the parametrization model for unresolved scales is not known a priori. Our analysis, therefore, comprises a predictive dynamical core empowered by (i) a data-driven closure model for subgrid-scale processes, (ii) a data assimilation approach for forecast error correction, and (iii) both data-driven closure and data assimilation procedures. We show significant improvement in the long-term prediction of the underlying chaotic dynamics with our framework compared to using only neural network parametrizations for future prediction. Moreover, we demonstrate that these data-driven parametrization models can handle the non-Gaussian statistics of subgrid-scale processes, and effectively improve the accuracy of outer data assimilation workflow loops in a modular nonintrusive way.

42 ENGINEERING↗
DOE OSTI2024

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics

AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.

Lu, Dan↗
DOE OSTI2025

Data Assimilation for Robust UQ Within Agent-Based Simulation on HPC Systems

Agent-based simulation provides a powerful tool for in silico system modeling. However, these simulations do not provide built-in methods for uncertainty quantification (UQ). Within these types of models a typical approach to UQ is to run multiple realizations of the model then compute aggregate statistics. This approach is limited due to the compute time required for a solution. When faced with an emerging biothreat, public health decisions need to be made quickly and solutions for integrating near real-time data with analytic tools are needed. We propose an integrated Bayesian UQ framework for agent-based models based on sequential Monte Carlo sampling. Given streaming or static data about the evolution of an emerging pathogen this Bayesian framework provides a distribution over the parameters governing the spread of a disease through a population. These estimates of the spread of a disease may be provided to public health agencies seeking to abate the spread. By coupling agent-based simulations with Bayesian modeling in a data assimilation, our proposed framework provides a powerful tool for modeling dynamical systems in silico. We propose a method which reduces model error and provides a range of realistic possible outcomes. Moreover, our method addresses two primary limitations of ABMs: the lack of UQ and an inability to assimilate data. Our proposed framework combines the flexibility of an agent-based model with UQ provided by the Bayesian paradigm in a workflow which scales well to HPC systems. We provide algorithmic details and results on a simulated outbreak with both static and streaming data.

Spannaus, Adam [ORNL] (ORCID:0000000225213657)↗
DOE OSTI2022

Efficient high-dimensional variational data assimilation with machine-learned reduced-order models

Abstract. Data assimilation (DA) in geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction and is a crucial building block that has allowed dramatic improvements in weather forecasting over the past few decades. DA is commonly framed in a variational setting, where one solves an optimization problem within a Bayesian formulation using raw model forecasts as a prior and observations as likelihood. This leads to a DA objective function that needs to be minimized, where the decision variables are the initial conditions specified to the model. In traditional DA, the forward model is numerically and computationally expensive. Here we replace the forward model with a low-dimensional, data-driven, and differentiable emulator. Consequently, gradients of our DA objective function with respect to the decision variables are obtained rapidly via automatic differentiation. We demonstrate our approach by performing an emulator-assisted DA forecast of geopotential height. Our results indicate that emulator-assisted DA is faster than traditional equation-based DA forecasts by 4 orders of magnitude, allowing computations to be performed on a workstation rather than a dedicated high-performance computer. In addition, we describe accuracy benefits of emulator-assisted DA when compared to simply using the emulator for forecasting (i.e., without DA). Our overall formulation is denoted AIEADA (Artificial Intelligence Emulator-Assisted Data Assimilation).

58 GEOSCIENCES↗
DOE OSTI2022

Data assimilation for burnup distribution of PWR with three-dimensional variational algorithm and artificial neutral network

In this paper, a data-assimilation method has been proposed and applied for the burnup distribution of PWR. The burnup distribution is significant to the safety and economy of the reactor, as it is essential for the fuel-reloading design and optimization. Due to the burnup distribution cannot be measured directly during the reactor operation, the numerical simulation is widely applied to determine the burnup distribution. However, there is a deviation between the numerical simulation and the actual core due to some unavoidable factors, such as component manufacturing deviation, uneven flow distribution and so on. These differences would induce the errors to the simulation values of power distributions and hence to the burnup distribution. To address this problem, a data-assimilation method for the burnup distribution has been proposed with the application of power-distribution measurements. In our research, the three-dimensional variational (3DVAR) algorithm was applied for burnup-distribution calibration and the artificial neutral network (ANN) was applied to establish the relation between power distribution and corresponding burnup distribution. As engineering verification, the proposed data-assimilation method has been applied to the CNP1000 PWR operated in China. The numerical results indicated that the burnup-distribution errors can be reduced notably, as the maximum value of relative errors for power distribution can be reduced from 5.35% to 3.96%. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

A Scalable Space-Time Domain Decomposition Approach for Solving Large Scale Nonlinear Regularized Inverse Ill Posed Problems in 4D Variational Data Assimilation

We address the development of innovative algorithms designed to solve the strong-constraint Four Dimensional Variational Data Assimilation (4DVar DA) problems in large scale applications. We present a space-time decomposition approach which employs the whole domain decomposition, i.e. both along the spacial and temporal direction in the overlapping case, and the partitioning of both the solution and the operator. Starting from the global functional defined on the entire domain, we get to a sort of regularized local functionals on the set of sub domains providing the order reduction of both the predictive and the Data Assimilation models. The algorithm convergence is developed. Performance in terms of reduction of time complexity and algorithmic scalability is discussed on the Shallow Water Equations on the sphere. The number of state variables in the model, the number of observations in an assimilation cycle, as well as numerical parameters as the discretization step in time and in space domain are defined on the basis of discretization grid used by data available at repository Ocean Synthesis/Reanalysis Directory of Hamburg University.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Using Ensemble Data Assimilation to Estimate Transient Hydrologic Exchange Flow Under Highly Dynamic Flow Conditions

Abstract Quantifying dynamic hydrologic exchange flows (HEFs) within river corridors that experience high‐frequency flow variations caused by dam regulations is important for understanding the biogeochemical processes at the river water and groundwater interfaces. Heat has been widely used as a tracer to infer steady‐state flow velocities through analytical solutions of heat transport defined by the diurnal temperature signals. Under sub‐daily dynamic flow conditions, however, such analytical solutions are not applicable due to the violation of their fundamental assumptions. In this study, we developed a data assimilation‐based approach to estimate the sub‐daily flux under highly dynamic flow conditions using multi‐depth temperature observations at a 5‐min resolution. If the hydraulic gradient is measured, Darcy's law was used to calculate the flux with permeability estimated from temperature responses below the riverbed. Otherwise, flux was estimated directly by assimilating multi‐depth temperature data at 1‐ or 2‐hr time intervals assuming one‐dimensional flow and heat transport governing equation. By comparing estimated fluxes with model‐generated synthetic truth, we demonstrated that both schemes have robust performance in estimating fluxes under highly dynamic flow conditions. This data assimilation‐based flux estimation method was able to capture the vertical sub‐daily fluxes using multi‐depth high‐resolution temperature data alone, even in the presence of multi‐dimensional flow. This approach has been successfully applied to real field temperature data collected at the Hanford site, which experiences highly dynamic HEFs. Our study shows the promise of adopting distributed 1‐D temperature monitoring to capture spatial and temporal exchange dynamics in river corridors at a watershed scale or beyond.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Development of an open-source regional data assimilation system in PEcAn v. 1.7.2: application to carbon cycle reanalysis across the contiguous US using SIPNET

Abstract. The ability to monitor, understand, and predict the dynamics of the terrestrial carbon cycle requires the capacity to robustly and coherently synthesize multiple streams of information that each provide partial information about different pools and fluxes. In this study, we introduce a new terrestrial carbon cycle data assimilation system, built on the PEcAn model–data eco-informatics system, and its application for the development of a proof-of-concept carbon “reanalysis” product that harmonizes carbon pools (leaf, wood, soil) and fluxes (GPP, Ra, Rh, NEE) across the contiguous United States from 1986–2019. We first calibrated this system against plant trait and flux tower net ecosystem exchange (NEE) using a novel emulated hierarchical Bayesian approach. Next, we extended the Tobit–Wishart ensemble filter (TWEnF) state data assimilation (SDA) framework, a generalization of the common ensemble Kalman filter which accounts for censored data and provides a fully Bayesian estimate of model process error, to a regional-scale system with a calibrated localization. Combined with additional workflows for propagating parameter, initial condition, and driver uncertainty, this represents the most complete and robust uncertainty accounting available for terrestrial carbon models. Our initial reanalysis was run on an irregular grid of ∼ 500 points selected using a stratified sampling method to efficiently capture environmental heterogeneity. Remotely sensed observations of aboveground biomass (Landsat LandTrendr) and leaf area index (LAI) (MODIS MOD15) were sequentially assimilated into the SIPNET model. Reanalysis soil carbon, which was indirectly constrained based on modeled covariances, showed general agreement with SoilGrids, an independent soil carbon data product. Reanalysis NEE, which was constrained based on posterior ensemble weights, also showed good agreement with eddy flux tower NEE and reduced root mean square error (RMSE) compared to the calibrated forecast. Ultimately, PEcAn's new open-source regional data assimilation framework provides a scalable workflow for harmonizing multiple data constraints and providing a uniform synthetic platform for carbon monitoring, reporting, and verification (MRV) as well as accelerating terrestrial carbon cycle research.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Data-assimilated time-lapse visco-acoustic full-waveform inversion: Theory and application for injected CO 2 plume monitoring

Continuous seismic monitoring for quantifying CO 2 plume migration and detection of any potential leakages in the subsurface is essential for the security of long-term anthropogenic carbon dioxide geologic storage. Traditional time-lapse full-waveform inversion (TLFWI) methods aim to map the CO 2 distribution by estimating seismic velocity changes, but recent studies find that CO 2 -induced attenuation is an important complement to seismic velocity for tracking the CO 2 plumes and even quantifying the CO 2 saturation. We have developed a novel data-assimilated TLFWI method to construct high-resolution time-lapse velocity and attenuation changes from dense time-lapse monitoring data. This method consists of two theoretical developments: visco-acoustic full-waveform inversion (QFWI) and multiparameter hierarchical matrix-powered extended Kalman filter (mHiEKF). The method is capable of (1) posing temporal constraints to retrieve time-lapse information from dense monitoring data by using mHiEKF, (2) accurately recovering high-spatial-resolution velocity and attenuation perturbations using first-order equation system-based QFWI, and (3) providing the model uncertainty by estimating their model standard deviation. With numerical examples, we first find the effectiveness of the new QFWI on estimating accurate velocity and attenuation models simultaneously. Then, a CO 2 leakage case and a realistic Frio-II CO 2 monitoring case are presented to find the advantages and applicability of our data-assimilated QFWI method for estimating time-lapse changes using dense time-lapse monitoring surveys. Here, by assimilating time-lapse seismic monitoring data over time, our data-assimilated QFWI method can improve the resolution of velocity and attenuation changes and decrease their model uncertainties.

58 GEOSCIENCES↗
DOE OSTI2021

Predicting Thermal Performance of an Enhanced Geothermal System From Tracer Tests in a Data Assimilation Framework

Abstract Predicting the thermal performance of an enhanced geothermal system (EGS) requires a comprehensive characterization of the underlying fracture flow patterns from practically available data such as tracer data. However, due to the inherent complexities of subsurface fractures and the generally insufficient geological/geophysical data, interpreting tracer data for fracture flow characterization and thermal prediction remains a challenging task. The present study aims to tackle the challenge by leveraging a data assimilation method to maximize the utilization of information inherently contained in tracer data, and meanwhile maintain the flexibility to handle various uncertainties. A tracer data interpretation framework was proposed with the following three components integrated: (a) We use principal component analysis (PCA) to reduce the dimensionality of model parameter space. (b) We use ES‐MDA (ensemble smoother with multiple data assimilation) to invert for fracture aperture/flow fields and obtain posterior model ensembles for uncertainty quantification. Various data types are assimilated jointly to improve the predictive ability of the posterior ensemble. (c) The inverted fracture aperture fields are then incorporated into reservoir models to predict thermal performance. We developed a field‐scale EGS model to verify the ability of the framework to characterize highly heterogeneous fracture aperture/flow fields and predicting thermal performance. We also applied the framework to a mesoscale field experiment to demonstrate its potential application in real‐world geothermal reservoirs. The results indicate that the proposed framework can effectively retrieve fracture flow information from tracer data for thermal prediction and uncertainty quantification, and thus provide informative guidance for EGS optimization and risk management.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Randomized Preconditioned Solvers for Strong Constraint 4D-Var Data Assimilation

The Strong Constraint 4D Variational (SC-4DVAR) data assimilation method is widely used in climate and weather applications. SC-4DVAR involves solving a minimization problem to compute the maximum a posteriori estimate, which we tackle using the Gauss-Newton method. The computation of the descent direction is expensive since it involves the solution of a large-scale and potentially ill-conditioned linear system, solved using the preconditioned conjugate gradient (PCG) method. Here, to address this cost, we efficiently construct scalable preconditioners using three different randomization techniques, which all rely on a certain low-rank structure involving the Gauss-Newton Hessian. The proposed techniques come with theoretical guarantees on the condition number, and at the same time, are amenable to parallelization. We also develop an adaptive approach to estimate the sketch size and choose between the reuse or recomputation of the preconditioner. We demonstrate the performance and effectiveness of our methodology on two representative model problems—the Burgers and barotropic vorticity equation—showing a drastic reduction in both the number of PCG iterations and the number of Gauss-Newton Hessian products after including the preconditioner construction cost.

Gauss-Newton↗
DOE OSTI2022

The Impact of Constrained Data Assimilation on the Forecasts of Three Convection Systems During the ARM MC3E Field Campaign

A constrained data assimilation (CDA) system based on the ensemble variational (EnVar) method and physical constraints of mass and water conservations is evaluated through three convective cases during the Midlatitude Continental Convective Clouds Experiment (MC3E) of the Atmospheric Radiation Measurement (ARM) program. Compared to the original data assimilation (ODA), the CDA is shown to perform better in the forecasted state variables and simulated precipitation. The CDA is also shown to greatly mitigate the loss of forecast skills in observation denial experiments when radar radial winds are withheld in the assimilation. Modifications to the algorithm and sensitivities of the CDA to the calculation of the time tendencies in the constraints are described.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Data assimilation for combustion ignition delay time simulation using schlieren image velocimetry

This study sought to improve the accuracy of simulating spray penetration and combustion ignition delay by means of data assimilation (DA). The simulations were conducted using the Reynolds-averaged Navier–Stokes (RANS) equations and assimilating the schlieren image data. In DA, an ensemble square root filter (EnSRF) was used to build the statistical model, making the simulation results more accurate without any change in the governing equations. Recognizing that the spray-cone injection angle has a large effect on penetration, we created ensemble members with different injection angles. And we applied the two-component velocity distribution calculated via SIV and updated both velocity and temperature by using a DA statistical model derived from RANS ensemble simulations. The ignition delay time is generally known to vary even under the same experimental conditions because it is influenced by many factors. In this study, we attempted the transient DA-assisted RANS simulation to predict the ignition delay time even when the temporal resolution and accuracy of the observation data ware insufficient. Our trials offer an example of how a combination of techniques can be effectively used to assimilate experimental data obtained under restricted conditions.

Combustion simulation↗
DOE OSTI2021

Integration of AI/ML with Data Assimilation for Earth System Prediction

Focal Area(s): Development of dynamically consistent AI/ML methods that can integrate with the data assimilation cycle to improve the efficiency and effectiveness of state estimation and prediction at short to medium range forecast horizons. Science Challenge: This white paper addresses a first step toward complete integration of AI/ML and DA. Here, we address model emulation and its application to simple coupled atmosphere-ocean dynamics for use in data assimilation applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

WRF-Chem & Data Assimilation: Reconstructing a Historic Dispersion Event

CONCLUSIONS • For this particular case and use, 3D-VAR was the most useful data assimilation method applied for modeling this plume. • Slight downside was the plume was modeled to move too quickly. • Whether this result is generalizable may be debatable based on the circumstances. • The atmospheric state altered how effective the data assimilation algorithms performed. • Nudging and 3D-VAR are not mutually exclusive, but their errors for wind speed may compound

Thomas, Andrew M. [Savannah River National Laborat↗