Search NASA⌕ Search

SEARCH · Search NASA

Results for “DATA ASSIMILATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Quantifying UAS Observation Error Variance Used in Data Assimilation Systems and Its Impact on Predictive Skill

Observation error determines the weights of the observations and background state used in data assimilation to generate analyses. Quantifying observation error is critical for the optimal assimilation of observational data sets. Uncrewed Aircraft System (UAS) observations have shown potential benefits in filling observational gaps in the lower atmosphere; however, characterization of their error characteristics has been limited. To optimize the use of UAS observations in numerical weather prediction, UAS observation error is estimated based on the 3‐cornered hat diagnostic approach which uses three independent estimates of the atmospheric state. This approach is applied to data from the 2018 Lower Atmospheric Profiling Studies at Elevation‐a Remotely‐piloted Aircraft Team Experiment field campaign using collocated UAS and rawinsonde observations along with output from a set of convection‐permitting model simulations. The estimated observation error values for UAS temperature, wind, and relative humidity measurements were found to be only weakly dependent on height AGL with mean values equal to 0.5°C, 0.8 m s −1 , and 3%, respectively. Only the newly estimated observation error for temperature differed from that previously used to assimilate commercial aircraft observations into global models (1.0°C). However, using this reduced temperature observation error produced more accurate mesoscale analyses and forecasts of both terrain‐driven flows and convection initiation generated by colliding outflow boundaries within the San Luis Valley of Colorado.

54 ENVIRONMENTAL SCIENCES↗

The impact of multi-sensor land data assimilation on river discharge estimation

River discharge is one of the most critical renewable water resources. Accurately estimating river discharge with land surface models (LSMs) remains challenging due to the difficulty in estimating land water storages such as snow, soil moisture, and groundwater. While data assimilation (DA) ingesting optical, microwave, and gravity measurements from space can help constrain theses storage states, its impacts on runoff and eventually river discharge are not fully understood. In this study, by taking advantage of recently published land DA results that jointly assimilate eight different combinations of observations from the Moderate Resolution Imaging Spectroradiometer (MODIS), Gravity Recovery and Climate Experiment (GRACE), and Advanced Microwave Scanning Radiometer for EOS (AMSR-E), we quantify to what degree multi-sensor land DA improves the river discharge simulation skills over 40 global river basins, and investigate the complementary strengths of different satellite measurements on river discharge. To be more specific, river discharge is updated by feeding gridded runoff from the eight multi-sensor DA simulations into a vector-based river routing model named the Routing Application for Parallel computatIon of Discharge (RAPID). Our modeling results, including 7-year simulations at 177,458 river reaches globally, are used to study the seasonal to interannual variability of river discharge. It is found that assimilating GRACE has the greatest impact on global runoff patterns, leading to the most pronounced improvements in spatial river discharge in the middle and high latitudes with the R 2 increased by 0.16. The seasonal variation of spatial discharge is most skillful during the boreal summer. However, our evaluation also shows model and DA still struggle to generate reasonable variability and averaged discharge over permafrost regions. Finally, by assessing how different satellites add value to discharge forecasts, this study paves the way for more advanced multi-sensor satellite data assimilation to predict the terrestrial hydrological cycle.

54 ENVIRONMENTAL SCIENCES↗

Global Temperature Responses to Large Tropical Volcanic Eruptions in Paleo Data Assimilation Products and Climate Model Simulations Over the Last Millennium

Abstract Large volcanic eruptions are one of the dominant perturbations to global and regional atmospheric temperatures on timescales of years to decades. Discrepancies remain, however, in the estimated magnitude and persistence of the surface temperature cooling caused by volcanic eruptions, as characterized by paleoclimatic proxies and climate models. We investigate these discrepancies in the context of large tropical eruptions over the Last Millennium using two state‐of‐the‐art data assimilation products, the Paleo Hydrodynamics Data Assimilation product (PHYDA) and the Last Millennium Reanalysis (LMR), and simulations from the National Center for Atmospheric Research Community Earth System Model‐Last Millennium Ensemble (NCAR CESM‐LME). We find that PHYDA and LMR estimate mean global and hemispheric cooling that is similar in magnitude and persistence once effects from eruptions occurring in short succession are removed. The estimates also compare well to Northern‐Hemisphere reconstructions based solely or partially on tree‐ring density, which have been proposed as the most accurate proxy estimates of surface cooling due to volcanism. All proxy‐based estimates also agree well with the magnitude of the mean cooling simulated by the CESM‐LME. Differences remain, however, in the spatial patterns of the temperature responses in the PHYDA, LMR, and the CESM‐LME. The duration of cooling anomalies also persists for several years longer in the PHYDA and LMR relative to the CESM‐LME. Our results demonstrate progress in resolving discrepancies between proxy‐ and model‐based estimates of temperature responses to volcanism, but also indicate these estimates must be further reconciled to better characterize the risks of future volcanic eruptions.

Tejedor, E.↗

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate the Fourier Forecasting Neural Network (FourCastNet), a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 global reanalysis data from the European Centre for Medium-Range Weather Forecasts (ECMWF). Here, our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.

Data assimilation↗

Equation‐Free Surrogate Modeling of Geophysical Flows at the Intersection of Machine Learning and Data Assimilation

Abstract There is a growing interest in developing data‐driven reduced‐order models for atmospheric and oceanic flows that are trained on data obtained either from high‐resolution simulations or satellite observations. The data‐driven models are non‐intrusive in nature and offer significant computational savings compared to large‐scale numerical models. These low‐dimensional models can be utilized to reduce the computational burden of generating forecasts and estimating model uncertainty without losing the key information needed for data assimilation (DA) to produce accurate state estimates. This paper aims at exploring an equation‐free surrogate modeling approach at the intersection of machine learning and DA in Earth system modeling. With this objective, we introduce an end‐to‐end non‐intrusive reduced‐order modeling (NIROM) framework equipped with contributions in modal decomposition, time series prediction, optimal sensor placement, and sequential DA. Specifically, we use proper orthogonal decomposition (POD) to identify the dominant structures of the flow, and a long short‐term memory network to model the dynamics of the POD modes. The NIROM is integrated within the deterministic ensemble Kalman filter (DEnKF) to incorporate sparse and noisy observations at optimal sensor locations obtained through QR pivoting. The feasibility and the benefit of the proposed framework are demonstrated for the NOAA Optimum Interpolation Sea Surface Temperature (SST) V2 data set. Our results indicate that the NIROM is stable for long‐term forecasting and can model dynamics of SST with a reasonable level of accuracy. Furthermore, the prediction accuracy of the NIROM gets improved by almost one order of magnitude by the DEnKF algorithm.

Pawar, Suraj↗

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate FourCastNet, a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 data. Our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.

Adrian, Melissa [Univ. of Chicago, IL (United Stat↗

Physics‐Informed Machine Learning Method for Large‐Scale Data Assimilation Problems

Abstract We develop a physics‐informed machine learning approach for large‐scale data assimilation and parameter estimation and apply it for estimating transmissivity and hydraulic head in the two‐dimensional steady‐state subsurface flow model of the Hanford Site given synthetic measurements of said variables. In our approach, we extend the physics‐informed conditional Karhunen‐Loéve expansion (PICKLE) method to modeling subsurface flow with unknown flux (Neumann) and varying head (time‐dependent Dirichlet) boundary conditions. We demonstrate that the PICKLE method is comparable in accuracy with the standard maximum a posteriori (MAP) method, but is significantly faster than MAP for large‐scale problems. Both methods use a mesh to discretize the computational domain. In MAP, the parameters and states are discretized on the mesh; therefore, the size of the MAP parameter estimation problem directly depends on the mesh size. In PICKLE, the mesh is used to evaluate the residuals of the governing equation, while the parameters and states are approximated by the truncated conditional Karhunen‐Loéve expansions with the number of parameters controlled by the smoothness of the parameter and state fields, and not by the mesh size. For a considered example, we demonstrate that the computational cost of PICKLE increases near linearly (as N 1.15 ) with the number of grid nodes N , while that of MAP increases much faster (as N 3.28 ). We also show that once trained for one set of Dirichlet boundary conditions (i.e., one river stage), the PICKLE method provides accurate estimates of the hydraulic head for any value of the Dirichlet boundary conditions (i.e., for any river stage).

97 MATHEMATICS AND COMPUTING↗

Adjoint sensitivity analysis and data assimilation for verification of dry storage cask contents

Dry cask storage is a method for interim storage of spent fuel assemblies which contain fissile isotopes of uranium and plutonium. These can present a proliferation concern and consequently there is a need for non-destructive testing methods to verify a dry cask's contents for proliferation protection. We present an application of adjoint sensitivity analysis and data assimilation to a multigroup diffusion model of dry cask storage. Adjoint sensitivity analysis allows the efficient calculation of sensitivities for use in data assimilation to calibrate imprecisely known parameter values and data consistency tests to detect diversion scenarios. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Data Assimilative Optimization of WSA Source Surface and Interface Radii using Particle Filtering

TheWang-Sheeley-Arge (WSA) model estimates solar wind speed and interplanetary magnetic field polarity in the inner heliosphere using global photospheric magnetic field maps. WSA employs the Potential Field Source Surface (PFSS) and Schatten Current Sheet (SCS) models to determine the Sun's global coronal magnetic field. The PFSS and SCS models are connected through two radial parameters, the source surface and interface radii, which specify the overlap region between the inner SCS and outer PFSS models. Though both radii values are adjustable, they have typically been fixed to 2.5 solar radii. Our work highlights how solar wind predictions improve when the radii are allowed to vary over time. Data assimilation using particle filtering (sequential Monte Carlo) is used to infer optimal values over a fixed time window. Solar wind model predictions and satellite observations are compared with a newly developed quality-of-agreement prediction metric. The agreement metric between the model and observations is assumed to correspond to the probability of the two key WSA model parameters, the source surface and interface radii, where the highest metric value implies the optimal radii.We find that the optimal particle filter values of solar radii can perform twice as well as standard values for an exploratory period during Carrington Rotation 1901, with these values also reducing nonphysical kinking effects seen in solar magnetic field lines. Data assimilation choices of input realization and time frame have implications for variation in the solar wind over time. We present this work's theoretical context and practical applications for prediction accuracy.

79 ASTRONOMY AND ASTROPHYSICS↗

ML-based Data Assimilation and History Matching: Application to the IBDP CCS Project

It is crucial to monitor the CO2 plume effectively throughout the life cycle of a geologic CO2 sequestration project to ensure safety and storage efficiency. However, the computational cost of existing data assimilation methods can be prohibitively expensive due to the complex physics with multi-component non-isothermal simulation and high dimensionality of large-scale reservoir models. We address this challenge by proposing an accelerated deep learning-based workflow for model calibration and prediction of CO2 plume evolution in the reservoir.The power and efficacy of our workflow is demonstrated by application to the Illinois Basin-Decatur Project (IBDP), a large-scale CO2 storage test in saline aquifer. The data assimilation process is implemented rapidly by the proposed workflow with given field measurements including distributed pressure and temperature sensing (DTS) data at an injection and a monitoring well. CO2 plume evolution is predicted by running the simulations of the calibrated reservoir models.

Nagao, Masahiro↗

Improving CLM5.0 Biomass and Carbon Exchange Across the Western United States Using a Data Assimilation System

The Western United States is dominated by natural lands that play a critical role for carbon balance, water quality, and timber reserves. This region is also particularly vulnerable to forest mortality from drought, insect attack, and wildfires, thus requiring constant monitoring to assess ecosystem health. Carbon monitoring techniques are challenged by the complex mountainous terrain, thus there is an opportunity for data assimilation systems that combine land surface models and satellite-derived observations to provide improved carbon monitoring. Here, we use the Data Assimilation Research Testbed to adjust the Community Land Model (CLM5.0) with remotely sensed observations of leaf area and above-ground biomass. The adjusted simulation significantly reduced the above-ground biomass and leaf area, leading to a reduction in both photosynthesis and respiration fluxes. The reduction in the carbon fluxes mostly offset, thus both the adjusted and free simulation projected a weak carbon sink to the land. This result differed from a separate observation-constrained model (FLUXCOM) that projected strong carbon uptake to the land. Simulation diagnostics suggested water limitation had an important influence upon the magnitude and spatial pattern of carbon uptake through photosynthesis. We recommend that additional observations important for water cycling (e.g., snow water equivalent, land surface temperature) be included to improve the veracity of the spatial pattern in carbon uptake. Furthermore, the assimilation system should be enhanced to maximize the number of the simulated state variables that are adjusted, especially those related to the recommended observed quantities including water cycling and soil carbon.

54 ENVIRONMENTAL SCIENCES↗

Effect of data assimilation in the Polar WRF with 3DVAR on the prediction of radiation, heat flux, cloud, and near surface atmospheric variables over Svalbard

Although the Polar Weather Research and Forecasting (PWRF) model has been developed for polar environments, simulations of atmospheric states in the polar region still have large uncertainties. Therefore, the effects of data assimilation (DA) to improve forecasts in the polar region were investigated for September 2017 using PWRF and the three-dimensional variational (3DVAR) DA method. The experiments without DA and those with DA assimilating only conventional observations and both conventional observations and satellite radiance data were performed. The forecasts from all experiments both without and with DA underestimated (overestimated) the downward longwave (shortwave) radiation flux due to the underestimation of the amount of Arctic clouds. When satellite radiance data (i.e., the Advanced Microwave Sounding Unit-A (AMSU-A) and Microwave Humidity Sounder (MHS)) were assimilated in addition to conventional observations in the PWRF, the distribution and amount of water vapor became closer to observations, which improves cloud liquid water forecasts. Therefore, when both conventional observations and radiance data were assimilated, the 25–30 h forecast errors of the downward longwave and shortwave radiation fluxes and sensible and latent heat fluxes decreased by 12.7%, 8.1%, 3.2%, and 7.8% with the WSM5 scheme and by 17.1%, 4.7%, 2.5%, and 3.1% with the 2-moment Morrison scheme, respectively, compared to those in the experiments without DA. The forecast errors of the 10 m wind and 2 m temperature with DA were smaller than those without DA at most observation stations. Therefore, the uncertainties of the Arctic forecasts in the PWRF decreased when using DA. To further improve Arctic forecasts, the assimilation of various additional satellite data is necessary.

54 ENVIRONMENTAL SCIENCES↗

Integrating State Data Assimilation and Innovative Model Parameterization Reduces Simulated Carbon Uptake in the Arctic and Boreal Region

Model representation of carbon uptake and storage is essential for accurate projection of the response of the arctic-boreal zone to a rapidly changing climate. Land model estimates of LAI and aboveground biomass that can have a marked influence on model projections of carbon uptake and storage vary substantially in the arctic and boreal zone, making it challenging to correctly evaluate model estimates of Gross Primary Productivity (GPP). To understand and correct bias of LAI and aboveground biomass in the Community Land Model (CLM), we assimilated the 8-day Moderate Resolution Imaging Spectroradiometer (MODIS) LAI observation and a machine learning product of annual aboveground biomass into CLM using an Ensemble Adjustment Kalman Filter (EAKF) in an experimental region including Alaska and Western Canada. Assimilating LAI and aboveground biomass reduced these model estimates by 58% and 72%, respectively. The change of aboveground biomass was consistent with independent estimates of canopy top height at both regional and site levels. The International Land Model Benchmarking system assessment showed that data assimilation significantly improved CLM's performance in simulating the carbon and hydrological cycles, as well as in representing the functional relationships between LAI and other variables. Here, to further reduce the remaining bias in GPP after LAI bias correction, we re-parameterized CLM to account for low temperature suppression of photosynthesis. The LAI bias corrected model that included the new parameterization showed the best agreement with model benchmarks. Combining data assimilation with model parameterization provides a useful framework to assess photosynthetic processes in LSMs.

58 GEOSCIENCES↗

Development and evaluation of a new 4DEnVar-based weakly coupled ocean data assimilation system in E3SMv2

The development, implementation, and evaluation of a new weakly coupled ocean data assimilation (WCODA) system for the fully coupled Energy Exascale Earth System Model version 2 (E3SMv2) utilizing the four-dimensional ensemble variational (4DEnVar) method are presented in this study. The 4DEnVar method, based on the dimension-reduced projection four-dimensional variational (DRP-4DVar) approach, replaces the adjoint model with the ensemble technique, thereby reducing computational demands. Monthly mean ocean temperature and salinity data from the EN4.2.1 reanalysis are integrated into the ocean component of E3SMv2 from 1950 to 2021 with the goal of providing realistic initial conditions for decadal predictions and predictability studies. The performance of the WCODA system is assessed using various metrics, including the reduction rate of the cost function, root mean square error (RMSE) differences, correlation differences, and model biases. Results indicate that the WCODA system effectively assimilates the reanalysis data into the climate model, consistently achieving negative reduction rates of the cost function and notable improvements in RMSE and correlation across various ocean layers and regions. Significant enhancements are observed in the upper ocean layers across the majority of global ocean regions, particularly in the north Atlantic, north Pacific, and Indian Ocean. Model biases in sea surface temperature and salinity are also substantially reduced. For sea surface temperature, cold biases in the north Pacific and north Atlantic are diminished by about 1–2 °C, and warm biases in the Southern Ocean are corrected by approximately 1.5–2.5 °C. In terms of salinity, improvements are observed with bias reductions of about 0.5–1 psu in the north Atlantic and north Pacific and up to 1.5 psu in parts of the Southern Ocean. The ultimate goal of the WCODA system is to advance the predictive capabilities of E3SM for subseasonal to decadal climate predictions, thereby supporting research on strategic energy-sector policies and planning.

54 ENVIRONMENTAL SCIENCES↗

The Heavy Rainfall Mechanism Revealed by a Terrain-Resolving 4DVar Data Assimilation System—A Case Study

In this study, a newly developed terrain-resolving four-dimensional variational (4DVar)-based data assimilation system, Immersed Boundary Method_Variational Doppler Radar Analysis System (IBM_VDRAS), is applied to investigate the mechanisms leading to a heavy precipitation event that occurred in Taiwan during the Southwesterly Monsoon Experiment (SoWMEX) conducted in 2008. The multivariate analyses using IBM_VDRAS and surface observations reveal that the warm and moist southwesterly flow from the ocean decelerates after making landfall, forming a surface convergence zone along the coast, which is further strengthened during the passage of a prefrontal rainband. The flow ascends as it advances inland until reaching the mountains, producing persistent precipitation and the enhancement of evaporative cooling as well as a widespread high pressure zone. A very shallow (<0.4 km) layer of offshore flow can be identified over the southwestern plain, which helps to generate a quasi-stationary convergence zone near the coast. Furthermore, sensitivity studies are carried out to quantify the relative importance of the contributions made by topographic blockage, evaporative cooling, and their nonlinear interaction, to the evolution of this type of convective system. The influence of the topography is identified as the dominant factor in modulating the flow structure of the rainfall system. However, it is the nonlinear interaction between terrain and evaporation that determines the distribution of the temperature and pressure fields.

54 ENVIRONMENTAL SCIENCES↗

Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows

Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging approaches are still attractive due to their simplicity of implementation when more complex methods need to be avoided. However, optimal estimate of nudging gain matrix might be cumbersome. In this paper, we put forth a fully nonintrusive recurrent neural network approach based on a long short-term memory (LSTM) embedding architecture to estimate the nudging term, which plays a role not only to force the state trajectories to the observations but also acts as a stabilizer. Furthermore, our approach relies on the power of archival data and the trained model can be retrained effectively due to power of transfer learning in any neural network applications. In order to verify the feasibility of the proposed approach, we perform twin experiments using Lorenz 96 system. Our results demonstrate that the proposed LSTM nudging approach yields more accurate estimates than both extended Kalman filter (EKF) and ensemble Kalman filter (EnKF) when only sparse observations are available. With the availability of emerging AI-friendly and modular hardware technologies and heterogeneous computing platforms, we articulate that our simplistic nudging framework turns out to be computationally more efficient than either the EKF or EnKF approaches.

42 ENGINEERING↗

Ensemble Kalman filter for data assimilation coupled with low-resolution computations techniques applied in fluid dynamics

This paper presents an innovative Reduced-order model (ROM) for merging experimental and simulation data using data assimilation (DA) to estimate the "True" state of a fluid dynamics system, leading to more accurate predictions. Our methodology introduces a novel approach by implementing the ensemble Kalman filter (EnKF) within a reduced-dimensional framework, grounded in a robust theoretical foundation and applied to fluid dynamics. To address the substantial computational demands of DA, the proposed ROM employs low-resolution (LR) techniques to drastically reduce computational costs. This innovative approach involves downsampling datasets for DA computations, followed by an advanced reconstruction technique based on low-cost singular value decomposition (lcSVD). The lcSVD method, a key innovation in this paper, has never been applied to DA before and offers a highly efficient way to enhance resolution with minimal computational resources. Our results demonstrate significant reductions in both computation time and RAM usage through these LR techniques without compromising the accuracy of the estimations. For instance, in a turbulent test case, for a data compression rate of 15.9, the LR approach can achieve a speed-up of 13.7 and a RAM compression of 90.9% while maintaining a low relative root mean square error (RRMSE) of 2.6%, compared to 0.8% in the high-resolution (HR) reference. Furthermore, we highlight the effectiveness of the EnKF in estimating and predicting the state of fluid flow systems based on limited observations and given low-fidelity numerical data. This paper highlights the potential of the proposed DA method in fluid dynamics applications, particularly for improving computational efficiency in CFD and related fields. Its ability to balance accuracy with low computational and memory costs makes it especially suitable for large-scale and real-time applications, such as environmental monitoring or engineering design. This method will be incorporated into ModelFLOWs-app.

Data Assimilation↗

Real-time ensemble microalgae growth forecasting with data assimilation

Accurate short-range (e.g., 7-day) microalgae growth forecasts will be beneficial for both production and harvesting of microalgae. This study developed an operational microalgae growth forecasting system with ensemble data assimilation (DA). The forecasting system was validated against observed Monoraphidium minutum 26B-AM growth in two outdoor pond cultures located in Mesa, Arizona, U.S. We first examined the relative roles of uncertainty in the meteorological forecast and initial conditions (i.e., algal concentration at the time of forecast) in the microalgae 7-day forecast and found initial conditions dominated the microalgae forecasting skill, suggesting the importance of implementing DA to improve initial condition characterization. To correct the systematic bias in biomass simulations, we developed a particle filter with bias estimation (PFBE) DA method to estimate biases and correct the model forecast. We found the DA forecasting system could improve the 7-day microalgae forecasting skill by about 85% on average compared to model forecasts without DA. These results suggest the potential accuracy of biomass growth forecasts may be sufficient to inform real-time operational decisions, such as harvesting planning, for commercial-scale microalgae production.

59 BASIC BIOLOGICAL SCIENCES↗