Search NASA⌕ Search

SEARCH · Search NASA

Results for “DATA ASSIMILATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Performance of reanalysis and mesoscale models off the coast of Hawai'i

The eastern Hawai'i coast in the United States is characterized by considerable wind resource fuelled by persistent trade winds, making it an important area for energy research. The need is strong for reanalyses and higher-resolution regional simulations where observations have been historically limited, such as Hawai'i's offshore environments. However, studies using offshore observations in other parts of the world have shown that significant errors can occur in reanalyses and wind datasets, which can lead to inaccurate estimates of wind energy generation, payback periods, and extreme weather risks at project locations. The degree of such errors is influenced by a number of factors, including spatial resolution and the handling of processes within the planetary boundary layer (PBL). In this work, we provide a wind resource characterization from year-long lidar buoy measurements off the eastern coast of O'ahu, Hawai'i, an environment previously unobserved at the rotor level, and use the characterization to evaluate the performance of two simulation datasets. The O'ahu deployment location is meteorologically unique and less complex than land-based wind resource characterizations, being strongly characterized by trade winds with minimal land–atmosphere interaction influences. Despite the unique and fairly consistent meteorological conditions, we hypothesize that distinct simulation datasets will exhibit diverse ranges of errors similar to those that have been seen for other offshore locations. We find the European Centre for Medium-Range Weather Forecasts (ECMWF) Reanalysis version 5 (ERA5) to strongly underestimate observed wind speeds at the O'ahu location (bias = −1.54 m s −1 at a height of 140 m above sea level), while a regional Weather Research and Forecasting Model (WRF) simulation produced by the University of Hawai'i (UH-WRF) provides a significantly smaller wind speed bias (−0.25 m s −1 ), highlighting the value of running regional, higher-resolution simulations. The large bias noted for ERA5 is driven by significant underestimation of fast wind speeds (>9 m s −1 ), which the study site is largely characterized by, along with discontinuities in the ERA5 diurnal cycle. We also speculate that the relative sparsity of observations for data assimilation in this remote part of the world could influence the performance of ERA5 and that challenges with characterizing island effects could impact the performance of both datasets.

17 WIND ENERGY↗
DOE OSTI2026

SORCER TEST UTQIAĠVIK DEPLOYMENT FOR IONOGRAMS (STUDI) 2021-2024

The Air Force Research Laboratory (AFRL) has developed a passive broadband radio frequency (RF) receiver, called a Sounder Receiver (SoRcer), as an ionospheric diagnostic instrument. These systems can produce ionospheric specifications to characterize the local ionosphere. The specifications from the SoRcers can then be used to inform data-assimilation models; monitor diurnal, seasonal, or other cyclical changes; and detect irregularities or abnormalities in the ionosphere, such as traveling ionospheric disturbances (TIDs), sporadic E, and spread F.

frequency↗
DOE OSTI2024

Investigation of Correlation Methods for Use in Criticality Safety

Although their adoption by practitioners has been limited, the introduction of similarity indices in criticality safety was a major step forward in reducing the reliance on expert judgement in discerning applicable experiments for the validation of new appliations in criticality safety analyses. Similarity indices have been successfully employed in bias trending and data assimilation techniques, but it is often unclear which acceptance criteria should be used. In their 2004 paper, Broadhead et al. specify the most widely used similarity parameter, ck, as an acceptance cutoff at 0.9. (Broadhead et al., ”Sensitivity and Uncertainty-Based Criticality Safety Validation Techniques,” Nucl. Sci. Eng. 146, 340–366, 2004). Experiments with a ck < 0.9 are often not considered applicable for code validation. This heuristic is based on quantitative studies and engineering judgement, but in some cases, experiments with ck < 0.9 can be used to accurately estimate computational bias. This suggests that further analysis is needed to determine what components of ck are driving applicability and accuracy in bias estimation. For cases in which applicable experiments may not be available (as is the case with UF6 transport canisters), understanding what distinguishes experiments in providing adequate bias estimates aside from just the similarity index is particularly necessary. To further the goal to better interpret ck values, several visualization tools were developed to assist in the investigation of which components of ck are driving applicability.

ck↗
DOE OSTI2021

Assimilating Scanning Radar Data into Cloud-Scale Models

The aim of this project is to improve the initial conditions of large eddy simulations (LES) of deep convective storms by assimilating scanning radar reflectivity and radial velocity data as well as local environmental observations. Accomplishing this goal often results in more accurate numerical forecasts of clouds and precipitation than if the background initial meteorological conditions are solely relied upon for convection initiation and intensification, as is typical of most operational and research models. Conducted in a storm-scale LES framework, these more accurate numerical analyses can serve as tool to better understand and parameterize land-atmosphere coupling, boundary layer turbulence, and cloud processes, each used for model parameterization development of convection. Our work examined the sensitivity of the numerical representation of cloud-scale wind and microphysical structures to: i) the assimilation of radiosonde observations characterizing the near-storm inflow, ii) the assimilation of radar data of varying resolution for model simulations with grid spacings of 1-km and 0.25-km, and iii) to the assimilation of three-dimensional plan-projection-indicator (PPI) and range-height indicator (RHI) radar volumes. Few studies have explored deep convective storm analyses and forecasts produced by assimilation of radar observations to cloud-scale LES. Furthermore, to our knowledge, no storm-scale DA study has explored the value of assimilating high-resolution sector RHI volumes to determine if they can improve the retrieval of the vertical kinematic and microphysical storm structure aloft over the use of traditionally utilized PPI scans.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Inference of Rock Flow and Mechanical Properties from Injection-Induced Microseismic Events During Geologic CO 2 Storage

Monitoring microseismic activities during CO 2 injection into geologic formations is important for ensuring the safety of the storage operations. The resulting data provide insight into the response of the storage formation to CO 2 injection and can be used to infer the underlying rock flow and mechanical properties. In this paper, assimilation of microseismic data is performed for dynamic characterization of the storage formation by using a stochastic simulation model to forecast the microseismic response of a geologic formation during CO 2 injection. Two modeling approaches are adopted to predict the space-time distribution of the injection-induced microseismicity. The first model is based on pore pressure relaxation assumption, while the second model uses coupled flow and geomechanics simulation to establish the complex physical relation between the storage formation properties and the corresponding microseismic responses during CO 2 injection. The stochastic predictive models in each case are used in ensemble data assimilation frameworks to estimate rock properties from the observed microseismic data. Two data assimilation methods are considered: (i) a new ensemble-based stochastic point process filter (EnPPF) that can directly integrate discrete microseismic events, and (ii) a variant of ensemble smoother, known as the ensemble smoother with multiple data assimilation (ES-MDA), which requires continuous representation of microseismic events for assimilation. The two methods are successfully applied to a geologically realistic model of the Farnsworth Field in Texas, with complex geologic flow units and interacting fault systems.

42 ENGINEERING↗
DOE OSTI2023

Data for Glucose Assimilation Rate Determines the Partition of Flux at Pyruvate Between Lactic Acid and Ethanol in Saccharomyces cerevisiae

Engineered Saccharomyces cerevisiae expressing a lactic acid dehydrogenase can metabolize pyruvate into lactic acid. However, three pyruvate decarboxylase (PDC) isozymes drive most carbon flux toward ethanol rather than lactic acid. Deletion of endogenous PDCs will eliminate ethanol production, but the resulting strain suffers from C2 auxotrophy and struggles to complete a fermentation. Engineered yeast assimilating xylose or cellobiose produce lactic acid rather than ethanol as a major product without the deletion of any PDC genes. We report here that sugar flux, but not sensing, contributes to the partition of flux at the pyruvate branch point in S. cerevisiae expressing the Rhizopus oryzae lactic acid dehydrogenase (LdhA). While the membrane glucose sensors Snf3 and Rgt2 did not play any direct role in the option of predominant product, the sugar assimilation rate was strongly correlated to the partition of flux at pyruvate: fast sugar assimilation favors ethanol production while slow sugar assimilation favors lactic acid. Applying this knowledge, we created an engineered yeast capable of simultaneously converting glucose and xylose into lactic acid, increasing lactic acid production to approximately 17 g L−1 from the 12 g L−1 observed during sequential consumption of sugars. This work elucidates the carbon source-dependent effects on product selection in engineered yeast.

Conversion↗
DOE OSTI2025

Data-Driven Closures and Assimilation for Stiff Multiscale Random Dynamics

Here, we introduce a data-driven and physics-informed framework for propagating uncertainty in stiff, multiscale random ordinary differential equations (RODEs) driven by correlated (colored) noise. Unlike systems subjected to Gaussian white noise, a deterministic equation for the joint probability density function (PDF) of RODE state variables does not exist in closed form. Moreover, such an equation would require as many phase-space variables as there are states in the RODE system. To alleviate this curse of dimensionality, we instead derive exact, albeit unclosed, reduced-order PDF (RoPDF) equations for low-dimensional observables/quantities of interest. The unclosed terms take the form of state-dependent conditional expectations, which are directly estimated from data at sparse observation times. However, for systems exhibiting stiff, multiscale dynamics, data sparsity introduces regression discrepancies that compound during RoPDF evolution. This is overcome by introducing a kinetic-like defect term to the RoPDF equation, which is learned by assimilating in sparse, low-fidelity RoPDF estimates. Two assimilation methods are considered, namely nudging and deep neural networks, which are successfully tested against Monte Carlo simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations

For centuries, flow visualization has been the art of making fluid motion visible in physical and biological systems. Although such flow patterns can be, in principle, described by the Navier-Stokes equations, extracting the velocity and pressure fields directly from the images is challenging. We addressed this problem by developing hidden fluid mechanics (HFM), a physics-informed deep-learning framework capable of encoding the Navier-Stokes equations into the neural networks while being agnostic to the geometry or the initial and boundary conditions. We demonstrate HFM for several physical and biomedical problems by extracting quantitative information for which direct measurements may not be possible.

Raissi, Maziar↗
DOE OSTI2025

The Sensor Dilemma in Intelligent Transportation Systems

Intelligent Transportation Systems (ITS) are at the forefront in advancing the way we interact and perceive with the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as Radar, LiDAR and Video Imaging which are the most popular modalities for ITS. Real-time perception data from these sensors allows intelligent infrastructure side decision making to improve the energy, efficiency and safety at traffic intersections. As traffic departments across the United States are transitioning from traditional loop detectors / emulators and embracing newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception which is reliable, inexpensive, easy to setup and has robust performance in varying weather conditions. However, choosing a sensor which checks all boxes is not straightforward as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long range vehicles and weather resistance but lacks high resolution. LiDAR is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines Radar, LiDAR and camera sensors capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. Through this evaluation, we hope to draw attention to the necessity of National Renewable Energy Laboratory's (NREL) Infrastructure Perception and Control (IPC) framework which presents a multi-sensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like Radar, LiDAR and cameras, offers the most robust solution for enhancing the safety and efficiency in intelligent transportation systems.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

The Sensor Dilemma in Intelligent Transportation Systems: Evaluating Radar, Lidar and Camera: Preprint

Intelligent transportation systems (ITS) are at the forefront in advancing the way we interact with and perceive the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as radar, lidar, and video imaging, which are the most popular modalities for ITS. Real-time perception data from these sensors allow intelligent infrastructure-side decision-making to improve the energy, efficiency, and safety at traffic intersections. As traffic departments across the United States transition from traditional loop detectors and emulators and embrace newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception that is reliable, inexpensive, and easy to set up and that has robust performance in varying weather conditions. However, choosing a sensor that checks all these boxes is not straightforward, as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long-range vehicles and weather resistance but lacks high resolution. Lidar is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines radar, lidar, and camera sensor capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like radar, lidar, and cameras offers the most robust solution for enhancing the safety and efficiency of ITS. Through this evaluation, we hope to draw attention to the necessity of the National Renewable Energy Laboratory's infrastructure perception and control framework, which presents a multisensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Assimilation of X-band Phased-Array Radar Data with EnKF for the Analysis and Warning Forecast of a Tornadic storm

The impact of assimilating China's operational X-band Phased-Array radar's (X-PAR) data on the analysis and warning forecast of the vortex structure and intensity of the June 8, 2018 Foshan, Guangdong province, tornadic storm was investigated for the first time using an Ensemble Kalman Filter (EnKF) data assimilation system. Both radar radial velocity (Vr) and reflectivity (Z) from two S-band operational radars and one X-PAR were assimilated. Deterministic forecasts were launched every 6 min from 05:42 UTC (20 min before the tornado touched down) to 06:00 UTC from the EnKF mean analysis field. Five experiments were conducted to examine the added capability of Z assimilation of the EnKF system, and to investigate the impact of assimilating X-PAR data on the analysis and prediction of the tornadic storm. Compared to the experiment without Z assimilation, the assimilation of Z reduced the analysis error and greatly reduced the forecast error of Z. Furthermore, the assimilation of X-PAR data greatly improved the vortex structure of the tornadic storm at low levels, and improved the intensity of the rear inflow of the tornadic storm, especially with a higher assimilation frequency. Compared to the experiments without X-PAR data assimilation, assimilating X-PAR data improved the predictability of tornadic storm.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Wave-by-Wave Forecasting via Assimilation of Marine Radar Data

Abstract This work describes a phase-resolving wave-forecasting algorithm that is based on the assimilation of marine radar image time series. The algorithm is tested against synthetic data and field observations. The algorithm couples X-band marine radar observations with a phase-resolving wave model that uses the linear mild slope equations for reconstruction of water surface elevations over a large domain of O (km) and a prescribed time window of O (min). The reconstruction also enables wave-by-wave forecasting through forward propagation in space and time. Marine radar image time series provide the input wave observations through a previously given relationship between backscatter intensity and the radial component of the sea surface slope. The algorithm assimilates the wave slope information into the model via a best-fit wave source function at the boundary that minimizes the slope reconstruction error over an annular region at the outer ranges of the radar images. The wave model is then able to propagate the waves across a polar domain to a location of interest at nearer ranges. The constraints on the method for achieving real-time forecasting are identified, and the algorithm is verified against synthetic data and tested using field observations.

Engineering↗
DOE OSTI2021

Assimilation of citizen science data in snowpack modeling using a new snow data set: Community Snow Observations

A physically based snowpack evolution and redistribution model was used to test the effectiveness of assimilating crowd-sourced snow depth measurements collected by citizen scientists. The Community Snow Observations project gathers, stores, and distributes measurements of snow depth recorded by recreational users and snow professionals in high mountain environments. These citizen science measurements are valuable since they come from terrain that is relatively undersampled and can offer in situ snow information in locations where snow information is sparse or nonexistent. The present study investigates (1) the improvements to model performance when citizen science measurements are assimilated, and (2) the number of measurements necessary to obtain those improvements. Model performance is assessed by comparing time series of observed (snow pillow) and modeled snow water equivalent values, by comparing spatially distributed maps of observed (remotely sensed) and modeled snow depth, and by comparing fieldwork results from within the study area. The results demonstrate that few citizen science measurements are needed to obtain improvements in model performance, and these improvements are found in 62 % to 78 % of the ensemble simulations, depending on the model year. Model estimations of total water volume from a subregion of the study area also demonstrate improvements in accuracy after CSO measurements have been assimilated. These results suggest that even modest measurement efforts by citizen scientists have the potential to improve efforts to model snowpack processes in high mountain environments, with implications for water resource management and process-based snow modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Mechanisms Behind the Long‐Distance Diurnal Offshore Precipitation Propagation in Northwestern South America

Abstract Northwestern South America (NWSA) is the rainiest region on Earth, with diurnal precipitation exhibiting extensive westward offshore propagation of up to about 1,200 km in boreal spring (March‐May). The diurnal offshore precipitation propagation begins slowly (3–10 m s −1 ) near the coast of NWSA (<200 km) but accelerates significantly (∼20 m s −1 ) and shows an afternoon enhancement far from the coast (>400 km). However, the driving mechanisms behind this long‐distance precipitation propagation remain unclear. Using a new cloud tracking and classification data set, we found that mesoscale convective systems (MCSs) are the dominant precipitation contributors in the offshore region of NWSA. Cloud tracking shows that the long‐distance propagation and the afternoon enhancement of diurnal precipitation primarily originate from MCSs initiated in the early morning, either over open oceans or from the coast of Central America. Composite tendency analysis shows that MCSs initiated near the coast of Central America have significant upward cooling and moistening signals starting from the surface before initiation. Further analysis of surface diurnal perturbation fields indicates that the land breeze is the primary driving mechanism for MCS initiation. Conversely, for MCSs initiated over open oceans, a significant downward cooling signal from 400 hPa is observed ∼7 hr before initiation, corresponding to the passage of diurnal gravity waves emitted from the Andes. Additionally, our findings highlight the critical role of lower and mid‐level moisture conditions in MCS initiation, alongside the influence of gravity waves.

Hu, Jingyi [Department of Meteorology and Atmosphe↗
DOE OSTI2020

Power Grid Contingency Analysis with Machine Learning: A Brief Survey and Prospects

We briefly review previous applications of machine learning (ML) in power grid analyses and introduce our ongoing effort toward developing a generative-adversarial (GA) model for fast and reliable grid contingency analyses. According to our review, the persisting limitation of traditional ML techniques in grid analyses is the need for an exhaustive amount of training data for model generalization and accurate predictions. GA models overcome this limitation by first learning true data distribution from a small training set, from which new samples assimilating true data are generated with some variations. Subsequently, GA models can transfer learn or super-generalize with increased accuracy, that is, accurately predict n - (k + 2) contingencies from a small n - k training set and generated n - (k + 1) data. The joint effort between Idaho National Lab and Florida State University strives to develop a zero-shot and deep learning-based contingency analysis tool, named Smart Contingency Analysis Neural Network (SCANN), by leveraging the aforementioned advantages of GA models. The basic architecture of SCANN stems from the Latent Encoding of Atypical Perturbations network combined with an adversarial network, and it is designed to generate imbalanced power flow data from learned true data distributions for prediction purposes. Here we also introduce the abstract concept of resilience-chaos plots, a new resilience characterization tool proposed to complement SCANN by aiding in the assessment of large amounts of high-order contingency predictions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Automated Integration of Continental-Scale Observations in Near-Real Time for Simulation and Analysis of Biosphere–Atmosphere Interactions

The National Ecological Observatory Network (NEON) is a continental-scale observatory with sites across the US collecting standardized ecological observations that will operate for multiple decades. To maximize the utility of NEON data, we envision edge computing systems that gather, calibrate, aggregate, and ingest measurements in an integrated fashion. Edge systems will employ machine learning methods to cross-calibrate, gap-fill and provision data in near-real time to the NEON Data Portal and to High Performance Computing (HPC) systems, running ensembles of Earth system models (ESMs) that assimilate the data. For the first time gridded EC data products and response functions promise to offset pervasive observational biases through evaluating, benchmarking, optimizing parameters, and training new machine learning parameterizations within ESMs all at the same model-grid scale. Leveraging open-source software for EC data analysis, we are already building software infrastructure for integration of near-real time data streams into the International Land Model Benchmarking (ILAMB) package for use by the wider research community. We will present a perspective on the design and integration of end-to-end infrastructure for data acquisition, edge computing, HPC simulation, analysis, and validation, where Artificial Intelligence (AI) approaches are used throughout the distributed workflow to improve accuracy and computational performance.

Durden, David J.↗
DOE OSTI2021

Development and application of marginal likelihood optimization for integral parameter adjustment

When adjusting nuclear data with integral experiments, care must be taken that spurious adjustments are not made by assimilating poorly characterized integral parameters. If there are unaccounted for biases or poorly estimated uncertainties in the calculated and experimental values for an integral parameter, the Bayesian data assimilation may adjust the nuclear data in a manner that does not reflect the physics of the integral parameter. To identify and lessen the impact of these inconsistent integral parameters, in this study we present a Marginal Likelihood Optimization algorithm. In a data-driven way, the marginalized likelihood is used to modulate hyperparameter terms that decrease the influence of inconsistent integral parameters on the adjustment. The advantage of this approach over other methods in the literature is that it incorporates correlation information and does not remove an integral parameter from the adjustment. Herein, we present and motivate the algorithm, and apply it to an integral data assimilation case study.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗