Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large ensemble”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Lattice QCD Calculations of Transverse-Momentum-Dependent Soft Function through Large-Momentum Effective Theory

The transverse-momentum-dependent (TMD) soft function is a key ingredient in QCD factorization of Drell-Yan and other processes with relatively small transverse momentum. We present a lattice QCD study of this function at moderately large rapidity on a 2 + 1 flavor CLS dynamic ensemble with a = 0.098 fm. We extract the rapidity-independent (or intrinsic) part of the soft function through a large-momentumtransfer pseudoscalar meson form factor and its quasi-TMD wave function using leading-order factorization in large-momentum effective theory. We also investigate the rapidity-dependent part of the soft function—the Collins-Soper evolution kernel—based on the large-momentum evolution of the quasi-TMD wave function.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Determination of a most representative cycle from cylinder pressure ensembles via statistical method using distribution skewness

In internal combustion engine research, cylinder pressure measurements provide valuable information about the underlying thermodynamic and combustion processes, and are typically collected in ensembles of several 100 traces. Although in some particular fields of combustion research all traces are analyzed, in most cases only one trace is studied because analyzing all the traces is impractical due to the large number of collected samples. Instead, an ensemble-averaged pressure trace is commonly calculated and used for analysis. However, this pressure trace is highly smoothed and dynamic information is lost during the averaging process. With the average trace, pressure rise rates are lower and pressure oscillations such as the ones resulting from combustion knock are lost. In this work, a statistical method was developed to determine the “most representative cycle,” which is the cycle from the ensemble that has the pressure trace most representative of the engine operating condition. Eleven characteristic parameters are computed from each pressure trace and probabilistic distributions are obtained for each of the parameters using all the traces in the ensemble. Finally, the most representative cycle is selected by means of a cost function minimization. The benefits of this method are illustrated using experimental data from four very different engine platforms, under four different combustion modes and over a range of operating conditions.

42 ENGINEERING↗
DOE OSTI2021

HAIMOS Ensemble Forecasts for Intra-day and Day- Ahead GHI, DNI and Ramps

The objective of this research is to develop a hybrid physics-based/data-driven forecast model to improve direct normal and global horizontal irradiance (DNI and GHI) prediction for horizons ranging from 1 to 72 hours. Project objectives also address key gaps in state-of-the-art solar forecasting: accurate probabilistic solar forecasts and the forecasting of large irradiance ramps (ramp onset and magnitude). The proposed model ensembles Numerical Weather Prediction (NWP) forecasts, determinist physics-based algorithms, and new-generation cloud cover products (high-resolution rapid refresh satellite images and Large Eddy Simulations). The result is the Hybrid Adaptive Input Model Objective Selection (HAIMOS) ensemble model. HAIMOS blends state of the art machine learning methodologies with physics-based models for cloud cover and cloud optical depth forecasts. The technical activities followed a two-pronged strategy. First, the preprocessing of data, the selection of inputs to the nonlinear approximators, the type of approximator and objective functions, and post-processing ensembling techniques included in HAIMOS were all optimized adaptively to find the best model for a specific goal (reduce DNI/GHI forecast error, improve the prediction of ramp onset, etc.). Second, a large effort was put in improving cloud identification and the forecast of cloud cover and cloud optical depth. To this end, new-generation cloud parametrization products were developed in this work. These include improved algorithms to assist in cloud identification, cloud classification and cloud parametrization from satellite images – three key factors in the accuracy of 1 to 6-hours irradiance forecasts and prediction of ramp onset. Furthermore, we also included cloud information extracted from high resolution rapid refresh satellite images (GOES-16) and Large Eddy Simulations (LES). LES was used to model the atmosphere in detail over locations of interest and produce cloud optical depth forecasts. Once these data streams were validated, they were used as input data to the HAIMOS forecast. The model was developed using data from several climatologically distinct locations with potential for high solar penetration. In the last year of the project, we conducted a validation campaign according to the guidelines stipulated by the Topic Area 1 project as described in the FOA. This effort brings, for the first time, proven machine-learning methodologies for generating state-of-the-art solar forecasts interweaved with detailed physics-based models for cloud detection, and cloud optical depth forecasts. HAIMOS will generate accurate irradiance probabilistic forecast to assist in reducing solar generation prediction error. Globally optimized solar forecast models are more likely to impact solar energy stakeholders. The goal of this project was to increase the state-of-the-art forecast skill from their present values of 10 to 35%. At the end of the project, we achieved between 30% and 50% forecast skill across a wide range of horizons for both GHI and DNI.

14 SOLAR ENERGY↗
DOE OSTI2022

Ensemble approximate control variate estimators: Applications to multi-fidelity importance sampling.

The recent growth in multifidelity uncertainty quantification has given rise to a large set of variance reduction techniques that leverage information from model ensembles to provide variance reduction for estimates of the statistics of a high-fidelity model. In this paper we provide two contributions: (1) we utilize an ensemble estimator to account for uncertainties in the optimal weights of approximate control variate (ACV) approaches and derive lower bounds on the number of samples required to guarantee variance reduction; and (2) we extend an existing multifidelity importance sampling (MFIS) scheme to leverage control variates. Our approach directly addresses a limitation of many multifidelity sampling strategies that require the usage of pilot samples to estimate covariances. As such we make significant progress towards both increasing the practicality of approximate control variates—for instance, by accounting for the effect of pilot samples—and using multifidelity approaches more effectively for estimating low-probability events. The numerical results indicate our hybrid MFIS-ACV estimator achieves up to 50% improvement in variance reduction over the existing state-of-the-art MFIS estimator, which had already shown an outstanding convergence rate compared to the Monte Carlo method, on several problems of computational mechanics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Transfer learning of neural surrogates on multifidelity groundwater simulations

Multifidelity data used in the paper published in Advances in Water Resources 206 (2025) 105140, https://doi.org/10.1016/j.advwatres.2025.105140 The code used to process the data is openly available on GitHub at https://github.com/Model-Reduction-and-UQ-Group/Transfer_Learning_K_reconstruction Computationally inexpensive surrogates of process-based models, such as deep neural networks, enable ensemble-based computations used in risk assessment, data assimilation, etc. However, generation of large datasets required to train a neural network can be as expensive as the ensemble simulations themselves. We ameliorate this challenge by using data from multifidelity (MF) groundwater simulations and transfer learning (TL) to reduce data generation costs while maintaining model accuracy. As a computational example, we train a deep convolutional neural network (CNN) to reconstruct permeability fields from saturation maps derived from a multiphase flow model. Starting with very low- and low-fidelity data generated on increasingly coarse meshes, we pretrain the CNN, followed by output-layer training and fine-tuning using only a limited number of high-fidelity samples. We demonstrate the surrogate’s robustness when interpreting low-quality inputs—such as interpolated maps or data affected by noise—which has strong implications for the applicability in practical hydrogeological scenarios. This multilevel MF-TL strategy achieves a favorable trade-off between computational efficiency and predictive accuracy, significantly outperforming high-fidelity-only approaches under the same computational budget.

Chiofalo, Alessia [University of Bologna] (ORCID:0↗
DOE OSTI2020

Clouds and Convective Self-Aggregation in a Multimodel Ensemble of Radiative-Convective Equilibrium Simulations

The Radiative-Convective Equilibrium Model Intercomparison Project (RCEMIP) is an intercomparison of multiple types of numerical models configured in radiative-convective equilibrium (RCE). RCE is an idealization of the tropical atmosphere that has long been used to study basic questions in climate science. Here, we employ RCE to investigate the role that clouds and convective activity play in determining cloud feedbacks, climate sensitivity, the state of convective aggregation, and the equilibrium climate. RCEMIP is unique among intercomparisons in its inclusion of a wide range of model types, including atmospheric general circulation models (GCMs), single column models (SCMs), cloud-resolving models (CRMs), large eddy simulations (LES), and global cloud-resolving models (GCRMs). The first results are presented from the RCEMIP ensemble of more than 30 models. While there are large differences across the RCEMIP ensemble in the representation of mean profiles of temperature, humidity, and cloudiness, in a majority of models anvil clouds rise, warm, and decrease in area coverage in response to an increase in sea surface temperature (SST). Nearly all models exhibit self-aggregation in large domains and agree that self-aggregation acts to dry and warm the troposphere, reduce high cloudiness, and increase cooling to space. The degree of self-aggregation exhibits no clear tendency with warming. There is a wide range of climate sensitivities, but models with parameterized convection tend to have lower climate sensitivities than models with explicit convection. In models with parameterized convection, aggregated simulations have lower climate sensitivities than unaggregated simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Co-scheduling Ensembles of In Situ Workflows

Molecular dynamics (MD) simulations are widely used to study large-scale molecular systems. HPC systems are ideal platforms to run these studies, however, reaching the necessary simulation timescale to detect rare processes is challenging, even with modern supercomputers. To overcome the timescale limitation, the simulation of a long MD trajectory is replaced by multiple short-range simulations that are executed simultaneously in an ensemble of simulations. Analyses are usually co-scheduled with these simulations to efficiently process large volumes of data generated by the simulations at runtime, thanks to in situ techniques. Executing a workflow ensemble of simulations and their in situ analyses requires efficient co- scheduling strategies and sophisticated management of computational resources so that they are not slowing down each other. In this paper, we propose an efficient method to co-schedule simulations and in situ analyses such that the makespan of the workflow ensemble is minimized. We present a novel approach to allocate resources for a workflow ensemble under resource constraints by using a theoretical framework modeling the workflow ensemble’s execution. We evaluate the proposed approach using an accurate simulator based on the WRENCH simulation framework on various workflow ensemble configurations. Results demonstrate the significance of co-scheduling simulations and in situ analyses that couple data together to benefit from data locality, in which inefficient scheduling decisions can lead to slowdown in makespan up to a factor of 30.

Do, Tu Mai Anh↗
DOE OSTI2022

Greenhouse-gas forced changes in the Atlantic meridional overturning circulation and related worldwide sea-level change

Abstract The effect of anthropogenic climate change in the ocean is challenging to project because atmosphere-ocean general circulation models (AOGCMs) respond differently to forcing. This study focuses on changes in the Atlantic Meridional Overturning Circulation (AMOC), ocean heat content ( $$\Delta$$ Δ OHC), and the spatial pattern of ocean dynamic sea level ( $$\Delta \zeta$$ Δ ζ ). We analyse experiments following the FAFMIP protocol, in which AOGCMs are forced at the ocean surface with standardised heat, freshwater and momentum flux perturbations, typical of those produced by doubling $$\hbox {CO}_{{2}}$$ CO 2 . Using two new heat-flux-forced experiments, we find that the AMOC weakening is mainly caused by and linearly related to the North Atlantic heat flux perturbation, and further weakened by a positive coupled heat flux feedback. The quantitative relationships are model-dependent, but few models show significant AMOC change due to freshwater or momentum forcing, or to heat flux forcing outside the North Atlantic. AMOC decline causes warming at the South Atlantic-Southern Ocean interface. It does not strongly affect the global-mean vertical distribution of $$\Delta$$ Δ OHC, which is dominated by the Southern Ocean. AMOC decline strongly affects $$\Delta \zeta$$ Δ ζ in the North Atlantic, with smaller effects in the Southern Ocean and North Pacific. The ensemble-mean $$\Delta \zeta$$ Δ ζ and $$\Delta$$ Δ OHC patterns are mostly attributable to the heat added by the flux perturbation, with smaller effects from ocean heat and salinity redistribution. The ensemble spread, on the other hand, is largely due to redistribution, with pronounced disagreement among the AOGCMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Precipitation Probability and Its Future Changes From a Global Cloud-Resolving Model and CMIP6 Simulations

This study investigates precipitation probability and its future changes using simulations from the Non-hydrostatic Icosahedral Atmospheric Model (NICAM), a global cloud-resolving model, and Coupled Model Intercomparison Project Phase 6 (CMIP6) models. For the precipitation probability comparison between models and Tropical Rainfall Measuring Mission (TRMM) during 1998–2008, the difference is greatly reduced by regridding to a common coarser resolution, but the difference signs largely remain. Both NICAM and CMIP6 model ensemble mean show less global-mean nonprecipitation fractions than observations, but NICAM agrees better with observations. For global-mean light precipitation probability, NICAM (CMIP6 model ensemble mean) is smaller (larger) than TRMM. NICAM shows higher heavy precipitation probability than TRMM in native resolutions, but it is close to TRMM and falls in the CMIP6 model range after regridding. For the precipitation probability changes from 1979–2008 to 2075–2104, NICAM predicts an increase in nonprecipitation and extreme heavy (>100 mm/day) precipitation probability but a slight decrease in the probability for precipitation <100 mm/day. After regridding to 2.5°, the precipitation intensity where the probability starts to increase becomes ~20 mm/day and the relative increases in nonprecipitation and heavy precipitation probability become much larger. Future heavy precipitation probability relative increases from CMIP6 models are much larger than NICAM at their native resolutions, but NICAM falls in the CMIP6 model range after regridding, indicating robust future increase (decrease) in heavy (light) precipitation probability regardless of underlying convection treatments. Discrepancy, however, exists in the projected nonprecipitation fraction changes: NICAM shows that nonprecipitation probability will increase over most of low and middle latitudes where CMIP6 models show less increases and even decreases.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

What CMIP6 Models Tell Us About the Impact of AMOC Variability on the Arctic

In this paper we address the question whether variability in the Atlantic Meridional Overturning Circulation (AMOC) and its associated heat transport at mid-latitudes impacts the Arctic Earth system. To that end, we perform coherence analysis on time series of ocean heat transport, AMOC strength, and Arctic climate metrics across a large number of models from the CMIP6 ensemble. We find that, on multidecadal timescales, the majority of CMIP6 models indeed display a statistically significant relationship between AMOC at mid-latitudes (45 °N) and metrics like Arctic surface air temperatures and sea ice. However, our results do not support the narrative that heat transport anomalies at lower latitudes propagate northward toward the Arctic. Instead, our results confirm that variability in meridional ocean heat transport arises in the subpolar North Atlantic and propagates southward and northward.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Non-Hermitian approach for quantum plasmonics

Herein, we examine the limits of applicability of a simple non-Hermitian model for exciton/plasmon interactions in the presence of dissipation and dephasing. The model can be used as an alternative to the more complete Lindblad density matrix approach and is computationally and conceptually simpler. We find that optical spectra in the linear regime can be adequately described by this approach. The model can fail, however, under continuous optical driving in some circumstances. In the case of two quantum dots or excitons interacting with a plasmon, the model can also describe coherences and entanglement qualitatively when both dissipation and dephasing are present and quantitatively in the limit with no dephasing. The approach, within a single excitation manifold, is also applied to assess the role of disorder for 50 quantum dots interacting with a plasmon, where we find that, on average, large enough disorder can help stabilize the ensemble average of the open quantum system toward a dark quasi-steady-state much faster than without disorder. Furthermore, while such single excitation manifold calculations in this size limit can readily be done with either the non-Hermitian or Lindblad forms, as one goes to larger Hilbert space sizes, the computational and storage advantages of the non-Hermitian approach can become more useful. Published under license by AIP Publishing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Threefold reduction of modeled uncertainty in direct radiative effects over biomass burning regions by constraining absorbing aerosols

Absorbing aerosols emitted from biomass burning (BB) greatly affect the radiation balance, cloudiness, and circulation over tropical regions. Assessments of these impacts rely heavily on the modeled aerosol absorption from poorly constrained global models and thus exhibit large uncertainties. By combining the AeroCom model ensemble with satellite and in situ observations, we provide constraints on the aerosol absorption optical depth (AAOD) over the Amazon and Africa. Our approach enables identification of error contributions from emission, lifetime, and MAC (mass absorption coefficient) per model, with MAC and emission dominating the AAOD errors over Amazon and Africa, respectively. In addition to primary emissions, our analysis suggests substantial formation of secondary organic aerosols over the Amazon but not over Africa. Furthermore, we find that differences in direct aerosol radiative effects between models decrease by threefold over the BB source and outflow regions after correcting the identified errors. This highlights the potential to greatly reduce the uncertainty in the most uncertain radiative forcing agent.

09 BIOMASS FUELS↗
DOE OSTI2022

Simulation process and data flow for a large system dynamics model

This paper documents the workflow and supporting technologies that a large system dynamics model, the biomass scenario model, employs to streamline the data preparation, simulation, quality control, and analysis process at the National Renewable Energy Laboratory. The workflow centers on automation of routine aspects of the flow of data between data stores, simulations, and visualizations. It enforces quality checks on data, reproducibility of computations, and traceability of results, while maintaining complete archives of modeling and analysis artifacts. The resulting frictionless simulation/analysis environment supports large-scale sensitivity analysis, interactive creation of ensembles of simulations, and rapid visualization-based exploration of simulation results.

09 BIOMASS FUELS↗
DOE OSTI2022

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The Atmospheric Carbon and Transport (ACT)-America Mission

The Atmospheric Carbon and Transport (ACT)-America NASA Earth Venture Suborbital Mission set out to improve regional atmospheric greenhouse gas (GHG) inversions by exploring the intersection of the strong GHG fluxes and vigorous atmospheric transport that occurs within the midlatitudes. In this study, two research aircraft instrumented with remote and in situ sensors to measure GHG mole fractions, associated trace gases, and atmospheric state variables collected 1,140.7 flight hours of research data, distributed across 305 individual aircraft sorties, coordinated within 121 research flight days, and spanning five 6-week seasonal flight campaigns in the central and eastern United States. Flights sampled 31 synoptic sequences, including fair-weather and frontal conditions, at altitudes ranging from the atmospheric boundary layer to the upper free troposphere. The observations were complemented with global and regional GHG flux and transport model ensembles. We found that midlatitude weather systems contain large spatial gradients in GHG mole fractions, in patterns that were consistent as a function of season and altitude. We attribute these patterns to a combination of regional terrestrial fluxes and inflow from the continental boundaries. These observations, when segregated according to altitude and air mass, provide a variety of quantitative insights into the realism of regional CO 2 and CH 4 fluxes and atmospheric GHG transport realizations. The ACT-America dataset and ensemble modeling methods provide benchmarks for the development of atmospheric inversion systems. As global and regional atmospheric inversions incorporate ACT-America’s findings and methods, we anticipate these systems will produce increasingly accurate and precise subcontinental GHG flux estimates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Fast uncertainty estimates in deep learning interatomic potentials

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and material properties. A common short-coming shared by current approaches, however, is that neural networks only give point estimates of their predictions and do not come with predictive uncertainties associated with these estimates. Existing uncertainty quantification efforts have primarily leveraged the standard deviation of predictions across an ensemble of independently trained neural networks. This incurs a large computational overhead in both training and prediction, resulting in order-of-magnitude more expensive predictions. Here, we propose a method to estimate the predictive uncertainty based on a single neural network without the need for an ensemble. This allows us to obtain uncertainty estimates with virtually no additional computational overhead over standard training and inference. We demonstrate that the quality of the uncertainty estimates matches those obtained from deep ensembles. We further examine the uncertainty estimates of our methods and deep ensembles across the configuration space of our test system and compare the uncertainties to the potential energy surface. Finally, we study the efficacy of the method in an active learning setting and find the results to match an ensemble-based strategy at order-of-magnitude reduced computational cost.

Chemistry↗
DOE OSTI2025

Nonlinear Ensemble Filtering with Diffusion Models: Application to the Surface Quasigeostrophic Dynamics

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here, we explore another promising solution in which diffusion models are used to formulate a robust nonlinear ensemble filter for sequential data assimilation. Unlike standard machine learning methods, the proposed ensemble score filter (EnSF) is completely training free and can efficiently generate a set of analysis ensemble members. Here, in this study, we apply the EnSF to a surface quasigeostrophic model and compare its performance against the popular local ensemble transform Kalman filter (LETKF), which makes Gaussian assumptions in the analysis step. Numerical tests demonstrate that EnSF maintains stable performance in the absence of localization and for a variety of experimental settings. We find that while LETKF maintains optimal performance in the case of linear observations of the entire state and a perfect model, EnSF shows improvements over LETKF when nonlinear observations are assimilated and the system is subject to unexpected model errors. A spectral decomposition of the analysis results in this nonlinear observation regime shows that the largest improvements over LETKF occur at large scales (small wavenumbers), where LETKF lacks sufficient ensemble spread. Overall, this initial application of EnSF to a geophysical model of intermediate complexity motivates further development of the algorithm for more realistic problems.

Artificial intelligence↗
DOE OSTI2021

Assessing boundary condition and parametric uncertainty in numerical-weather-prediction-modeled, long-term offshore wind speed through machine learning and analog ensemble

To accurately plan and manage wind power plants, not only does the time-varying wind resource at the site of interest need to be assessed but also the uncertainty connected to this estimate. Numerical weather prediction (NWP) models at the mesoscale represent a valuable way to characterize the wind resource offshore, given the challenges connected with measuring hub-height wind speed. The boundary condition and parametric uncertainty associated with modeled wind speed is often estimated by running a model ensemble. However, creating an NWP ensemble of long-term wind resource data over a large region represents a computational challenge. Here, we propose two approaches to temporally extrapolate wind speed boundary condition and parametric uncertainty using a more convenient setup in which a mesoscale ensemble is run over a short-term period (1 year), and only a single model covers the desired long-term period (20 year). We quantify hub-height wind speed boundary condition and parametric uncertainty from the short-term model ensemble as its normalized across-ensemble standard deviation. Then, we develop and apply a gradient-boosting model and an analog ensemble approach to temporally extrapolate such uncertainty to the full 20-year period, for which only a single model run is available. As a test case, we consider offshore wind resource characterization in the California Outer Continental Shelf. Both of the proposed approaches provide accurate estimates of the long-term wind speed boundary condition and parametric uncertainty across the region (R 2 >0.75), with the gradient-boosting model slightly outperforming the analog ensemble in terms of bias and centered root-mean-square error. At the three offshore wind energy lease areas in the region, we find a long-term median hourly uncertainty between 10 % and 14 % of the mean hub-height wind speed values. Finally, we assess the physical variability in the uncertainty estimates. In general, we find that the wind speed uncertainty increases closer to land. Also, neutral conditions have smaller uncertainty than the stable and unstable cases, and the modeled wind speed in winter has less boundary condition and parametric sensitivity than summer.

17 WIND ENERGY↗