Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large ensemble”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Towards physics-inspired data-driven weather forecasting: integrating data assimilation with a deep spatial-transformer-based U-NET in a case study with ERA5

Abstract. There is growing interest in data-driven weather prediction (DDWP), e.g., using convolutional neural networks such as U-NET that are trained on data from models or reanalysis. Here, we propose three components, inspired by physics, to integrate with commonly used DDWP models in order to improve their forecast accuracy. These components are (1) a deep spatial transformer added to the latent space of U-NET to capture rotation and scaling transformation in the latent space for spatiotemporal data, (2) a data-assimilation (DA) algorithm to ingest noisy observations and improve the initial conditions for next forecasts, and (3) a multi-time-step algorithm, which combines forecasts from DDWP models with different time steps through DA, improving the accuracy of forecasts at short intervals. To show the benefit and feasibility of each component, we use geopotential height at 500 hPa (Z500) from ERA5 reanalysis and examine the short-term forecast accuracy of specific setups of the DDWP framework. Results show that the spatial-transformer-based U-NET (U-STN) clearly outperforms the U-NET, e.g., improving the forecast skill by 45 %. Using a sigma-point ensemble Kalman (SPEnKF) algorithm for DA and U-STN as the forward model, we show that stable, accurate DA cycles are achieved even with high observation noise. This DDWP+DA framework substantially benefits from large (O(1000)) ensembles that are inexpensively generated with the data-driven forward model in each DA cycle. The multi-time-step DDWP+DA framework also shows promise; for example, it reduces the average error by factors of 2–3. These results show the benefits and feasibility of these three components, which are flexible and can be used in a variety of DDWP setups. Furthermore, while here we focus on weather forecasting, the three components can be readily adopted for other parts of the Earth system, such as ocean and land, for which there is a rapid growth of data and need for forecast and assimilation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Systematic Validation of Ensemble Cloud-Process Simulations using Polarimetric Radar Observations and Simulator over the NASA Wallops Flight Facility

The BiLateral Operational Storm-Scale Observation and Modeling (BLOSSOM) project was initiated to establish a long-term supersite to improve understanding of cloud physical states and processes as well as to support satellite and climate model programs over the WFF site via a bilateral approach of storm-scale observations and process modeling. This study highlights a noble systematic validation framework of the BLOSSOM ensemble cloud-process simulations through mixed-phase, light-rain, and deep-convective precipitation cases. The framework consists of creating a domain-shifted ensemble of large-scale forcing datasets, and configuring and performing cloud-process simulations with three different bulk microphysics schemes. Validation uses NASA S-band dual-POLarimetric radar (NPOL) observations in the form of statistical composites and skill scores via a polarimetric radar simulator and newly developed CfRad Data tool (CfRAD). While the simulations capture the overall structures of the reflectivity composites, polarimetric signals are still poorly simulated, mainly due to a lack of representation of ice microphysics diversity in shapes, orientation distributions, and their complex mixtures. Despite the limitation, this new ensemble-based validation framework demonstrates that 1) no particular forcing or microphysics scheme outperforms the rest and 2) the skill scores of coarse- and fine-resolution ensemble simulations with different domain-shifted forcing and microphysics schemes are highly correlated with each other with no clear improvement. On the other hand, this suggests that coarse-resolution ensemble simulations are relevant for selecting the best meteorological forcing and microphysics scheme before conducting computationally demanding large eddy simulations (LESs) in support of aircraft and satellite instrument development as well as cloud-precipitation-convection parameterizations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Statistical emulation of a perturbed basal melt ensemble of an ice sheet model to better quantify Antarctic sea level rise uncertainties

Abstract. Antarctic ice shelves are vulnerable to warming ocean temperatures, and some have already begun thinning in response to increased basal melt rates. Sea level is therefore expected to rise due to Antarctic contributions, but uncertainties in its amount and timing remain largely unquantified. In particular, there is substantial uncertainty in future basal melt rates arising from multi-model differences in thermal forcing and how melt rates depend on that thermal forcing. To facilitate uncertainty quantification in sea level rise projections, we build, validate, and demonstrate projections from a computationally efficient statistical emulator of a high-resolution (4 km) Antarctic ice sheet model, the Community Ice Sheet Model version 2.1. The emulator is trained to a large (500-member) ensemble of 200-year-long 4 km resolution transient ice sheet simulations, whereby regional basal melt rates are perturbed by idealized (yet physically informed) trajectories. The main advantage of our emulation approach is that by sampling a wide range of possible basal melt trajectories, the emulator can be used to (1) produce probabilistic sea level rise projections over much larger Monte Carlo ensembles than are possible by direct numerical simulation alone, thereby providing better statistical characterization of uncertainties, and (2) predict the simulated ice sheet response under differing assumptions about basal melt characteristics as new oceanographic studies are published, without having to run additional numerical ice sheet simulations. As a proof of concept, we propagate uncertainties about future basal melt rate trajectories, derived from regional ocean models, to generate probabilistic sea level rise estimates for 100 and 200 years into the future.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Scalable Generation of High-fidelity Synthetic Population Ensembles

Used within social simulations, synthetic population ensembles enable uncertainty quantification (UQ) methods for obtaining more robust model inference and prediction. A synthetic population ensemble is a series of plausible virtual reconstructions of an area’s population at the granularity of people and residences, generated stochastically to preserve privacy of the source population survey’s respondents. In this paper, we demonstrate the production of large synthetic population ensembles for the U.S. via Oak Ridge National Laboratory’s UrbanPop framework to support modeling of high spatial resolution energy affordability metrics from nationwide social surveys in collaboration with the fusionACS project. The study involves two scenarios: creating ensembles for (1) 17 U.S. metropolitan areas in 2019 and (2) full U.S. Census Divisions in 2023, with each scenario consisting of 41 population instances (a base realization and 40 replicates). To accomplish this task at scale, we configured an integrated system within a research cloud, comprised of virtual containerizations, GPU-enhanced functionality, and orchestrated deployments of UrbanPop’s maturing Likeness Python ecosystem. Results demonstrate we maintained high-fidelity approximations of residential totals by areas of interest and the demographic characteristics of neighborhoods while reducing manual workflow burdens. Finally, we discuss plans to fine-tune and further develop our automated workflows for truly distributed job orchestration to increase computational efficiency, as well as provide an outlook for broadening applications of the ensembles.

Cluster computing↗
DOE OSTI2025

Producing High-fidelity Synthetic Population Ensembles at Scale

Used within social simulations, synthetic population ensembles enable uncertainty quantification (UQ) methods for obtaining more robust model inference and prediction. A synthetic population ensemble is a series of plausible virtual reconstructions of an area’s population at the granularity of people and residences, generated stochastically to preserve privacy of the source population survey’s respondents. In this paper, we demonstrate the production of large synthetic population ensembles for the US via Oak Ridge National Laboratory’s UrbanPop framework to support modeling of high spatial resolution energy affordability metrics from nationwide social surveys in collaboration with the fusionACS project. Our initial task involves creating ensembles for 17 US metropolitan areas, each consisting of 41 population instances (a base realization and 40 replicates). To accomplish this task at scale, we configured an integrated system comprised of a research cloud, virtual containerization, GPU-enhanced functionality, and a dual API/CLI to interact with UrbanPop’s maturing Likeness Python ecosystem. We observe a reduction in theoretical execution time while maintaining high-fidelity approximations of residential totals by metropolitan area and the demographic characteristics of neighborhoods. We discuss expansion of our approach to produce synthetic population ensembles for the entire US, particularly plans to establish automated workflows for job orchestration to increase computational efficiency, as well as provide outlook for broadening applications of the ensembles.

Gaboardi, James [ORNL] (ORCID:0000000247766826)↗
DOE OSTI2020

Efficient Ensemble-Based Stochastic Gradient Methods for Optimization Under Geological Uncertainty

Ensemble-based stochastic gradient methods, such as the ensemble optimization (EnOpt) method, the simplex gradient (SG) method, and the stochastic simplex approximate gradient (StoSAG) method, approximate the gradient of an objective function using an ensemble of perturbed control vectors. These methods are increasingly used in solving reservoir optimization problems because they are not only easy to parallelize and couple with any simulator but also computationally more efficient than the conventional finite-difference method for gradient calculations. In this work, we show that EnOpt may fail to achieve sufficient improvement of the objective function when the differences between the objective function values of perturbed control variables and their ensemble mean are large. On the basis of the comparison of EnOpt and SG, we propose a hybrid gradient of EnOpt and SG to save on the computational cost of SG. We also suggest practical ways to reduce the computational cost of EnOpt and StoSAG by approximating the objective function values of unperturbed control variables using the values of perturbed ones. We first demonstrate the performance of our improved ensemble schemes using a benchmark problem. Results show that the proposed gradients saved about 30–50% of the computational cost of the same optimization by using EnOpt, SG, and StoSAG. As a real application, we consider pressure management in carbon storage reservoirs, for which brine extraction wells need to be optimally placed to reduce reservoir pressure buildup while maximizing the net present value. Results show that our improved schemes reduce the computational cost significantly.

58 GEOSCIENCES↗
DOE OSTI2024

EAGLES Liquid Cloud Testbed Large Eddy Simulation Library (v2)

This library consists of large eddy simulation (LES) model output using the PINACLES codebase coupled to the Hebrew University Fast Spectral Bin Microphysics scheme representing shallow, liquid phase clouds from a range of global liquid cloud testbed regions as well as some well known LES model intercomparison cases. This data is particularly suitable for examining microphysical modeling assumptions in coarser-scale models, and was used for this purpose in the work "“Evaluation of Autoconversion Representation in E3SM.v2 using an Ensemble of Large-Eddy Simulations of Low-Level Warm Clouds” by M. Ovchinnikov, P.-L. Ma, C. M. Kaul, K. G. Pressel, M. Huang, J. Shpund, and S. Tang

Kaul, Colleen M↗
DOE OSTI2025

Combined Meteorological and Hydrologic Uncertainties Shape Projections of Future Soil Moisture in the Eastern United States

Physical hazards pose risks to many critical systems. Designing adaptive measures to mitigate these risks is challenging due to large uncertainties in modeling future hazards and the associated sectoral responses. Here, we help address this challenge in a hydrologic context by examining the combined role of meteorological forcing and hydrologic parameter uncertainties in shaping projections of future soil moisture. By encoding a simple conceptual water balance model in a differentiable programming framework, we facilitate fast runtimes and an efficient calibration, enabling an improved uncertainty analysis. We characterize uncertainty in model parameters by calibrating against different target data sets and by using several loss functions. We then convolve the resulting parameter ensemble with a set of Earth system model projections to produce a large ensemble (2,340 members) of daily soil moisture simulations. Focusing on the eastern United States, we find that most ensemble members project a drying of soils across the region, although some simulate wetter conditions throughout this century. Our ensemble shows an increase in the frequency and intensity of dry extremes while there is less agreement for wet extremes. We conduct sensitivity analyses on several soil moisture signatures to measure the relative influence of meteorological and hydrologic uncertainties across space and time. Both meteorological and hydrologic factors contribute consistently to uncertainty surrounding long-term trends, while changes to both wet and dry soil extremes are typically more sensitive to hydrologic parameter uncertainty. Our results underscore the need to account for varied sources of uncertainty when developing long-term hydrometeorological projections.

Lafferty, David C. [University of Illinois Urbana‐↗
DOE OSTI2020

Characterization of organic aerosol across the global remote troposphere: a comparison of ATom measurements and global chemistry models

The spatial distribution and properties of submicron organic aerosol (OA) are among the key sources of uncertainty in our understanding of aerosol effects on climate. Uncertainties are particularly large over remote regions of the free troposphere and Southern Ocean, where very few data have been available and where OA predictions from AeroCom Phase II global models span 2 to 3 orders of magnitude, greatly exceeding the model spread over source regions. The (nearly) pole-to-pole vertical distribution of non-refractory aerosols was measured with an aerosol mass spectrometer onboard the NASA DC-8 aircraft as part of the Atmospheric Tomography (ATom) mission during the Northern Hemisphere summer (August 2016) and winter (February 2017). This study presents the first extensive characterization of OA mass concentrations and their level of oxidation in the remote atmosphere. OA and sulfate are the major contributors by mass to submicron aerosols in the remote troposphere, together with sea salt in the marine boundary layer. Sulfate was dominant in the lower stratosphere. OA concentrations have a strong seasonal and zonal variability, with the highest levels measured in the lower troposphere in the summer and over the regions influenced by biomass burning from Africa (up to 10 µg sm -3 ). Lower concentrations (~0.1–0.3 µg sm -3 ) are observed in the northern middle and high latitudes and very low concentrations (<0.1 µg sm -3 ) in the southern middle and high latitudes. The ATom dataset is used to evaluate predictions of eight current global chemistry models that implement a variety of commonly used representations of OA sources and chemistry, as well as of the AeroCom-II ensemble. The current model ensemble captures the average vertical and spatial distribution of measured OA concentrations, and the spread of the individual models remains within a factor of 5. These results are significantly improved over the AeroCom-II model ensemble, which shows large overestimations over these regions. However, some of the improved agreement with observations occurs for the wrong reasons, as models have the tendency to greatly overestimate the primary OA fraction and underestimate the secondary fraction. Measured OA in the remote free troposphere is highly oxygenated, with organic aerosol to organic carbon (OA/OC) ratios of ~2.2–2.8, and is 30 %–60 % more oxygenated than in current models, which can lead to significant errors in OA concentrations. The model–measurement comparisons presented here support the concept of a more dynamic OA system as proposed by Hodzic et al. (2016), with enhanced removal of primary OA and a stronger production of secondary OA in global models needed to provide better agreement with observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Divergent Members of the Nitrogenase Superfamily: Tetrapyrrole Biosynthesis and Beyond

The nitrogenase superfamily constitutes a large and diverse ensemble of two–component metalloenzymes. These systems couple the hydrolysis of ATP to the reduction of disparate substrates from diatomic gases (Mo and alternative nitrogenases) to photosynthetic pigments (protochlorophyllide and chlorophyllide oxidoreductases). Only very recently have the activities of the highly divergent and paraphyletic Group IV nitrogenases begun to be uncovered. In conclusion, this review highlights the first characterized member of this group, which was found to catalyze an unprecedented reaction in the coenzyme F430 biosynthetic pathway, and the catalytic potential of a superfamily that has yet to be fully explored.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Gravitational duals to the grand canonical ensemble abhor Cauchy horizons

The gravitational dual to the grand canonical ensemble of a large N holographic theory is a charged black hole. These spacetimes - for example Reissner- Nordström-AdS - can have Cauchy horizons that render the classical gravitational dynamics of the black hole interior incomplete. We show that a (spatially uniform) deformation of the CFT by a neutral scalar operator generically leads to a black hole with no inner horizon. There is instead a spacelike Kasner singularity in the interior. For relevant deformations, Cauchy horizons never form. For certain irrelevant deformations, Cauchy horizons can exist at one specific temperature. We show that the scalar field triggers a rapid collapse of the Einstein-Rosen bridge at the would-be Cauchy horizon. Finally, we make some observations on the interior of charged dilatonic black holes where the Kasner exponent at the singularity exhibits an attractor mechanism in the low temperature limit.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Technology Pathways Could Help Drive the U.S. West Coast Grid's Exposure to Hydrometeorological Uncertainty

Abstract Previous studies investigating deep decarbonization of bulk electric power systems and wholesale electricity markets have not sufficiently explored how future grid pathways could affect the grid's vulnerability to hydrometeorological uncertainty on multiple timescales. Here, we employ a grid operations model and a large synthetic weather ensemble to “stress test” a range of future grid pathways for the U.S. West Coast developed by ReEDS, a well‐known capacity planning model. Our results show that gradual changes in the underlying capacity mix from 2020 to 2050 can cause significant “re‐ranking” of weather years in terms of annual wholesale electricity prices (with “good” years becoming bad, and vice versa). Nonetheless, we find the highest and lowest ranking price years in terms of average electricity price remain mostly tied to extremes in hydropower availability (streamflow) and load (summer temperatures), with the strongest sensitivities related to drought. Seasonal dynamics seen today involving spring snowmelt and hot, dry summers remain well‐defined out to 2050. In California, future supply shortfalls in our model are concentrated in the evening and occur mostly during periods of high temperature anomalies in late summer months and in late winter; in the Pacific Northwest, supply shortfalls are much more strongly tied to negative streamflow anomalies. Under our more robust sampling of stationary hydrometeorological uncertainty, we also find that the ratio of dis‐patchable thermal (i.e., natural gas) capacity to wind and solar required to ensure grid reliability can differ significantly from values reported by ReEDS.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Inverse Mapping of the Collision Kernel and Wall Flux Scaling in a Tall Convection‐Cloud Chamber Using Local Sensors and Knowledge‐Informed Deep Learning

Droplet collision–coalescence is a crucial process in cloud physics, but accurately representing this process under different dynamical conditions remains challenging. A proposed future convective‐cloud chamber aims to investigate this key process, but the method for observing it remains unclear, even though it is theoretically established that collision‐coalescence will occur. This study serves as a proof‐of‐concept demonstration of how knowledge‐informed deep learning, combined with measurement data from local sensors in the chamber, can be used to estimate the collision kernels, which determine how the droplet size distribution evolves during collision‐coalescence. In addition to estimating the collision kernel, we also address wall fluxes, another uncertain but important process that acts as a source of heat and moisture in the chamber. Ensemble runs of large‐eddy simulations are conducted by scaling the wall fluxes and the collision kernel, while the measured flow and cloud properties are used as inputs for a neural network. Results indicate that this approach successfully maps the scaling of wall fluxes and the collision kernel with biases of approximately 1% or less relative to the range of the target data. This proof‐of‐concept lays the groundwork for future applications; when the real measurements are available, real sensor data combined with the trained model presented in this work will enable estimation of the actual wall fluxes and collision kernel.

cloud chamber↗
DOE OSTI2023

Statistical Generation of Ocean Forcing With Spatiotemporal Variability for Ice Sheet Models

Melting of ice at the base of floating ice shelves that fringe the Antarctic ice sheet has been identified as a significant source of uncertainty in sea level rise projections. Part of this uncertainty derives from chaotic internal variability of the coupled ocean-atmosphere system. For numerical ice sheet model projections, this uncertainty has not previously been quantified because of the prohibitive computational expense of running large climate model ensembles. Here, we develop and demonstrate a technique that generates independent realizations of internal climate variability from a single climate model simulation. Building on previous developments in model emulation, this technique uses empirical orthogonal function decomposition and Fourier-phase randomization to generate statistically consistent realizations of spatiotemporal variability fields for the target climate variable. The method facilitates efficient sampling of a wide range of climate trajectories, which can also be incorporated within ice sheet or other physical models to represent feedback processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Strong Scalability Analysis of the Albany Land Ice code on HPC Architectures

Scalability is a critical factor in High-Performance Computing (HPC), where optimizing resource usage has a direct impact on cost-effectiveness and time-efficiency. This report presents a strong scaling performance study of the Albany Land Ice (ALI) code across different HPC architectures, towards determining the best configuration to use when running large-scale simulation ensembles.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Quantifying albedo susceptibility biases in shallow clouds

The evaluation of radiative forcing associated with aerosol–cloud interactions remains a significant source of uncertainty in future climate projections. The problem is confounded by the fact that aerosol particles influence clouds locally and that averaging to larger spatial and/or temporal scales carries biases that depend on the heterogeneity and spatial correlation of the interacting fields and the nonlinearity of the responses. Mimicking commonly applied satellite data analyses for calculation of albedo susceptibility S o , we quantify S o aggregation biases using an ensemble of 127 large eddy simulations of marine stratocumulus. We explore the cloud field properties that control this spatial aggregation bias and quantify the bias for a large range of shallow stratocumulus cloud conditions manifesting a variety of morphologies and ranges of cloud fractions. We show that S o spatial aggregation biases can be on the order of hundreds of percent, depending on the methodology. Key uncertainties emanate from the typically applied adiabatic drop concentration N d retrieval, the correlation between aerosol and cloud fields, and the extent to which averaging reduces the variance in cloud albedo A c and N d . So biases are more often positive than negative and are highly correlated with biases in the liquid water path adjustment. Temporal aggregation biases are shown to offset spatial aggregation biases. Both spatial and temporal biases have significant implications for observationally based assessments of aerosol indirect effects and our inferences of underlying aerosol–cloud–radiation effects.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2017

Quantifying the Influence of Global Warming on Unprecedented Extreme Climate Events

Efforts to understand the influence of historical global warming on individual extreme climate events have increased over the past decade. However, despite substantial progress, events that are unprecedented in the local observational record remain a persistent challenge. Leveraging observations and a large climate model ensemble, we quantify uncertainty in the influence of global warming on the severity and probability of the historically hottest month, hottest day, driest year, and wettest 5-d period for different areas of the globe. We find that historical warming has increased the severity and probability of the hottest month and hottest day of the year at >80% of the available observational area. Our framework also suggests that the historical climate forcing has increased the probability of the driest year and wettest 5-d period at 57% and 41% of the observed area, respectively, although we note important caveats. For the most protracted hot and dry events, the strongest and most widespread contributions of anthropogenic climate forcing occur in the tropics, including increases in probability of at least a factor of 4 for the hottest month and at least a factor of 2 for the driest year. We also demonstrate the ability of our framework to systematically evaluate the role of dynamic and thermodynamic factors such as atmospheric circulation patterns and atmospheric water vapor, and find extremely high statistical confidence that anthropogenic forcing increased the probability of record-low Arctic sea ice extent.

Diffenbaugh, Noah S.↗
NASA NTRS2020

Underlying Fundamentals of Kalman Filtering for River Network Modeling

The grand challenge of producing hydrometeorological estimates every time and everywhere has motivated the fusion of sparse observations with dense numerical models, with a particular interest on discharge in river modeling. Ensemble methods are largely preferred as they enable the estimation of error properties, but at the expense of computational load and generally with underestimations. These imperfect stochastic estimates motivate the use of correction methods, that is, error localization and inflation, although the physical justifications for their optimality are limited. The purpose of this study is to use one of the simplest forms of data assimilation when applied to river modeling and reveal the underlying mechanisms impacting its performance. Our framework based on assimilating daily averaged in situ discharge measurements to correct daily averaged runoff was tested over a 4-yr case study of two rivers in Texas. Results show that under optimal conditions of inflation and localization, discharge simulations are consistently improved such that the mean values of Nash–Sutcliffe efficiency are enhanced from211.32 to 0.55 at observed gauges and from212.24 to21.10 at validation gauges. Yet, parameters controlling the inflation and the localization have a large impact on the performance. Further investigations of these sensitivities showed that optimal inflation occurs when compensating exactly for discrepancies in the magnitude of errors while optimal localization matches the distance traveled during one assimilation window. These results may be applicable to more advanced data assimilation methods as well as for larger applications motivated by upcoming river-observing satellite missions, such as NASA’s Surface Water and Ocean Topography mission.

Streamflow↗