Search NASA⌕ Search

SEARCH · Search NASA

Results for “ensemble modeling system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Ensuring statistical reproducibility of ocean model simulations in the age of hybrid computing

Novel high performance computing systems that feature hybrid architectures require large scale code refactoring to unravel underlying exploitable parallelism. Such redesign can often be accompanied with machine-precision changes as the order of computation cannot always be maintained. For chaotic systems like climate models, these round-off level differences can grow rapidly. Systematic errors may also manifest initially as machine-precision differences. Isolating genuine round off level differences from such errors remains a challenge. Here, we apply two-sample equality of distribution tests to evaluate statistical reproducibility of the ocean model component of US Department of Energy's Energy Exascale Earth System Model (E3SM). A 2-year control simulation ensemble is compared to a modified ensemble as a test case - after a known non-bit-for-bit change in a model component is introduced - to evaluate the null hypothesis that the two ensembles are statistically indistinguishable. To quantify the false negative rates of these tests, we conduct a formal power analysis using a targeted suite of short simulation ensembles. The ensemble suite contains several perturbed ensembles, each with a progressively different climate than the baseline ensemble - obtained by perturbing the magnitude of a single model tuning parameter, the Gent and McWilliams κ, in a controlled manner. The null hypothesis is evaluated for each of perturbed ensembles using these tests. The power analysis informs on the detection limits of the tests for given ensemble size allowing model developers to evaluate the impact of an introduced non-bit-for-bit change to the model.

Mahajan, Salil↗

PathParser [SWR-19-54]

PathParser is a python-based computational tool for the thermodynamics and robustness analysis of native and designed metabolic pathways. The following functionalities are provided: 1 Max-min driving force (MDF) optimization. The Gibbs free energy change of the least favorable reaction will be maximized to evaluate thermodynamic feasibility of the entire pathway. 2 Protein cost estimation. The smallest enzyme investment will be assessed by calculating the minimal total enzyme cost supporting a given pathway flux. 3 Robustness analysis. Specifically, an ensemble of models is generated to simulate the system response to enzyme perturbation based on bifurcation theory and a continuation method. Probability of system failure and flux fold change against enzyme perturbation are estimated as well as a flux control index.

Xiong, Wei↗

Cloud model-based simulation of spaceborne radar observations

Simulations of observations from potential spaceborne radars are made based on storm structure generated from the three-dimensional (3D) Goddard cumulus ensemble model simulation of an intense overland convective system. Five frequencies of 3, 10, 14, 35, and 95 GHz are discussed, but the Tropical Rainfall Measuring Mission precipitation radar sensor frequency (14 GHz) is the focus of this study. Radar reflectives and their attenuation in various atmospheric conditions are studied in this simulation. With the attenuation from cloud and precipitation in the estimation of reflectivity factor (dBZ), the reflectivities in the lower atmosphere in the convective cores are significantly reduced. With spatial resolution of 4 km X 4 km, attenuation at 14 GHz may cause as large as a 20-dBZ difference between the simulated measurements of the peak, Z(sub mp) and near-surface reflectivity, Z(sub ms) in the most intense convective region. The Z(sub mp) occurs at various altitudes depending on the hydrometeor concentrations and their vertical distribution. Despite the significant attenuation in the intense cores, the presence of the rain maximum is easily detected by using information of Z(sub mp). In the stratiform region, the attenuation is quite limited (usually less than 5 dBZ), and the reduction of reflectivity is mostly related to the actual vertical structure of cloud distribution. Since Z(sub ms) suffers severe attenuation and tends to underestimate surface rainfall intensity in convective regions. Z(sub mp) can be more representative for rainfall retrieval in the lower atmosphere in these regions. In the stratiform region where attenuation is negligible, however, Z(sub mp) tends to overestimate surface rainfall and Z(sub ms) is more appropriate for rainfall retrieval. A hybrid technique using a weight between the two rain intensities is tested and found potentially usefull for future applications. The estimated surface rain-rate map based on this hybrid approach captures many of the details of the cloud model rain field but still slightly underestimates the rain-rate maximum.

Yeh, H.-Y. M.↗

Control of the NASA Langley 16-Foot Transonic Tunnel with the Self-Organizing Feature Map

A predictive, multiple model control strategy is developed based on an ensemble of local linear models of the nonlinear system dynamics for a transonic wind tunnel. The local linear models are estimated directly from the weights of a Self Organizing Feature Map (SOFM). Local linear modeling of nonlinear autonomous systems with the SOFM is extended to a control framework where the modeled system is nonautonomous, driven by an exogenous input. This extension to a control framework is based on the consideration of a finite number of subregions in the control space. Multiple self organizing feature maps collectively model the global response of the wind tunnel to a finite set of representative prototype controls. These prototype controls partition the control space and incorporate experimental knowledge gained from decades of operation. Each SOFM models the combination of the tunnel with one of the representative controls, over the entire range of operation. The SOFM based linear models are used to predict the tunnel response to a larger family of control sequences which are clustered on the representative prototypes. The control sequence which corresponds to the prediction that best satisfies the requirements on the system output is applied as the external driving signal. Each SOFM provides a codebook representation of the tunnel dynamics corresponding to a prototype control. Different dynamic regimes are organized into topological neighborhoods where the adjacent entries in the codebook represent the minimization of a similarity metric which is the essence of the self organizing feature of the map. Thus, the SOFM is additionally employed to identify the local dynamical regime, and consequently implements a switching scheme than selects the best available model for the applied control. Experimental results of controlling the wind tunnel, with the proposed method, during operational runs where strict research requirements on the control of the Mach number were met, are presented. Comparison to similar runs under the same conditions with the tunnel controlled by either the existing controller or an expert operator indicate the superiority of the method.

Motter, Mark A.↗

Control of the NASA Langley 16-Foot Transonic Tunnel with the Self-Organizing Map

A predictive, multiple model control strategy is developed based on an ensemble of local linear models of the nonlinear system dynamics for a transonic wind tunnel. The local linear models are estimated directly from the weights of a self-organizing map (SOM). Multiple self-organizing maps collectively model the global response of the wind tunnel to a finite set of representative prototype controls. These prototype controls partition the control space and incorporate experiential knowledge gained from decades of operation. Each SOM models the combination of the tunnel with one of the representative controls, over the entire range of operation. The SOM based linear models are used to predict the tunnel response to a larger family of control sequences which are clustered on the representative prototypes. The control sequence which corresponds to the prediction that best satisfies the requirements on the system output is applied as the external driving signal.

Mark A. Motter↗

Investigation of Long-Term Impacts of Urbanization when Considering Global Warming for a Coastal Tropical Region

The overachieving goal of this project is to gain a better understanding of the climate impacts caused by the combined effects of land cover and land use (LCLU) changes and increasing global concentrations of green house gases (GHG) in tropical coastal areas, regions where global, regional and local climate phenomena converge, taking as the test case the densely populated northeast region of the Caribbean island of Puerto Rico. The research uses an integrated approach of high-resolution remote sensing information linked to a high resolution Regional Atmospheric Modeling System (RAMS), which was employed to perform ensembles of climate simulations (combining 2-LCLU and 2-GHG concentration scenarios). Reconstructed agricultural maps are used to define past LCLU, and combined with reconstructed sea surface temperatures (SST) for the same period form the PAST climate scenario (1951-1956); while the PRESENT scenario (2000-2004) was additionally supported by high resolution remote sensing data (10-m-res). The climate reconstruction approach is validated with available observed climate data from surface weather stations for both periods of time simulated. The selection of the past and present climate scenarios considers large-scale biases (i.e. ENSO/NAO) as reflected in the region of interest. Direct and cross comparison of the results is allowing quantifying single, combined, and competitive effects. Results indicate that global GHG have dominant effects on minimum temperatures (following regional tendencies), while urban sprawl dominates maximum temperatures. To further investigate impacts of land use the Bowen Ratio and the thermal response number (TRN) are analyzed. The Bowen ratio indicates that forestation of past agricultural high areas have an overwhelmingly mitigation effect on increasing temperatures observed in different LCLU scenarios, but when abandoned agricultural lands are located in plains, the resulting shrub/grass lands produce higher surface temperatures. The TRN (J/m^2/degC) is a surface property defined as the ratio of the surface net radiation to the rate of change in surface temperature, expresses how those fluxes are reacting to radiant energy inputs. Natural vegetated surfaces have a greater TRN than urban and barren surfaces because the net radiation processed by them is mostly used for latent heat and thermal storage heat rather than sensible heat (heating the air). Significant changes in TRN were observed in the metropolitan area of San Juan for the two analyzed periods reflecting a reduction of this variable in the present from the past consistent with increasing in thermal mass, or intense urbanization.

Gonalez, Jorge E.↗

Situation awareness and dynamic ensemble forecasting of abnormal behavior in cyber-physical system

A plurality of monitoring nodes may each generate a time-series of current monitoring node values representing current operation of a cyber-physical system. A feature-based forecasting framework may receive the time-series of and generate a set of current feature vectors using feature discovery techniques. The feature behavior for each monitoring node may be characterized in the form of decision boundaries that separate normal and abnormal space based on operating data of the system. A set of ensemble state-space models may be constructed to represent feature evolution in the time-domain, wherein the forecasted outputs from the set of ensemble state-space models comprise anticipated time evolution of features. The framework may then obtain an overall features forecast through dynamic ensemble averaging and compare the overall features forecast to a threshold to generate an estimate associated with at least one feature vector crossing an associated decision boundary.

Abbaszadeh, Masoud↗

Estimating Changes in Temperature Distributions in a Large Ensemble of Climate Simulations Using Quantile Regression

Understanding future changes in extreme temperature events in a transient climate is inherently challenging. A single model simulation is generally insufficient to characterize the statistical properties of the evolving climate, but ensembles of repeated simulations with different initial conditions greatly expand the amount of data available. In this paper, we present a new approach for using ensembles to characterize changes in temperature distributions based on quantile regression that more flexibly characterizes seasonal changes. Specifically, our approach uses a continuous representation of seasonality rather than breaking the dataset into seasonal blocks; that is, we assume that temperature distributions evolve smoothly both day to day over an annual cycle and year to year over longer secular trends. To demonstrate our method’s utility, we analyze an ensemble of 50 simulations of the Community Earth System Model (CESM) under a scenario of increasing radiative forcing to 2100, focusing on North America. As previous studies have found, we see that daily temperature bulk variability generally decreases in wintertime in the continental mid- and high latitudes (>40°). A more subtle result that our approach uncovers is that differences in two low quantiles of wintertime temperatures do not shrink as much as the rest of the temperature distribution, producing a more negative skew in the overall distribution. Although the examples above concern temperature only, the technique is sufficiently general that it can be used to generate precise estimates of distributional changes in a broad range of climate variables by exploiting the power of ensembles.

54 ENVIRONMENTAL SCIENCES↗

Huge ensembles – Part 1: Design of ensemble weather forecasts using spherical Fourier neural operators

Abstract. Simulating low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computational constraints, it is infeasible to generate huge ensembles (comprised of 1000–10 000 members) with traditional, physics-based numerical models. In this two-part paper, we replace traditional numerical simulations with machine learning (ML) to generate hindcasts of huge ensembles. In Part 1, we construct an ensemble weather forecasting system based on spherical Fourier neural operators (SFNOs), and we discuss important design decisions for constructing such an ensemble. The ensemble represents model uncertainty through perturbed-parameter techniques, and it represents initial condition uncertainty through bred vectors, which sample the fastest-growing modes of the forecast. Using the European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS) as a baseline, we develop an evaluation pipeline composed of mean, spectral, and extreme diagnostics. With large-scale, distributed SFNOs with 1.1 billion learned parameters, we achieve calibrated probabilistic forecasts. As the trajectories of the individual members diverge, the ML ensemble mean spectra degrade with lead time, consistent with physical expectations. However, the individual ensemble members' spectra stay constant with lead time. Therefore, these members simulate realistic weather states during the rollout, and the ML ensemble passes a crucial spectral test in the literature. The IFS and ML ensembles have similar extreme forecast indices, and we show that the ML extreme weather forecasts are reliable and discriminating. These diagnostics ensure that the ensemble can reliably simulate the time evolution of the atmosphere, including low-likelihood high-impact extremes. In Part 2, we generate a huge ensemble initialized each day in summer 2023, and we characterize the simulations of extremes.

Mahesh, Ankur↗

Adaptive Ensemble Refinement of Protein Structures in High Resolution Electron Microscopy Density Maps with Radical Augmented Molecular Dynamics Flexible Fitting

Recent advances in cryo-electron microscopy (cryo-EM) have enabled modeling macromolecular complexes that are essential components of the cellular machinery. The density maps derived from cryo-EM experiments are often integrated with manual, knowledge or artificial intelligence driven, and physics-guided computational methods to build, fit, and refine molecular structures. Going beyond a single stationary- structure determination scheme, it is becoming more common to interpret the experimental data with an ensemble of models, which contributes to an average observation. Hence, there is a need to decide on the quality of an ensemble of protein structures on-the-fly, while refining them against the density maps. Here, we introduce such an adaptive decision making scheme during the molecular dynamics flexible fitting (MDFF) of biomolecules. Using RADICAL-Cybertools, and the new RADICAL augmented MDFF implementation (R-MDFF) is examined in high-performance computing environments for refinement of two protein systems, Adenylate Kinase and Carbon Monoxide Dehydrogenase. For the test cases, use of multiple replicas in flexible fitting with adaptive decision making in R-MDFF improves the overall correlation to the density by 40% relative to the refinements of the brute-force MDFF. The improvements are particularly significant at high, 2 - 3 Å, map resolutions. More importantly, the ensemble model captures key features of biologically relevant molecular dynamics that is inaccessible to a single-model interpretation. Finally, the pipeline is applicable to systems of growing sizes, which is demonstrated using ensemble refinement of capsid proteins from Chimpanzee adenovirus. The overhead for decision making remaining low and robust to computing environments. The software is publicly available on GitHub and includes a short user guide to install the R-MDFF on different computing environments, from local Linux based workstations to High Performance Computing (HPC) environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

SPICE: discovery of phenotype-determining component interplays

Background: A latent behavior of a biological cell is complex. Deriving the underlying simplicity, or the fundamental rules governing this behavior has been the Holy Grail of systems biology. Data-driven prediction of the system components and their component interplays that are responsible for the target system’s phenotype is a key and challenging step in this endeavor. Results: The proposed approach, which we call System Phenotype-related Interplaying Components Enumerator (SPICE), iteratively enumerates statistically significant system components that are hypothesized (1) to play an important role in defining the specificity of the target system’s phenotype(s); (2) to exhibit a functionally coherent behavior, namely, act in a coordinated manner to perform the phenotype-specific function; and (3) to improve the predictive skill of the system’s phenotype(s) when used collectively in the ensemble of predictive models. SPICE can be applied to both instance-based data and network-based data. When validated, SPICE effectively identified system components related to three target phenotypes: biohydrogen production, motility, and cancer. Manual results curation agreed with the known phenotype-related system components reported in literature. Additionally, using the identified system components as discriminatory features improved the prediction accuracy by 10% on the phenotype-classification task when compared to a number of state-of-the-art methods applied to eight benchmark microarray data sets. Conclusion: We formulate a problem—enumeration of phenotype-determining system component interplays—and propose an effective methodology (SPICE) to address this problem. SPICE improved identification of cancer-related groups of genes from various microarray data sets and detected groups of genes associated with microbial biohydrogen production and motility, many of which were reported in literature. SPICE also improved the predictive skill of the system’s phenotype determination compared to individual classifiers and/or other ensemble methods, such as bagging, boosting, random forest, nearest shrunken centroid, and random forest variable selection method.

59 BASIC BIOLOGICAL SCIENCES↗

Simulation process and data flow for a large system dynamics model

This paper documents the workflow and supporting technologies that a large system dynamics model, the biomass scenario model, employs to streamline the data preparation, simulation, quality control, and analysis process at the National Renewable Energy Laboratory. The workflow centers on automation of routine aspects of the flow of data between data stores, simulations, and visualizations. It enforces quality checks on data, reproducibility of computations, and traceability of results, while maintaining complete archives of modeling and analysis artifacts. The resulting frictionless simulation/analysis environment supports large-scale sensitivity analysis, interactive creation of ensembles of simulations, and rapid visualization-based exploration of simulation results.

09 BIOMASS FUELS↗

Simulated Radar Characteristics of LBA Convective Systems: Easterly and Westerly Regimes

The 3D Goddard Cumulus Ensemble (GCE) model was used to simulate convection that occurred during the TRMM LBA field experiment in Brazil. Convection in this region can be categorized into two different regimes. Low-level easterly flow results in moderate to high CAPE and a drier environment. Convection is more intense like that seen over continents. Low-level westerly flow results in low CAPE and a moist environment. Convection is weaker and more widespread characteristic of oceanic or monsoon-like systems. The GCE model has been used to study both regimes n order to provide cloud datasets that are representative of both environments in support of TRMM rainfall and heating algorithm development. Two different cases are analyzed: Jan 26, 1999, an eastely regime case, and Feb 23, 1999, a westerly regime case. The Jan 26 case is an organized squall line, while the Feb 23 case is less organized with only transient lines. Radar signatures, including CFADs, from the two simulated cases are compared to each other and with observations. The microphysical processes simulated in the model are also compared between the two cases.

Lang, Stephen E.↗

Short ensembles: An Efficient Method for Discerning Climate-relevant Sensitivities in Atmospheric General Circulation Models

This paper explores the feasibility of an experimentation strategy for investigating sensitivities in fast components of atmospheric general circulation models. The basic idea is to replace the traditional serial-in-time long-term climate integrations by representative ensembles of shorter simulations. The key advantage of the proposed method lies in its efficiency: since fewer days of simulation are needed, the computational cost is less, and because individual realizations are independent and can be integrated simultaneously, the new dimension of parallelism can dramatically reduce the turnaround time in benchmark tests, sensitivities studies, and model tuning exercises. The strategy is not appropriate for exploring sensitivity of all model features, but it is very effective in many situations. Two examples are presented using the Community Atmosphere Model version 5. The first example demonstrates that the method is capable of characterizing the model cloud and precipitation sensitivity to time step length. A nudging technique is also applied to an additional set of simulations to help understand the contribution of physics-dynamics interaction to the detected time step sensitivity. In the second example, multiple empirical parameters related to cloud microphysics and aerosol lifecycle are perturbed simultaneously in order to explore which parameters have the largest impact on the simulated global mean top-of-atmosphere radiation balance. Results show that in both examples, short ensembles are able to correctly reproduce the main signals of model sensitivities revealed by traditional long-term climate simulations for fast processes in the climate system. The efficiency of the ensemble method makes it particularly useful for the development of high-resolution, costly and complex climate models.

atmospheric general circulation models↗

A study of the response of deep tropical clouds to mesoscale processes - Three-dimensional numerical experiments

A three-dimensional numerical cloud model is utilized to study the collective feedback effects of cloud systems on the large-scale environment. The characteristic features of the cloud ensemble model are described. The model is applied to a case of a well-defined ITCZ rainband over the eastern tropical Atlantic ocean. The location, number, and configuration of the clouds that formed in the model during the simulations are examined. The cloud heating and moistening, environmental wind shear, and vertical transports of momentum are analyzed. The collective feedbacks of cloud systems on the large-scale temperature, moisture, and horizontal momentum fields are computed after each simulation. The effect of the pressure gradient force on the v-momentum flux is investigated. It is observed that there is good correlation between the model simulations and the observed data.

Tao, Wei-Kuo↗

Scaling Observation Error for Optimal Assimilation of CCI SST Data into a Regional HYCOM EnOI System

South Africa currently possesses no operational ocean forecasting system for the purpose of predicting ocean state variables including temperature,salinity and velocity. Substantial initial efforts towards this goal have been made and resulted in a system using a regional Hybrid Coordinate Ocean Model (HYCOM) along with the Ensemble Optimal Interpolation (EnOI)assimilation scheme. Assimilating only sea surface temperature (SST) observations from the Operational Sea Surface Temperature and Sea Ice Analysis (OSTIA) product into the system resulted in a degraded forecast. Aiming to address this, Climate Change Initiative (CCI) SSTs are assimilated into the system in an effort to improve the forecast skill. Observation errors in the assimilated product are used in the EnOI to determine whether more confidence should be placed in the model or observations in producing the analysis, but overconfidence in observations can shock the model and result in failure. To tweak the impact of the assimilation, a scaling factor is applied in the assimilation code. A scaling factor of 25 was found to produce a favourable result with lowest mean root mean square error (RMSE;1.098°C) between the model and observations over time. Postulating the error to be overconfident, a floor value is introduced in order to set a minimum value for the observation error thereby reducing confidence in the observations. These experiments fared less favourably with a floor value of 0.5 and a scaling factor of 15 producing the best mean RMSE (1.118°C).

Luyt, Hermann↗

On the Prediction of Surface Melt Over the Greenland Ice Sheet at NWP and S2S Timescales

Greenland surface melt “events” – encompassing large swaths of the ice sheet over approximately 4-10 day periods – have occurred with increasing frequency in the 21st Century. Surface processes are significant to the ice sheet’s overall contribution to sea level. In addition, the sudden onset of widespread surface melt produces hazardous conditions for researchers and for communities adjacent to the ice sheet. The mechanisms producing melt events, their associated large-scale forcing, and timescales of interest are highly variable and poorly understood. Here we examine the predictability of melt events in a numerical weather prediction system (NWP) and a subseasonal-to-seasonal system (S2S). The NASA Global Modeling and Assimilation Office forward processing (GMAO-FP) is an NWP system that incorporates an evolving, global hybrid 4D ensemble–variational (4DEnVar) data assimilation system and a state-of-the-art model that is run twice-daily with forecasts out to five and ten days. The GMAO S2S system is a hindcast-anomaly, coupled-model prediction system initialized with an atmospheric analysis, and in situ and satellite ocean data assimilation. Both systems represent ice sheet surface hydrology and snowpack processes. We examine the performance of the systems over the period 2018-2023, a span that includes approximately nine significant events, against analyses and satellite-derived melt extent. In addition to extent, we examine related conditions and their role in the melt forecast, including the onset of both omega and Rex atmospheric blocking patterns, sea surface temperatures, sea ice extent, water vapor transport, precipitation, and surface preconditioning. We further examine the tendency for false-alarm events in each system and assess reasons for the forecast performance. North Atlantic atmospheric blocking patterns leading to surface melt are well forecast by the NWP system out to around eight days, while the S2S system generally underestimates the magnitude of such events at monthly lead times. These systems suggest that while short term forecasts of ice sheet melt and melt events are relatively robust, S2S predictions of surface conditions are highly dependent on the ability of a coupled system to generate the short-term atmospheric conditions associated with surface melt events.

Richard Cullather↗

Changing windstorm characteristics over the US Northeast in a single model large ensemble

Abstract Extreme windstorms pose a significant hazard to infrastructure and public safety, particularly in the highly populated US Northeast (NE). However, the influence climate change and changing land use will have on these events remains unclear. A large ensemble generated using the Max-Planck Institute (MPI) Earth system model is used to generate projections of NE windstorms under different shared socioeconomic pathways (SSPs) and to attribute changes to projected land use land cover (LULC) change, externally forced changes and internal climate variability. To reduce the influence of coarse grid cell resolution and uncertainties in surface roughness lengths, windstorms are identified using simultaneous widespread exceedance of local 99th percentile 10 m wind speeds (U 99 ). Projected declines in forest cover in the NE and the resulting reductions in surface roughness length under SSP3-7.0 lead to projections of large increases in U 99 and derived windstorm intensity and scale. However, these projected changes in regional LULC under SSP3-7.0 are unprecedented in a historical context and may not be realistic. After corrections are applied to remove the influence of LULC on wind speeds, regionally averaged U 99 exhibit declines for most of the single model initial-condition large ensemble (SMILE) members which are broadly proportional to the radiative forcing and global air temperature increase in the SSPs, with a median value of −0.15 ms −1 °C −1 . While weak cyclones are projected to decline in frequency in the NE, intense cyclones and the resulting windstorms and indices of socioeconomic loss do not. Where present, significant trends in these loss indices are positive, and some MPI SMILE members generate future windstorms that are unprecedented in the historical period.

Coburn, Jacob (ORCID:0000000309538117)↗