Search NASA⌕ Search

SEARCH · Search NASA

Results for “model sensitivity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

A theoretical model for determining turbine flowmeter sensitivity

Analytical model of turbine-type flowmeter guides in the selection of valid extrapolation of available calibration data. An expression for flowmeter performance is developed to include the effects of fluid friction, bearing drag, and magnetic drag upon helical rotor design.

Smith, R. L.↗

Changes in Extratropical Storm Track Cloudiness 1983-2008: Observational Support for a Poleward Shift

Climate model simulations suggest that the extratropical storm tracks will shift poleward as a consequence of global warming. In this study the northern and southern hemisphere storm tracks over the Pacific and Atlantic ocean basins are studied using observational data, primarily from the International Satellite Cloud Climatology Project, ISCCP. Potential shifts in the storm tracks are examined using the observed cloud structures as proxies for cyclone activity. Different data analysis methods are employed, with the objective to address difficulties and uncertainties in using ISCCP data for regional trend analysis. In particular, three data filtering techniques are explored; excluding specific problematic regions from the analysis, regressing out a spurious viewing geometry effect, and excluding specific cloud types from the analysis. These adjustments all, to varying degree, moderate the cloud trends in the original data but leave the qualitative aspects of those trends largely unaffected. Therefore, our analysis suggests that ISCCP data can be used to interpret regional trends in cloudiness, provided that data and instrumental artefacts are recognized and accounted for. The variation in magnitude between trends emerging from application of different data correction methods, allows us to estimate possible ranges for the observational changes. It is found that the storm tracks, here represented by the extent of the midlatitude-centered band of maximum cloud cover over the studied ocean basins, experience a poleward shift as well as a narrowing over the 25 year period covered by ISCCP. The observed magnitudes of these effects are larger than in current generation climate models (CMIP3). The magnitude of the shift is particularly large in the northern hemisphere Atlantic. This is also the one of the four regions in which imperfect data primarily prevents us from drawing firm conclusions. The shifted path and reduced extent of the storm track cloudiness is accompanied by a regional reduction in total cloud cover. This decrease in cloudiness can primarily be ascribed to low level clouds, whereas the upper level cloud fraction actually increases, according to ISCCP. Independent satellite observations of radiative fluxes at the top of the atmosphere are consistent with the changes in total cloud cover. The shift in cloudiness is also supported by a shift in central position of the mid-troposphere meridional temperature gradient. We do not find support for aerosols playing a significant role in the satellite observed changes in cloudiness. The observed changes in storm track cloudiness can be related to local cloud-induced changes in radiative forcing, using ERBE and CERES radiative fluxes. The shortwave and the longwave components are found to act together, leading to a positive (warming) net radiative effect in response to the cloud changes in the storm track regions, indicative of positive cloud feedback. Among the CMIP3 models that simulate poleward shifts in all four storm track areas, all but one show decreasing cloud amount on a global mean scale in response to increased CO2 forcing, further consistent with positive cloud feedback. Models with low equilibrium climate sensitivity to a lesser extent than higher-sensitivity models simulate a poleward shift of the storm tracks.

Bender, Frida A-M.↗

Comparisons of Mixing Efficiency for the Strut Fuel Injector Obtained from Large-Eddy and Reynolds-Averaged Simulations, and Experiments

Mixing efficiency is obtained for a strut fuel injector at hypervelocity flow conditions by using large-eddy simulations (LES), Reynolds-averaged simulations (RAS), and experiments. The injector and flow conditions have been previously investigated by using RAS and experiments as a part of the Enhanced Injection and Mixing Project (EIMP) at the NASA Langley Research Center (LaRC). Because the fidelity of LES is a strong function of the grid, the mixing efficiency is obtained on two grids, the coarser of which is a factor of two coarser in each of the three dimensions with respect to the fine grid. The RAS uses the two-equation linear eddy viscosity and diffusivity modeling of Menter. In RAS, the species diffusivity model exhibits a strong dependence on the turbulent Schmidt number, which is often adjusted until some metric of engineering interest, such as the mixing efficiency, matches the experimental data. In the absence of experimental data, scale-resolving simulations, such as LES, have been proposed as surrogates for experiments that could provide the data needed to “calibrate” the turbulent Schmidt number in the RAS models. This approach is followed because LES requires significantly more computational resources (CPU, data storage, and time) than RAS, making it prohibitive for use in many engineering applications and specifically for parameter exploration or optimization. Here we examine the mixing efficiency obtained from several RAS with different values of the turbulent Schmidt number, and compare the results with those obtained from the LES and experiments. In addition, the least squares fitting approach was used to demonstrate how to obtain an estimate for the turbulent Schmidt number from LES analytically. These estimates were then used together with prior knowledge about RAS model sensitivity to select a turbulence model that was expected to best match the LES data.

LES↗

Comparisons of Mixing Efficiency for the Strut Fuel Injector Obtained from Large-Eddy and Reynolds-Averaged Simulations, and Experiments

Mixing efficiency is obtained for a strut fuel injector at hypervelocity flow conditions by using large-eddy simulations (LES), Reynolds-averaged simulations (RAS), and experiments. The injector and flow conditions have been previously investigated by using RAS and experiments as a part of the Enhanced Injection and Mixing Project (EIMP) at the NASA Langley Research Center (LaRC). Because the fidelity of LES is a strong function of the grid, the mixing efficiency is obtained on two grids, the coarser of which is a factor of two coarser in each of the three dimensions with respect to the fine grid. The RAS uses the two-equation linear eddy viscosity and diffusivity modeling of Menter. In RAS, the species diffusivity model exhibits a strong dependence on the turbulent Schmidt number, which is often adjusted until some metric of engineering interest, such as the mixing efficiency, matches the experimental data. In the absence of experimental data, scale-resolving simulations, such as LES, have been proposed as surrogates for experiments that could provide the data needed to “calibrate” the turbulent Schmidt number in the RAS models. This approach is followed because LES requires significantly more computational resources (CPU, data storage, and time) than RAS, making it prohibitive for use in many engineering applications and specifically for parameter exploration or optimization. Here we examine the mixing efficiency obtained from several RAS with different values of the turbulent Schmidt number, and compare the results with those obtained from the LES and experiments. In addition, the least squares fitting approach was used to demonstrate how to obtain an estimate for the turbulent Schmidt number from LES analytically. These estimates were then used together with prior knowledge about RAS model sensitivity to select a turbulence model that was expected to best match the LES data.

LES↗

Bayesian weighting of climate models based on climate sensitivity

Using climate model ensembles containing members that exhibit very high climate sensitivities to increasing CO 2 concentrations can result in biased projections. Various methods have been proposed to ameliorate this ‘hot model’ problem, such as model emulators or model culling. Here, we utilize Bayesian Model Averaging as a framework to address this problem without resorting to outright rejection of models from the ensemble. Taking advantage of multiple lines of evidence used to construct the best estimate of the earth’s climate sensitivity, the Bayesian Model Averaging framework produces an unbiased posterior probability distribution of model weights. The updated multi-model ensemble projects end-of-century global mean surface temperature increases of 2 °C for a low emissions scenario (SSP1-2.6) and 5 °C for a high emissions scenario (SSP5-8.5). These estimates are lower than those produced using a simple multi-model mean for the CMIP6 ensemble. The results are also similar to results from a model culling approach, but retain some weight on low-probability models, allowing for consideration of the possibility that the true value could lie at the extremes of the assessed distribution. Our results showcase Bayesian Model Averaging as a path forward to project future climate change that is commensurate with the available scientific evidence.

59 BASIC BIOLOGICAL SCIENCES↗

Sensitivity of the boundary layer energy fluxes to forcing parameters in a simple climate model

Winter and summer surface temperatures and time-averaged boundary layer energy fluxes are calculated by utilizing the Saltzman-Ashe parameterization for boundary layer fluxes in a two-level static model. The results are found to agree with observed patterns. Within the framework of this simple model, sensitivity analyses of the time-averaged boundary layer energy fluxes are conducted. Based on these results some of the forcing parameters (such as the subsurface temperature, cloud cover, surface albedo, etc.) are arranged in a hierarchical order of importance. A generalized method of sensitivity analysis is also suggested.

Rao, M. S.↗

Informing Robust Functional Relationship Benchmarks: An Evaluation of the Temperature Sensitivity of Ecosystem Respiration Across the Arctic-Boreal Region

During land model development, simulated carbon dynamics are often benchmarked against observational data sets to evaluate model performance. Functional relationship benchmarks are the relationship between a driving variable (e.g., temperature) and a response variable (e.g., ecosystem respiration) and are a promising tool for assessing model performance by evaluating modeled sensitivities to changing environmental conditions. However, observed functional relationships can be influenced by choices made during data collection and throughout the benchmarking process, impacting the inferred skill of land models. To avoid misrepresenting a model's true performance, it is necessary to systematically evaluate best practices when constructing functional relationship benchmarks. We developed a set of guidelines for constructing functional relationship benchmarks, considering the choice of data set, number of daily observations, temporal extent, and temporal resolution across Alaska and Canada over a 20-year period from 2001 to 2020. The temperature sensitivity of ecosystem respiration from observations, evaluated through an apparent Q 10 , is highly variable both spatially and as a result of the data processing approach applied in the benchmark formation. When benchmarking 13 models from the Warming Permafrost Model Intercomparison Project (WrPMIP), the range in inferred model skill is substantially impacted by the choices applied in constructing functional relationship benchmarks. The inferred performance of a given model is most sensitive to the number of daily observations and temporal extent, followed by choice of benchmark data set and temporal averaging. Results from this analysis can guide the development of consistent and robust functional relationships for future model evaluation studies.

Poe, Jeralyn [Northern Arizona University, Flagsta↗

Provably conservative approximations to complex reliability models

Complex models can be the bases for derivation of provably conservative and optimistic reliability models that incorporate a reduced state space and fewer transitions; they accordingly possess solutions that are more cost-effective than those of the original complex models. Design space can thereby be extensively explored without incurring the expense of multiple complex model solutions. A conservative-optimistic pair of derived models produces a band that includes the solution to the complex model. Sensitivity analysis can be performed on this pair of models to determine those parameters of the original model that are most sensitive to change and therefore require further expense in obtaining tighter specifications.

Smotherman, M.↗

Using ARM Observations to Evaluate Process-Interactions in MCS Simulations Across Scales (Final Progress Report)

This project, funded by DOE Atmospheric System Research (DE-SC0020050), focused on improving the representation of mesoscale convective systems (MCSs) in numerical weather and climate models by leveraging high-resolution observations from the DOE Atmospheric Radiation Measurement (ARM) program. The research aimed to evaluate model sensitivities to grid spacing, microphysics, and planetary boundary layer (PBL) schemes, with a particular emphasis on improving convection parameterization for high-resolution modeling. Findings from this work highlight several key advancements. Model validation against ARM radar wind profiler data from the Southern Great Plains (SGP) and Manaus (MAO) sites revealed systematic biases in simulated convective mass flux profiles, leading to the development of an observationally constrained evaluation framework for diagnosing and improving model performance. Sensitivity analyses demonstrated that the representation of Amazonian MCSs was highly dependent on PBL scheme selection, while mid-latitude MCSs were more strongly influenced by microphysics parameterizations. A series of high-resolution WRF simulations, ranging from 4 km to 125 m grid spacing, provided insight into the behavior of convective drafts across scales. While updraft properties converged at sub-kilometer resolutions, biases in downdraft intensity persisted even at the finest resolution tested, emphasizing the need for further refinements in model physics. Additionally, comparisons of MCS vertical structures between mid-latitude and tropical environments revealed stronger updrafts and larger mass flux in mid-latitude MCSs, providing critical insights for improving climate model representations of storm-scale dynamics. The project’s findings have already contributed to advancing numerical modeling capabilities, particularly in WRF, MPAS, ICON, and DOE’s SCREAM model, by refining how convective processes are represented in high-resolution climate simulations. Results were disseminated through peer-reviewed publications, conference presentations, and ARM/ASR Research Highlights, engaging the broader scientific community. The project also provided valuable training opportunities for two postdoctoral researchers, who played central roles in model development, analysis, and dissemination of results. Their work contributed to several publications and conference presentations, helping prepare them for careers in atmospheric modeling. By improving the simulation of MCSs, this research directly supports the development of next-generation climate models capable of more accurately representing extreme precipitation and convective processes. The insights gained will inform future improvements in convective parameterization and guide the design of high-resolution weather and climate simulations, ultimately enhancing the reliability of climate projections and weather forecasts.

54 ENVIRONMENTAL SCIENCES↗

Increasing large wildfires over the western United States linked to diminishing sea ice in the Arctic

Abstract The compound nature of large wildfires in combination with complex physical and biophysical processes affecting variations in hydroclimate and fuel conditions makes it difficult to directly connect wildfire changes over fire-prone regions like the western United States (U.S.) with anthropogenic climate change. Here we show that increasing large wildfires during autumn over the western U.S. are fueled by more fire-favorable weather associated with declines in Arctic sea ice during preceding months on both interannual and interdecadal time scales. Our analysis (based on observations, climate model sensitivity experiments, and a multi-model ensemble of climate simulations) demonstrates and explains the Arctic-driven teleconnection through regional circulation changes with the poleward-shifted polar jet stream and enhanced fire-favorable surface weather conditions. The fire weather changes driven by declining Arctic sea ice during the past four decades are of similar magnitude to other leading modes of climate variability such as the El Niño-Southern Oscillation that also influence fire weather in the western U.S.

54 ENVIRONMENTAL SCIENCES↗

Semi-automated Design of Artificial Intelligence Earth Systems Models

Prediction and observation of water cycles at various scales involve not only patterns isolated in space and time, but also modeling of complex spatio-temporal relationships across multiple domains. For instance, evapotranspiration (ET) and leaf area indexes (LAI) are two parameters that are needed to accurately model and understand land-atmosphere processes. Accurate assessments of ET and LAI are critical for understanding hydrological processes, deforestation, crop yield, and irrigation impacts. However, ET estimates for global simulations are available at very coarse spatial resolution. They are usually derived from satellite data based on broad plant functional types (PFTs), which fail to capture fine-scale variations because of changes in vegetation type across the globe. Similarly LAI estimates have typically been derived from vegetation indices at global scales or estimated locally using physical models, both of which suffer from a range of uncertainties that impact model sensitivity. The new era of AI model development for Earth systems (ES) calls for data-driven methods that provide domain scientists with uncertainty-aware estimations of biophysical parameters such as ET and LAI in a generalizable, interpretable, and discoverable manner.

54 ENVIRONMENTAL SCIENCES↗

Earth System Model Parameter Adjustment Using a Green's Functions Approach

We demonstrate the practicality and effectiveness of using a Green's functions estimation approach for adjusting uncertain parameters in an Earth system model (ESM). This estimation approach has previously been applied to an intermediate-complexity climate model and to individual ESM components, e.g., ocean, sea ice, or carbon cycle components. Here, the Green's functions approach is applied to a state-of-the-art ESM that comprises a global atmosphere/land configuration of the Goddard Earth Observing System (GEOS) coupled to an ocean and sea ice configuration of the Massachusetts Institute of Technology general circulation model (MITgcm). Horizontal grid spacing is approximately 110 km for GEOS and 37–110 km for MITgcm. In addition to the reference GEOS-MITgcm simulation, we carried out a series of model sensitivity experiments, in which 20 uncertain parameters are perturbed. These “control” parameters can be used to adjust sea ice, microphysics, turbulence, radiation, and surface schemes in the coupled simulation. We defined eight observational targets: sea ice fraction, net surface shortwave radiation, downward longwave radiation, near-surface temperature, sea surface temperature, sea surface salinity, and ocean temperature and salinity at 300 m. We applied the Green's functions approach to optimize the values of the 20 control parameters so as to minimize a weighted least-squares distance between the model and the eight observational targets. The new experiment with the optimized parameters resulted in a total cost reduction of 9 % relative to a simulation that had already been adjusted using other methods. The optimized experiment attained a balanced cost reduction over most of the observational targets. We also report on results from a set of sensitivity experiments that are not used in the final optimized simulation but helped explore options and guided the optimization process. These experiments include an assessment of sensitivity to the number of control parameters and to the selection of observational targets and weights in the cost function. Based on these sensitivity experiments, we selected a specific definition for the cost function. The sensitivity experiments also revealed a decreasing overall cost as the number of control variables was increased. In summary, we recommend using the Green's functions estimation approach as an additional fine-tuning step in the model development process. The method is not a replacement for modelers' experience in choosing and adjusting sensitive model parameters. Instead, it is an additional practical and effective tool for carrying out final adjustments of uncertain ESM parameters.

Green's Function↗

Validation and moisture content sensitivity analysis of cross-laminated timber wall assemblies in EnergyPlus

Cross-laminated timber buildings are becoming more common in North America, with many numerical studies showing potential energy savings. However, no studies have validated any EnergyPlus heat transfer algorithms or quantified their accuracy in simulating CLT in building envelopes. This study empirically validates the heat flux predictions for each of EnergyPlus's heat transfer algorithms (Conduction Transfer Functions (CTF), Effective Moisture Penetration Depth (EMPD), Conduction Finite Difference (CondFD), and Heat and Moisture Transfer (HAMT)) for two different CLT ply thicknesses with both summer and winter boundary conditions measured in controlled lab experiments. It also evaluates the model sensitivity of heat flux and heating and cooling loads to moisture content. The 1D validation shows that the HAMT model is the most accurate among all algorithms. All EnergyPlus's heat flux predictions are accurate independent of CLT plate thickness for summer conditions. However, the three constant property algorithms (CTF, EMPD, and CondFD) underpredict heat flux throughout the whole day during winter conditions. The 1D sensitivity analysis indicates that elevated moisture content can increase peak heat fluxes through the material by up to 20 %. Finally, the whole building model sensitivity analysis shows increased heating load and slight cooling load variation due to increased moisture content when using constant property models. The analysis shows significantly lower peak thermal demand (7 % lower heating and 6 % lower cooling) and monthly thermal load (8 % less cooling and 6 % less heating) predictions when using HAMT vs a constant property model.

42 ENGINEERING↗

Bayesian analysis for estimating statistical parameter distributions of elasto-viscoplastic material models

High temperature design methods rely on constitutive models for inelastic deformation and failure typically calibrated against the mean of experimental data without considering the associated scatter. Variability may arise from the experimental data acquisition process, from heat-to-heat material property variations, or both and need to be accurately captured to predict parameter bounds leading to efficient component design. Applying the Bayesian Markov Chain Monte Carlo (MCMC) method to produce statistical models capturing the underlying uncertainty in the experimental data is an area of ongoing research interest. This work varies aspects of the Bayesian MCMC method and explores their effect on the posterior parameter distributions for a uniaxial elasto-viscoplastic damage model using synthetically generated reference data. From our analysis with the uniaxial inelastic model we determine that an informed prior distribution including different types of test conditions results in more accurate posterior parameter distributions. The parameter posterior distributions, however, do not improve when increasing the number of similar experimental data. Additionally, changing the amount of scatter in the data affects the quality of the posterior distributions, especially for the less sensitive model parameters. Moreover, we perform a sensitivity study of the model parameters against the likelihood function prior to the Bayesian analysis. The results of the sensitivity analysis help to determine the reliability of the posterior distributions and reduce the dimensionality of the problem by fixing the insensitive parameters. The comprehensive study described in this work demonstrates how to efficiently apply the Bayesian MCMC methodology to capture parameter uncertainties in high temperature inelastic material models. Quantifying these uncertainties in inelastic models will improve high temperature engineering design practices and lead to safer, more effective component designs.

42 ENGINEERING↗

Land surface interaction

The topics covered include the following: land and climate modeling; sensitivity studies; the process of a land model; model-specific parameterizations; water stress; within-canopy resistances; partial vegetation; canopy temperature; and present experience with a land model coupled to a general circulation model.

Dickinson, Robert E.↗

Data-Driven Surrogate Modeling with Microstructure-Sensitivity of Viscoplastic Creep in Grade 91 Steel

Abstract To support the development of advanced steel alloys tailored to withstand extreme conditions, it is imperative to account for the mechanical performance of components, while considering the influence of local microstructure on the macroscopic response. To this end, this study focuses on the development of microstructure-sensitive constitutive models for the mechanical response of Grade 91 steel exposed to extreme thermo-mechanical environments. Polynomial chaos expansion (PCE) surrogates are used to emulate high-fidelity polycrystal simulations of the viscoplastic response of Grade 91 steel as a function of the microstructure fingerprint (e.g., dislocations and precipitates). To cover a wide temperature–stress domain, two separate PCE surrogates—one that captures softening and the other that captures hardening behavior—are combined using another (sparse) Gaussian process regression model. The resulting constitutive creep surrogate model is integrated within the MOOSE finite element framework to simulate the intricate effects of microstructure, in particular MX-phase precipitates, on a component with a graded microstructure. Surrogate sensitivity analysis is applied to quantify the relevant impact of spatially varying microstructure on the creep response in a test-case involving a Grade 91 alloy with a prototypical weld.

36 MATERIALS SCIENCE↗

Vertical Structure and Ice Production Processes of Shallow Convective Postfrontal Clouds over the Southern Ocean in MARCUS. Part II: Modeling Study

Abstract Part I of this series presented a detailed overview of postfrontal mixed-phase clouds observed during the Measurements of Aerosols, Radiation, and Clouds over the Southern Ocean (MARCUS) field campaign. In Part II, we focus on a multiday (23–26 February 2018) case with the aim of understanding ice production as well as model sensitivity to ice process parameterizations using the Weather Research and Forecasting (WRF) Model. The control simulation with the Predicted Particle Properties (P3) microphysics scheme underestimates the ice content and overestimates the supercooled liquid water content, contrary to the bias common in global climate models. The simulations targeted at ice production processes show negligible sensitivity to cloud droplet number concentrations. Further, neither increasing ice nuclei particle (INP) concentrations to an unrealistic level nor adjusting it to MARCUS field estimations alone guarantees more ice production in the model. However, the simulated clouds are found to be highly sensitive to the implementation of immersion freezing, the thresholding of condensation/deposition freezing initiation, and the rime splintering process. By increasing immersion freezing of cloud droplets, relaxing thresholds for condensation/deposition freezing, or removing rime splintering thresholds, the model significantly improves its performance in producing ice. The relaxation of the immersion freezing temperature threshold to the observed cloud-top temperature suggests an in-cloud seeder–feeder mechanism. The results of this work call for an increase in observations of INP, especially over the remote Southern Ocean and at relatively high temperatures, and measurements of ice particle size distributions to better constrain ice nucleating processes in models.

Meteorology & Atmospheric Sciences↗