Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Sensitivity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2009

Weather Research and Forecasting Model Wind Sensitivity Study at Edwards Air Force Base, CA

This abstract describes work that will be done by the Applied Meteorology Unit (AMU) in assessing the success of different model configurations in predicting "wind cycling" cases at Edwards Air Force Base, CA (EAFB), in which the wind speeds and directions oscillate among towers near the EAFB runway. The Weather Research and Forecasting (WRF) model allows users to choose among two dynamical cores - the Advanced Research WRF (ARW) and the Non-hydrostatic Mesoscale Model (NMM). There are also data assimilation analysis packages available for the initialization of the WRF model - the Local Analysis and Prediction System (LAPS) and the Advanced Regional Prediction System (ARPS) Data Analysis System (ADAS). Having a series of initialization options and WRF cores, as well as many options within each core, creates challenges for local forecasters, such as determining which configuration options are best to address specific forecast concerns. The goal of this project is to assess the different configurations available and determine which configuration will best predict surface wind speed and direction at EAFB.

Watson, Leela R.↗
NASA NTRSDate not supplied

Regional and Model-Specific Response Types in A Global Gridded Crop Model Ensemble

Crop models are often employed to project crop yields under changing conditions such as global warming and associated management change for adaptation. Multi-model ensembles are promoted to enhance the robustness of projections, but questions remain on what causes often large differences between projections of individual models. Global Gridded Crop Models (GGCMs) are especially exposed to this question when applied for assessing climate change impacts, adaptation, environmental impacts of agricultural production, because their results are used in downstream analyses, such as in integrated assessment or economic modeling for projecting future land-use change. Even though global gridded crop models are often based on detailed field-scale models or have implemented similar modeling principles in other ecosystem models, global-scale models are subject to substantial uncertainties from both model structure and parametrization as well as from calibration and input data quality. AgMIP’s Global Gridded Crop Model Intercomparison (GGCMI) has thus set out to intercompare GGCMs in order to evaluate model performance, describe model uncertainties, identify inconsistencies within the ensemble and underlying reasons, and to ultimately improve models and modeling capacities. In phase 2 of the GGCMI activities, 12 modeling groups followed a modeling protocol that asked for up to 1404 31-year global simulations at 0.5 arc-degree spatial resolution to assess models’ sensitivities to changes in carbon dioxide (C; 4 different levels) temperature (T; 7 different offset levels), water supply (W; 9 levels), and nitrogen (N; 3 levels), the so-called CTWN experiment (Franke et al. 2020; http://dx.doi.org/10.5194/gmd-13-2315-2020). We here present analyses of model response types using impact response surfaces along the C, T, W, and N dimensions, respectively and collectively. Doing so, we can understand differences in simulated responses per driver rather than aggregated changes in yields. We find that models’ sensitivities to the individual driver dimensions are substantially different and often more different across models than across regions. A cluster analysis finds regional and model-specific patterns. There is some agreement across models with respect to the spatial patterns of response types but strong differences in the distribution of response type clusters across models suggests that models need to undergo further scrutiny. We suggest establishing standards in model process evaluation not only against historical dynamics but also against dedicated experiments across the CTWN dimensions.

crop models↗
NASA NTRS1977

Dynamic modeling and sensitivity analysis of solar thermal energy conversion systems

Since the energy input to solar thermal conversion systems is both time variant and probabilistic, it is unlikely that simple steady-state methods for estimating lifetime performance will provide satisfactory results. The work described here uses dynamic modeling to begin identifying what must be known about input radiation and system dynamic characteristics to estimate performance reliably. Daily operation of two conceptual solar energy systems was simulated under varying operating strategies with time-dependent radiation intensity ranging from smooth input of several magnitudes to input of constant total energy whose intensity oscillated with periods from 1/4 hour to 6 hours. Integrated daily system output and efficiency were functions of both level and dynamic characteristics of insolation. Sensitivity of output to changes in total input was greater than one.

Hamilton, C. L.↗
DOE OSTI2026

Automated ICRF heating surrogate modeling via machine learning

This work introduces automated machine learning workflows that address critical bottlenecks in surrogate model development for Ion Cyclotron Range of Frequencies (ICRF) heating applications. The automated framework includes data analysis tools that transform raw datasets into actionable insights in seconds, replacing weeks of manual exploratory effort and ensuring consistent, reproducible dataset characterization. By integrating advanced hyperparameter optimization (HPO) methods including Bayesian optimization via BoTorch and Tree-structured Parzen Estimators (TPE), the framework significantly reduces model development time from weeks to hours, decreasing computational cost and required expertise, while enabling high-accuracy surrogate models. Compared to traditional hyperparameter scanning (HPS) techniques such as methodical, randomized, and grid searches, HPO methods achieve superior convergence and predictive performance, even when compared to already well-tuned reference models. On NSTX High Harmonic Fast Wave (HHFW) heating datasets, both Random Forest Regressor (RFR) and neural network surrogates demonstrate improved accuracy, achieving R 2 values beyond 0.97 and 0.98, respectively. The results show that while HPO gains are modest for robust architectures like RFR, they become essential for more sensitive models such as neural networks, highlighting the trade-offs across optimization strategies. Through automated workflows that eliminate manual hyperparameter tuning and require minimal ML expertise, this work enables widespread adoption of high-fidelity surrogate models across the fusion community for real-time plasma control, uncertainty quantification, rapid experimental scenario development, and integrated system optimization.

Sanchez-Villar, Alvaro [Princeton Plasma Physics L↗
NASA NTRSDate not supplied

Modeling and Sensitivity Analysis of Sandwich Composite Cylinders with Geometric Imperfections

It is well known that real shell structures can have significantly lower buckling loads and even different mode shapes than the theoretical predictions for perfect structures. Much of this difference can be attributed to geometric and loading imperfections, and geometrically nonlinear effects. The realistic buckling response can be investigated using geometrically nonlinear finite element analyses and including radial imperfections. Such analyses are used in the NASA Engineering and Safety Center Shell Buckling Knockdown Factor Project, which has the goal of developing new analysis-based buckling design recommendations for select classes of cylindrical shell structures under uniaxial compressive load. The approach for modeling several sandwich composite cylinders with two-dimensional general-purpose shell elements and the influence of the element type selection and element size on the buckling load is discussed. The influence of geometric imperfections of various magnitudes on buckling behavior of a sandwich composite cylinder was also investigated.

Structural Modeling↗
NASA NTRSDate not supplied

Modeling and Sensitivity Analysis of Sandwich Composite Cylinders with Geometric Imperfections

It is well known that manufactured shell structures can have significantly lower buckling loads and different mode shapes than the theoretical predictions for perfect structures. Much of this difference can be attributed to geometric and loading imperfections, and geometrically nonlinear effects. The buckling response of cylindrical structures can be investigated using geometrically nonlinear finite element analyses and including radial imperfections. Such analyses are used in the NASA Engineering and Safety Center Shell Buckling Knockdown Factor Project, which has the goal of developing new analysis-based buckling design recommendations for select classes of cylindrical shell structures under uniaxial compressive load. The approach for modeling several sandwich composite cylinders with two-dimensional general-purpose shell elements and the influence of the element type selection and element size on the buckling load is discussed. The influence of geometric imperfections of various magnitudes on buckling behavior of a sandwich composite cylinder was also investigated.

Structural Modeling↗
NASA NTRSDate not supplied

: Modeling and Sensitivity Analysis of Sandwich Composite Cylinders with Geometric Imperfections

It is well known that manufactured shell structures can have significantly lower buckling loads and different mode shapes than the theoretical predictions for perfect structures. Much of this difference can be attributed to geometric and loading imperfections, and geometrically nonlinear effects. The buckling response of cylindrical structures can be investigated using geometrically nonlinear finite element analyses and including radial imperfections. Such analyses are used in the NASA Engineering and Safety Center Shell Buckling Knockdown Factor Project, which has the goal of developing new analysis-based buckling design recommendations for select classes of cylindrical shell structures under uniaxial compressive load. The approach for modeling several sandwich composite cylinders with two-dimensional general-purpose shell elements and the influence of the element type selection and element size on the buckling load is discussed. The influence of geometric imperfections of various magnitudes on buckling behavior of a sandwich composite cylinder was also investigated.

Structural Modeling↗
NASA NTRSDate not supplied

Coupled Material Response Simulations of Dragonfly Capsule and DrEAM Reconstruction

Icarus is a three-dimensional, unstructured, finite-volume material response solver developed at NASA Ames Research Center and has been recently used to analyze the material response of the Dragonfly capsule for a variety of problems. Since the Dragonfly capsule will be instrumented in a similar manner to the Mars 2020 and MSL capsules, it is important to assess how our current simulation tools can aid in understanding Dragonfly Entry Aerosciences Measurements (DrEAM). In this presentation, the Ares multi-physics tool that couples Icarus to the flow and radiation physics of the aerothermal environment will be used to better understand how modeling sensitivities might affect environment reconstructions and our understanding of measured data. Ares couples Icarus to the US3D flow solver and NERO, a reduced-order, finite-volume radiation transport solver and uses a customized time-scale management to enable coupled simulations for a large portion of the Dragonfly trajectory. As a result of the coupling, a more accurate and consistent assessment of modelling sensitivities to aerothermal reconstruction can be assessed. For example, the radiometer is sensitive to the quantity of CN in the flow, which is a byproduct of the free-stream methane but also the pyrolysis gas products injected into the boundary layer due to ablation of the heatshield. Ares will be used to conduct a simulation of the full Dragonfly capsule for 50 seconds of the trajectory. The different aerothermal and material response models will be discussed and the key results will be presented in terms of the simulated thermocouple and radiometer measurements on the backshell.

Ablation↗
NASA NTRS2020

Comparison of Surface Fluxes Derived from CYGNSS and Simulated by WRF Model: An MJO Case Study

This study focuses on ocean surface fluxes, mainly the latent heat flux, and their impact on MJO propagation and associated precipitation structures over the Indian Ocean and Maritime Continent. The Coupled-Ocean-Atmosphere-Wave-Sediment Transport (COAWST) model is used to simulate two MJO events during the 2017-2018 season: the December 10 - January 20, 2017 case, which maintained its strong precipitation signal over the Maritime Continent, and the March 1 - 20, 2018 case, which was weaker and did not propagate through the Maritime Continent. Both simulated MJO events show positive biases in surface rainfall compared with GPM IMERG data. During the MJO suppressed phase, the simulations rain more often than the observations. During the active phase, the westward propagating precipitation structures are more organized and much stronger compared with the observations, sometimes forming westward propagating cyclones that weakened the eastward precipitation signals. Two aspects of the surface flux interactions are investigated: the impact of the domain mean surface fluxes, and the impact of storm scale circulations and their interactions with local surface fluxes. Both aspects affect water vapor budget, atmosphere instability and mean flow, through which convection initiation, organization, and propagation are influenced. Model sensitivity tests with different radiation, microphysics, PBL schemes and nudging schemes indicate that in the control simulations, higher SST and surface fluxes, especially during the suppressed period, are the main reason of rainfall overestimation compared with IMERG data. The strong westward propagating signals are caused by both increased atmosphere instability and reduced mean wind shear. Unfortunately, the small differences in mean SST and surface fluxes between different model sensitivity tests are all within the satellite observation error margin, and cannot be directly corroborated by observations. One of the advantages of CYGNSS satellites is that they observe ocean surface wind and heat fluxes underneath strong rainfall events such as the convective systems associated with MJO active phases. Currently we are comparing CYGNSS level 2 surface fluxes retrievals and the model simulations in order to better understand the second aspect of the MJO and surface fluxes interactions, and how this affects MJO strengths and propagations. The interactive atmosphere-ocean-wave model also provides cases that directly comparing satellite observables (the bistatic radar cross section) and the model simulations (through CYGNSS satellite simulator). These discrepancies are more prominent in coupled ocean simulations, mainly due to higher SST and enhanced surface fluxes.

Li, Xiaowen↗
DOE OSTI2025

Atmospheric Feedbacks Reverse the Sensitivity of Modeled Photosynthesis to Stomatal Function

Stomata mediate fluxes of carbon and water between terrestrial plants and the atmosphere. These fluxes are governed by stomatal function and can be modulated in many Earth system models by an empirical parameter within the calculation of stomatal conductance, the stomatal slope (𝑔 1⁢𝑀 ). Intuitively, 𝑔 1⁢𝑀 represents the marginal water cost of carbon, relating it to the emergent plant property of water use efficiency. Observations show that 𝑔 1⁢𝑀 can range widely across and within plant types in varying environments, and this distribution of 𝑔 1⁢𝑀 is not captured within Earth system models which represent each plant type with a single 𝑔 1⁢𝑀 value. Here we examine how 𝑔 1⁢𝑀 influences photosynthesis using coupled Earth system model simulations by perturbing 𝑔 1⁢𝑀 to observed 5⁢t⁢h and 95⁢t⁢h percentiles for each plant type. We find that high 𝑔 1⁢𝑀 reduces photosynthesis nearly everywhere, while low 𝑔 1⁢𝑀 has regionally dependent responses. Under fixed atmospheric conditions, low 𝑔 1⁢𝑀 increases photosynthesis in the Amazon and central North America but decreases photosynthesis in boreal Canada. These responses reverse when the atmosphere responds interactively due to spatially differing sensitivity to increases in temperature and vapor pressure deficit. Choice of 𝑔 1⁢𝑀 also influences photosynthetic response to changes in atmospheric carbon dioxide (CO 2 ), with lower and higher 𝑔1⁢𝑀 modifying total global response to elevated 2x preindustrial CO 2 by +6.4% and −9.6%, respectively. Our work demonstrates that atmospheric feedbacks are critical for determining the photosynthetic response to 𝑔 1⁢𝑀 assumptions and some regions are particularly sensitive to choice of 𝑔 1⁢𝑀 .

Liu, Amy X. [University of Washington, Seattle, WA↗
NASA NTRS2008

Weather Research and Forecasting Model Wind Sensitivity Study at Edwards Air Force Base, CA

NASA prefers to land the space shuttle at Kennedy Space Center (KSC). When weather conditions violate Flight Rules at KSC, NASA will usually divert the shuttle landing to Edwards Air Force Base (EAFB) in Southern California. But forecasting surface winds at EAFB is a challenge for the Spaceflight Meteorology Group (SMG) forecasters due to the complex terrain that surrounds EAFB, One particular phenomena identified by SMG is that makes it difficult to forecast the EAFB surface winds is called "wind cycling". This occurs when wind speeds and directions oscillate among towers near the EAFB runway leading to a challenging deorbit bum forecast for shuttle landings. The large-scale numerical weather prediction models cannot properly resolve the wind field due to their coarse horizontal resolutions, so a properly tuned high-resolution mesoscale model is needed. The Weather Research and Forecasting (WRF) model meets this requirement. The AMU assessed the different WRF model options to determine which configuration best predicted surface wind speed and direction at EAFB, To do so, the AMU compared the WRF model performance using two hot start initializations with the Advanced Research WRF and Non-hydrostatic Mesoscale Model dynamical cores and compared model performance while varying the physics options.

Watson, Leela R.↗
NASA NTRSDate not supplied

Transfer Function Models and Sensitivity Analysis

In many situations, real or induced flaws such as tight cracks with known morphology cannot be manufactured in part configuration specimens or in real parts. Typically, fatigue cracks are manufactured in simple geometry specimens such as flat plates, dog-bone shaped flat or round specimens. If a nondestructive evaluation (NDE) technique is required to provide a reliably detectable target flaw size denoted as α_(90/95) for induced flaws in real part, then the direct method for qualifying the NDE procedure is to use the appropriate induced flaw specimens and perform probability of detection analysis using these flaws. This can be described as direct POD demonstration testing, which may follow guidelines of MIL-HDBK-1823. This paper considers a case, where induced flaws are not available in part configuration specimens. Therefore, a direct POD demonstration study cannot be undertaken. In such situation, general practice for NDE procedure qualification is to use artificial flaws in simple geometry and part configuration specimens, and induced flaws in the chosen simple geometry specimens. Signal response data is taken on all sets of artificial and induced flaws. NDE procedure testing on induced flaw in simple geometry specimen is called NDE demonstration testing here. A transfer function NDE procedure qualification method for forward case calculates predicted induced flaw size for demonstration using a chosen target flaw size. Another transfer function method for inverse case, calculates the target flaw size using a given demonstration flaw size. The transfer function analysis assumes relationship of artificial flaw signal responses in real parts and simple geometry specimens; and induced flaw responses in simple geometry specimens to induced flaws in real parts. The signal response transfer relationships model should be defined before transfer function models can be devised. Assuming that the signal response transfer relationships model is valid, forward and inverse case transfer function methods have been devised. Because of lack of signal response data from induced flaws in real part, 90/95% POD/confidence (P/C) cannot be demonstrated directly. However, the transfer function method may be assessed using simulation to evaluate whether the resulting target flaw size or demonstration flaw size provides adequate confidence to the assumed signal response transfer relationships model. Therefore, the transfer function approach is a risk assessment approach. Both the signal response transfer relationships model and the transfer function model are important in managing risk in results provided by the transfer function NDE technique qualification or assessment. The signal response transfer relationships model needs to be validated with empirical data and then transfer function model needs to be validated for desired P/C on case-by-case basis.

Nondestructive evaluation↗
NASA NTRS2000

The Sensitivity of Model Ozone to Advective and Photochemical Processes in the High Latitude Winter Lower Stratosphere

Three dimensional chemistry and transport models (CTMs) contain a set of coupled continuity equations which describe the evolution of constituents such as ozone and other minor species which affect ozone. Both advection and photochemical processes contribute to constituent evolution, and a CTM provides a means to evaluate these contributions separately. Such evaluation is particularly useful when both terms are important to the modeled tendency. An example is the ozone tendency in the high latitude winter lower stratosphere, where advection tends to increase ozone, and catalytic processes involving chlorine radicals tend to decrease ozone. The Goddard three dimensional chemistry and transport model uses meteorological fields from the Goddard Earth Observing System Data Assimilation System, thus the modeled ozone evolution may reproduce the observed evolution and provide a test of the model representation of photochemical processes if the transport is shown to be modeled appropriately. We have investigated the model advection further using diabatic trajectory calculations. For long lived constituents such as N2O, the model field for a particular time on a potential temperature surface is compared with a field produced by calculating 15 day back trajectories for a fixed latitude longitude grid, and mapping model N2O at the terminus of the back trajectories onto the initial grid. This provides a quantitative means to evaluate two aspects of the CTM transport: one, the model horizontal gradient between middle latitudes and the polar vortex is compared with the gradient produced using the non-diffusive trajectory calculation; two, the model vertical advection, which is produced by the divergence of the horizontal winds, is compared with the vertical transport expected from diabatic cooling.

Douglass, A.↗