Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sensitivity analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

High Accuracy Coronagraph Flight Model For WFIRST–CGI Raw Contrast Sensitivity Analysis

A high-accuracy high-fidelity flight wavefront control (WFC) model is developed for detailed raw contrast sensitivity analysis of WFIRST-CGI. Built upon features of recently testbed validated model, it is further refined to combine a full Fresnel propagation diffraction model for high accuracy contrast truth evaluation, and an economical compact model for WFC purposes. Extensive individual raw contrast error sensitivities are evaluated systematically, both as known imperfections and as unknown calibration errors, for both spectroscopy mode and wide field-of-view mode with shaped pupil coronagraph. More than 90 distinct error items were identified, including system aberrations, optical misalignment, component manufacturing error, telescope interface related errors, etc. The result forms the basis for raw contrast error budget flow down to a sub-system level, where detailed specifications needed to aid in component design and manufacturing, mechanical alignment and instrument integration, and verification and validation operations. Evaluations are mostly automated, making it relatively easy for repeat runs of revised design or at new desired error quantity. Top error sensitivities and contrast floor contributors are discussed and several observations are noted.

Poberezhskiy, Ilya↗
DOE OSTI2021

SAGE Intrusion Detection System: Sensitivity Analysis Guided Explainability for Machine Learning.

This report details the results of a three-fold investigation of sensitivity analysis (SA) for machine learning (ML) explainability (MLE): (1) the mathematical assessment of the fidelity of an explanation with respect to a learned ML model, (2) quantifying the trustworthiness of a prediction, and (3) the impact of MLE on the efficiency of end-users through multiple users studies. We focused on the cybersecurity domain as the data is inherently non-intuitive. As ML is being using in an increasing number of domains, including domains where being wrong can elicit high consequences, MLE has been proposed as a means of generating trust in a learned ML models by end users. However, little analysis has been performed to determine if the explanations accurately represent the target model and they themselves should be trusted beyond subjective inspection. Current state-of-the-art MLE techniques only provide a list of important features based on heuristic measures and/or make certain assumptions about the data and the model which are not representative of the real-world data and models. Further, most are designed without considering the usefulness by an end-user in a broader context. To address these issues, we present a notion of explanation fidelity based on Shapley values from cooperative game theory. We find that all of the investigated MLE explainability methods produce explanations that are incongruent with the ML model that is being explained. This is because they make critical assumptions about feature independence and linear feature interactions for computational reasons. We also find that in deployed, explanations are rarely used due to a variety of reason including that there are several other tools which are trusted more than the explanations and there is little incentive to use the explanations. In the cases when the explanations are used, we found that there is the danger that explanations persuade the end users to wrongly accept false positives and false negatives. However, ML model developers and maintainers find the explanations more useful to help ensure that the ML model does not have obvious biases. In light of these findings, we suggest a number of future directions including developing MLE methods that directly model non-linear model interactions and including design principles that take into account the usefulness of explanations to the end user. We also augment explanations with a set of trustworthiness measures that measure geometric aspects of the data to determine if the model output should be trusted.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2012

Probabilistic Sensitivity Analysis for Launch Vehicles with Varying Payloads and Adapters for Structural Dynamics and Loads

This paper examines Probabilistic Sensitivity Analysis (PSA) methods and tools in an effort to understand their utility in vehicle loads and dynamic analysis. Specifically, this study addresses how these methods may be used to establish limits on payload mass and cg location and requirements on adaptor stiffnesses while maintaining vehicle loads and frequencies within established bounds. To this end, PSA methods and tools are applied to a realistic, but manageable, integrated launch vehicle analysis where payload and payload adaptor parameters are modeled as random variables. This analysis is used to study both Regional Response PSA (RRPSA) and Global Response PSA (GRPSA) methods, with a primary focus on sampling based techniques. For contrast, some MPP based approaches are also examined.

McGhee, David S.↗
DOE OSTI2022

Sensitivity analysis for characterizing the impact of HNGD model on the prediction of hydrogen redistribution in Zircaloy cladding using BISON code

Hydrogen in zirconium cladding is able to precipitate into zirconium hydrides which impacts cladding integrity. The Hydride Nucleation-Growth-Dissolution (HNGD) model in the BISON code accounts for the precipitation and dissolution kinetics of hydride in Zircaloy material. This paper presents global sensitivity analyses of the HNGD model aiming to enhance our understanding of the hydride precipitation phenomena by quantifying the variance that key parameters have on the prediction of hydrogen behavior under various environmental conditions. Here, model predictions are compared to experimental data obtained under two different conditions: 1) with uniformly precharged specimens subjected to a linear thermal gradient, and 2) specimens precharged with a cathodically applied hydride rim at one end of the sample and subjected to an asymmetric thermal gradient. The Sobol sensitivity analysis identifies the key parameters in the HNGD model for both types of specimens. For linear temperature cases, the heat of transport dominates the accuracy of predictions when no precipitation occurs at the cold end, while Terminal Solid Solubility for Dissolution (TSSD) is the most important parameter when precipitation occurs. A large variation in the predicted hydrogen concentration profiles is found in the range of high TSSD due to the occurrence of precipitation. For asymmetric temperature cases, the solubility coefficient gives the largest impact on the predicted hydrogen distribution, as it determines the amount of solute hydrogen dissolved from the initially applied hydride rim. A large discrepancy in hydrogen distribution between simulations and experiments exists with the asymmetric specimens because BISON simulations fail to predict the precipitation of hydride at the cooler end. Comparative studies using former and updated models verifies the significant impact of the hydride growth mechanism on predicted hydrogen concentration profiles. In particular, when hydride initially exists, changes in TSSD generate a large variation in the predicted amount of precipitation by hydride growth, giving large uncertainty in predicting the hydrogen distribution over the sample length. The outputs characterize the significant impact of the hydride growth mechanism in the HNGD model on predicting hydrogen behavior, and improve the understanding of the precipitation of hydride in Zircaloy cladding within a range of expected environmental conditions. The analyses indicate work is still needed to improve the hydride solvus models in the BISON code to accurately predict experimentally observed hydride concentrations and distributions.

36 MATERIALS SCIENCE↗
NASA NTRS1985

Shape design sensitivity analysis using domain information

A numerical method for obtaining accurate shape design sensitivity information for built-up structures is developed and demonstrated through analysis of examples. The basic character of the finite element method, which gives more accurate domain information than boundary information, is utilized for shape design sensitivity improvement. A domain approach for shape design sensitivity analysis of built-up structures is derived using the material derivative idea of structural mechanics and the adjoint variable method of design sensitivity analysis. Velocity elements and B-spline curves are introduced to alleviate difficulties in generating domain velocity fields. The regularity requirements of the design velocity field are studied.

Seong, Hwal-Gyeong↗
DOE OSTI2023

Industrial PLC Network Modeling and Parameter Identification Using Sensitivity Analysis and Mean Field Variational Inference

A multiple input multiple output (MIMO) power line communication (PLC) model for industrial facilities was developed that uses the physics of a bottom-up model but can be calibrated like top-down models. The PLC model considers 4-conductor cables (three-phase conductors and a ground conductor) and has several load types, including motor loads. The model is calibrated to data using mean field variational inference with a sensitivity analysis to reduce the parameter space. The results show that the inference method can accurately identify many of the model parameters, and the model is accurate even when the network is modified.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Efficient sensitivity analysis of the thermal profile in powder bed fusion of metals using hypercomplex automatic differentiation finite element method

Rapid cyclic temperature fluctuation occurring in powder bed fusion of metals using a laser beam (PBF-LB/M) influences the formation of flaws in printed parts. Consequently, there is a pressing need to enhance the quality of printed parts by developing innovative methodologies that can predict thermal histories and help uncover the intricate relationships between process parameters and thermal profiles. Sensitivity Analysis (SA) emerges as an essential tool for this, offering the potential for process optimization and enhanced quality control. Nonetheless, conventional SA methodologies often incur in excessive computational costs and potential numerical approximation errors. Here, to address this technical challenge, we present a novel method for SA that integrates the HYPercomplex-based Automatic Differentiation (HYPAD) technique with transient thermal simulations conducted via the finite element method (FEM). Leveraging this methodology, we efficiently and accurately perform SA for PBF-LB/M processes in a post-processing step. Compared to traditional methods like Finite Differences (FD), HYPAD-FEM required 96 % less computational time for obtaining sensitivities for 22 process parameters, under a comparative study conducted within the context of the 2018–02 AM benchmark of the National Institute of Standards and Technology. In summary, HYPAD-FEM offers superior efficiency and accuracy in SA over conventional methods, delivering the best sensitivity of a model without the need for step-size selection and problem or parameter-based implementations.

36 MATERIALS SCIENCE↗
NASA NTRS1977

Use of sensitivity analysis to predict pilot performance as a function of different displays

A technique for objectively evaluating different displays by sensitivity analysis is described. First, the mathematical model used to analyze static displays is developed. The technique is based on formulating functional relationships between the state variables and the variables observable in the display. The matrix of the partial derivatives of the display variables with respect to the state variables, together with the observer's acuity function, is used to calculate expected errors in the state vector estimation. The technique is expanded by the use of Kalman filtering to process a time series of observation vectors. This provides a tool for analyzing displays of dynamic processes by means of a dynamic display evaluation computer program. Results are reported using this program to simulate an Instrument Landing System approach.

Mout, M. L.↗
DOE OSTI2024

Machine Learning Driven Sensitivity Analysis of E3SM Land Model Parameters for Wetland Methane Emissions

Methane (CH 4 ) is globally the second most critical greenhouse gas after carbon dioxide, contributing to 16%–25% of the observed atmospheric warming. Wetlands are the primary natural source of methane emissions globally. However, wetland methane emission estimates from biogeochemistry models contain considerable uncertainty. One of the main sources of this uncertainty arises from the numerous uncertain model parameters within various physical, biological, and chemical processes that influence methane production, oxidation, and transport. Sensitivity Analysis (SA) can help identify critical parameters for methane emission and achieve reduced biases and uncertainties in future projections. This study performs SA for 19 selected parameters responsible for critical biogeochemical processes in the methane module of the Energy Exascale Earth System Model (E3SM) land model (ELM). The impact of these parameters on various CH 4 fluxes is examined at 14 FLUXNET- CH 4 sites with diverse vegetation types. Given the extensive number of model simulations needed for global variance-based SA, we employ a machine learning (ML) algorithm to emulate the complex behavior of ELM methane biogeochemistry. We found that parameters linked to CH 4 production and diffusion generally present the highest sensitivities despite apparent seasonal variation. Comparing simulated emissions from perturbed parameter sets against FLUXNET-CH 4 observations revealed that better performances can be achieved at each site compared to the default parameter values. This presents a scope for further improving simulated emissions using parameter calibration with advanced optimization techniques.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1992

Boundary formulations for three-dimensional continuum structural shape sensitivity analysis

The direct, singular, boundary element analysis formulation is shown to provide a basis for a computationally efficient and accurate shape design sensitivity analysis approach for the structural response of three-dimensional solid objects. The theoretical formulation for surface displacement and traction component sensitivities, and all components of the stress tensor is presented along with a formulation for the recovery of displacement and stress components in the interior of the object under consideration. Discussion of computational issues related to the overall efficiency of these formulations is given, along with numerical results to demonstrate the accuracy and efficiency of this approach.

Kane, J. H.↗
DOE OSTI2025

Uncertainty quantification and sensitivity analysis for SPERT III E-core reactivity measurement benchmarking

The Special Power Excursion Reactor Test (SPERT) III E-core experiment is important because it provides critical data on reactor behavior under significant reactivity insertions, which is essential for validating computer simulations and ensuring the safety of modern light water reactors. Its design similarities to contemporary reactors make it a valuable resource for understanding and mitigating extreme hazards in nuclear operations. The current study details the application of formal parametric uncertainty quantification and sensitivity analysis to a model of the SPERT-III E-core model for zero power reactivity benchmarking. Additionally, the reactivity impact from various modeling assumptions is quantified. Overall, an conservative estimate for an uncertainty in k$_{\text{eff}}$ of $\pm$1257 was observed. A less conservative, more realistic, uncertainty estimate of $\pm$1096 pcm can be justified by the potential for various parametric uncertainties to become negligible when sampled independently across the ~1400 pins in the core. The experimental results fall within both of these uncertainty bounds. Standardized regression coefficient as well as Sobol indices are used to identify the guide tube thicknesses as the primary contributors to the uncertainty in k$_{\text{eff}}$. Overall, this study provides information on how the uncertainties in input parameters and modeling methods impact simulated k$_{\text{eff}}$ values and can be used to aid model building efforts for future code validation with the SPERT-III E-core experiment.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Data-driven surrogate modeling of hPIC ion energy-angle distributions for high-dimensional sensitivity analysis of plasma parameters' uncertainty

In this work, we present a data-driven strategy for effective construction of a surrogate model in high-dimensional parameter space for the ion energy-angle distribution (IEAD) output of hPIC simulations of plasma-surface interactions. The methodology is based on a bin-by-bin least-squares fitting of the IEAD in the parameter space. The fitting is performed in a transformed coordinate system to normalize the IEAD, and it employs sparse grids for sampling the parameter space to overcome sampling challenges in high dimensions. The surrogate model is significantly cheaper computationally than direct hPIC simulations yet maintains high fidelity to them, providing a fast emulator for hPIC simulations. Sensitivity analysis based on the surrogate model is utilized to characterize the dependence of the ion impact angle and energy moments on the physical parameters.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRSDate not supplied

Uncertainty Quantification and Sensitivity Analysis in Process-Structure-Property Simulations for Laser Powder Bed Fusion Additive Manufacturing

Process variations and process-induced defects like porosity cause significant uncertainty in the microstructure and mechanical behavior of additively manufactured metals. Establishing process-structure-property (PSP) relationships and quantifying uncertainty using experiments alone is costly, especially for structural applications where mechanical allowables must be established for qualification and certification. This work presents a PSP simulation framework for laser powder bed fusion with a focus on uncertainty quantification through probabilistic calibration and multi-fidelity uncertainty propagation. Motivated by phenomenological input parameters related to grain nucleation and growth that are difficult to characterize, a global sensitivity analysis (GSA) is completed. Through GSA, the most important input parameters are identified based on their influence on the statistical distributions of microstructural metrics that influence mechanical behavior, including grain size, morphology, and crystallographic texture. The results provide insight on what experiments are necessary to quantify and control PSP uncertainties, particularly those associated with the more challenging input parameters.

additive manufacturing↗
DOE OSTI2021

Sensitivity analysis of in-pile critical heat flux experiments in TREAT for characterization of RIA power-transient effects

A reactivity-initiated accident (RIA) is one type of postulated design basis accident (DBA) that can cause a departure from nucleate boiling (DNB) event in pressurized-water reactors (PWRs). A DNB occurrence and its consequences depend on the thermophysical properties of the fuel components and coolant, characteristics of the transient energy insertion into the fuel rod, and the onset of the critical heat flux (CHF) phenomenon. To leverage the restart of the Transient Reactor Test (TREAT) Facility, an effort is currently underway to better understand the cladding-to-coolant heat transfer mechanisms and the CHF phenomenon under fast-transient irradiation conditions. This paper characterizes the impact of power transients on the thermal-hydraulic behavior of a TREAT Facility reactor heater rodlet CHF experiment to provide the priority of parameters that need to be investigated for an improved CHF model. Sobol sensitivity analysis methods and the Reactor Excursion and Leak Analysis Program (RELAP5-3D) code were used to identify key input parameters on the uncertainty in the prediction of peak outer- and inner-surface temperatures of the heater tube, as well as the time of the DNB event. A series of sensitivity analyses revealed the total energy deposition on the tube and the transient effects of power pulse had large impacts on the maximum temperatures. The CHF multiplier had the largest impact on the time occurrence of CHF. The overall results show the energy deposition rate in the tube is the most influencing factor to the manifestation of CHF and the resulting thermal-hydraulic behaviors of the tube. The multiplier for the CHF, which is interpreted as the predicted CHF value, has the largest Sobol indices for the time of the CHF in all cases, since it directly determines the occurrence of CHF. It is inferred that the uncertainties in the thermal-hydraulic behaviors of fuels increase with respect to the key parameters as the power pulse becomes broader, and an accurate estimation of the energy deposition rate is required to reduce the uncertainty in the evaluation of the integrity of fuel if the CHF is expected to occur near the peak power. Therefore, the outputs are expected to provide rigorous interpretation of ongoing in-pile CHF experiments in the TREAT Facility reactor regarding thermal-hydraulic behavior of the fuel system aiming for a new transient in-pile CHF model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Sensitivity Analysis, Reduced-order Modeling, and Optimization of a Gas-Cooled Pebble Bed Reactor using Equilibrium-Core and DLOFC Performance

This work presents and applies a workflow for performing design optimization on gas-cooled pebble-bed reactors. Based on previous research, a representative equilibrium core of a pebble-bed reactor and a depressurized loss-of-forced-cooling model are created. These applications are built using the Multiphysics Object-Oriented Simulation Environment (MOOSE), specifically utilizing Griffin, Pronghorn, and Bison. After defining design-related parameters and quantities of interest regarding reactor safety and efficiency, this multiphysics model is sampled using the MOOSE stochastic tools module. The result is a comprehensive dataset of configurations, enabling sensitivity analysis and the generation of reduced-order models. Subsequently, the dataset and reduced-order models are employed in an optimization study aimed at maximizing fuel utilization while adhering to safety and operational constraints. The optimization process leads to an improvement of fuel utilization by approximately 10\%, compared to engineering-judgment-based nominal conditions.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Sensitivity Analysis of Occupant Preferences on Energy Usage in Residential Buildings: Preprint

Residential buildings, accounting for 37% of the total electricity consumption in the United States, are suitable for demand-side management (DSM) programs to support effective and economical operation of the power system. A home energy management system (HEMS) enables residential buildings to participate in such programs. It is important to account for occupant preferences in HEMS to ensure occupant satisfaction while participating in DSM programs. For example, people who prefer a higher thermal comfort level are likely to consume more energy. In this study, we used foresee™, a HEMS developed by the National Renewable Energy Lab (NREL), to perform a sensitivity analysis of occupant preferences with the following objectives: minimize utility cost, minimize carbon footprint, and maximize thermal comfort. To incorporate the preferences into the HEMS, the SMARTER method was used to derive a set of weighting factors for each objective. We performed week-long building energy simulations using a model of a home in Fort Collins, Colorado, where there is mandatory time-of-use electricity rate structure. The foreseeTM HEMS was used to control the home with six different sets of occupant preferences. The study shows that occupant preferences can have a significant impact and is important to consider when modeling residential buildings. Results show that the HEMS could achieve energy reduction ranging from 3% to 21%, cost savings ranging from 5% to 24%, and carbon emission reduction ranging from 3% to 21%, while maintaining a low thermal discomfort level ranging from 0.78 K-hour to 6.47 K-hour in a one-week period during winter. These outcomes quantify the impact of varying occupant preferences and will be useful for controlling the electrical grid and developing HEMS solutions.

carbon footprint↗