Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Sensitivity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Increasing large wildfires over the western United States linked to diminishing sea ice in the Arctic

Abstract The compound nature of large wildfires in combination with complex physical and biophysical processes affecting variations in hydroclimate and fuel conditions makes it difficult to directly connect wildfire changes over fire-prone regions like the western United States (U.S.) with anthropogenic climate change. Here we show that increasing large wildfires during autumn over the western U.S. are fueled by more fire-favorable weather associated with declines in Arctic sea ice during preceding months on both interannual and interdecadal time scales. Our analysis (based on observations, climate model sensitivity experiments, and a multi-model ensemble of climate simulations) demonstrates and explains the Arctic-driven teleconnection through regional circulation changes with the poleward-shifted polar jet stream and enhanced fire-favorable surface weather conditions. The fire weather changes driven by declining Arctic sea ice during the past four decades are of similar magnitude to other leading modes of climate variability such as the El Niño-Southern Oscillation that also influence fire weather in the western U.S.

54 ENVIRONMENTAL SCIENCES↗

Photovoltaic System Modeling: Uncertainty and Sensitivity Analyses

We report an uncertainty and sensitivity analysis for modeling AC energy from photovoltaic systems. Output from a PV system is predicted by a sequence of models. We quantify uncertainty in the output of each model using empirical distributions of each model’s residuals. We propagate uncertainty through the sequence of models by sampling these distributions to obtain an empirical distribution of a PV system’s output. We consider models that: (1) translate measured global horizontal, direct and global diffuse irradiance to plane-of-array irradiance; (2) estimate effective irradiance; (3) predict cell temperature; (4) estimate DC voltage, current and power; (5) reduce DC power for losses due to inefficient maximum power point tracking or mismatch among modules; and (6) convert DC to AC power. Our analysis considers a notional PV system comprising an array of FirstSolar FS-387 modules and a 250 kW AC inverter; we use measured irradiance and weather at Albuquerque, NM. We found the uncertainty in PV system output to be relatively small, on the order of 1% for daily energy. We found that uncertainty in the models for POA irradiance and effective irradiance to be the dominant contributors to uncertainty in predicted daily energy. Our analysis indicates that efforts to reduce the uncertainty in PV system output predictions may yield the greatest improvements by focusing on the POA and effective irradiance models.

14 SOLAR ENERGY↗

Semi-automated Design of Artificial Intelligence Earth Systems Models

Prediction and observation of water cycles at various scales involve not only patterns isolated in space and time, but also modeling of complex spatio-temporal relationships across multiple domains. For instance, evapotranspiration (ET) and leaf area indexes (LAI) are two parameters that are needed to accurately model and understand land-atmosphere processes. Accurate assessments of ET and LAI are critical for understanding hydrological processes, deforestation, crop yield, and irrigation impacts. However, ET estimates for global simulations are available at very coarse spatial resolution. They are usually derived from satellite data based on broad plant functional types (PFTs), which fail to capture fine-scale variations because of changes in vegetation type across the globe. Similarly LAI estimates have typically been derived from vegetation indices at global scales or estimated locally using physical models, both of which suffer from a range of uncertainties that impact model sensitivity. The new era of AI model development for Earth systems (ES) calls for data-driven methods that provide domain scientists with uncertainty-aware estimations of biophysical parameters such as ET and LAI in a generalizable, interpretable, and discoverable manner.

54 ENVIRONMENTAL SCIENCES↗

Validation and moisture content sensitivity analysis of cross-laminated timber wall assemblies in EnergyPlus

Cross-laminated timber buildings are becoming more common in North America, with many numerical studies showing potential energy savings. However, no studies have validated any EnergyPlus heat transfer algorithms or quantified their accuracy in simulating CLT in building envelopes. This study empirically validates the heat flux predictions for each of EnergyPlus's heat transfer algorithms (Conduction Transfer Functions (CTF), Effective Moisture Penetration Depth (EMPD), Conduction Finite Difference (CondFD), and Heat and Moisture Transfer (HAMT)) for two different CLT ply thicknesses with both summer and winter boundary conditions measured in controlled lab experiments. It also evaluates the model sensitivity of heat flux and heating and cooling loads to moisture content. The 1D validation shows that the HAMT model is the most accurate among all algorithms. All EnergyPlus's heat flux predictions are accurate independent of CLT plate thickness for summer conditions. However, the three constant property algorithms (CTF, EMPD, and CondFD) underpredict heat flux throughout the whole day during winter conditions. The 1D sensitivity analysis indicates that elevated moisture content can increase peak heat fluxes through the material by up to 20 %. Finally, the whole building model sensitivity analysis shows increased heating load and slight cooling load variation due to increased moisture content when using constant property models. The analysis shows significantly lower peak thermal demand (7 % lower heating and 6 % lower cooling) and monthly thermal load (8 % less cooling and 6 % less heating) predictions when using HAMT vs a constant property model.

42 ENGINEERING↗

An ensemble model of QSAR tools for regulatory risk assessment

Quantitative structure activity relationships (QSARs) are theoretical models that relate a quantitative measure of chemical structure to a physical property or a biological effect. QSAR predictions can be used for chemical risk assessment for protection of human and environmental health, which makes them interesting to regulators, especially in the absence of experimental data. For compatibility with regulatory use, QSAR models should be transparent, reproducible and optimized to minimize the number of false negatives. In silico QSAR tools are gaining wide acceptance as a faster alternative to otherwise time-consuming clinical and animal testing methods. However, different QSAR tools often make conflicting predictions for a given chemical and may also vary in their predictive performance across different chemical datasets. In a regulatory context, conflicting predictions raise interpretation, validation and adequacy concerns. To address these concerns, ensemble learning techniques in the machine learning paradigm can be used to integrate predictions from multiple tools. By leveraging various underlying QSAR algorithms and training datasets, the resulting consensus prediction should yield better overall predictive ability. We present a novel ensemble QSAR model using Bayesian classification. The model allows for varying a cut-off parameter that allows for a selection in the desirable trade-off between model sensitivity and specificity. The predictive performance of the ensemble model is compared with four in silico tools (Toxtree, Lazar, OECD Toolbox, and Danish QSAR) to predict carcinogenicity for a dataset of air toxins (332 chemicals) and a subset of the gold carcinogenic potency database (480 chemicals). Leave-one-out cross validation results show that the ensemble model achieves the best trade-off between sensitivity and specificity (accuracy: 83.8 % and 80.4 %, and balanced accuracy: 80.6 % and 80.8 %) and highest inter-rater agreement [kappa (κ): 0.63 and 0.62] for both the datasets. The ROC curves demonstrate the utility of the cut-off feature in the predictive ability of the ensemble model. In conclusion, this feature provides an additional control to the regulators in grading a chemical based on the severity of the toxic endpoint under study.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bayesian analysis for estimating statistical parameter distributions of elasto-viscoplastic material models

High temperature design methods rely on constitutive models for inelastic deformation and failure typically calibrated against the mean of experimental data without considering the associated scatter. Variability may arise from the experimental data acquisition process, from heat-to-heat material property variations, or both and need to be accurately captured to predict parameter bounds leading to efficient component design. Applying the Bayesian Markov Chain Monte Carlo (MCMC) method to produce statistical models capturing the underlying uncertainty in the experimental data is an area of ongoing research interest. This work varies aspects of the Bayesian MCMC method and explores their effect on the posterior parameter distributions for a uniaxial elasto-viscoplastic damage model using synthetically generated reference data. From our analysis with the uniaxial inelastic model we determine that an informed prior distribution including different types of test conditions results in more accurate posterior parameter distributions. The parameter posterior distributions, however, do not improve when increasing the number of similar experimental data. Additionally, changing the amount of scatter in the data affects the quality of the posterior distributions, especially for the less sensitive model parameters. Moreover, we perform a sensitivity study of the model parameters against the likelihood function prior to the Bayesian analysis. The results of the sensitivity analysis help to determine the reliability of the posterior distributions and reduce the dimensionality of the problem by fixing the insensitive parameters. The comprehensive study described in this work demonstrates how to efficiently apply the Bayesian MCMC methodology to capture parameter uncertainties in high temperature inelastic material models. Quantifying these uncertainties in inelastic models will improve high temperature engineering design practices and lead to safer, more effective component designs.

42 ENGINEERING↗

Wave Energy Converter Effects on Wave Fields: Evaluation of SNL-SWAN and Sensitivity Studies in Monterey Bay CA.

A modified version of an indust ry standard wave modeling tool was evaluated, optimized, and utilized to investigate model sensitivity to input parameters a nd wave energy converter ( WEC ) array deployment scenarios. Wave propagation was investigated d ownstream of the WECs to evaluate overall near - and far - field effects of WEC arrays. The sensitivity study illustrate d that wave direction and WEC device type we r e most sensitive to the variation in the model parameters examined in this study . Generally, the changes in wave height we re the primary alteration caused by the presence of a WEC array. Specifically, W EC device type and subsequently their size directly re sult ed in wave height variations; however, it is important to utilize ongoing laboratory studies and future field tests to determine the most appropriate power matrix values for a particular WEC device and configuration in order to improve modeling results .

Roberts, Jesse D.↗

Predicting chemically-induced skin reactions. Part I: QSAR models of skin sensitization and their application to identify potentially hazardous compounds

Repetitive exposure to a chemical agent can induce an immune reaction in inherently susceptible individuals that leads to skin sensitization. Although many chemicals have been reported as skin sensitizers, there have been very few rigorously validated QSAR models with defined applicability domains (AD) that were developed using a large group of chemically diverse compounds. In this study, we have aimed to compile, curate, and integrate the largest publicly available dataset related to chemically-induced skin sensitization, use this data to generate rigorously validated and QSAR models for skin sensitization, and employ these models as a virtual screening tool for identifying putative sensitizers among environmental chemicals. We followed best practices for model building and validation implemented with our predictive QSAR workflow using Random Forest modeling technique in combination with SiRMS and Dragon descriptors. The Correct Classification Rate (CCR) for QSAR models discriminating sensitizers from non-sensitizers was 71–88% when evaluated on several external validation sets, within a broad AD, with positive (for sensitizers) and negative (for non-sensitizers) predicted rates of 85% and 79% respectively. When compared to the skin sensitization module included in the OECD QSAR Toolbox as well as to the skin sensitization model in publicly available VEGA software, our models showed a significantly higher prediction accuracy for the same sets of external compounds as evaluated by Positive Predicted Rate, Negative Predicted Rate, and CCR. These models were applied to identify putative chemical hazards in the Scorecard database of possible skin or sense organ toxicants as primary candidates for experimental validation. - Highlights: • It was compiled the largest publicly-available skin sensitization dataset. • Predictive QSAR models were developed for skin sensitization. • Developed models have higher prediction accuracy than OECD QSAR Toolbox. • Putative chemical hazards in the Scorecard database were found using our models.

60 APPLIED LIFE SCIENCES↗

Data-Driven Surrogate Modeling with Microstructure-Sensitivity of Viscoplastic Creep in Grade 91 Steel

Abstract To support the development of advanced steel alloys tailored to withstand extreme conditions, it is imperative to account for the mechanical performance of components, while considering the influence of local microstructure on the macroscopic response. To this end, this study focuses on the development of microstructure-sensitive constitutive models for the mechanical response of Grade 91 steel exposed to extreme thermo-mechanical environments. Polynomial chaos expansion (PCE) surrogates are used to emulate high-fidelity polycrystal simulations of the viscoplastic response of Grade 91 steel as a function of the microstructure fingerprint (e.g., dislocations and precipitates). To cover a wide temperature–stress domain, two separate PCE surrogates—one that captures softening and the other that captures hardening behavior—are combined using another (sparse) Gaussian process regression model. The resulting constitutive creep surrogate model is integrated within the MOOSE finite element framework to simulate the intricate effects of microstructure, in particular MX-phase precipitates, on a component with a graded microstructure. Surrogate sensitivity analysis is applied to quantify the relevant impact of spatially varying microstructure on the creep response in a test-case involving a Grade 91 alloy with a prototypical weld.

36 MATERIALS SCIENCE↗

Sensitivity of Turbine-Height Wind Speeds to Parameters in the Planetary Boundary-Layer Parametrization Used in the Weather Research and Forecasting Model: Extension to Wintertime Conditions

This work extends the model sensitivity analysis of Yang et al. (Boundary-Layer Meteorology, 2017, Vol. 162, 117-142) to include results for February 2011, in addition to May of the same year. We investigated the sensitivity of simulated hub-height wind speeds to the selection of 26 parameters applied in the Mellor-Yamada-Nakanishi-Niino (MYNN) planetary boundary-layer parameterization in the Weather Research and Forecasting (WRF) model, including parameters used to represent the dissipation of turbulence kinetic energy (TKE), Prandtl number (Pr), and turbulence length scales. Differences in the sensitivity of the ensemble of simulated wind speed to the various parameters can largely be explained by changes in the static stability. The largest monthly differences were found during the day, while the sensitivity to many of the parameters during the night were similar regardless of the month. This finding is consistent with an increased frequency of day-time stable conditions in February compared to May. The spatial variability of the sensitivity to TKE dissipation, Pr, and k can also be attributed to variability in the static stability across the domain at any point in time.

parametrization schemes, Parametric sensitivity, P↗

Vertical Structure and Ice Production Processes of Shallow Convective Postfrontal Clouds over the Southern Ocean in MARCUS. Part II: Modeling Study

Abstract Part I of this series presented a detailed overview of postfrontal mixed-phase clouds observed during the Measurements of Aerosols, Radiation, and Clouds over the Southern Ocean (MARCUS) field campaign. In Part II, we focus on a multiday (23–26 February 2018) case with the aim of understanding ice production as well as model sensitivity to ice process parameterizations using the Weather Research and Forecasting (WRF) Model. The control simulation with the Predicted Particle Properties (P3) microphysics scheme underestimates the ice content and overestimates the supercooled liquid water content, contrary to the bias common in global climate models. The simulations targeted at ice production processes show negligible sensitivity to cloud droplet number concentrations. Further, neither increasing ice nuclei particle (INP) concentrations to an unrealistic level nor adjusting it to MARCUS field estimations alone guarantees more ice production in the model. However, the simulated clouds are found to be highly sensitive to the implementation of immersion freezing, the thresholding of condensation/deposition freezing initiation, and the rime splintering process. By increasing immersion freezing of cloud droplets, relaxing thresholds for condensation/deposition freezing, or removing rime splintering thresholds, the model significantly improves its performance in producing ice. The relaxation of the immersion freezing temperature threshold to the observed cloud-top temperature suggests an in-cloud seeder–feeder mechanism. The results of this work call for an increase in observations of INP, especially over the remote Southern Ocean and at relatively high temperatures, and measurements of ice particle size distributions to better constrain ice nucleating processes in models.

Meteorology & Atmospheric Sciences↗

A sensitivity analysis to predict the neutronics behavior of samples irradiated in the VTR rabbit system

We report a low-order neutronics model is developed to carry out hundreds of simulations efficiently and investigate the neutronics behavior of samples being irradiated in a test reactor setting under different geometrical constraints. The low-order model allowed for simulations that yield the expected neutronics behavior of any irradiated sample in any environment and allows for the calculation of highly accurate spatially averaged statistics and idealized spatial distributions in the neutron flux. Several benchmarks are performed to evaluate the performance and limitations of the low-order model revealing many important findings. The low-order model predicted the LHGR in the EBR-II driver fuel to within 2.34% by only simulating the fuel rod by itself, which served as a validation for the model. Sensitivity studies investigated 3% enriched UO 2 and U-10Zr being irradiated in the Versatile Test Reactor rabbit system. The analyses investigated a range of combinations of 15 radii and 5 heights for each sample in the rabbit system. Similar data sets are also provided for irradiations in the Advanced Test Reactor’s B-10 irradiation position, which is a thermal neutron spectrum environment. Generalized fits and fit coefficients are obtained for sample heating, reaction rate densities, and local multiplication rate characteristics, allowing the predictions of the neutronics behavior of the samples based on their geometrical constraints. The analyses and fits laid the groundwork for developing a user-end Multiphysics analysis framework to assist and accelerate irradiation experiment design and optimization.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Everolimus in combination with Imatinib overcomes resistance in Chronic myeloid leukaemia

Although Imatinib and other tyrosine kinase inhibitors (TKIs) have excellent results, the appearance of resistance is a problem in chronic myeloid leukaemia (CML). PI3K/AKT/mTOR pathway is activated by BCR-ABL playing a crucial rule in CML. This study aimed to evaluate the therapeutic potential of Everolimus, in CML models sensitive and resistant to Imatinib. We used one CML cell line sensitive to Imatinib (K562) and two resistant (K562-RC and K56-RD). Cell lines were treated with Everolimus alone and in combination with Imatinib. Cell viability was analysed by resazurin assay. Cell death and cell cycle were analysed by flow cytometry. Additionally, we also studied peripheral blood samples obtained from 52 patients under TKI treatment. Everolimus reduced cell line viability in sensitive (IC{sub 50} = 20 µM) and resistant models (K562-RC, IC{sub 50} = 25 µM; K562-RD, IC{sub 50} = 30 µM). This drug induced cell death by apoptosis and cell cycle arrest in G{sub 0}/G{sub 1} phase. Everolimus also reduced cell viability by increasing apoptosis of haematopoietic stem cells (CD34{sup +} cells) with low cytotoxicity to lymphocytes. Everolimus at 25 µM increased apoptotic cells 18.7% in CD34{sup +} cells and only 8% in lymphocytes. The response to Everolimus was influenced by TKI treatment, with a better response in samples from patients under 2nd and 3rd generation TKI and with less toxicity to lymphocytes. Our results reveal that Everolimus induce cell death in CML cells sensitive and resistant to Imatinib, with low cytotoxicity to normal cells, suggesting that Everolimus could be an alternative targeted therapeutic approach in CML patients, even in cases of Imatinib resistance.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Global Sensitivity Analysis for Statistical Model Parameters

Global sensitivity analysis (GSA) is typically used to analyze the influence of uncertain parameters in mathematical models and simulations. In principle, tools from GSA may be extended to analyze the influence of parameters in statistical models. Such analyses may enable reduced or parsimonious modeling and greater predictive capability. Yet, difficulties such as parameter correlation, model stochasticity, multivariate model output, and unknown parameter distributions prohibit a direct application of GSA tools to statistical models. By leveraging a loss function associated with the statistical model, we introduce a novel framework to address these difficulties and enable efficient GSA for statistical model parameters. Theoretical and computational properties are considered and hihglighted on a synthetic example. The framework is applied to a Gaussian process model from the literature, which depends on 95 parameters. Noninfluential parameters are discovered through GSA, and a reduced model with equal or stronger predictive capability is constructed by using only 79 parameters.

97 MATHEMATICS AND COMPUTING↗

Deposition Modeling Updates for a Vertical System

This report provides deposition modeling updates and results for a vertical spent nuclear fuel (SNF) storage system. The vertical storage system was the NAC International’s Modular, Advanced Generation, Nuclear All-purpose STORage System (MAGNASTOR®). The updates to the model included running a turbulent model sensitivity study and incorporating droplet evaporation into the deposition model for the MAGNASTOR®. In addition to the updates to the vertical MAGNASTOR system this report discusses the topic of particle resuspension and future work related to looking at resuspension in both a vertical and horizontal storage system.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Investigation of boundary-layer wind predictions during nocturnal low-level jet events using the Weather Research and Forecasting model

Simulations of two periods featuring three consecutive low level jet (LLJ) events in the US Upper Great Plains during the autumn of 2011 were conducted to explore the impacts of various setup configurations and physical process models on simulated flow parameters within the lowest 200 m above the surface, using the Weather Research and Forecasting (WRF) model. Sensitivities of simulated flow parameters to the horizontal and vertical grid spacing, planetary boundary layer (PBL) and land surface model (LSM) physics options, were assessed. Data from a Light Detection and Ranging (lidar) system, deployed to the Weather Forecast Improvement Project (WFIP; Finley et al. 2013) were used to evaluate the accuracy of simulated wind speed and direction at 80 m above the surface, as well as their vertical distributions between 120 and 40 m, covering the typical span of contemporary tall wind turbines. All of the simulations qualitatively captured the overall diurnal cycle of wind speed and stratification, producing LLJs during each overnight period, however large discrepancies occurred at certain times for each simulation in relation to the observations. 54-member ensembles encompassing changes of the above discussed configuration parameters displayed a wide range of simulated vertical distributions of wind speed and direction, and potential temperature, reflecting highly variable representations of stratification during the weakly stable overnight conditions. Root mean square error (RMSE) statistics show that different ensemble members performed better and worse in various simulated parameters at different times, with no clearly superior configuration . Simulations using a PBL parameterization designed specifically for the stable conditions investigated herein provided superior overall simulations of wind speed at 80 m, demonstrating the efficacy of targeting improvements of physical process models in areas of known deficiencies. However, the considerable magnitudes of the RMSE values of even the best performing simulations indicate ample opportunities for further improvements.

Mirocha, Jeff D.↗