SEARCH · Search NASA

Results for “model credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Distribution Development for the RDX Regional Model at Los Alamos National Laboratory - 20385

Representing uncertainty in model inputs often means finding a balance between uncertainty and physical reality. Developing wide distributions may seem conservative in principle, but this approach may lead to unrealistic model results. Characterizing the current state of knowledge of stochastic inputs presents many challenges, especially if the data available are limited or have limited relevance to the site. Relationships among these inputs may also be important to represent but are typically complex or difficult to define. Often special adjustments must be made to account for reduced credibility in particular data. If parameters are strongly related to one another, a correlation structure may be developed for input to the model. Other techniques such as regression models may be used to incorporate relationships between the information available and the desired parameters. The process of developing distributions must consider details of the model in terms of what the distribution is meant to represent. This paper uses the example of a probabilistic fate and transport model for hexahydro-1,3,5-trinitro-1,3,5-triazine (RDX) in the regional aquifer at Los Alamos National Laboratory (LANL). For many parameters, a single draw is applied to all space and time over which the model is run, for a single iteration. This simplification is often made for many reasons, and can often be beneficial, but also adds additional complexity in the distribution development process. Defining the distributional goals as they relate to the modeling process is an important step, which should take place prior to evaluation of the data. Usually, the distributions developed are meant to characterize the average value of the parameter over the spatial and temporal domain of the model. Distribution development requires consideration of many sources of information on the parameter where available, ideally from multiple references. Examples of different sources include data from different references but also from different conditions, measurement methods, or experimental types. Depending on these conditions and the reliability or relevance of particular references, different sources of data may each contribute valuable information but have varying relevance to the site. In these cases, weighting data unequally is a useful way to incorporate this information. As an example, aqueous dispersivity data are available for a variety of rock types. Only a few values are available for the desired rock type, and this is not enough to develop a distribution. Therefore, dispersivity values from other rock types are included in distribution development but are down-weighted such that the best data have the most influence on the distribution developed. In another case, K{sub d} distributions in the model are meant to represent a known composition of multiple soil types. Data from these materials are weighted accordingly to develop a distribution for the weighted average K{sub d} across soil types. Other cases include varying reliability of different sources, and weighting data according to the confidence in these sources. In some cases, input parameters are correlated with one another. An example is advective porosity, which is positively correlated with total porosity and must be less than total porosity. Paired data with both parameters must exist to discern the relationship between the two parameters and if it is necessary to build a correlation structure into the model. In general, correlated parameters may be represented in the model by a multivariate distribution, or perhaps more desirably, capturing the correlation within the developed distributions which may be treated as independent from one another. In the example of porosity, this can be done by transforming advective porosity into a proportion of total porosity which may be drawn independently from the distribution of total porosity. This paper explores how complex data and correlations can be incorporated to meet the distributional goals of the model, using the RDX regional model as a detailed example. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NASA NTRS2015

Conclusion: Major Findings and Future Activities.

The Agricultural Model Intercomparison and Improvement Project (AgMIP) incorporates a number of major advances in the way that climate impacts, vulnerability, and adaptation are being simulated. At its core is a protocol approach that results in impact assessments being more scientifically credible and thus ultimately having greater value to the wide range of agricultural stakeholders. Moreover, the use of the protocol approach enables closer scrutiny and intercomparison of models and methods so that they can be improved over time. By creating a truly trans-disciplinary, systems-based approach, AgMIP impact assessments and evaluation of adaptations become useful to agricultural decision-makers at multiple scales. The chapters in this two-part set demonstrate the use of this approach and represent early steps towards the full realization of these new methods and their application.

damage assessment↗

NASA NTRS1989

The role of climate studies in the future exploration of Mars

Three major reasons for the continued study of the weather and climate of Mars are: (1) the engineering support of future unmanned and manned missions, including operations on the Martian surface, (2) the comparative study of the climates of earth and Mars, and (3) the perspective provided by understanding what Mars is really like now and how it got that way. Together, the suite of national and international missions to Mars currently in progress and in the advanced planning stages could provide a credible data base for addressing many outstanding climatic questions, as well as greatly improving current engineering models of the Mars atmosphere and surface.

Zurek, Richard W.↗

DOE OSTI2023

Hyper Suprime-Cam Year 3 results: Cosmology from galaxy clustering and weak lensing with HSC and SDSS using the minimal bias model

Here, we present cosmological parameter constraints from a blind joint analysis of three two-point correlation functions measured from the Year 3 Hyper Suprime-Cam (HSC-Y3) imaging data, covering about 416 deg 2 , and the SDSS DR11 spectroscopic galaxies spanning the redshift range [0.15, 0.70]. We subdivide the SDSS galaxies into three luminosity-cut, and therefore nearly volume-limited samples separated in redshift, each of which acts as a large-scale structure tracer characterized by the measurement of the projected correlation function, w p ⁡(R). We also use the measurements of the galaxy-galaxy weak-lensing signal Δ⁢Σ⁡(R) for each of these SDSS samples which act as lenses for a secure sample of source galaxies selected from the HSC-Y3 shape catalog based on their photometric redshifts. We combine these measurements with the cosmic shear correlation functions, ξ ± ⁡($\vartheta$) measured for our HSC source sample. We model these observables with the minimal bias model of the galaxy clustering observables in the context of a flat Λ⁢CDM cosmology. We use conservative scale cuts, R >12 and 8⁢ℎ -1 Mpc for Δ⁢Σ and w p , respectively, where the minimal bias model is valid, in addition to conservative prior on the residual bias in the mean redshift of the HSC photometric source galaxies. We present various validation tests of our model as well as analysis methods. Our baseline analysis yields S 8 = $0.77⁢5^{+0.043}_{-0.038}$ (68% C.I.) for the Λ⁢CDM model, after marginalizing over uncertainties in other parameters. Our value of S 8 is consistent with that from the Planck 2018 data, but the credible interval of our result is still relatively large. We show that various internal consistency tests based on different splits of the data are passed. Our results are statistically consistent with those of a companion paper, which extends this analysis to smaller scales with an emulator-based halo model, using Δ⁢Σ⁡(R) and w p ⁡(R) down to R >3 and 2⁢ℎ -1 Mpc, respectively.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2021

Constraining the Neutron Star Mass–Radius Relation and Dense Matter Equation of State with NICER. III. Model Description and Verification of Parameter Estimation Codes

We describe the X-ray pulse profile models we use and how we use them to analyze Neutron Star Interior Composition Explorer(NICER)observations of rotation-powered millisecond pulsars to obtain information about the mass–radius relation of neutron stars and the equation of state of the dense matter in their cores. Here we detail our modeling of the observed profile of PSR J0030+0451 that we analyzed in Miller et al. and Riley et al. and describe a cross-verification of computations of the pulse profiles of a star with R/M 3, in case stars this compact need to be considered in future analyses. We also present our early cross-verification efforts of the parameter estimation procedures used by Miller et al. and Riley et al. by analyzing two distinct synthetic data sets. Both codes yielded credible regions in the mass–radius plane that are statistically consistent with one another, and both gave posterior distributions for model parameter values consistent with the values that were used to generate the data. We also summarize the additional tests of the parameter estimation procedure of Miller et al. that used synthetic pulse profiles and the NICER pulse profile of PSR J0030+0451. We then illustrate how the precision of mass and radius estimates depends on the pulsar’s spin rate and the size of its hot spot by analyzing four different synthetic pulse profiles. Finally, we assess possible sources of systematic error in the estimates made using this technique, some of which may warrant further investigation.

Slavko Bogdanov↗

NASA NTRS1972

Investigation of bubbles in arterial heat pipes

The behavior of gas occlusions in arterial heat pipes has been studied experimentally and theoretically. Specifically, the gas-liquid system properties, solubility and diffusivity, have been measured from -50 to 100 C for helium and argon in ammonia, Freon-21 (CHC12F), and methanol. Properties values obtained were then used to experimentally test models for gas venting from a heat pipe artery under isothermal conditions (i.e., no-heat flow), although the models, as developed, are also applicable to heat pipes operated at power, with some minor modifications. Preliminary calculations indicated arterial bubbles in a stagnant pipe require from minutes to days to collapse and vent. It has been found experimentally that a gas bubble entrapped within an artery structure has a very long lifetime in many credible situations. This lifetime has an approximately inverse exponential dependence on temperature, and is generally considerably longer for helium than for argon. The models postulated for venting under static conditions were in general quantitative agreement with experimental data. Factors of primary importance in governing bubble stability are artery diameter, artery wall thickness, noncondensible gas partial pressure, and the property group (the Ostwald solubility coefficient multiplied by the gas/liquid diffusivity).

Saaski, E. W.↗

DOE OSTI2022

First Sagittarius A* Event Horizon Telescope Results. I. The Shadow of the Supermassive Black Hole in the Center of the Milky Way

We present the first Event Horizon Telescope (EHT) observations of Sagittarius A* (Sgr A*), the Galactic center source associated with a supermassive black hole. These observations were conducted in 2017 using a global interferometric array of eight telescopes operating at a wavelength of λ = 1.3 mm. The EHT data resolve a compact emission region with intrahour variability. A variety of imaging and modeling analyses all support an image that is dominated by a bright, thick ring with a diameter of 51.8 ± 2.3 μas (68% credible interval). The ring has modest azimuthal brightness asymmetry and a comparatively dim interior. Using a large suite of numerical simulations, we demonstrate that the EHT images of Sgr A* are consistent with the expected appearance of a Kerr black hole with mass ∼4 × 10$^{6}$ M $_{⊙}$, which is inferred to exist at this location based on previous infrared observations of individual stellar orbits, as well as maser proper-motion studies. Our model comparisons disfavor scenarios where the black hole is viewed at high inclination (i > 50°), as well as nonspinning black holes and those with retrograde accretion disks. Our results provide direct evidence for the presence of a supermassive black hole at the center of the Milky Way, and for the first time we connect the predictions from dynamical measurements of stellar orbits on scales of 10$^{3}$–10$^{5}$ gravitational radii to event-horizon-scale images and variability. Furthermore, a comparison with the EHT results for the supermassive black hole M87* shows consistency with the predictions of general relativity spanning over three orders of magnitude in central mass.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Evaluation of E3SM land model snow simulations over the western United States

Abstract. Seasonal snow has crucial impacts on climate, ecosystems, and humans, but it is vulnerable to global warming. The land component (ELM) of the Energy Exascale Earth System Model (E3SM) mechanistically simulates snow processes from accumulation, canopy interception, compaction, and snow aging to melt. Although high-quality field measurements, remote sensing snow products, and data assimilation products with high spatio-temporal resolution are available, there has been no systematic evaluation of the snow properties and phenology in ELM. This study comprehensively evaluates ELM snow simulations over the western United States at 0.125∘ resolution during 2001–2019 using the Snow Telemetry (SNOTEL) in situ networks, MODIS remote sensing products (i.e., MCD43 surface albedo product), the spatially and temporally complete (STC) snow-covered area and grain size (MODSCAG) and MODIS dust and radiative forcing in snow (MODDRFS) products (STC-MODSCAG/STC-MODDRFS), and the snow property inversion from remote sensing (SPIReS) product and two data assimilation products of snow water equivalent and snow depth – i.e., University of Arizona (UA) and SNOw Data Assimilation System (SNODAS). Overall the ELM simulations are consistent with the benchmarking datasets and reproduce the spatio-temporal patterns, interannual variability, and elevation gradients for different snow properties including snow cover fraction (fsno), surface albedo (αsur) over snow cover regions, snow water equivalent (SWE), and snow depth (Dsno). However, there are large biases of fsno with dense forest cover and αsur in the Rocky Mountains and Sierra Nevada in winter, compared to the MODIS products. There are large discrepancies of snow albedo, snow grain size, and light-absorbing particle-induced snow albedo reduction between ELM and the MODIS products, attributed to uncertainties in the aerosol forcing data, snow aging processes in ELM, and remote sensing retrievals. Against UA and SNODAS, ELM has a mean bias of −20.7 mm (−35.9 %) and −20.4 mm (−35.5 %), respectively, for spring, and −13.8 mm (−27.8 %) and −10.2 mm (−22.2 %), respectively, for winter. ELM shows a relatively high correlation with SNOTEL SWE, with mean correlation coefficients of 0.69 but negative mean biases of −122.7 mm. Compared to the snow phenology of STC-MODSCAG and SPIReS, ELM shows delayed snow accumulation onset dates by 17.3 and 12.4 d, earlier snow end dates by 35.5 and 26.8 d, and shorter snow durations by 52.9 and 39.5 d, respectively. This study underscores the need for diagnosing model biases and improving ELM representations of snow properties and snow phenology in mountainous areas for more credible simulation and future projection of mountain snowpack.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Optimal experimental design for prediction based on push-forward probability measures

Incorporating experimental data is essential for increasing the credibility of simulation-aided decision making and design. This paper presents a method which uses a computational model to guide the optimal acquisition of experimental data to produce data-informed predictions of quantities of interest (QoI). Many strategies for optimal experimental design (OED) select data that maximize some utility that measures the reduction in uncertainty of uncertain model parameters, for example the expected information gain between prior and posterior distributions of these parameters. In this paper, we seek to maximize the expected information gained from the pushforward of an initial (prior) density to the push-forward of the updated (posterior) density through the parameter-to-prediction map. The formulation presented is based upon the solution of a specific class of stochastic inverse problems which seeks a probability density that is consistent with the model and the data in the sense that the push-forward of this density through the parameter-to-observable map matches a target density on the observable data. While this stochastic inverse problem forms the mathematical basis for our approach, we develop a one-step algorithm, focused on push-forward probability measures, that leverages inference-for-prediction to bypass constructing the solution to the stochastic inverse problem. A number of numerical results are presented to demonstrate the utility of this optimal experimental design for prediction and facilitate comparison of our approach with traditional OED.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

First Sagittarius A* Event Horizon Telescope Results. IV. Variability, Morphology, and Black Hole Mass

In this paper we quantify the temporal variability and image morphology of the horizon-scale emission from Sgr A*, as observed by the EHT in 2017 April at a wavelength of 1.3 mm. We find that the Sgr A* data exhibit variability that exceeds what can be explained by the uncertainties in the data or by the effects of interstellar scattering. The magnitude of this variability can be a substantial fraction of the correlated flux density, reaching ~100% on some baselines. Through an exploration of simple geometric source models, we demonstrate that ring-like morphologies provide better fits to the Sgr A* data than do other morphologies with comparable complexity. We develop two strategies for fitting static geometric ring models to the time-variable Sgr A* data; one strategy fits models to short segments of data over which the source is static and averages these independent fits, while the other fits models to the full data set using a parametric model for the structural variability power spectrum around the average source structure. Both geometric modeling and image-domain feature extraction techniques determine the ring diameter to be 51.8 ± 2.3 μas (68% credible intervals), with the ring thickness constrained to have an FWHM between ~30% and 50% of the ring diameter. To bring the diameter measurements to a common physical scale, we calibrate them using synthetic data generated from GRMHD simulations. This calibration constrains the angular size of the gravitational radius to be ${4.8}_{-0.7}^{+1.4}$ μas, which we combine with an independent distance measurement from maser parallaxes to determine the mass of Sgr A* to be ${4.0}_{-0.6}^{+1.1}\times {10}^{6}$ M⊙.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1994

A Numerical Investigation of Turbulent Flow in Noncircular Ducts

Since turbulent duct flows play an important role in engineering, continuous efforts to investigate this problem have been made. Until recently, these investigations were limited mostly to experiments and various semi-analytic methods. Owing to the improvement of turbulence modeling, the prevailing method of prediction is now mainly numerical. The majority of these studies deals, however, with turbulent flows in circular or square ducts and only limited information is available for straight noncircular ducts. In view of this situation, we propose to conduct a numerical investigation of turbulent flow in a class of ducts, whose cross sections vary from a circle to a near square. Turbulent flow in a noncircular duct is characterized by the presence of secondary flow for which a more refined turbulence model than the k-epsilon equations is required. In order to show that the calculated results are credible, various modes of verification were used to examine the results for a selected configuration, including an accuracy check by a scaling law and observing the decay of secondary flow as the cross section changes from a noncircular shape to a circle. After this was done, computations were performed for other configurations and with different Reynolds numbers from which wall shear stresses and friction factors are plotted.

Kao, Hsiao C.↗

NASA NTRS2016

Qualitative Validation of the IMM Model for ISS and STS Programs

To validate and further improve the Integrated Medical Model (IMM), medical event data were obtained from 32 ISS and 122 STS person-missions. Using the crew characteristics from these observed missions, IMM v4.0 was used to forecast medical events and medical resource utilization. The IMM medical condition incidence values were compared to the actual observed medical event incidence values, and the IMM forecasted medical resource utilization was compared to actual observed medical resource utilization. Qualitative comparisons of these parameters were conducted for both the ISS and STS programs. The results of these analyses will provide validation of IMM v4.0 and reveal areas of the model requiring adjustments to improve the overall accuracy of IMM outputs. This validation effort should result in enhanced credibility of the IMM and improved confidence in the use of IMM as a decision support tool for human space flight.

risk assessment↗

DOE OSTI2025

Investigating performance and variability of NIF ICF experiments with deep learning

The parameter space involved in designing an inertial confinement fusion shot at the National Ignition Facility (NIF) is massively multi-dimensional and the cost of a single shot makes a comprehensive set of sensitivity studies in the laboratory impractical. The use of machine learning to overcome these challenges has gained popularity and has had several successful applications by the scientific community. We extend on these efforts by training a neural network (NN) on information about the experimental design, engineering elements, and drive asymmetry to predict with uncertainty the neutron yield of an experiment. We find the measured and model predicted values are in good agreement, with an R 2 value of 0.91 for a randomly selected test dataset. Almost all the predicted 95% credible intervals contain the corresponding measured value for both training and test datasets. We identify correlations picked up by the NN between the shot design, yield, and variability and use them to motivate shot sensitivity studies. The first shot to exceed the Lawson-like ignition criteria (N210808) was conducted at the NIF and subsequent shots studied the design’s robustness. In a follow-up shot to N210808, our model predicts capsule quality to be the main performance degradation mechanism that prevented the shot from repeating previous performance levels. Shot N221204 was the first shot to exceed a target energy gain of 1. Our model predicts increased yield with reduced coast time for a N221204 study and greater variability for designs with lower peak powers at constant yield. The model’s fast prediction speed and uncertainty prediction are useful for identifying interesting design paths that could warrant further investigation with conventional simulations to search for robust high yield designs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2004

An Exploratory Study of Cost Engineering in Axiomatic Design: Creation of the Cost Model Based on an FR-DP Map

Large complex projects cost large sums of money throughout their life cycle for a variety of reasons and causes. For such large programs, the credible estimation of the project cost, a quick assessment of the cost of making changes, and the management of the project budget with effective cost reduction determine the viability of the project. Cost engineering that deals with these issues requires a rigorous method and systematic processes. This paper introduces a logical framework to a&e effective cost engineering. The framework is built upon Axiomatic Design process. The structure in the Axiomatic Design process provides a good foundation to closely tie engineering design and cost information together. The cost framework presented in this paper is a systematic link between the functional domain (FRs), physical domain (DPs), cost domain (CUs), and a task/process-based model. The FR-DP map relates a system s functional requirements to design solutions across all levels and branches of the decomposition hierarchy. DPs are mapped into CUs, which provides a means to estimate the cost of design solutions - DPs - from the cost of the physical entities in the system - CUs. The task/process model describes the iterative process ot-developing each of the CUs, and is used to estimate the cost of CUs. By linking the four domains, this framework provides a superior traceability from requirements to cost information.

Lee, Taesik↗

DOE OSTI2025

Simulation of Deuterium Oxidation in a Room with a Fire

A series of experiments where deuterium was released in trace amounts into a room with a fire were performed at Sandia National Laboratories. This report describes the corresponding effort to model the test series using SIERRA/FUEGO. The objective of this modeling effort was to produce a simulation test matrix that can be utilized to help interpret the corresponding experiments and be used to assess the credibility of using the SIERRA/FUEGO simulations as a surrogate for real tritium reaction data for mock fire and release studies. The simulations assessed multiple configurations of fire size and location and overall found that there was low conversion of deuterium to oxidized deuterium. There are some notable differences between the simulation predictions and the experimental results, such as the simulations generally predicting higher amounts of deuterium conversion compared to the experiment. A strategy to address modeling uncertainties and unknowns is also given in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.14

Sandia's Dakota software supports science and engineering transformation through advanced exploration of simulations. Specifically, Dakota manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to: (1) enhance understanding of risk, (2) improve products, and (3) assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a computational model. Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. The algorithms implemented in Dakota aim to address challenges in performing these analyses with complex science and engineering models from desktop to high performance computers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-10468 O

Adams, BrianM.↗

DOE OSTI2021

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.16

Adams, BrianM.↗

DOE OSTI2024

A Review of Parameter Ranges for Uncertainty Estimation for Decomposing Carbon Fiber Epoxy Composites

Carbon fiber epoxy composites are increasingly used in systems requiring a material that is both strong and light weight, as in airplanes, cars, and pressure vessels. In fire environments, carbon fiber epoxy composites are a fuel source subject to oxidation. This literature review seeks to provide material properties as well as uncertainty bounds for those properties for computational models of decomposing carbon fiber epoxy composites. The goal is to guide analysts when measurements are lacking and increase credibility of uncertainty quantification ranges.

36 MATERIALS SCIENCE↗