SEARCH · Search NASA

Results for “model credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Evaluation of E3SM land model snow simulations over the western United States

Abstract. Seasonal snow has crucial impacts on climate, ecosystems, and humans, but it is vulnerable to global warming. The land component (ELM) of the Energy Exascale Earth System Model (E3SM) mechanistically simulates snow processes from accumulation, canopy interception, compaction, and snow aging to melt. Although high-quality field measurements, remote sensing snow products, and data assimilation products with high spatio-temporal resolution are available, there has been no systematic evaluation of the snow properties and phenology in ELM. This study comprehensively evaluates ELM snow simulations over the western United States at 0.125∘ resolution during 2001–2019 using the Snow Telemetry (SNOTEL) in situ networks, MODIS remote sensing products (i.e., MCD43 surface albedo product), the spatially and temporally complete (STC) snow-covered area and grain size (MODSCAG) and MODIS dust and radiative forcing in snow (MODDRFS) products (STC-MODSCAG/STC-MODDRFS), and the snow property inversion from remote sensing (SPIReS) product and two data assimilation products of snow water equivalent and snow depth – i.e., University of Arizona (UA) and SNOw Data Assimilation System (SNODAS). Overall the ELM simulations are consistent with the benchmarking datasets and reproduce the spatio-temporal patterns, interannual variability, and elevation gradients for different snow properties including snow cover fraction (fsno), surface albedo (αsur) over snow cover regions, snow water equivalent (SWE), and snow depth (Dsno). However, there are large biases of fsno with dense forest cover and αsur in the Rocky Mountains and Sierra Nevada in winter, compared to the MODIS products. There are large discrepancies of snow albedo, snow grain size, and light-absorbing particle-induced snow albedo reduction between ELM and the MODIS products, attributed to uncertainties in the aerosol forcing data, snow aging processes in ELM, and remote sensing retrievals. Against UA and SNODAS, ELM has a mean bias of −20.7 mm (−35.9 %) and −20.4 mm (−35.5 %), respectively, for spring, and −13.8 mm (−27.8 %) and −10.2 mm (−22.2 %), respectively, for winter. ELM shows a relatively high correlation with SNOTEL SWE, with mean correlation coefficients of 0.69 but negative mean biases of −122.7 mm. Compared to the snow phenology of STC-MODSCAG and SPIReS, ELM shows delayed snow accumulation onset dates by 17.3 and 12.4 d, earlier snow end dates by 35.5 and 26.8 d, and shorter snow durations by 52.9 and 39.5 d, respectively. This study underscores the need for diagnosing model biases and improving ELM representations of snow properties and snow phenology in mountainous areas for more credible simulation and future projection of mountain snowpack.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Optimal experimental design for prediction based on push-forward probability measures

Incorporating experimental data is essential for increasing the credibility of simulation-aided decision making and design. This paper presents a method which uses a computational model to guide the optimal acquisition of experimental data to produce data-informed predictions of quantities of interest (QoI). Many strategies for optimal experimental design (OED) select data that maximize some utility that measures the reduction in uncertainty of uncertain model parameters, for example the expected information gain between prior and posterior distributions of these parameters. In this paper, we seek to maximize the expected information gained from the pushforward of an initial (prior) density to the push-forward of the updated (posterior) density through the parameter-to-prediction map. The formulation presented is based upon the solution of a specific class of stochastic inverse problems which seeks a probability density that is consistent with the model and the data in the sense that the push-forward of this density through the parameter-to-observable map matches a target density on the observable data. While this stochastic inverse problem forms the mathematical basis for our approach, we develop a one-step algorithm, focused on push-forward probability measures, that leverages inference-for-prediction to bypass constructing the solution to the stochastic inverse problem. A number of numerical results are presented to demonstrate the utility of this optimal experimental design for prediction and facilitate comparison of our approach with traditional OED.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

First Sagittarius A* Event Horizon Telescope Results. IV. Variability, Morphology, and Black Hole Mass

In this paper we quantify the temporal variability and image morphology of the horizon-scale emission from Sgr A*, as observed by the EHT in 2017 April at a wavelength of 1.3 mm. We find that the Sgr A* data exhibit variability that exceeds what can be explained by the uncertainties in the data or by the effects of interstellar scattering. The magnitude of this variability can be a substantial fraction of the correlated flux density, reaching ~100% on some baselines. Through an exploration of simple geometric source models, we demonstrate that ring-like morphologies provide better fits to the Sgr A* data than do other morphologies with comparable complexity. We develop two strategies for fitting static geometric ring models to the time-variable Sgr A* data; one strategy fits models to short segments of data over which the source is static and averages these independent fits, while the other fits models to the full data set using a parametric model for the structural variability power spectrum around the average source structure. Both geometric modeling and image-domain feature extraction techniques determine the ring diameter to be 51.8 ± 2.3 μas (68% credible intervals), with the ring thickness constrained to have an FWHM between ~30% and 50% of the ring diameter. To bring the diameter measurements to a common physical scale, we calibrate them using synthetic data generated from GRMHD simulations. This calibration constrains the angular size of the gravitational radius to be ${4.8}_{-0.7}^{+1.4}$ μas, which we combine with an independent distance measurement from maser parallaxes to determine the mass of Sgr A* to be ${4.0}_{-0.6}^{+1.1}\times {10}^{6}$ M⊙.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Investigating performance and variability of NIF ICF experiments with deep learning

The parameter space involved in designing an inertial confinement fusion shot at the National Ignition Facility (NIF) is massively multi-dimensional and the cost of a single shot makes a comprehensive set of sensitivity studies in the laboratory impractical. The use of machine learning to overcome these challenges has gained popularity and has had several successful applications by the scientific community. We extend on these efforts by training a neural network (NN) on information about the experimental design, engineering elements, and drive asymmetry to predict with uncertainty the neutron yield of an experiment. We find the measured and model predicted values are in good agreement, with an R 2 value of 0.91 for a randomly selected test dataset. Almost all the predicted 95% credible intervals contain the corresponding measured value for both training and test datasets. We identify correlations picked up by the NN between the shot design, yield, and variability and use them to motivate shot sensitivity studies. The first shot to exceed the Lawson-like ignition criteria (N210808) was conducted at the NIF and subsequent shots studied the design’s robustness. In a follow-up shot to N210808, our model predicts capsule quality to be the main performance degradation mechanism that prevented the shot from repeating previous performance levels. Shot N221204 was the first shot to exceed a target energy gain of 1. Our model predicts increased yield with reduced coast time for a N221204 study and greater variability for designs with lower peak powers at constant yield. The model’s fast prediction speed and uncertainty prediction are useful for identifying interesting design paths that could warrant further investigation with conventional simulations to search for robust high yield designs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

Simulation of Deuterium Oxidation in a Room with a Fire

A series of experiments where deuterium was released in trace amounts into a room with a fire were performed at Sandia National Laboratories. This report describes the corresponding effort to model the test series using SIERRA/FUEGO. The objective of this modeling effort was to produce a simulation test matrix that can be utilized to help interpret the corresponding experiments and be used to assess the credibility of using the SIERRA/FUEGO simulations as a surrogate for real tritium reaction data for mock fire and release studies. The simulations assessed multiple configurations of fire size and location and overall found that there was low conversion of deuterium to oxidized deuterium. There are some notable differences between the simulation predictions and the experimental results, such as the simulations generally predicting higher amounts of deuterium conversion compared to the experiment. A strategy to address modeling uncertainties and unknowns is also given in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.14

Sandia's Dakota software supports science and engineering transformation through advanced exploration of simulations. Specifically, Dakota manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to: (1) enhance understanding of risk, (2) improve products, and (3) assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a computational model. Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. The algorithms implemented in Dakota aim to address challenges in performing these analyses with complex science and engineering models from desktop to high performance computers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-10468 O

Adams, BrianM.↗

DOE OSTI2021

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.16

Adams, BrianM.↗

DOE OSTI2024

A Review of Parameter Ranges for Uncertainty Estimation for Decomposing Carbon Fiber Epoxy Composites

Carbon fiber epoxy composites are increasingly used in systems requiring a material that is both strong and light weight, as in airplanes, cars, and pressure vessels. In fire environments, carbon fiber epoxy composites are a fuel source subject to oxidation. This literature review seeks to provide material properties as well as uncertainty bounds for those properties for computational models of decomposing carbon fiber epoxy composites. The goal is to guide analysts when measurements are lacking and increase credibility of uncertainty quantification ranges.

36 MATERIALS SCIENCE↗

DOE OSTI2025

DRE: Designing for Resilience through Emulation

Threats to cyber- and cyber-physical systems have continued to increase over the past decade. Now more than ever, it is vital that cyber-physical system stakeholders have the tools to deeply understand their systems and the threats they face. High-fidelity modeling capabilities are powerful tools to support system understanding and decision-making, but they currently lack scientifically rigorous experimentation practices and infrastructures. The purpose of the project Designing for Resilience through Emulation (DRE) was to bring together past research and existing tools into a new pipeline to improve our ability to quantitatively evaluate future cyber scenarios. DRE offers new integrated capabilities for large dataset collection, noise studies, sensitivity analysis, uncertainty quantification, and surrogate modeling using a cyber-physical system emulation environment. These new capabilities significantly improve our ability to establish the credibility of the answers derived from emulation environments, ultimately leading to better critical decision support.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

DOE OSTI2023

Comparison of ozone formation attribution techniques in the northeastern United States

The Integrated Source Apportionment Method (ISAM) has been revised in the Community Multiscale Air Quality (CMAQ) model. This work updates ISAM to maximize its flexibility, particularly for ozone (O 3 ) modeling, by providing multiple attribution options, including products inheriting attribution fully from nitrogen oxide reactants, fully from volatile organic compound (VOC) reactants, equally from all reactants, or dynamically from NO x or VOC reactants based on the indicator gross production ratio of hydrogen peroxide (H 2 O 2 ) to nitric acid (HNO 3 ). The updated ISAM has been incorporated into the most recent publicly accessible versions of CMAQ (v5.3.2 and beyond). This study's primary objective is to document these ISAM updates and demonstrate their impacts on source apportionment results for O 3 and its precursors. Additionally, the ISAM results are compared with the Ozone Source Apportionment Technology (OSAT) in the Comprehensive Air-quality Model with Extensions (CAMx) and the brute-force method (BF). All comparisons are performed for a 4 km horizontal grid resolution application over the northeastern US for a selected 2 d summer case study (9 and 10 August 2018). General similarities among ISAM, OSAT, and BF results add credibility to the new ISAM algorithms. However, some discrepancies in magnitude or relative proportions among tracked sources illustrate the distinct features of each approach, while others may be related to differences in model formulation of chemical and physical processes. Despite these differences, OSAT and ISAM still provide useful apportionment data by identifying the geographical and temporal contributions of O 3 and its precursors. Both OSAT and ISAM attribute the majority of O 3 and NO x contributions to boundary, mobile, and biogenic sources, whereas the top three contributors to VOCs are found to be biogenic, boundary, and area sources.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Policy-Driven Sustainable Saline Drainage Disposal and Forage Production in the Western San Joaquin Valley of California

Environmental policies to address water quality impairments in the San Joaquin River of California have focused on the reduction of salinity and selenium-contaminated subsurface agricultural drainage loads from westside sources. On 31 December 2019, all of the agricultural drainage from a 44,000 ha subarea on the western side of the San Joaquin River basin was curtailed. This policy requires the on-site disposal of all of the agricultural drainage water in perpetuity, except during flooding events, when emergency drainage to the River is sanctioned. The reuse of this saline agricultural drainage water to irrigate forage crops, such as ‘Jose’ tall wheatgrass and alfalfa, in a 2428 ha reuse facility provides an economic return on this pollutant disposal option. Irrigation with brackish water requires careful management to prevent salt accumulation in the crop root zone, which can impact forage yields. The objective of this study was to optimize the sustainability of this reuse facility by maximizing the evaporation potential while achieving cost recovery. This was achieved by assessing the spatial and temporal distribution of the root zone salinity in selected fields of ‘Jose’ tall wheatgrass and alfalfa in the drainage reuse facility, some of which have been irrigated with brackish subsurface drainage water for over fifteen years. Electromagnetic soil surveys using an EM-38 instrument were used to measure the spatial variability of the salinity in the soil profile. The tall wheatgrass fields were irrigated with higher salinity water (1.2–9.3 dS m -1 ) compared to the fields of alfalfa (0.5–6.5 dS m -1 ). Correspondingly, the soil salinity in the tall wheatgrass fields was higher (12.5 dS m -1 –19.3 dS m -1 ) compared to the alfalfa fields (8.97 dS mm -1 –14.4 dS mm -1 ) for the years 2016 and 2017. Better leaching of salts was observed in the fields with a subsurface drainage system installed (13–1 and 13–2). The depth-averaged root zone salinity data sets are being used for the calibration of the transient hydro-salinity computer model CSUID-ID (a one-dimensional version of the Colorado State University Irrigation Drainage Model). This user-friendly decision support tool currently provides a useful framework for the data collection needed to make credible, field-scale salinity budgets. In time, it will provide guidance for appropriate leaching requirements and potential blending decisions for sustainable forage production. This paper shows the tie between environmental drainage policy and the role of local governance in the development of sustainable irrigation practices, and how well-directed collaborative field research can guide future resource management.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Improvements to PVWatts for Fixed and One-Axis Tracking Systems

This work presents improvements to the widely used NREL PVWatts photovoltaic system energy model to improve modeling accuracy for typical fixed and one axis system designs. The aim is to calculate losses in the PV system assuming typical modern system design practices, while maintaining simplicity by keeping the required set of input parameters small. These improvements allow users to more credibly and quickly evaluate competing system designs in early stage feasibility. Common submodels for module cover, spectral, snow, tracker, transformer, plant controller, and self-shading losses, in addition to a bifacial gain option, are incorporated into the PVWatts model, and are shown to improve PVWatts' system performance prediction capabilities without major impact to ease of use. We anticipate including these improvements in a future release of NREL's open source PVWatts code, and some of the features may become available in the System Advisor Model (SAM) desktop software as well as the popular PVWatts web application.

14 SOLAR ENERGY↗

DOE OSTI2024

A Novel Emergent Constraint Approach for Refining Regional Climate Model Projections of Peak Flow Timing

Abstract Global climate models (GCMs) are unable to produce detailed runoff conditions at the basin scale. Assumptions are commonly made that dynamical downscaling can resolve this issue. However, given the large magnitude of the biases in downscaled GCMs, it is unclear whether such projections are credible. Here, we use an ensemble of dynamically downscaled GCMs to evaluate this question in the Sierra‐Cascade mountain range of the western US. Future projections across this region are characterized by earlier seasonal shifts in peak flow, but with substantial inter‐model uncertainty (−25 ± 34.75 days, 95% confidence interval (CI)). We apply the emergent constraint (EC) method for the first time to dynamically downscaled projections, leading to a 39% (−28.25 ± 20.75 days, 95% CI) uncertainty reduction in future peak flow timing. While the constrained results can differ from bias corrected projections, the EC is based on GCM biases in historical peak flow timing and has a strong physical underpinning.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

A NICER View of the Massive Pulsar PSR J0740+6620 Informed by Radio Timing and XMM-Newton Spectroscopy

We report on Bayesian estimation of the radius, mass, and hot surface regions of the massive millisecond pulsar PSR J0740+6620, conditional on pulse-profile modeling of Neutron Star Interior Composition Explorer X-ray Timing Instrument event data. We condition on informative pulsar mass, distance, and orbital inclination priors derived from the joint North American Nanohertz Observatory for Gravitational Waves and Canadian Hydrogen Intensity Mapping Experiment/Pulsar wideband radio timing measurements of Fonseca et al. We use XMM-Newton European Photon Imaging Camera spectroscopic event data to inform our X-ray likelihood function. The prior support of the pulsar radius is truncated at 16 km to ensure coverage of current dense matter models. We assume conservative priors on instrument calibration uncertainty. We constrain the equatorial radius and mass of PSR J0740+6620 to be ${12.39}_{-0.98}^{+1.30}$ km and ${2.072}_{-0.066}^{+0.067}$ M ⊙ respectively, each reported as the posterior credible interval bounded by the 16% and 84% quantiles, conditional on surface hot regions that are non-overlapping spherical caps of fully ionized hydrogen atmosphere with uniform effective temperature; a posteriori, the temperature is ${\mathrm{log}}_{10}(T\,[{\rm{K}}])={5.99}_{-0.06}^{+0.05}$ for each hot region. All software for the X-ray modeling framework is open-source and all data, model, and sample information is publicly available, including analysis notebooks and model modules in the Python language. Furthermore, our marginal likelihood function of mass and equatorial radius is proportional to the marginal joint posterior density of those parameters (within the prior support) and can thus be computed from the posterior samples.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Swift and extensive Omicron outbreak in China after sudden exit from ‘zero-COVID’ policy

In late 2022, China transitioned from a strict ‘zero-COVID’ policy to rapidly abandoning nearly all interventions and data reporting. This raised great concern about the presumably-rapid but unreported spread of the SARS-CoV-2 Omicron variant in a very large population of very low pre-existing immunity. By modeling a combination of case count and survey data, we show that Omicron spread extremely rapidly, at a rate of 0.42/day (95% credibility interval: [0.35, 0.51]/day), translating to an epidemic doubling time of 1.6 days ([1.6, 2.0] days) after the full exit from zero-COVID on Dec. 7, 2022. Consequently, we estimate that the vast majority of the population (97% [95%, 99%], sensitivity analysis lower limit of 90%) was infected during December, with the nation-wide epidemic peaking on Dec. 23. Overall, our results highlight the extremely high transmissibility of the variant and the importance of proper design of intervention exit strategies to avoid large infection waves.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

Probing quarkyonic matter in neutron stars with the Bayesian nuclear-physics multimessenger astrophysics framework

The interiors of neutron stars contain matter at the highest densities realized in our Universe. Interestingly, theoretical studies of dense matter, in combination with the existence of two-solar-mass neutron stars, indicate that the speed of sound $c_s$ has to increase to values well above the conformal limit ($c_s^2$ = 1/3) before decreasing again at higher densities. Further, the decrease could be explained by either a strong first-order phase transition or a crossover transition from hadronic to quark matter. The latter scenario leads to a pronounced peak in the speed of sound, reaching values above the conformal limit, naturally explaining the inferred behavior. In this work, we use the nuclear-physics multimessenger astrophysics (NMMA) framework to compare predictions of the quarkyonic matter model with astrophysical observations of neutron stars, with the goal of constraining model parameters. Assuming quarkyonic matter to be realized within neutron stars, we find that there can be a significant amount of quarks inside the cores of neutron stars with masses in the two-solar-mass range, amounting to up to ≈0.13$M$ ⊙ , contributing ≈ 5.9% of the total mass. Furthermore, for the quarkyonic matter model investigated here, the radius of a 1.4$M$ ⊙ neutron star would be $13.44_{–1.54}^{+1.69}(13. 54_{–1.04}^{+1.02})$ km, at 95% credibility, without (with) the inclusion of AT2017gfo.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2025

Regional Oil and gas Aerial Methane Synthesis model (ROAMS) v2.0

The Regional Oil and gas Aerial Methane Synthesis model is a tool to convert the results of wide-area, source-resolved aerial methane remote sensing surveys of oil and natural gas infrastructure in a given region into methane emissions inventories (estimates of the magnitude and breakdown of methane emissions from the surveyed infrastructure). The tool leverages databases of source-resolved methane emissions detected in aerial surveys, aerial survey coverage information (which areas were measured and when), data summarizing surveyed oil and natural gas infrastructure and production (derived from third-party databases), as well as state-of-the-art mechanistic emissions simulation tools to characterize emissions too small for the aerial system to see. The regional methane emissions estimates produced by this tool are much more granular in both space and asset type than common satellite- or flux tower-based regional estimates. Unlike other tools for converting site-level measurements into regional emissions estimates, our unique geostatistical approach integrates aerially measured emissions with limited need for statistical extrapolation, which can be highly sensitive to modeler assumptions. As a result, ROAMS-based estimates of regional methane emissions from oil and gas activity are widely viewed as highly credible, as evidenced by the success of Dr. Sherwin's recent paper in Nature.

Sherwin, Evan [Lawrence Berkeley National Laborato↗

DOE OSTI2025

Regional Oil and gas Aerial Methane Synthesis model (Analytica) (ROAMS Analytica) v1.5.2

The Regional Oil and gas Aerial Methane Synthesis model (Analytica) is a tool to convert the results of wide-area, source-resolved aerial methane remote sensing surveys of oil and natural gas infrastructure in a given region into methane emissions inventories (estimates of the magnitude and breakdown of methane emissions from the surveyed infrastructure). This version is written in the Analytica programming language, and this version accompanies a correction in preparation for submission to Sherwin et al. 2024 (Nature). The tool leverages databases of source-resolved methane emissions detected in aerial surveys, aerial survey coverage information (which areas were measured and when), data summarizing surveyed oil and natural gas infrastructure and production (derived from third-party databases), as well as state-of-the-art mechanistic emissions simulation tools to characterize emissions too small for the aerial system to see. The regional methane emissions estimates produced by this tool are much more granular in both space and asset type than common satellite- or flux tower-based regional estimates. Unlike other tools for converting site-level measurements into regional emissions estimates, our unique geostatistical approach integrates aerially measured emissions with limited need for statistical extrapolation, which can be highly sensitive to modeler assumptions. As a result, ROAMS-based estimates of regional methane emissions from oil and gas activity are widely viewed as highly credible, as evidenced by the success of Dr. Sherwin's recent paper in Nature.

Sherwin, Evan [Lawrence Berkeley National Laborato↗