Search NASA⌕ Search

SEARCH · Search NASA

Results for “model credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Deep Learning of Dark Energy Spectroscopic Instrument Mock Spectra to Find Damped Lyα Systems

We have updated and applied a convolutional neural network (CNN) machine-learning model to discover and characterize damped Ly α systems (DLAs) based on Dark Energy Spectroscopic Instrument (DESI) mock spectra. We have optimized the training process and constructed a CNN model that yields a DLA classification accuracy above 99% for spectra that have signal-to-noise ratios (S/N) above 5 per pixel. The classification accuracy is the rate of correct classifications. This accuracy remains above 97% for lower S/N ≈1 spectra. This CNN model provides estimations for redshift and H i column density with standard deviations of 0.002 and 0.17 dex for spectra with S/N above 3 pixel -1 . Also, this DLA finder is able to identify overlapping DLAs and sub-DLAs. Further, the impact of different DLA catalogs on the measurement of baryon acoustic oscillations (BAO) is investigated. The cosmological fitting parameter result for BAO has less than 0.61% difference compared to analysis of the mock results with perfect knowledge of DLAs. This difference is lower than the statistical error for the first year estimated from the mock spectra: above 1.7%. We also compared the performances of the CNN and Gaussian Process (GP) models. Our improved CNN model has moderately 14% higher purity and 7% higher completeness than an older version of the GP code, for S/N > 3. Both codes provide good DLA redshift estimates, but the GP produces a better column density estimate by 24% less standard deviation. A credible DLA catalog for the DESI main survey can be provided by combining these two algorithms.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2004

Stratospheric Impact of Varying Sea Surface Temperatures

The Finite-Volume General Circulation Model (FVGCM) has been run in 50 year simulations with the: 1) 1949-1999 Hadley Centre sea surface temperatures (SST), and 2) a fixed annual cycle of SSTs. In this presentation we first show that the 1949-1999 FVGCM simulation produces a very credible stratosphere in comparison to an NCEP/NCAR reanalysis climatology. In particular, the northern hemisphere has numerous major and minor stratospheric warming, while the southern hemisphere has only a few over the 50-year simulation. During the northern hemisphere winter, temperatures are both warmer in the lower stratosphere and the polar vortex is weaker than is found in the mid-winter southern hemisphere. Mean temperature differences in the lower stratosphere are shown to be small (less than 2 K), and planetary wave forcing is found to be very consistent with the climatology. We then will show the differences between our varying SST simulation and the fixed SST simulation in both the dynamics and in two parameterized trace gases (ozone and methane). In general, differences are found to be small, with subtle changes in planetary wave forcing that lead to reduced temperatures in the SH and increased temperatures in the NH.

Newman, Paul A.↗
NASA NTRS1984

Missions/Planning Panel

A panel discussion was held to develop a viewpoint of space power technology needs and state of readiness for future mission scenarios. Among the points made in the discussion, it was agreed that missions, particularly the far term ones, do serve to drive technology; however, as the missions become nearer term, issues of schedule and cost severely limit the willingness to accept risk. There are, in fact, no rewards to a mission manager for introducing new technology. Mission downscaling is the usual response to technology limitations. All panelists agreed that there exists a serious gap between when technologists feel their job is done and what mission managers need for decision. Typically a two to three year engineering development gap exists. It is essential to take technologies to the engineering model level and conduct a flight demonstration to close this gap. All agreed that increased effort should be made to achieve stronger interactions between planners and technologists and that workshops like the present one are a step in the right direction. Technologists need mission credibility and vice versa.

Fordyce, J. S.↗
NASA NTRS2012

Linked Open Data in the Global Change Information System (GCIS)

The U.S. Global Change Research Program (http://globalchange.gov) coordinates and integrates federal research on changes in the global environment and their implications for society. The USGCRP is developing a Global Change Information System (GCIS) that will centralize access to data and information related to global change across the U.S. federal government. The first implementation will focus on the 2013 National Climate Assessment (NCA) . (http://assessment.globalchange.gov) The NCA integrates, evaluates, and interprets the findings of the USGCRP; analyzes the effects of global change on the natural environment, agriculture, energy production and use, land and water resources, transportation, human health and welfare, human social systems, and biological diversity; and analyzes current trends in global change, both human-induced and natural, and projects major trends for the subsequent 25 to 100 years. The NCA has received over 500 distinct technical inputs to the process, many of which are reports distilling and synthesizing even more information, coming from thousands of individuals around the federal, state and local governments, academic institutions and non-governmental organizations. The GCIS will present a web-based version of the NCA including annotations linking the findings and content of the NCA with the scientific research, datasets, models, observations, etc. that led to its conclusions. It will use semantic tagging and a linked data approach, assigning globally unique, persistent, resolvable identifiers to all of the related entities and capturing and presenting the relationships between them, both internally and referencing out to other linked data sources and back to agency data centers. The developing W3C PROV Data Model and ontology will be used to capture the provenance trail and present it in both human readable web pages and machine readable formats such as RDF and SPARQL. This will improve visibility into the assessment process, increase understanding and reproducibility, and ultimately increase credibility and trust of the resulting report. Building on the foundation of the NCA, longer term plans for the GCIS include extending these capabilities throughout the U.S. Global Change Research Program, centralizing access to global change data and information across the thirteen agencies that comprise the program.

Tilmes, Curt A.↗
DOE OSTI2025

Model-agnostic likelihood for the reinterpretation of the 𝐵 + → 𝐾 + ⁢$𝑣\bar{𝑣}$ measurement at Belle II

We recently measured the branching fraction of the 𝐵 + → 𝐾 + ⁢$𝑣\bar{𝑣}$ decay using 362 fb −1 of on-resonance 𝑒 + ⁢𝑒 − collision data under the assumption of Standard Model kinematics, providing the first evidence for this decay. To facilitate future reinterpretations and maximize the scientific impact of this measurement, we publicly release the full analysis likelihood along with all necessary material required for reinterpretation under arbitrary theoretical models sensitive to this measurement. In this work, we demonstrate how the measurement can be reinterpreted within the framework of the weak effective theory. Using a kinematic reweighting technique in combination with the published likelihood, we derive marginal posterior distributions for the Wilson coefficients, construct credible intervals, and assess the goodness of fit to the Belle II data. For the weak effective theory Wilson coefficients, the posterior mode of the magnitudes |𝐶 VL +𝐶 VR |, |𝐶 SL +𝐶 SR |, and |𝐶 TL | corresponds to the point (11.3, 0.0, 8.2). The respective 95% credible intervals are [1.9, 16.2], [0.0, 15.4], and [0.0, 11.2].

bottom quark↗
DOE OSTI2023

Overcoming the Technical Challenges of Coordinating Distributed Load Resources at Scale (Final Report)

Significant recent research has investigated the potential for loads to provide balancing services to the grid. However, this research has not addressed key issues that may arise when such schemes are applied at scale including: 1. Distribution Network Issues. Coordination of large numbers of loads could result in power flows that violate distribution network constraints; 2. Stability Issues. Certain strategies to control loads can exhibit nonlinearity in the form of period-adding bifurcations and chaos. Other control strategies can potentially synchronize the behavior of large numbers of loads. In both cases, the outcome can be power oscillations and instability; 3. Communication Network Issues. Bidirectional low-latency communication channels between a central controller (or several distributed controllers) and each resource are expensive and likely not necessary for effective coordination. Our research questions were: What network, stability, and communication issues might arise in practice when we coordinate large aggregations of loads? How can we coordinate loads to achieve performance objectives in a cost effective manner while avoiding these issues? The ultimate technical goal of the project was the development of network-aware, communication-constrained, non-disruptive load control strategies with stability guarantees that achieve the performance requirements of typical balancing services at a sufficiently low cost to enable the load aggregator and customer to profit. The overall goal was to establish credibility for load control at scale and contribute to U.S. energy security and environmental goals. The team succeeded in answering these research questions and developing these control strategies. The overall approach was based on the development of three testing environments: a simulation testbed, an experimental testbed (20 physical model houses with window-box air conditioners) coupled with the simulation testbed, and a field testbed (100 actual homes in Austin, TX) coupled with the simulation testbed, which enabled controller testing, identification of issues, controller development, and controller validation. The resulting controller was used to demonstrate fast timescale grid balancing (frequency regulation) by aggregations of physical and virtual air conditioners, with sufficient quality to participate in the electricity market. Cost benefit analysis showed overall benefits to the participating households, load aggregators, and the grid, especially if the control technology was integrated directly into existing programmable communicating thermostats. The project provides a variety of wider benefits. Our technology transfer and outreach activities lead us to choose an open-source licensing commercialization pathway, enabling the project results to be available to researchers, industry, and the public. Furthermore, new grid balancing technologies will increase grid flexibility and will enable higher penetrations of intermittent renewable energy resources, such as wind and solar, to be connected to the grid, reducing its environmental impact, and mitigating climate change to the benefit of society.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2002

The MJO-ENSO Relationship: A Re-assessment

Noting the similarities among the spatial patterns of outgoing longwave radiation among MJO and ENSO, Lau and Chan speculated a possible relationship between the two phenomena. This speculation received a substantial boost in credibility after the 1997-98 El Nino, when MJO activities were found to be substantially enhanced prior to the onset of the warm phase, and clear signals of oceanic Kelvin waves forced by MJO induced anomalous surface wind were detected as possible triggers of ENSO. Yet statistical and modeling studies have so far yielded either nil or at best, very weak relationship between MJO activities and SST. Recently Kessler suggested using an MJO index which includes convective variability in the equatorial central Pacific lead to a more robust MJO-ENSO relationship. Clearly, while MJO might have been instrumental in triggering some El Nino, there are other events that can occur without any MJO trigger.

Lau, William K. M.↗
NASA NTRS2011

A Methodology for Evaluating Artifacts Produced by a Formal Verification Process

The goal of this study is to produce a methodology for evaluating the claims and arguments employed in, and the evidence produced by formal verification activities. To illustrate the process, we conduct a full assessment of a representative case study for the Enabling Technology Development and Demonstration (ETDD) program. We assess the model checking and satisfiabilty solving techniques as applied to a suite of abstract models of fault tolerant algorithms which were selected to be deployed in Orion, namely the TTEthernet startup services specified and verified in the Symbolic Analysis Laboratory (SAL) by TTTech. To this end, we introduce the Modeling and Verification Evaluation Score (MVES), a metric that is intended to estimate the amount of trust that can be placed on the evidence that is obtained. The results of the evaluation process and the MVES can then be used by non-experts and evaluators in assessing the credibility of the verification results.

Siminiceanu, Radu I.↗
DOE OSTI2025

It is not σ 8 : constraining the non-linear matter power spectrum with the Dark Energy Survey Year-5 supernova sample

The weak gravitational lensing magnification of Type Ia supernovae (SNe Ia) is sensitive to the matter power spectrum on scales $k\gt 1 h$ Mpc$^{-1}$, making it unwise to interpret SNe Ia lensing in terms of power on linear scales. We compute the probability density function of SNe Ia magnification as a function of standard cosmological parameters, plus an empirical parameter $A_{\rm mod}$ which describes the suppression or enhancement of matter power on non-linear scales compared to a cold dark matter only model. While baryons are expected to enhance power on the scales relevant to SN Ia lensing, other physics such as neutrino masses or non-standard dark matter may suppress power. Using the Dark Energy Survey Year-5 sample, we find $A_{\rm mod} = 0.77^{+0.69}_{-0.40}$ (68 per cent credible interval around the median). Although the median is consistent with unity there are hints of power suppression, with $A_{\rm mod} \lt 1.09$ at 68 per cent credibility.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Small-scale validation tests for MFIX-Exa CFD-DEM

This report describes several bench-scale fluidization experiments that can be used to validate the CFD-DEM method as encapsulated in the MFIX-Exa code. The five cases considered are the cold-flow fluidized beds of Müller et al., Link et al. (spout-fluid), and Goldschmidt et al. (bi-disperse), the hot fluidized bed of Patil et al., and the adsorbing fluidized bed of Li et al. and Janssen. In most cases, MFIX-Exa with “standard” or “typical” CFD-DEM settings, the Gidaspow drag model, and the Gunn heat transfer provide a relatively good prediction of the quantities considered: mean void fraction profiles, mean velocity profiles, fluctuating velocity profiles, mean particle temperature and segregation index. These results, with other verification and validation tests reported elsewhere, contribute to a body of work providing confidence and credibility in CFD predictions from the MFIX-Exa code.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Neutron Star Radii, Deformabilities, and Moments of Inertia from Experimental and Ab Initio Theory Constraints of the 208Pb Neutron Skin Thickness

Recent experimental and ab initio theory investigations of the 208Pb neutron skin thickness have the potential to inform the neutron star equation of state. In particular, the strong correlation between the 208Pb neutron skin thickness and the pressure of neutron matter at normal nuclear densities leads to modified predictions for the radii, tidal deformabilities, and moments of inertia of typical 1.4M⊙ neutron stars. In the present work, we study the relative impact of these recent analyses of the 208Pb neutron skin thickness on bulk properties of neutron stars within a Bayesian statistical analysis. Two models for the equation of state prior are employed in order to highlight the role of the highly uncertain high-density equation of state. From our combined Bayesian analysis of nuclear theory, nuclear experiment, and observational constraints on the dense matter equation of state, we find at the 90% credibility level R1.4=12.36−0.73+0.38 km for the radius of a 1.4M⊙ neutron star, R2.0=11.96−0.71+0.94 km for the radius of a 2.0M⊙ neutron star, Λ1.4=440−144+103 for the tidal deformability of a 1.4M⊙ neutron star, and I1.338=1.425−0.146+0.074×1045gcm2 for the moment of inertia of PSR J0737-3039A whose mass is 1.338M⊙.

Lim, Yeunhwan↗
NASA NTRS2016

Properties of the Binary Black Hole Merger GW150914

On September 14, 2015, the Laser Interferometer Gravitational-Wave Observatory (LIGO) detected a gravitational-wave transient (GW150914); we characterize the properties of the source and its parameters. The data around the time of the event were analyzed coherently across the LIGO network using a suite of accurate waveform models that describe gravitational waves from a compact binary system in general relativity. GW150914 was produced by a nearly equal mass binary black hole of masses 36(+5/-4) solar mass and 29(+4/-4) solar mass; for each parameter we report the median value and the range of the 90% credible interval. The dimensionless spin magnitude of the more massive black hole is bound to be less than 0.7 (at 90% probability). The luminosity distance to the source is 410(+160/-180) Mpc, corresponding to a redshift 0.09(+0.03/−0.04) assuming standard cosmology. The source location is constrained to an annulus section of 610 sq deg, primarily in the southern hemisphere. The binary merges into a black hole of mass 62(+4/−4) solar mass and spin 0.67(+0.05/−0.07). This black hole is significantly more massive than any other inferred from electromagnetic observations in the stellar-mass regime.

Abbott, B. P.↗
DOE OSTI2023

Comparing simulated demand flexibility against actual performance in commercial office buildings

Commercial building energy benchmarking has been used as a mechanism to evaluate energy use of a single building over time, relative to other similar buildings, or to simulations of a reference building conforming to various energy standards. Lack of empirical demand flexibility data and consistent flexibility metrics has limited the ability to compare demand flexibility performance with estimated demand flexibility in buildings. In this study, we collected demand response performance data for a total of 831 demand response events from 192 sites as a first step to build such a building demand flexibility dataset, and propose a standard core data schema to consolidate field data from different sources. We also performed parametric simulations of a control strategy called “global temperature adjustment” using commercial office prototype building models. We then compared the simulated demand flexibility performance against the actual data for offices with global temperature adjustment strategy implemented. During demand response events with an average outside air temperature of 34 °C (range 23 °C–42 °C), the measured demand decrease intensity of the demand flexibility metrics were 6.1 watts per square meter (W/m 2 ), 10.0 W/m 2 , 11.1 W/m 2 , 7.1 W/m 2 , and 4.7 W/m 2 for small, small–medium, medium, medium–large, and large office buildings, respectively. Compared to the measured data in medium- and large-size buildings, the simulated demand decrease intensity was 0.7 W/m 2 (17%) lower on average. The discrepancy between simulated and measured peak demand intensities fell within one standard deviation of the mean measured data. Here, the comparison results validate the credibility of simulations in capturing real building data for assessing the technical potential of building demand flexibility.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Resolving Low Cloud Feedbacks Globally With E3SM High‐Res MMF: Agreement With LES but Stronger Shortwave Effects

This study investigates low cloud feedback in a warmer climate using global simulations from the High-Resolution Multi-scale Modeling Framework (HR-MMF), which explicitly simulates small-scale eddies globally. Two 5-year simulations—one with present-day sea surface temperatures (SSTs) and a second with SSTs warmed uniformly by 4 K—reveal a positive global shortwave cloud radiative effect (SWCRE = 0.3 W/m 2 /K), comparable to estimates from CMIP models. As the climate warms, significant reductions in low cloud cover occur over stratocumulus regions. This study is the first attempt to compare HR-MMF results with predictions from idealized large-eddy simulations from the CGILS intercomparison. Despite different underlying assumptions, we find qualitative agreement in SWCRE and inversion height changes between HR-MMF and CGILS predictions. This suggests reasonable credibility for the CGILS framework in predicting cloud responses under the out-of-sample conditions found in HR-MMF. However, the HR-MMF exhibits stronger SWCRE changes than predicted by CGILS. We explore potential causes for this discrepancy, examining variations in cloud-controlling factors (CCFs) and cloud conditions. Our results show a fairly homogeneous SWCRE response, with little systematic variation tied to the variations in CCFs. This reveals a dominant role for SST forcing in modulating SWCRE.

boundary-layer clouds↗
DOE OSTI2025

Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Developing Uncertainty Quantification Strategies in Electromagnetic Problems Involving Highly Resonant Cavities

High-quality factor resonant cavities are challenging structures to model in electromagnetics owing to their large sensitivity to minute parameter changes. Therefore, uncertainty quantification (UQ) strategies are pivotal to understanding key parameters affecting the cavity response. Furthermore, we discuss here some of these strategies focusing on shielding effectiveness (SE) properties of a canonical slotted cylindrical cavity that will be used to develop credibility evidence in support of predictions made using computational simulations for this application.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

A gamma-ray pulsar timing array constrains the nanohertz gravitational wave background

We report after large galaxies merge, their central supermassive black holes are expected to form binary systems. Their orbital motion should generate a gravitational wave background (GWB) at nanohertz frequencies. Searches for this background use pulsar timing arrays, which perform long-term monitoring of millisecond pulsars at radio wavelengths. We used 12.5 years of Fermi Large Area Telescope data to form a gamma-ray pulsar timing array. Results from 35 bright gamma-ray pulsars place a 95% credible limit on the GWB characteristic strain of 1.0 × 10 -14 at a frequency of 1 year –1 . The sensitivity is expected to scale with t obs , the observing time span, as t$^{-13/6}_{obs}$. This direct measurement provides an independent probe of the GWB while offering a check on radio noise models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Projecting Future Energy Production from Operating Wind Farms in North America. Part II: Statistical Downscaling

Abstract Capacity factors (CFs) derived from daily expected power at 22 operating wind farms in different regions of North America are used as predictands to train statistical downscaling algorithms using output from ERA5. The statistical downscaling models are then used to make CF projections for a suite of CMIP6 Earth System Models (ESMs). Downscaling is performed using a hybrid statistical approach that employs synoptic types derived using k -means clustering applied to sea level pressure fields with variance corrections applied as a function of the pressure gradient intensity. ESMs exhibit marked variability in terms of the skill with which the frequency of synoptic types and pressure gradients are reproduced relative to ERA5, and that differential skill is used to infer differential credibility in the associated CF projections. Projections of median annual mean CF [P50(CF)] in each 20-yr period from 1980 to 2099 show evidence of declines at most wind farms except in parts of the southern Great Plains, although the magnitude of the changes is strongly dependent on the ESM. For example, P50(CF) in 2080–99 deviate from those in 1980–99 by from −3.1 to +0.2 percentage points in the Northeast. The largest-magnitude declines in P50(CF) ranging from −3.9 to −2 percentage points are projected for the southern West Coast. CF trends exhibit marked seasonality and are strongly linked to changes in the relative intensity of future synoptic patterns, with much less impact from shifts in the occurrence of synoptic types over time. Internal climate modes continue to play a significant role in inducing interannual variability in wind power production, even under high radiative forcing scenarios. Significance Statement We describe how future climate changes may affect wind resources and wind power generation. Near-term changes in projected wind power electricity generation potential at operating wind farms over North America are small, but by the end of the current century electricity production is projected to decrease in many areas but may increase in parts of the southern Great Plains. The amount of change in projected wind power production is a strong function of the Earth system model that is downscaled and also depends on the continued presence of internally forced climate variability. An additional dependence on the amount of greenhouse gas–induced global warming indicates the transition of the energy sector to low-carbon sources may assist in maintaining the abundant U.S. wind resource.

Meteorology & Atmospheric Sciences↗