SEARCH · Search NASA

Results for “Bias and Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Evaluating Current and Future Sensor-Specific Biomass Calibration in the Tallest Mangrove Forest on Earth

High-resolution global-scale estimates of aboveground biomass density will soon be available from a suite of spaceborne LiDAR and radar missions. The 2016-2017 AfriSAR campaign was specifically designed to evaluate a suite of sensors for estimating biomass in a range of tropical forest environments. Here, we compare the calibration and biomass estimates from 5 different active sensors - ALOS Global Digital Surface Model (DSM), Shuttle Radar Topography Mission (SRTM), Uninhabited Aerial Vehicle Synthetic Aperture Radar (UAVSAR), NASA Land Vegetation Ice Sensor (LVIS), and TanDEM-X (TDX) - in the tallest known mangrove forest on Earth - Pongara National Park, Gabon. We leverage this comparison to evaluate the implications for future satellite missions that are aimed at improving global estimates of forest carbon storage. Our findings are directly relevant for space-borne missions estimating terrestrial carbon storage - GEDI, ICESat-2, NISAR, BIOMASS, Tandem-X, and Tandem-L - highlighting the specific uncertainty and bias that can be expected in several global biomass products in mangrove ecosystems.

Atticus E L Stovall↗

NASA NTRS2023

Towards an Indian Land Data Assimilation System (ILDAS): A Coupled Hydrologic-Hydraulic System for Water Balance Assessments

Effective management of water resources requires reliable estimates of land surface states and fluxes, including water balance components. But most land surface models run in uncoupled mode and do not produce river discharge at catchment scales to be useful for water resources management applications. Such integrated systems are also rare over India where hydrometeorological extremes have wreaked havoc on the economy and people. So, an Indian Land Data Assimilation System (ILDAS) with a coupled land surface and a hydrodynamic model has been developed and driven by multiple meteorological forcings (0.1°, daily) to estimate land surface states, channel discharge, and floodplain inundation. ILDAS benefits from an integrated framework as well as the largest suite of observation records collected over India and has been used to produce a reanalysis product for 1981–2021 using four forcing datasets, namely, Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2), Climate Hazards Group InfraRed Precipitation with Station data (CHIRPS), ECMWF’s ERA-5, and Indian Meteorological Department (IMD) gridded precipitation. We assessed the uncertainty and bias in these precipitation datasets and validated all major components of the terrestrial water balance, i.e., surface runoff, soil moisture, terrestrial water storage anomalies, evapotranspiration, and streamflow, against a combination of satellite and in situ observation datasets. Our assessment shows that ILDAS can represent the hydrological processes reasonably well over the Indian landmass with IMD precipitation showing the best relative performance. Evaluation against ESA-CCI soil moisture shows that MERRA-2 based estimates outperform the others, whereas ERA-5 performs best in simulating evapotranspiration when evaluated against MODIS ET. Evaluations against observed records show that CHIRPS-based estimates have the highest performance in reconstructing surface runoff and streamflow. Once operational, this system will be useful for supporting transboundary water management decision making in the region.

Indian Land Data Assimilation System (ILDAS)↗

NASA NTRS2024

Characterizing the California Current System through Sea Surface Temperature and Salinity

Characterizing temperature and salinity (T-S) conditions is a standard framework in oceanography to identify and describe deep water masses and their dynamics. At the surface, this practice is hindered by multiple air–sea–land processes impacting T-S properties at shorter time scales than can easily be monitored. Now, however, the unsurpassed spatial and temporal coverage and resolution achieved with satellite sea surface temperature (SST) and salinity (SSS) allow us to use these variables to investigate the variability of surface processes at climate-relevant scales. In this work, we use SSS and SST data, aggregated into domains using a cluster algorithm over a T-S diagram, to describe the surface characteristics of the California Current System (CCS), validating them with in situ data from uncrewed Saildrone vessels. Despite biases and uncertainties in SSS and SST values in highly dynamic coastal areas, this T-S framework has proven useful in describing CCS regional surface properties and their variability in the past and in real time, at novel scales. This analysis also shows the capacity of remote sensing data for investigating variability in land–air–sea interactions not previously possible due to limited in situ data.

Marisol García-Reyes↗

NASA NTRSDate not supplied

Understanding Relationships Between Satellite, Model, and Ground-Based Surface Temperature Characterizations From Overcast to Clear Conditions in Support of Satellite Remote Sensing of Clouds and Radiation

Accurate and consistent global estimates of cloud coverage and their properties are fundamental to long-term Earth radiation budget (ERB) monitoring efforts like the Clouds and the Earth’s Radiant Energy System (CERES) project. Cloud detection algorithms often apply thresholding approaches to identify where clouds occur by comparing satellite-measured radiances with those that are expected under cloud-free conditions. In addition, once a cloud is detected, the derivation of cloud optical and microphysical properties also requires knowledge of the background radiances below the cloud. In the infrared, knowledge of the surface emissivity and the expected skin temperature under both cloudy and cloud-free conditions is needed. These traits are generally well known over the oceans. Over land, however, comparisons between satellite-derived land surface temperature (LST) with that characterized in numerical weather analyses reveal large differences in many parts of the world, often exceeding 5 K, which can lead to significant satellite cloud detection and cloud property retrieval errors. Furthermore, clouds have a dramatic influence on the LST, and therefore characterization of that model parameter also depends on the capability of the model to accurately resolve clouds. Thus, the LST characterized in models is, at times, a poor approximation for what would otherwise be observed, thereby impeding accurate satellite cloud retrievals. As a result, we seek to develop a more robust method for estimating the LST required for satellite cloud characterizations. This effort is accomplished through a combination of surface emission/air temperature relationship studies in all-sky conditions using ground measurement stations, along with deep neural network (DNN) estimates of expected LST under overcast and cloud-free conditions. We demonstrate that substituting DNN-predicted LST for that generated by numerical models can mitigate model-inherent diurnal dependencies and reduce overall bias and uncertainty relative to satellite/ground observations by 0.5–4 K and 0.5–2 K, respectively. It is expected that this work will lead to improved satellite cloud retrievals that enhance ERB monitoring efforts.

B Scarino↗

DOE OSTI2023

Application of a Density Law via Python for Aqueous Plutonium Nitrate

A predictive density tool has been developed in Python to reduce bias and uncertainty in nuclear criticality safety calculations for plutonium nitrate systems. The Pitzer Method and an empirical method were implemented into the tool, allowing for plutonium nitrate density calculations. Additionally, the Python tool can generate atom densities for a MCNP6.2 material card using the density from the selected method and directly the densities into a prepared MCNP6 input text file. The material card and density are calculated based on customizable user inputs of plutonium content, nitric acid content, temperature, plutonium isotope weight percentages and impurity concentrations. The Python tool has been validated and verified against the International Handbook of Evaluated Criticality Safety Benchmark Experiments to predict densities within a root mean square error of 1.0% for the Pitzer method and 1.8% for the empirical method. These errors in density were shown to lead to a ±0.5% error in MCNP6.2 calculated k effective for the Pitzer method and a ±1.7% error for the Empirical method. Simultaneous work is also being done at the University of New Mexico and Los Alamos National Laboratory to create a similar tool for plutonium chloride solutions, which aims to provide the accreditation of the chlorine absorption. These capabilities will not only provide more accurate models but also lead the way towards a better understanding of solution systems and potential relaxation in the conservatism of the current aqueous plutonium processing limits.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Constraining Cosmology with Simulation-based inference and Optical Galaxy Cluster Abundance

We test the robustness of simulation-based inference (SBI) in the context of cosmological parameter estimation from galaxy cluster counts and masses in simulated optical datasets. We construct ``simulations'' using analytical models for the galaxy cluster halo mass function (HMF) and for the observed richness (number of observed member galaxies) to train and test the SBI method. We compare the SBI parameter posterior samples to those from an MCMC analysis that uses the same analytical models to construct predictions of the observed data vector. The two methods exhibit comparable performance, with reliable constraints derived for the primary cosmological parameters, ($\Omega_m$ and $\sigma_8$), and richness-mass relation parameters. We also perform out-of-domain tests with observables constructed from galaxy cluster-sized halos in the Quijote simulations. Again, the SBI and MCMC results have comparable posteriors, with similar uncertainties and biases. Unsurprisingly, upon evaluating the SBI method on thousands of simulated data vectors that span the parameter space, SBI exhibits worsened posterior calibration metrics in the out-of-domain application. We note that such calibration tests with MCMC is less computationally feasible and highlight the potential use of SBI to stress-test limitations of analytical models, such as in the use for constructing models for inference with MCMC.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Exploring Data Set Bias and Decision Support with Predictive Uncertainty Through Bayesian Approximations and Convolutional Neural Networks

Individual seismic catalogs can contain multiscale observations from fault level to global scales and associated waveforms from discrete events reflect crustal structure across many different scales and locations. Seismic network aperture, geographic location, and observation distance may not provide informative guidance or intuition on how different catalogs will behave across models trained under different conditions. We rely on uncertainty to provide guardrails for when to trust model decisions, but understanding when our uncertainty is trustworthy is an open challenge. Here, in this work, we explore Bayesian approximation methods for assigning predictive uncertainty in seismic event classification problems. We find that computationally expensive Bayesian approximations do not outperform simple ensemble methods. We also find that when exploiting multiple seismic event catalogs, joint training with data from all the catalogs combined with Bayesian approximations and supervised training for classification can obscure bias and result in less robust uncertainty while also not providing substantial performance benefits compared to training individual models for each catalog.

58 GEOSCIENCES↗

DOE OSTI2023

Uncertainty analysis for techno-economic and life-cycle assessment of wet waste hydrothermal liquefaction with centralized upgrading to produce fuel blendstocks

Wet waste hydrothermal liquefaction is a promising technology for producing transportation fuels with much lower greenhouse gases emissions than petroleum-based fuels. However, its techno-economic and life cycle assessment are primarily based on laboratory scale testing data, subject to considerable uncertainties, and even bias, due to knowledge gaps. Here, a preliminary uncertainty analysis of key economic measures was conducted based on the 2019 state-of-technology model for biocrude production. Building on the preliminary analysis, this work presents a comprehensive uncertainty analysis in both economic and environmental measures of the entire supply chain of wet waste hydrothermal liquefaction to fuel blendstocks including biocrude upgrading based on the 2021 state-of-technology model. The analysis includes the most recent developments in hydrothermal liquefaction and biocrude upgrading technologies and Monte Carlo simulation based on an integrated model system including an improved reactor yield model, reduced-order process model, discounted cash flow economic model and simplified life-cycle assessment model. The estimated biocrude yield ranges from 42.2% to 52.4% with a median of 47.3%. The estimated fuel yield ranges from 34.7% to 42.7% with a median of 38.7%. The estimated minimum fuel selling price ranges from $\$ $2.28/gge to $\$ $3.45/gge with a median of $\$ $2.80/gge. Relative to petroleum-derived diesel, the estimated reduction in supply chain greenhouse gas emissions ranges from 73.4% to 81.8% with a median of 77.7%. Compared to the 2019 state-of-technology analysis, a significant improvement in biocrude selectivity and economic measures and reduction in uncertainties were achieved due to the incorporation of additional continuous experimental data sets, technology development and de-risking, and improvement in model accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Machine learning-assisted identification of potential sources of bias in measurements of prompt-fission neutron spectra

Unrecognized sources of uncertainty (USU) can bias the reported mean and/or covariance of experimental nuclear data. These biases, in turn, can propagate through evaluated nuclear data to application simulations or may poorly inform nuclear theory that is fitted to the experimental data. Such unknown sources of bias must be tied to the inherent physical constituents of the measurements such as the characteristics of a detector response or a background reduction technique. Here, in this article, a sparse Bayesian learning model is used to support experts in their efforts to identify and characterize USU in experimental prompt fission neutron spectra (PFNS) for spontaneous fissioning of 252 Cf by linking observed biases to features of the measurement system. Three different bias components were found. The first acts as a verification case for the algorithm as it identifies a bias coming from a well-known source related to the use of 6 Li in the neutron detection system. The second two cases demonstrate how this method can benefit the evaluation of experimental nuclear data by identifying, quantifying, and relating unknown biases to potential causes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

Global variance decomposition of downscaled and bias-corrected CMIP6 climate projections

This dataset provides the results of a global variance decomposition of downscaled and bias-corrected CMIP6 climate projections. The total projection variance for a set of climate metrics is partitioned into contributions from: scenario uncertainty, model/GCM uncertainty, downscaling and bias-correction uncertainty, and interannual variability. The contribution from each source is expressed as a percentage of the total variance. Seven climate metrics are analyzed: Annual average temperature (avg_tas.nc) Annual total precipitation (tot_pr.nc) Annual maximum of daily maximum temperature (max_tasmax.nc) Annual maximum 1-day precipitation (max_pr.nc) Annual number of extremely hot days (hot_days.nc) Annual number of extremely wet days (wet_days.nc) Annual number of dry days (dry_days.nc) Extremely hot/wet days are defined to occur when temperature/precipitation exceeds the local 99th percentile defined over 1980-2014. Dry days are defined to occur when daily precipitation is less than 1mm. all_metrics_timesliced.nc gives the results for all metrics averaged over three 20-year periods: 2020-2039, 2050-2069, 2080-2099. For more details on the methods, see: Lafferty & Sriver, Downscaling and bias-correction contribute considerable uncertainty to local climate projections in CMIP6, npj Climate & Atmospheric Science (2023) An interactive visualization of this data can be found at: https://lafferty-sriver-2023-downscaling-uncertainty.msdlive.org

Lafferty, David↗

NASA NTRS2019

GOES-16 ABI Solar Reflective Channel Validation for Earth Science Application

This paper presents the validation results of GOES-16 Satellite's Advanced Baseline Imager (ABI) obtained from a reflectance-based field campaign undertaken at the Salar de Uyuni in Bolivia in June 2017. In situ ground measurements are used to characterize the surface reflectance and the atmosphere in order to constrain the radiative transfer code and predict at-sensor reflectance (also referred to as top-of-atmosphere (TOA) reflectance) to compare with concurrent GOES-16 ABI measurements. The five-day field campaign provided repeated TOA reflectance estimates, allowing assessment not only of the calibration accuracy of the ABI reflective channels 1, 2, 3, 5 and 6, but also of its stability over the duration of the campaign. The results show that the accuracy of the ABI reflective channels calibration is within specification for channels 1, 3, 5, and 6 - average biases within 2%; for channel 2 the bias is 5%. The estimated uncertainty on the derived biases is 2–2.4%. Some calibration stability issues were present in the ABI calibration at the time of the campaign: (i) a jump on the order of 2% in channels 1 and 6, coincident with an ABI solar calibration event, reflects an instability of the ABI gains in these channels, and (ii) short-term variability in channels 1 and 2 is due to striping (ABI detector-todetector calibration differences). Continued validation and subsequent reprocessing of ABI reflectance imagery would allow Earth scientists to fully benefit from the high spatial and spectral fidelity of the GOES-16 ABI diurnal measurements at the continental scale.

Joel McCorkel↗

NASA NTRS2004

Characterization and Uncertainty Analysis of a Reference Pressure Measurement System for Wind Tunnels

This paper presents the calibration results and uncertainty analysis of a high-precision reference pressure measurement system currently used in wind tunnels at the NASA Langley Research Center (LaRC). Sensors, calibration standards, and measurement instruments are subject to errors due to aging, drift with time, environment effects, transportation, the mathematical model, the calibration experimental design, and other factors. Errors occur at every link in the chain of measurements and data reduction from the sensor to the final computed results. At each link of the chain, bias and precision uncertainties must be separately estimated for facility use, and are combined to produce overall calibration and prediction confidence intervals for the instrument, typically at a 95% confidence level. The uncertainty analysis and calibration experimental designs used herein, based on techniques developed at LaRC, employ replicated experimental designs for efficiency, separate estimation of bias and precision uncertainties, and detection of significant parameter drift with time. Final results, including calibration confidence intervals and prediction intervals given as functions of the applied inputs, not as a fixed percentage of the full-scale value are presented. System uncertainties are propagated beginning with the initial reference pressure standard, to the calibrated instrument as a working standard in the facility. Among the several parameters that can affect the overall results are operating temperature, atmospheric pressure, humidity, and facility vibration. Effects of factors such as initial zeroing and temperature are investigated. The effects of the identified parameters on system performance and accuracy are discussed.

Amer, Tahani↗

DOE OSTI2024

Joint inference of multiplicative and additive systematics in galaxy density fluctuations and clustering measurements

Galaxy clustering measurements are a key probe of the matter density field in the Universe. With the era of precision cosmology upon us, surveys rely on precise measurements of the clustering signal for meaningful cosmological analysis. However, the presence of systematic contaminants can bias the observed galaxy number density, and thereby bias the galaxy two-point statistics. As the statistical uncertainties get smaller, correcting for these systematic contaminants becomes increasingly important for unbiased cosmological analysis. We present and validate a new method for understanding and mitigating both additive and multiplicative systematics in galaxy clustering measurements (two-point function) by joint inference of contaminants in the galaxy overdensity field (one-point function) using a maximum-likelihood estimator (MLE). We test this methodology with Kilo-Degree Survey-like mock galaxy catalogues and synthetic systematic template maps. We estimate the cosmological impact of such mitigation by quantifying uncertainties and possible biases in the inferred relationship between the observed and the true galaxy clustering signal. Our method robustly corrects the clustering signal to the sub-percent level and reduces numerous additive and multiplicative systematics from 1.5σ to less than 0.1σ for the scenarios we tested. In addition, we provide an empirical approach to identifying the functional form (additive, multiplicative, or other) by which specific systematics contaminate the galaxy number density. Even though this approach is tested and geared towards systematics contaminating the galaxy number density, the methods can be extended to systematics mitigation for other two-point correlation measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS2006

On the Biases in AIRS Retrieval of Ozone (Work in Progress)

A viewgraph presentation on various biases in AIRS retrieval of ozone is given. The topics include: 1) AIRS captures UTLS ozone events; 2) Simplified AIRS retrieval of ozone; 3) How much is AIRS getting its skill in ozone from regression? biases are similar to ECMWF; 4) How does channel selection and damping affect the retrieval?; 5) Decreasing damping worsens results in upper"trop/lower"strat with current channel selection; 6) If results worse with decreased damping, let s give the retrieval more information; 7) Adding channels at current damping doesn't change anything.; 8) Adding channels and decreasing damping gives mixed results; 9) Let's look at the radiances and their uncertainties ; 10) Systematic biases in radiance uncertainties?; 11) Surface Temperature; 12) Temperature Profile; and 13) x vs Brightness Temperature Error Optimal Estimation Retrieval.

Atmospheric Infrared Sounder (AIRS)↗

DOE OSTI2025

The DECADE cosmic shear project II: photometric redshift calibration of the source galaxy sample

We present the photometric redshift characterization and calibration for the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. The redshifts are estimated from a combination of wide-field photometry, deep-field photometry with associated redshift estimates, and a transfer function between the wide field and deep field that is estimated using a source injection catalog. We construct four tomographic bins for the galaxy catalog, and estimate the redshift distribution, $n(z)$, within each one using the Self-organizing Map Photo-Z (SOMPZ) methodology. Our estimates include the contributions from sample variance, zeropoint calibration uncertainties, and redshift biases, as quantified for the deep-field dataset. The total uncertainties on the mean redshifts are $σ_{\langle}$$_z$$_{\rangle} ≈ 0.01$. The SOMPZ estimates are then compared to those from the clustering redshift method, obtained by cross-correlating our source galaxies with galaxies in spectroscopic surveys, and are shown to be consistent with each other.

Anbajagane, D. [Univ. of Chicago, IL (United State↗

DOE OSTI2022

Cross-correlation of Dark Energy Survey Year 3 lensing data with ACT and Planck thermal Sunyaev-Zel’dovich effect observations. I. Measurements, systematics tests, and feedback model constraints

Here we present a tomographic measurement of the cross-correlation between thermal Sunyaev-Zel’dovich (TSZ) maps from Planck and the Atacama Cosmology Telescope and weak galaxy lensing shears measured during the first three years of observations of the Dark Energy Survey. This correlation is sensitive to the thermal energy in baryons over a wide redshift range and is therefore a powerful probe of astrophysical feedback. We detect the correlation at a statistical significance of 21σ, the highest significance to date. We examine the TSZ maps for potential contaminants, including cosmic infrared background and radio sources, finding that cosmic infrared background has a substantial impact on our measurements and must be taken into account in our analysis. We use the cross-correlation measurements to test different feedback models. In particular, we model the TSZ using several different pressure profile models calibrated against hydrodynamical simulations. Our analysis marginalizes over redshift uncertainties, shear calibration biases, and intrinsic alignment effects. We also marginalize over Ω m and σ 8 using Planck or DES priors. We find that the data prefer the model with a low amplitude of the pressure profile at small scales, compatible with a scenario with strong active galactic nuclei feedback and ejection of gas from the inner part of the halos. When using a more flexible model for the shear profile, constraints are weaker, and the data cannot discriminate between different baryonic prescriptions.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2018

Uncertainty in Inverted Pendulum Thrust Measurements

An uncertainty analysis of a common configuration of electric propulsion thrust stand is presented. The analysis applies to inverted pendulum thrust stands operating in a null-coil configuration with in-situ calibration. Several sources of bias and precision uncertainty are discussed, propagated, and combined to form conservative estimates of the relative and absolute thrust uncertainties. A case study of the NASA Glenn Research Center Vacuum Facility 6 thrust stand is presented. For the thruster investigated, the uncertainty was estimated to be +/-6.9 mN over the entire span of thrust. This uncertainty represents a maximum instrument bias introduced by the thrust stand. The paper does not address repeatability of actual thrust measurements, as this is generally beyond the influence of the thrust stand and can be dependent on a large number of factors.

Mackey, J.↗

NASA NTRS2018

Uncertainty in Inverted Pendulum Thrust Measurements

An uncertainty analysis of a common configuration of electric propulsion thrust stand is presented. The analysis applies to inverted pendulum thrust stands operating in a null-coil configuration with in-situ calibration. Several sources of bias and precision uncertainty are discussed, propagated, and combined to form conservative estimates of the relative and absolute thrust uncertainties. A case study of the NASA Glenn Research Center Vacuum Facility 6 thrust stand is presented. For the thruster investigated, the uncertainty was estimated to be ±6.9 mN over the entire span of thrust. This uncertainty represents a maximum instrument bias introduced by the thrust stand. The paper does not address repeatability of actual thrust measurements, as this is generally beyond the influence of the thrust stand and can be dependent on a large number of factors.

Mackey, Jonathan A.↗