Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bias and Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

CSEWG Meeting Minutes

Work has been done at LANL to validate various updated evaluations from ENDF/BVIII.1b0 including: Fe, Cu, Si, U, Pu. Continuous energy tables were processed with NJOY2016 and output to ACE files. For non-Pu legacy critical benchmarks, all calculations were within the experimental benchmark uncertainty, with some benchmarks having shown lower bias using ENDF/B-VIII.1b0. In HST systems, ENDF/B-VIII.0 shows reasonable results above the thermal leakage fraction. ENDF/B-VIII.0.1 is doing slightly worse than ENDF/B- VIII.0. b0.2 and it also includes a new 19 F evaluation, so more work is needed to examine its impact. 233 U thermal and intermediate bare and water-reflected benchmarks agree well with ENDF/B-VIII.0. From ENDF/B-VIII.0 to ENDF/B-VIII.0b0.1, HMF-007 C/E are increasing and the new 19 F evaluation is helping the HMF-007 cases containing Teflon which have historically had high C/E. The Pu legacy benchmark suite is within experimental uncertainty with the exception of THOR. The INDEN evaluation followed by LANL gave the lowest mean absolute bias, but it remains difficult to make a determination on which Pu evaluation is the best. INDEN performs slightly better for the JEZEBEL series, while the LANL Pu evaluation is better for THOR and flattop benchmarks. For the PMI benchmark series INDEN outperforms the LLNL evaluation. For the PST benchmark series ENDF/B-VIII.0 and LLNL Pu evaluations are better than the INDEN evaluation. C/E ratios for Jezebel and Godiva reaction rate ratios show all the Pu evaluations are very close to one another, making it again difficult to say which is best. When examining neutron reactor kinetics parameters, each Pu evaluation is once again very close. Each individual Pu evaluation seems to have advantages in their own applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2022

Regression Bias in using Solar Wind Measurements

Simultaneous solar wind measurements from the solar wind monitors, WIND and ACE, differ due to the spatial and temporal structure of the solar wind. Correlation studies that use these measurements as input may infer an incorrect correlation due to uncertainties arising from this spatial and temporal structure, especially at extreme and rare solar wind values. In particular, regression analysis will lead to a regression function whose slope is biased towards the mean value of the measurement parameter. This article demonstrates this regression bias by comparing simultaneous ACE and WIND solar wind measurements. A non-linear regression analysis between them leads to a perception of underestimation of extreme values of one measurement on average over the other. Using numerical experiments, we show that popular regression analysis techniques such as linear least-squares, orthogonal least-squares, and non-linear regression are not immune to this bias. Hence while using solar wind parameters as an independent variable in a correlation or regression analysis, random uncertainty in the independent variable can create unintended biases in the response of the dependent variable. More generally, the regression to the mean effect can impact both event-based, statistical studies of magnetospheric response to solar wind forcing.

magnetosphere↗
DOE OSTI2023

Large Ensemble Particle Filter for Spatial Climate Reconstructions Using a Linear Inverse Model

Proxy records that document the last 2000 years of climate provide evidence for the wide range of the natural climate variability from inter-annual to secular timescales not captured by the short window of recent direct observations. Assessing climate models ability to reproduce such natural variations is crucial to understand climate sensitivity and impacts of future climate change. Paleoclimate data assimilation (PDA) offers a powerful way to extend the short instrumental period by optimally combining the physics described by General Circulation Climate Models (GCMs) with information from available proxy records while taking into account their uncertainties. Here we present a new PDA approach based on a sequential importance resampling (SIR) Particle filter (PF) that uses Linear Inverse Modeling (LIM) as an emulator of several CMIP-class GCMs. We examine in a perfect-model framework the skill of the various LIMs to forecast the dynamics of the surface temperatures and provide spatial field reconstructions over the last millennium in a SIR PF. Our results show that the LIMs allow for skillful ensemble forecasts at 1-year lead-time based on GCMs dynamical knowledge with best prediction in the tropics and the North Atlantic. The PDA further provides a set of physically consistent spatial fields allowing robust uncertainty quantification related to climate models biases and proxy spatial sampling. Our results indicate that the LIM yields dynamical memory improving climate variability reconstructions and support the use of the LIM as a GCM-emulator in real reconstruction to propagate large ensembles of particles at low cost in SIR PF.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Global terrestrial nitrogen fixation and its modification by agriculture

Biological nitrogen fixation (BNF) is the largest natural source of new nitrogen (N) that supports terrestrial productivity, yet estimates of global terrestrial BNF remain highly uncertain. Here, in this study, we show that this uncertainty is partly because of sampling bias, as field BNF measurements in natural terrestrial ecosystems occur where N fixers are 17 times more prevalent than their mean abundances worldwide. To correct this bias, we develop new estimates of global terrestrial BNF by upscaling field BNF measurements using spatially explicit abundances of all major biogeochemical N-fixing niches. We find that natural biomes sustain lower BNF, 65 (52–77) Tg N yr −1 , than previous empirical bottom-up estimates, with most BNF occurring in tropical forests and drylands. We also find high agricultural BNF in croplands and cultivated pastures, 56 (54–58) Tg N yr −1 . Agricultural BNF has increased terrestrial BNF by 64% and total terrestrial N inputs from all sources by 60% over pre-industrial levels. Our results indicate that BNF may impose stronger constraints on the carbon sink in natural terrestrial biomes and represent a larger source of agricultural N than is generally considered in analyses of the global N cycle, with implications for proposed safe operating limits for N use.

Reis Ely, Carla R. [Oregon State Univ., Corvallis,↗
DOE OSTI2019

Lick Observatory Supernova Search follow-up program: photometry data release of 93 Type Ia supernovae

Here, we present BVRI and unfiltered light curves of 93 Type Ia supernovae (SNe Ia) from the Lick Observatory Supernova Search (LOSS) follow-up program conducted between 2005 and 2018. Our sample consists of 78 spectroscopically normal SNe Ia, with the remainder divided between distinct subclasses (3 SN 1991bg-like, 3 SN 1991T-like, 4 SNe Iax, 2 peculiar, and 3 super-Chandrasekhar events), and has a median redshift of 0.0192. The SNe in our sample have a median coverage of 16 photometric epochs at a cadence of 5.4 d, and the median first observed epoch is ~4.6 d before maximum B-band light. We describe how the SNe in our sample are discovered, observed, and processed, and we compare the results from our newly developed automated photometry pipeline to those from the previous processing pipeline used by LOSS. After investigating potential biases, we derive a final systematic uncertainty of 0.03 mag in BVRI for our data set. We perform an analysis of our light curves with particular focus on using template fitting to measure the parameters that are useful in standardizing SNe Ia as distance indicators. All of the data are available to the community, and we encourage future studies to incorporate our light curves in their analyses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Can Agricultural Management Induced Changes in Soil Organic Carbon Be Detected Using Mid-Infrared Spectroscopy?

A major limitation to building credible soil carbon sequestration programs is the cost of measuring soil carbon change. Diffuse reflectance spectroscopy (DRS) is considered a viable low-cost alternative to traditional laboratory analysis of soil organic carbon (SOC). While numerous studies have shown that DRS can produce accurate and precise estimates of SOC across landscapes, whether DRS can detect subtle management induced changes in SOC at a given site has not been resolved. Here, we leverage archived soil samples from seven long-term research trials in the U.S. to test this question using mid infrared (MIR) spectroscopy coupled with the USDA-NRCS Kellogg Soil Survey Laboratory MIR spectral library. Overall, MIR-based estimates of SOC%, with samples scanned on a secondary instrument, were excellent with the root mean square error ranging from 0.10 to 0.33% across the seven sites. In all but two instances, the same statistically significant (p < 0.10) management effect was found using both the lab-based SOC% and MIR estimated SOC% data. Despite some additional uncertainty, primarily in the form of bias, these results suggest that large existing MIR spectral libraries can be operationalized in other laboratories for successful carbon monitoring.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

It’s Dust: Solving the Mysteries of the Intrinsic Scatter and Host-galaxy Dependence of Standardized Type Ia Supernova Brightnesses

The use of Type Ia supernovae (SNe Ia) as cosmological tools has motivated significant effort to understand what drives the intrinsic scatter of SN Ia distance modulus residuals after standardization, characterize the distribution of SN Ia colors, and explain why properties of the host galaxies of the SNe correlate with SN Ia distance modulus residuals. We use a compiled sample of ~1450 spectroscopically confirmed photometric light curves of SNe Ia and propose a solution to these three problems simultaneously that also explains an empirical 11 σ detection of the dependence of Hubble residual scatter on SN Ia color. We introduce a physical model of color where intrinsic SN Ia colors with a relatively weak correlation with luminosity are combined with extrinsic dust-like colors ( E ( B - V )) with a wide range of extinction parameter values ( R V ). This model captures the observed trends of Hubble residual scatter and indicates that the dominant component of SN Ia intrinsic scatter is variation in R V . We also find that the recovered E ( B - V ) and R V distributions differ based on global host-galaxy stellar mass, and this explains the observed correlation ( γ ) between mass and Hubble residuals seen in past analyses, as well as an observed 4.5 σ dependence of γ on SN Ia color. This finding removes any need to ascribe different intrinsic luminosities to different progenitor systems. Finally, we measure biases in the equation of state of dark energy ( w ) up to |Δ w | = 0.04 by replacing previous models of SN color with our dust-based model; this bias is larger than any systematic uncertainty in previous SN Ia cosmological analyses.

Astronomy & Astrophysics↗
DOE OSTI2025

Estimation of the radiation budget during MOSAiC based on ground-based and satellite remote sensing observations

An accurate representation of the radiation budget is essential for investigating the impact of clouds on the climate system, especially in the Arctic, an environment highly sensitive to complex and rapid environmental changes. In this study, we analyse a unique dataset of observations from the central Arctic made during the MOSAiC (Multidisciplinary drifting Observatory for the Study of Arctic Climate) expedition in conjunction with state-of-the-art satellite products from CERES (Clouds and the Earth's Radiant Energy System) to investigate the radiative effect of clouds and radiative closure at the surface and the top of the atmosphere (TOA). We perform a series of radiative transfer simulations using derived cloud macro- and microphysical properties as inputs to the simulations for the entire MOSAiC period, comparing our results to collocated satellite products and ice-floe observations. The radiative closure biases were generally within the instrumental uncertainty, indicating that the simulations are sufficiently accurate to reproduce the radiation budget during MOSAiC. Comparisons of the simulated radiation budget relative to CERES show similar values in the terrestrial flux but relatively large differences in the solar flux, which are attributed to a lower surface albedo and a possible underestimation of atmospheric opacity by CERES. While the simulation results were consistent with the observations, more detailed analyses reveal an overestimation of simulated cloud opacity for cases involving geometrically thick ice clouds. In the annual mean, we found that, during the MOSAiC expedition, the presence of clouds leads to a loss of 5.2 W m −2 of the atmosphere–surface system to space, while the surface gains 25.0 W m −2 and the atmosphere is cooled by 30.2 W m −2 .

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1972

Future techniques for tracking of synchronous satellites

A tracking system error analysis computer program is reported to study the feasibility of using range sum and range-rate sum measurements through a synchronous satellite to a user satellite, and range sum and range-rate sum measurements through a synchronous satellite to a ground based transponder for tracking of synchronous satellites. Error analysis transformed noise, bias, ground station location and orbit uncertainties into expected uncertainties in each of the orbits after tracking. Results show that both of the proposed measurement methods are feasible for determining and refining the orbits of future synchronous satellites.

Cooley, J. L.↗
NASA NTRS1979

Oceanic geoid and tides derived from GEOS 3 satellite data in the Northwestern Atlantic Ocean

Two sets of GEOS 3 altimeter data which fall within about a 2.5-deg width are analyzed for ocean geoid and tides. One set covers a path from Newfoundland to Cuba, and the other a path from Puerto Rico to the North Carolina coast. Forty different analyses using various parameters are performed in order to investigate convergence. Profiles of the geoid and four tides, M2, O1, S2, and K1, are derived along the two strips. While the analyses produced convergent solutions for all 40 cases, the uncertainty caused by the linear orbital bias error of the satellite is too large to claim that the solutions represent the true ocean tides in the area. A spot check of the result with the Mode deep-sea tide gauge data shows poor agreement. A positive conclusion of this study is that despite the uncertain orbital error the oceanic geoid obtained through this analysis can improve significantly the short-wavelength structure over existing spherical harmonic geoid models.

Won, I. J.↗
NASA NTRS2006

Geopositional Statistical Methods

RMSE based methods distort circular error estimates (up to 50% overestimation). The empirical approach is the only statistically unbiased estimator offered. Ager modification to Shultz approach is nearly unbiased, but cumbersome. All methods hover around 20% uncertainty (@ 95% confidence) for low geopositional bias error estimates. This requires careful consideration in assessment of higher accuracy products.

Ross, Kenton↗
NASA NTRS2009

Combined MODIS/AMSR-E SST Composites for Regional Weather Applications

Recent applications of a high resolution MODlS composite SST product have clearly shown the importance of developing high-resolution SST data sets for coastal applications and modeling. In general, coupling between the oceans and atmospheres has been closely linked to SST gradients and fronts, indicating a need for high resolution SSTs, specifically in the areas of large gradients associated with coastal regions. Thus an accurate determination of SST gradients has become critical for determining the appropriate air-sea coupling and the influence on ocean modeling. Recent research is focused on improving the accuracy and spatial coverage of the current operational MODIS SST composite product provided by the Short-term Prediction Research and Transition (SPORT) project and distributed to the community. GHRSST-PP MODlS data and microwave AMSR-E data are being combined to produce composite data sets for both the West Coast and East Coast of the United States, including the Gulf of Mexico. The use of 1 km MODIS data has explicit advantages over other SST products including its global coverage and high resolution. The AMSR-E data will reduce the latency of the composites. A strategy for utilizing the error characteristics contained in the GHRSST data has been developed. This strategy will include using the error characteristics directly to calculate weights in the SST composites, uncertainty maps based on the composite biases and RMS errors, and latency products calculated in the compositing process. Recent accomplishments include the development of an enhanced compositing approach based on the error-weighted combination of recent clear MODIS SST values, where the error contributions come from measurement error, potential cloud contamination, and data latency sources. Future plans call for the inclusion of AMSR-E SST values with appropriate weights based upon measurement accuracy, MODIS-AMSR-E SST bias, and latency.

Jedlovec, Gary↗
DOE OSTI2026

SPT-3G D1: Foreground-Robust Lensing Templates for Primordial Gravitational Wave Searches

Gravitational lensing of the cosmic microwave background (CMB) generates B-mode polarization that acts as a source of contamination to searches for B modes generated by primordial gravitational waves (PGWs). The strongest constraint on PGW B modes is already significantly limited by lensing B modes, as shown in the most recent BICEP result. In this work, we present CMB lensing B-mode templates constructed using SPT-3G and Planck data, which characterize the lensing B modes and can be used to improve PGW B-mode searches. We use SPT-3G data from the 2019 and 2020 observing seasons for the E modes and the CMB-reconstructed lensing potential, and a cosmic infrared background (CIB) map from Planck as an external lensing tracer. To test for extragalactic foreground biases in the lensing template, we consider CMB lensing reconstruction variants with different levels of foreground immunity: the standard and profile-hardened global minimum variance (GMV) quadratic estimators, and a polarization-only quadratic estimator. We validate the template construction using Gaussian simulations and Agora simulations with realistic non-Gaussian foregrounds. From simulations, we find that foreground-induced biases are strongly suppressed for the template constructed with the profile-hardened GMV + CIB tracer, with residual bias below 10% of the statistical uncertainty on the template power spectrum. Data difference tests on this template similarly show no evidence for significant foreground contamination. This foreground-immune lensing template achieves delensed residual BB power of $A_{\rm lens}^{\rm res} \simeq 0.48$ averaged over $20 \leq \ell \leq 200$, the highest delensing efficiency lensing template to date. These results demonstrate and validate a method to construct foreground-robust lensing templates which will be used in upcoming delensed PGW B-mode analyses of BICEP data.

Nakato, Y. [Stanford U.]↗
DOE OSTI2026

Precise Modeling of a Complex Solenoidal Magnetic Field Using a Combination of Analytic Functions and a PINN

We demonstrate an iterative approach to modeling a sparsely measured magnetic field in a large-bore solenoid. This approach uses a hybrid of traditional and machine learning techniques. The traditional technique is a linear least-squares fit using a series solution to Laplace's equation, while the machine learning technique involves the training of a physics-informed neural network (PINN) on the least-squares fit residuals. We use a newly defined activation function "DELTAsnake," a modification to the snake activation function proposed by Ziyin et al. that allows for stronger curvature and non-monotonicity. The combined model approximately obeys Maxwell's equations to a level sufficient for producing high quality physics simulations and analysis. Our approach is applied to a highly realistic calculation of the expected magnetic field in the Mu2e experiment's Detector Solenoid which includes a simple model for the expected statistical measurement uncertainties. Using ten toy measurement simulations, we demonstrate the capabilities of our model in comparison to the least-squares method alone; the least-squares method alone results in a reduced chi-squared statistic of ${2.15 \pm 0.01}$, while our approach improves the reduced chi-square to ${1.034 \pm 0.005}$. Furthermore, for an average toy simulation, we show that the range of the RMS of the three field component residuals reduces from ${0.07-0.37}$ Gauss to ${0.05-0.07}$ Gauss. We find that this novel method is robust against a realistic systematic uncertainty deriving from Hall probe calibration bias and can be used to significantly reduce the number of measurements required to achieve an accurate model.

Kampa, Cole [Caltech] (ORCID:0000000192972920)↗
NASA NTRS1993

Validation of ISCCP cloud detections

This paper describes the validation of the International Satellite Cloud Climatology project (ISCCP)cloud detections by verifying the accuracy of the infrared clear-sky radiances. Comparison of retrieved surface temperatures to other measurements shows that bias errors are less than 2 K and random errors are about 2 K for sea surface (monthly means at 280-km scales) and that bias errors are less than 2 K and random errors are about 4 K for land surfaces (3 hourly at 280-km scales). Bias errors over a few persistently cloudy locations are sometimes -(2-4) K and over winter sea ice may be about +2 K. Surface reflectances are confirmed to be within 3% of other measurements and models for ocean, except for sun glint geometries, and to be within 3%-5% for land surfaces. Sufficiently accurate validation data are not avilable for visible reflectances of sea ice and snow-covered land, but some tests of specific cases suggest that errors are approximately 10%. These errors in clear-sky radiances suggest uncertainties in the ISCCP cloud detections of about 10% with a small (3%-6%) negative bias over land. Some specific regions exhibit both larger rms uncertainties and somewhat larger biases in cloud amount approaching 10%. ISCCP cloud detections are more in error over the polar regions than anywhere else. Based on comparisons with an anlysis of radiances measured at other wavelengths, the ISCCP analysis appears to miss 15%-25% of the clouds in summer but only 5%-10% of the winter clouds.

Rossow, William B.↗
DOE OSTI2022

High-fidelity retrieval from instantaneous line-of-sight returns of nacelle-mounted lidar including supervised machine learning

Abstract. Wind turbine applications that leverage nacelle-mounted Doppler lidar are hampered by several sources of uncertainty in the lidar measurement, affecting both bias and random errors. Two problems encountered especially for nacelle-mounted lidar are solid interference due to intersection of the line of sight with solid objects behind, within, or in front of the measurement volume and spectral noise due primarily to limited photon capture. These two uncertainties, especially that due to solid interference, can be reduced with high-fidelity retrieval techniques (i.e., including both quality assurance/quality control and subsequent parameter estimation). Our work compares three such techniques, including conventional thresholding, advanced filtering, and a novel application of supervised machine learning with ensemble neural networks, based on their ability to reduce uncertainty introduced by the two observed nonideal spectral features while keeping data availability high. The approach leverages data from a field experiment involving a continuous-wave (CW) SpinnerLidar from the Technical University of Denmark (DTU) that provided scans of a wide range of flows both unwaked and waked by a field turbine. Independent measurements from an adjacent meteorological tower within the sampling volume permit experimental validation of the instantaneous velocity uncertainty remaining after retrieval that stems from solid interference and strong spectral noise, which is a validation that has not been performed previously. All three methods perform similarly for non-interfered returns, but the advanced filtering and machine learning techniques perform better when solid interference is present, which allows them to produce overall standard deviations of error between 0.2 and 0.3 m s−1, or a 1 %–22 % improvement versus the conventional thresholding technique, over the rotor height for the unwaked cases. Between the two improved techniques, the advanced filtering produces 3.5 % higher overall data availability, while the machine learning offers a faster runtime (i.e., ∼ 1 s to evaluate) that is therefore more commensurate with the requirements of real-time turbine control. The retrieval techniques are described in terms of application to CW lidar, though they are also relevant to pulsed lidar. Previous work by the authors (Brown and Herges, 2020) explored a novel attempt to quantify uncertainty in the output of a high-fidelity lidar retrieval technique using simulated lidar returns; this article provides true uncertainty quantification versus independent measurement and does so for three techniques rather than one.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Optical Characterization of the Keck Array and BICEP3 CMB Polarimeters from 2016 to 2019

The BICEP/Keck experiment (BK) is a series of small-aperture refracting telescopes observing degree-scale cosmic microwave background (CMB) polarization from the South Pole in search of a primordial B-mode signature. This B-mode signal arises from primordial gravitational waves interacting with the CMB and has amplitude parametrized by the tensor-to-scalar ratio r. Since 2016, BICEP3 and the Keck Array have been observing with 4800 total antenna-coupled transition-edge sensor detectors, with frequency bands spanning 95, 150, 220, and 270 GHz. Here we present the optical performance of these receivers from 2016 to 2019, including far-field beams measured in situ with an improved chopped thermal source and instrument spectral response measured with a field-deployable Fourier transform spectrometer. As a pair differencing experiment, an important systematic that must be controlled is the differential beam response between the co-located, orthogonally polarized detectors. We generate per-detector far-field beam maps and the corresponding differential beam mismatch that is used to estimate the temperature-to-polarization leakage in our CMB maps and to give feedback on detector and optics fabrication. The differential beam parameters presented here were estimated using improved low-level beam map analysis techniques, including efficient removal of non-Gaussian noise as well as improved spatial masking. These techniques help minimize systematic uncertainty in the beam analysis, with the goal of constraining the bias on r induced by temperature-to-polarization leakage to be subdominant to the statistical uncertainty. This is essential as we progress to higher detector counts in the next generation of CMB experiments.

79 ASTRONOMY AND ASTROPHYSICS↗