Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bias and Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

A Python Tool for Aqueous Plutonium Nitrate Density Law Input Preprocessing in MCNP6

Here, this work develops a predictive density tool in Python, named Plutonium Nitrate Solutions (PuNS), to reduce bias and uncertainty in nuclear criticality safety calculations for plutonium nitrate systems. The Pitzer method and an empirical method were implemented into the PuNS tool to generate atom densities for use in MCNP6 material cards. These material cards are directly prepared into an MCNP6 input text file and are calculated based on customizable user inputs of plutonium content, nitric acid content, temperature, and plutonium isotope weight percentages. The PuNS tool is validated and verified against the International Criticality Safety Benchmark Evaluation Project Handbook experiments and is observed to predict densities within a root mean square error of 0.89% for the Pitzer method and 1.82% for the empirical method. These errors in density lead to up to 1569 pcm difference in MCNP6 calculated k eff for the Pitzer method and up to a 1751 pcm difference for the empirical method when compared to experimental benchmarks. Simultaneous work is also being performed at Los Alamos National Laboratory and the University of New Mexico to create a similar tool for plutonium chloride solutions, named Plutonium Chloride Solution, which aims to provide the accreditation of the chlorine absorption. These capabilities will not only provide more accurate models but also facilitate an improved understanding of solution systems and a potential relaxation in the conservatism of current aqueous plutonium processing criticality safety limits.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Cross-correlation of Planck CMB lensing with DESI-like LRGs

ABSTRACT Cross-correlations between the lensing of the cosmic microwave background (CMB) and other tracers of large-scale structure provide a unique way to reconstruct the growth of dark matter, break degeneracies between cosmology and galaxy physics, and test theories of modified gravity. We detect a cross-correlation between Dark Energy Spectroscopic Instrument (DESI)-like luminous red galaxies (LRGs) selected from DECam Legacy Survey imaging and CMB lensing maps reconstructed with the Planck satellite at a significance of S/N = 27.2 over scales ℓmin = 30, ℓmax = 1000. To correct for magnification bias, we determine the slope of the LRG cumulative magnitude function at the faint limit as s = 0.999 ± 0.015, and find corresponding corrections of the order of a few per cent for $C^{\kappa g}_{\ell }, C^{gg}_{\ell }$ across the scales of interest. We fit the large-scale galaxy bias at the effective redshift of the cross-correlation zeff ≈ 0.68 using two different bias evolution agnostic models: a HaloFit times linear bias model where the bias evolution is folded into the clustering-based estimation of the redshift kernel, and a Lagrangian perturbation theory model of the clustering evaluated at zeff. We also determine the error on the bias from uncertainty in the redshift distribution; within this error, the two methods show excellent agreement with each other and with DESI survey expectations.

79 ASTRONOMY AND ASTROPHYSICS↗

A comparison of the baryonic Tully–Fisher relation in MaNGA and IllustrisTNG

We compare an observed baryonic Tully–Fisher relation (BTFR) from the Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) and HI-MaNGA surveys to a simulated BTFR from the cosmological magnetohydrodynamical simulation, IllustrisTNG. To do so, we calibrate the BTFR of the local universe using 377 galaxies from the MaNGA and HI-MaNGA surveys, and perform mock 21 cm observations of matching galaxies from IllustrisTNG. The mock observations are used to ensure that the comparison with the observed galaxies is fair since it has identical measurement algorithms, observational limitations, biases, and uncertainties. For comparison, we also calculate the BTFR for the simulation without mock observations and demonstrate how mock observations are necessary to fairly and consistently compare between observational and theoretical data. We report a MaNGA BTFR of log$_{10} (M_{ \rm Bary}/M_\odot)= (2.97 \pm 0.18)$ log$_{10} V_{ \rm Rot} + (4.04 \pm 0.41)\, \log _{10}{M_{\odot }}$ and an IllustrisTNG BTFR of log$_{10} (M_{ \rm Bary}/M_\odot) = (2.94 \pm 0.23$) log$_{10} V_{ \rm Rot} + (4.15 \pm 0.44)\, \log _{10}{M_{\odot }}$. Thus, MaNGA and IllustrisTNG produce BTFRs that agree within uncertainties, demonstrating that IllustrisTNG has created a galaxy population that obeys the observed relationship between mass and rotation velocity in the observed universe.

79 ASTRONOMY AND ASTROPHYSICS↗

Model independent comparison of supernova and strong lensing cosmography: Implications for the Hubble constant tension

We use supernovae measurements, calibrated by the local determination of the Hubble constant $H_0$ by SH0ES, to interpolate the distance-redshift relation using Gaussian process regression. We then predict, independent of the cosmological model, the distances that are measured with strong lensing time delays to test their mutual agreement. In this work we find excellent agreement between these predictions and the measurements. The agreement holds when we consider only the redshift dependence of the distance-redshift relation, independent of the value of $H_0$. Our results disfavor the possibility that lens mass modeling contributes a 10% bias or uncertainty in the strong lensing analysis, as suggested recently in the literature. In general our analysis strengthens the case that residual systematic errors in both measurements are below the level of the current discrepancy with the CMB determination of $H_0$, and supports the possibility of new physical phenomena on cosmological scales. With additional data our methodology can provide more stringent tests of unaccounted for systematics in the determinations of the distance-redshift relation in the late universe.

79 ASTRONOMY AND ASTROPHYSICS↗

Observations of Clouds, Aerosols, Precipitation, and Surface Radiation over the Southern Ocean: An Overview of CAPRICORN, MARCUS, MICRE, and SOCRATES

Weather and climate models are challenged by uncertainties and biases in simulating Southern Ocean (SO) radiative fluxes that trace to a poor understanding of cloud, aerosol, precipitation, and radiative processes, and their interactions. Projects between 2016 and 2018 used in situ probes, radar, lidar, and other instruments to make comprehensive measurements of thermodynamics, surface radiation, cloud, precipitation, aerosol, cloud condensation nuclei (CCN), and ice nucleating particles over the SO cold waters, and in ubiquitous liquid and mixed-phase clouds common to this pristine environment. Data including soundings were collected from the NSF–NCAR G-V aircraft flying north–south gradients south of Tasmania, at Macquarie Island, and on the R/V Investigator and RSV Aurora Australis. Synergistically these data characterize boundary layer and free troposphere environmental properties, and represent the most comprehensive data of this type available south of the oceanic polar front, in the cold sector of SO cyclones, and across seasons. Results show largely pristine environments with numerous small and few large aerosols above cloud, suggesting new particle formation and limited long-range transport from continents, high variability in CCN and cloud droplet concentrations, and ubiquitous supercooled water in thin, multilayered clouds, often with small-scale generating cells near cloud top. These observations demonstrate how cloud properties depend on aerosols while highlighting the importance of dynamics and turbulence that likely drive heterogeneity of cloud phase. Satellite retrievals confirmed low clouds were responsible for radiation biases. Furthermore, the combination of models and observations is examining how aerosols and meteorology couple to control SO water and energy budgets.

54 ENVIRONMENTAL SCIENCES↗

AWCC Simulations

Neutron well counters provide a means to measure fissile mass by detecting coincident neutrons, which is a unique signature to fission. For coincidence counting, mass is determined using a calibration curve established with items that have the same material characteristics. Multiplicity analysis solves the point model equations for mass using known detector parameters. In both cases, mass measurements may exhibit a bias due to item characteristics and should be corrected for. Experiments can be done to estimate bias and material effects, but they require having both the well counter and the material well defined. In pursuit of estimating measurement bias and uncertainty in a High Efficiency Neutron Counter (HENC), an MCNP simulation was matched to measurements performed with an Active Well Coincidence Counter (AWCC) to de ne a neutron source term. The neutron source term will be used to predict measurement performance of similar material types in a HENC.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluating the Influence of Plants on Hydrologic Cycling: Quantifying and Validating the Role of Plant Processes and Stomatal Conductance (Final Report)

Plants can exert strong controls on water cycling, both locally and across the globe. The impacts are driven by how plants control the exchange of water and energy between the land and the atmosphere, which in turn are influenced by how plants photosynthesize and grow (e.g. biogeochemical cycling). Our team has shown previously that plant responses to increasing CO 2 in the atmosphere can influence the water cycle through changes in rainfall and the amount of water on land with implications for drought. Plant responses can also alter both average and extreme flow of water in rivers, with implications for freshwater availability and flood frequency. Although the impact of plant responses on water cycling has been demonstrated to exist, significant uncertainty remains in our understanding of the magnitude and form of the plant responses themselves, as well as their ultimate impact on water availability for people and ecosystems. In this project we worked to quantify the role of plant processes in regulating water cycling (e.g., precipitation, evapotranspiration, runoff, droughts, etc.). We addressed the following objectives: quantify the control of physiological vs. radiative effects on water cycling across many coupled models in idealized and realistic scenarios, as well as to quantify how our assumptions about leaf-level processes (e.g. coupling between stomatal conductance and photosynthesis), and organism-level processes (e.g. leaf area response to high CO 2 ) contributed to uncertainties and biases in water cycling. We focused on the impact of these processes on water cycling to assess the sensitivities of precipitation, evapotranspiration, and runoff to model assumptions about plant processes at the leaf, organism, and community level. As part of this project we used measurements of stable carbon isotopes to generate observationally based estimates of plant functioning during the historical period. This work is directly relevant to DOE’s primary scientific research questions in the RGMA topic area (b) on Biogeochemical processes, feedbacks, and interactions in the Earth system.

59 BASIC BIOLOGICAL SCIENCES↗

Systematic uncertainty of off-shell corrections and higher-twist contribution in DIS at large x

We study the systematic uncertainty and biases introduced by theoretical assumptions needed to include large-x DIS data in a global QCD analysis. Working in the CTEQ-JLab framework, we focus on different implementations of higher-twist corrections to the nucleon structure functions and of offshell PDF deformations in deuteron targets and discuss how their interplay impacts the extraction of the d -quark PDF and the calculation of the neutron structure function at large x.

Cerutti, Matteo↗

Validation of the SCALE/Polaris–PARCS Code Procedure With the ENDF/B-VII.1 AMPX 56-Group Library: Boiling Water Reactor

The SCALE/Polaris–PARCS code procedure has been used in the confirmatory analysis for boiling water reactors by the US Nuclear Regulatory Commission. In this study, the SCALE/Polaris v6.3.0–PARCS v3.4.2 code procedure with the Evaluated Nuclear Data File (ENDF)/B-VII.1 AMPX 56-group library was validated by comparing the simulated results with the measured data for operating boiling water reactors, including Peach Bottom Unit 2 cycles 1–3, Hatch Unit 1 cycles 1–3, and Quad Cities Unit 1 cycles 1–3. The uncertainties and biases of the SCALE/Polaris–PARCS code package for boiling water reactor physics analysis were evaluated in the validation for key nuclear parameters such as reactivity and traversing in-core probe data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Measurements of Effective Optical Depth in the Lyα Forest from the BOSS DR12 Quasar Sample

We measure the effective optical depth in the Lyα forest using 40,035 quasar spectra from the Twelfth Data Release (DR12) of the Baryon Oscillation Spectroscopic Survey of Sloan Digital Sky Survey IV. A rigorous selection based on spectral index and the equivalent width of the C iv emission line is applied to choose seven uniform samples with minimal intrinsic variations across redshifts. Modeling the redshift evolution of the effective optical depth with a power law, ${\tau }_{\mathrm{eff}}={\tau }_{0}{(1+z)}^{\gamma },$ produces ${\tau }_{0}=(5.54\pm 0.64)\times {10}^{-3}$ and $\gamma =3.182\pm 0.074$. The 2.2% precision estimate on γ is dominated by systematic errors, likely arising from the bias and uncertainties in spectral index estimates. Even after incorporating the systematic errors, this work provides the most precise estimates of optical depth parameters to date. Finally, using the reconstructed Lyα forest continuum to directly measure the transmitted flux ratio as a function of redshift, we find deviations of less than 2.5% from the predictions from the global model and no convincing evidence for signal associated with He ii reionization.

79 ASTRONOMY AND ASTROPHYSICS↗

Reassessing long-standing meteorological records: an example using the national hottest day in Ireland

This analysis highlights the potential value in reanalysing early national meteorological records from around the world. These were oftentimes measured via techniques that preceded standardisation of instrumentation and methods of observation and thus could be subject to considerable biases and uncertainties. This analysis uses the techniques pioneered by WMO record assessment teams. The highest currently recognised air temperature (33.3 °C) ever recorded in the Republic of Ireland was logged at Kilkenny Castle in 1887. The original observational record however no longer exists. Given that Ireland is now the only country in Europe to have a national heat record that was set in the 19th century, a reassessment of the verity of this record is both timely and valuable. The present analysis undertakes a fundamental reassessment of the plausibility of the 1887 temperature record using methods similar to those used to assess various weather extremes under WMO auspices over recent years. Specifically, we undertake an inter-station reassessment using sparse available records and make recourse to the new and improved 20CRv3 sparse-input reanalysis product. Neither surrounding available stations nor the reanalysis offer substantive support for the Kilkenny record of 33.3 °C being correct. Moreover, recent data rescue efforts have uncovered several earlier extreme values, one of which exceeds the Kilkenny value (33.5 °C on 16 July 1876 recorded at the Phoenix Park). However, the sparsity of early observational networks, a distinct lack of synoptic support from 20CRv3 for many of the extreme heat values, and the fact that these measurements were obtained using non-standard exposures lead us to conclude that there is grossly insufficient evidence to support any of these 19th century extremes as robust national heat record candidates. Data from the early 20th century onwards benefit from a denser network of stations undertaking measurements in a more standardised manner, many under the direct auspices of Met Éireann and its predecessors, adhering to WMO guidance and protocols. This enables more robust cross-checking of records. We argue that the Met Éireann-recognised 20th century heat record from Boora in 1976 is verified as the most plausible robust national temperature record based upon the synoptic situation and comparisons with nearby neighbouring stations. This measurement of 32.5°C thus likely constitutes the highest reliably recorded temperature measurement in the Republic of Ireland. Ultimately, the formal decision on any reassessment and reassignment of the national record rests with the national meteorological service, Met Éireann.

15 GEOTHERMAL ENERGY↗

A Fortran–Python interface for integrating machine learning parameterization into earth system models

Abstract. Parameterizations in earth system models (ESMs) are subject to biases and uncertainties arising from subjective empirical assumptions and incomplete understanding of the underlying physical processes. Recently, the growing representational capability of machine learning (ML) in solving complex problems has spawned immense interests in climate science applications. Specifically, ML-based parameterizations have been developed to represent convection, radiation, and microphysics processes in ESMs by learning from observations or high-resolution simulations, which have the potential to improve the accuracies and alleviate the uncertainties. Previous works have developed some surrogate models for these processes using ML. These surrogate models need to be coupled with the dynamical core of ESMs to investigate the effectiveness and their performance in a coupled system. In this study, we present a novel Fortran–Python interface designed to seamlessly integrate ML parameterizations into ESMs. This interface showcases high versatility by supporting popular ML frameworks like PyTorch, TensorFlow, and scikit-learn. We demonstrate the interface's modularity and reusability through two cases: an ML trigger function for convection parameterization and an ML wildfire model. We conduct a comprehensive evaluation of memory usage and computational overhead resulting from the integration of Python codes into the Fortran ESMs. By leveraging this flexible interface, ML parameterizations can be effectively developed, tested, and integrated into ESMs.

54 ENVIRONMENTAL SCIENCES↗

A Fortran-Python Interface for Integrating Machine Learning Parameterization into Earth System Models

Parameterizations in Earth System Models (ESMs) are subject to biases and uncertainties arising from subjective empirical assumptions and incomplete understanding of the underlying physical processes. Recently, the growing representational capability of machine learning (ML) in solving complex problems has spawned immense interests in climate science applications. Specifically, ML-based parameterizations have been developed to represent convection, radiation and microphysics processes in ESMs by learning from observations or high-resolution simulations, which have the potential to improve the accuracies and alleviate the uncertainties. Previous works have developed some surrogate models for these processes using ML. These surrogate models need to be coupled with the dynamical core of ESMs to investigate the effectiveness and their performance in a coupled system. In this study, we present a novel Fortran-Python interface designed to seamlessly integrate ML parameterizations into ESMs. This interface showcases high versatility by supporting popular ML frameworks like PyTorch, TensorFlow, and Scikit-learn. We demonstrate the interface's modularity and reusability through two cases: a ML trigger function for convection parameterization and a ML wildfire model. We conduct a comprehensive evaluation of memory usage and computational overhead resulting from the integration of Python codes into the Fortran ESMs. By leveraging this flexible interface, ML parameterizations can be effectively developed, tested, and integrated into ESMs.

54 ENVIRONMENTAL SCIENCES↗

Application of a Density Law via Python for Aqueous Plutonium Nitrate

A predictive density tool has been developed in Python to reduce bias and uncertainty in nuclear criticality safety calculations for plutonium nitrate systems. The Pitzer Method and an empirical method were implemented into the tool, allowing for plutonium nitrate density calculations. Additionally, the Python tool can generate atom densities for a MCNP6.2 material card using the density from the selected method and directly the densities into a prepared MCNP6 input text file. The material card and density are calculated based on customizable user inputs of plutonium content, nitric acid content, temperature, plutonium isotope weight percentages and impurity concentrations. The Python tool has been validated and verified against the International Handbook of Evaluated Criticality Safety Benchmark Experiments to predict densities within a root mean square error of 1.0% for the Pitzer method and 1.8% for the empirical method. These errors in density were shown to lead to a ±0.5% error in MCNP6.2 calculated k effective for the Pitzer method and a ±1.7% error for the Empirical method. Simultaneous work is also being done at the University of New Mexico and Los Alamos National Laboratory to create a similar tool for plutonium chloride solutions, which aims to provide the accreditation of the chlorine absorption. These capabilities will not only provide more accurate models but also lead the way towards a better understanding of solution systems and potential relaxation in the conservatism of the current aqueous plutonium processing limits.

97 MATHEMATICS AND COMPUTING↗

Constraining Cosmology with Simulation-based inference and Optical Galaxy Cluster Abundance

We test the robustness of simulation-based inference (SBI) in the context of cosmological parameter estimation from galaxy cluster counts and masses in simulated optical datasets. We construct ``simulations'' using analytical models for the galaxy cluster halo mass function (HMF) and for the observed richness (number of observed member galaxies) to train and test the SBI method. We compare the SBI parameter posterior samples to those from an MCMC analysis that uses the same analytical models to construct predictions of the observed data vector. The two methods exhibit comparable performance, with reliable constraints derived for the primary cosmological parameters, ($\Omega_m$ and $\sigma_8$), and richness-mass relation parameters. We also perform out-of-domain tests with observables constructed from galaxy cluster-sized halos in the Quijote simulations. Again, the SBI and MCMC results have comparable posteriors, with similar uncertainties and biases. Unsurprisingly, upon evaluating the SBI method on thousands of simulated data vectors that span the parameter space, SBI exhibits worsened posterior calibration metrics in the out-of-domain application. We note that such calibration tests with MCMC is less computationally feasible and highlight the potential use of SBI to stress-test limitations of analytical models, such as in the use for constructing models for inference with MCMC.

79 ASTRONOMY AND ASTROPHYSICS↗

Exploring Data Set Bias and Decision Support with Predictive Uncertainty Through Bayesian Approximations and Convolutional Neural Networks

Individual seismic catalogs can contain multiscale observations from fault level to global scales and associated waveforms from discrete events reflect crustal structure across many different scales and locations. Seismic network aperture, geographic location, and observation distance may not provide informative guidance or intuition on how different catalogs will behave across models trained under different conditions. We rely on uncertainty to provide guardrails for when to trust model decisions, but understanding when our uncertainty is trustworthy is an open challenge. Here, in this work, we explore Bayesian approximation methods for assigning predictive uncertainty in seismic event classification problems. We find that computationally expensive Bayesian approximations do not outperform simple ensemble methods. We also find that when exploiting multiple seismic event catalogs, joint training with data from all the catalogs combined with Bayesian approximations and supervised training for classification can obscure bias and result in less robust uncertainty while also not providing substantial performance benefits compared to training individual models for each catalog.

58 GEOSCIENCES↗

Uncertainty analysis for techno-economic and life-cycle assessment of wet waste hydrothermal liquefaction with centralized upgrading to produce fuel blendstocks

Wet waste hydrothermal liquefaction is a promising technology for producing transportation fuels with much lower greenhouse gases emissions than petroleum-based fuels. However, its techno-economic and life cycle assessment are primarily based on laboratory scale testing data, subject to considerable uncertainties, and even bias, due to knowledge gaps. Here, a preliminary uncertainty analysis of key economic measures was conducted based on the 2019 state-of-technology model for biocrude production. Building on the preliminary analysis, this work presents a comprehensive uncertainty analysis in both economic and environmental measures of the entire supply chain of wet waste hydrothermal liquefaction to fuel blendstocks including biocrude upgrading based on the 2021 state-of-technology model. The analysis includes the most recent developments in hydrothermal liquefaction and biocrude upgrading technologies and Monte Carlo simulation based on an integrated model system including an improved reactor yield model, reduced-order process model, discounted cash flow economic model and simplified life-cycle assessment model. The estimated biocrude yield ranges from 42.2% to 52.4% with a median of 47.3%. The estimated fuel yield ranges from 34.7% to 42.7% with a median of 38.7%. The estimated minimum fuel selling price ranges from $\$ $2.28/gge to $\$ $3.45/gge with a median of $\$ $2.80/gge. Relative to petroleum-derived diesel, the estimated reduction in supply chain greenhouse gas emissions ranges from 73.4% to 81.8% with a median of 77.7%. Compared to the 2019 state-of-technology analysis, a significant improvement in biocrude selectivity and economic measures and reduction in uncertainties were achieved due to the incorporation of additional continuous experimental data sets, technology development and de-risking, and improvement in model accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning-assisted identification of potential sources of bias in measurements of prompt-fission neutron spectra

Unrecognized sources of uncertainty (USU) can bias the reported mean and/or covariance of experimental nuclear data. These biases, in turn, can propagate through evaluated nuclear data to application simulations or may poorly inform nuclear theory that is fitted to the experimental data. Such unknown sources of bias must be tied to the inherent physical constituents of the measurements such as the characteristics of a detector response or a background reduction technique. Here, in this article, a sparse Bayesian learning model is used to support experts in their efforts to identify and characterize USU in experimental prompt fission neutron spectra (PFNS) for spontaneous fissioning of 252 Cf by linking observed biases to features of the measurement system. Three different bias components were found. The first acts as a verification case for the algorithm as it identifies a bias coming from a well-known source related to the use of 6 Li in the neutron detection system. The second two cases demonstrate how this method can benefit the evaluation of experimental nuclear data by identifying, quantifying, and relating unknown biases to potential causes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗