Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bias and Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Nuclear data sensitivity and uncertainty study of copper-reflected integral experiments [Slides]

This presentation touches on reducing uncertainties in intermediate-energy actinide nuclear data and this continues to be a high priority for many applications. The goal of PARADIGM (PARallel Approach of Differential and InteGral Measurements): accelerate efforts to reduce biases and uncertainties in nuclear data through improvements to the nuclear data pipeline. This presentation includes integral experiments and a summarization of existing copper nuclear data.

Cu63↗
DOE OSTI2024

Machine Learning Driven Sensitivity Analysis of E3SM Land Model Parameters for Wetland Methane Emissions

Methane (CH 4 ) is globally the second most critical greenhouse gas after carbon dioxide, contributing to 16%–25% of the observed atmospheric warming. Wetlands are the primary natural source of methane emissions globally. However, wetland methane emission estimates from biogeochemistry models contain considerable uncertainty. One of the main sources of this uncertainty arises from the numerous uncertain model parameters within various physical, biological, and chemical processes that influence methane production, oxidation, and transport. Sensitivity Analysis (SA) can help identify critical parameters for methane emission and achieve reduced biases and uncertainties in future projections. This study performs SA for 19 selected parameters responsible for critical biogeochemical processes in the methane module of the Energy Exascale Earth System Model (E3SM) land model (ELM). The impact of these parameters on various CH 4 fluxes is examined at 14 FLUXNET- CH 4 sites with diverse vegetation types. Given the extensive number of model simulations needed for global variance-based SA, we employ a machine learning (ML) algorithm to emulate the complex behavior of ELM methane biogeochemistry. We found that parameters linked to CH 4 production and diffusion generally present the highest sensitivities despite apparent seasonal variation. Comparing simulated emissions from perturbed parameter sets against FLUXNET-CH 4 observations revealed that better performances can be achieved at each site compared to the default parameter values. This presents a scope for further improving simulated emissions using parameter calibration with advanced optimization techniques.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Hyper Suprime-Cam Year 3 results: Cosmology from cosmic shear power spectra

Here, we measure weak lensing cosmic shear power spectra from the 3-year galaxy shear catalog of the Hyper Suprime-Cam (HSC) Subaru Strategic Program imaging survey. The shear catalog covers 416 deg 2 of the northern sky, with a mean i-band seeing of 0.59 arcsec and an effective galaxy number density of 15 arcmin —2 within our adopted redshift range. With an i-band magnitude limit of 24.5 mag, and four tomographic redshift bins spanning 0.3 ≤ z ph ≤ 1.5 based on photometric redshifts, we obtain a high-significance measurement of the cosmic shear power spectra, with a signal-to-noise ratio of approximately 26.4 in the multipole range 300 < ℓ < 1800. The accuracy of our power spectrum measurement is tested against realistic mock shear catalogs, and we use these catalogs to get a reliable measurement of the covariance of the power spectrum measurements. We use a robust blinding procedure to avoid confirmation bias, and model various uncertainties and sources of bias in our analysis, including point spread function systematics, redshift distribution uncertainties, the intrinsic alignment of galaxies and the modeling of the matter power spectrum. For a flat Λ CDM model, we find S 8 ≡ σ 8 (Ω m /0.3) 0.5 = ${0.776}_{—0.033}^{+0.032}$, which is in excellent agreement with the constraints from the other HSC Year 3 cosmology analyses, as well as those from a number of other cosmic shear experiments. This result implies a ~2σ-level tension with the Planck 2018 cosmology. We study the effect that various systematic errors and modeling choices could have on this value, and find that they can shift the best-fit value of S 8 by no more than ~ 0.5σ, indicating that our result is robust to such systematics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Wind Plant Performance Prediction Benchmark Phase 1 (Technical Report)

Financial risk resulting from the uncertainty associated with developing, owning, and operating wind power plants remains a barrier to reducing the levelized cost of energy (LCOE). On average, modern wind power plants in the U.S. underperform their expected annual energy output by 3.5-4.5% , with many underperforming by over 10%. To compensate for this uncertainty, investors require a larger return on investment (ROI) and apply "knock-down" factors that mask much of the underlying sources of uncertainty. Wind energy projects thus have reduced access to low-cost capital. Furthermore, operating wind plants often take a simple approach to estimating operations & maintenance (O&M) costs (e.g. straight-line estimates based on similar plants), which can eat into profits. To overcome these issues, the wind industry must improve the models they use for estimating wind plant performance and operations. An industry consortium (IC) requested that the National Renewable Energy Laboratory (NREL) lead a Department of Energy (DOE) working group to benchmark the accuracy of wind power plant energy predictions against real operational data. The IC was also motivated by DOE and NREL's potential to characterize systematic energy underperformance, identify sources of uncertainty, and explore root causes. The Wind Plant Performance Prediction (WP3) project was created out of this request, and this report represents the successful completion of Phase 1 of the WP3 project. During the project, wind plant owners provided both pre-construction and operational data to NREL. The pre-construction data was provided to wind resource assessment (WRA) consultants so they could conduct energy yield assessments (EYA). NREL took all of the completed EYAs, along with the operational data, and conducted an operational assessment to benchmark the EYA results against actual operational data. Given the large amounts of sensitive data required for this effort, as well as historical opposition to sharing data within industry, successful completion of Phase 1 represents an unprecedented milestone for industry data sharing. To improve the accuracy and confidence of pre-construction EYAs, wind plant owners and investors need better, more certain, energy yield predictions. The WP3 Benchmark Project is an industry-driven response to this reality. For the first time, industry has taken the important step of working together at scale, sharing valuable operational data with DOE and NREL in order to investigate the sources of bias and uncertainty in these energy estimates. This IC provides wind plant preconstruction and operational data to NREL in an organized and documented fashion and provides guidance and feedback as needed. The IC also provides introspection of the design of experiment, key metrics of success, data challenges, analysis best practices, and quality of results.

17 WIND ENERGY↗
DOE OSTI2023

Uncertainty quantification of the virial black hole mass with conformal prediction

Precise measurements of the black hole mass are essential to gain insight on the black hole and host galaxy co-evolution. A direct measure of the black hole mass is often restricted to nearest galaxies and instead, an indirect method using the single-epoch virial black hole mass estimation is used for objects at high redshifts. However, this method is subjected to biases and uncertainties as it is reliant on the scaling relation from a small sample of local active galactic nuclei. In this study, we propose the application of conformalized quantile regression (CQR) to quantify the uncertainties of the black hole predictions in a machine learning setting. We compare CQR with various prediction interval techniques and demonstrated that CQR can provide a more useful prediction interval indicator. In contrast to baseline approaches for prediction interval estimation, we show that the CQR method provides prediction intervals that adjust to the black hole mass and its related properties. That is it yields a tighter constraint on the prediction interval (hence more certain) for a larger black hole mass, and accordingly, bright and broad spectral line width source. Using a combination of neural network model and CQR framework, the recovered virial black hole mass predictions and uncertainties are comparable to those measured from the Sloan Digital Sky Survey. The code is publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Coupled model intercomparison project phase 6 (CMIP6) high resolution model intercomparison project (HighResMIP) bias in extreme rainfall drives underestimation of amazonian precipitation

Abstract Extreme rainfall events drive the amount and spatial distribution of rainfall in the Amazon and are a key driver of forest dynamics across the basin. This study investigates how the 3-hourly predictions in the High Resolution Model Intercomparison Project (HighResMIP, a component of the recent Coupled Model Intercomparison Project, CMIP6) represent extreme rainfall events at annual, seasonal, and sub-daily time scales. TRMM 3B42 (Tropical Rainfall Measuring Mission) 3 h data were used as observations. Our results showed that eleven out of seventeen HighResMIP models showed the observed association between rainfall and number of extreme events at the annual and seasonal scales. Two models captured the spatial pattern of number of extreme events at the seasonal and annual scales better (higher correlation) than the other models. None of the models captured the sub-daily timing of extreme rainfall, though some reproduced daily totals. Our results suggest that higher model resolution is a crucial factor for capturing extreme rainfall events in the Amazon, but it might not be the sole factor. Improving the representation of Amazon extreme rainfall events in HighResMIP models can help reduce model rainfall biases and uncertainties and enable more reliable assessments of the water cycle and forest dynamics in the Amazon.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

CMB-S4: Foreground-cleaning Pipeline Comparison for Measuring Primordial Gravitational Waves

We compare multiple foreground-cleaning pipelines for estimating the tensor-to-scalar ratio, r, using simulated maps of the planned CMB-S4 experiment within the context of the South Pole Deep Patch. To evaluate robustness, we analyze bias and uncertainty on r across various foreground suites using map-based simulations. The foreground-cleaning methods include: a parametric maximum likelihood approach applied to auto- and cross-power spectra between frequency maps; a map-based parametric maximum-likelihood method; and a harmonic-space internal linear combination using frequency maps. We summarize the conceptual basis of each method to highlight their similarities and differences. To better probe the impact of foreground residuals, we implement an iterative internal delensing step, leveraging a map-based pipeline to generate a lensing B-mode template from the large aperture telescope frequency maps. Our results show that the performance of the three approaches is comparable for simple and intermediate-complexity foregrounds, with σ(r) ranging from 3–5 ×10 −4 . However, biases at the 1σ–2σ level appear when analyzing more complex forms of foreground emission. By extending the baseline pipelines to marginalize over foreground residuals, we demonstrate that contamination can be reduced to within statistical uncertainties, albeit with a pipeline-dependent impact on σ(r), which translates to a detection significance between 2σ and 4σ for an input value of r = 0.003. These findings suggest varying levels of maturity among the tested pipelines, with the auto- and cross-spectra-based approach demonstrating the best stability and overall performance. Moreover, given the extremely low noise levels, mutual validation of independent foreground-cleaning pipelines is essential to ensure the robustness of any potential detection.

astronomy data analysis↗
DOE OSTI2021

Ocean Surface Flux Algorithm Effects on Earth System Model Energy and Water Cycles

Earth system models parameterize ocean surface fluxes of heat, moisture, and momentum with empirical bulk flux algorithms, which introduce biases and uncertainties into simulations. We investigate the atmosphere and ocean model sensitivity to algorithm choice in the Energy Exascale Earth System Model (E3SM). Flux differences between algorithms are larger in atmosphere simulations (where wind speeds can vary) than ocean simulations (where wind speeds are fixed by forcing data). Surface flux changes lead to global scale changes in the energy and water cycles, notably including ocean heat uptake and global mean precipitation rates. Compared to the control algorithm, both COARE and University of Arizona (UA) algorithms reduce global mean precipitation and top of atmosphere radiative biases. Further, UA may slightly reduce biases in ocean meridional heat transport. We speculate that changes seen here, especially in the ocean, could be even larger in coupled simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Estimating epistemic uncertainty in soil parameters for nonlinear site response analyses: Introducing the Latin Hypercube Sampling technique

This study quantifies the effects of epistemic uncertainty in soil parameters on nonlinear (NL) site response analysis (SRA) results, validated against the data recorded at a well-instrumented geotechnical downhole array located in Japan. To this end, a one-dimensional soil column model of the Service Hall Array (SHA) near the Kashiwazaki-Kariwa Nuclear Power Plant (KKNPP) is developed using the finite element (FE) program LS-DYNA. The dynamic stress–strain relationship is characterized by a modified two-stage hyperbolic (MTH) NL backbone curve formulation capable of capturing soil behavior at both small- and large-shear strains. The model is then validated against the ground motion recordings to capture the model bias. The uncertainties associated with the shear-wave velocity profile (a small-strain soil property) and soil shear strength (a large-strain soil property) are incorporated in NL SRA to quantify their separate and joint randomization effects on the results. This study proposes using the Latin Hypercube Sampling (LHS) method as an efficient alternative to commonly used methods, such as Standard Monte Carlo (SMC), to account for uncertainty propagation in such reliability analysis. Both low-intensity and design-level records from the recordings at the SHA are applied to study the contribution of the small- and large-strain NL dynamic soil properties. Results from 46,200 NL FE analyses (23,100 per input motion) are presented. Measured and predicted site response, using recorded ground motions at this downhole array, is compared to assess the significance of soil parameter uncertainty on the observed ground motion dispersions. It is demonstrated that increasing the number of soft realizations and implementing higher level earthquake intensity lead to higher ground motion dispersion. Unlike past studies in randomization of Vs profiles with the SMC method, the LHS method is shown to have no significant effect on the predicted median surface response spectra and amplification factors (AFs) for this case study.

Engineering↗
DOE OSTI2020

Measurement of the 239 Pu$(n, f$) prompt fission neutron spectrum from 10 keV to 10 MeV induced by neutrons of energy 1–20 MeV

Although the prompt fission neutron spectrum (PFNS) is an essential component of neutron-driven systems that has been measured for decades, there are still multiple glaring unknowns regarding the PFNS of major actinides in the fission neutron incident energy range, specifically with regard to multichance fission and pre-equilibrium neutron emission processes. The only impactful experimental 239 Pu PFNS measurements included in recent nuclear data evaluations were measured over a limited outgoing neutron energy range at thermal and 1.5-MeV average incident neutron energy, while other potentially impactful measurements have been shown to contain errors that resulted in either large uncertainty increases or in complete exclusion from nuclear data evaluation. Here, we report a measurement of the 239 Pu PFNS over a wide range of incident neutron energy (1–20 MeV) and three orders of magnitude in outgoing neutron energy (0.01–10 MeV) resulting from the Chi-Nu experiment at the Los Alamos Neutron Science Center. These results are the combination of separate PFNS measurements in the same experimental area, one using a Li-glass and the other a liquid scintillator detector array. Covariances between all PFNS data points from each detector and within each incident energy range were generated between all other data in both detector arrays and within all other incident neutron energy bins, yielding a single covariance matrix for all 1300 PFNS data points reported here. These covariances are based on a thorough assessment of systematic bias and uncertainties associated with the measurement, PFNS extraction technique, combination of data from each detector type, and other aspects of the analysis. The existence of covariances between PFNS data points in different incident neutron energy ranges yielded covariances between average PFNS energy values at each incident energy to be reported here as well, which allowed for firm statements to be made regarding a shape of a purely experimental mean PFNS energy trend for the first time. Although minor PFNS shape differences exist between the results reported here and recent nuclear data evaluations, the ENDF/B-VIII.0 and JEFF-3.3 PFNS evaluations agree reasonably well with the present results from 1-to 10-MeV incident neutron energy, which spans the well-measured 1.5-MeV incident neutron energy PFNS from Lestone and Shores as well as the onset of second-chance fission. However, while the pre-equilibrium component of the PFNS above 12-MeV incident neutron energy roughly agrees in position and magnitude with ENDF/B-VIII.0 and JEFF-3.3, clear differences relating to the relative magnitude of third-chance fission PFNS features are present in the PFNS shape and in the mean PFNS energy trends.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Stochastically estimated covariance matrices for independent and cumulative fission yields in the ENDF/B-VIII.0 and JEFF-3.3 evaluations

A Monte-Carlo method for the generation of correlation and covariance matrices for independent and cumulative fission yields has been developed. The method uses a constrained Monte-Carlo resampling structure in order to vary evaluated fission yield libraries in a way that meets basic conservation principles. This results in the generation of correlation/covariance matrices with limited model bias and uncertainty; the matrices are primarily reflective of the evaluated fission yield uncertainties and correlations that arise from the evaluation process. This method has been applied to generate correlation and covariance matrices for all of the fissioning systems of the ENDF/B-VIII.0 and JEFF-3.3 evaluations, marking the first time such matrices have been generated for all of these systems. These covariance matrices have been published online for immediate public use. These correlation and covariance matrices can be used to improve uncertainty estimation in calculations of reactor antineutrino emission rates, decay heat problems, and nuclear forensics.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Convolution-based frequency domain multiplexing of SiPM readouts using the $\mathrm{DRS4}$ digitizer

Here we present 4:1 multiplexing of organic scintillators, each coupled to a silicon photomultiplier (SiPM), to reduce the need for a large number of digitizer input channels to readout highly pixelated radiation detection systems. Frequency domain multiplexing (FDM) encodes a detector pulse by assigning it a unique frequency via convolution before combining the encoded signal into a single channel. The combined signal is then read through a digitizer input channel. We have designed an FDM system to multiplex four SiPMs using DRS4 digitizer evaluation board from Paul Scherrer Institute (PSI). We demonstrate 4:1 multiplexing of the SiPM fast output signals and pulse recovery from the digitized multiplexed signal using deconvolution. The noise in the recovered pulse introduces a bias and uncertainty in the estimate of energy and timing that changes with pulse height. The relative uncertainty in the estimated energy from the recovered pulse decreases with pulse height with a maximum uncertainty of 3.1% for the low energy pulses (corresponding to 100 keV); the uncertainty in the estimated time pick-off also decreases with pulse height with a maximum uncertainty of 110 ps for the low energy pulses.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Identifying snowfall elevation patterns by assimilating satellite-based snow depth retrievals

Precipitation in mountain regions is highly variable and poorly measured, posing important challenges to water resource management. Traditional methods to estimate precipitation include in-situ gauges, Doppler weather radars, satellite radars and radiometers, numerical modeling and reanalysis products. Each of these methods is unable to adequately capture complex orographic precipitation. Here, we propose a novel approach to characterize orographic snowfall over mountain regions. We use a particle batch smoother to leverage satellite information from Sentinel-1 derived snow depth retrievals and to correct various gridded precipitation products. This novel approach is tested using a simple snow model for an alpine basin located in Trentino Alto Adige, Italy. Here, we quantify the precipitation biases across the basin and found that the assimilation method (i) corrects for snowfall biases and uncertainties, (ii) leads to cumulative snowfall elevation patterns that are consistent across precipitation products, and (iii) results in overall improved basin-wide snow variables (snow depth and snow cover area) and basin streamflow estimates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Molecular Imaging Reveals Two Distinct Mixing States of PM 2.5 Particles Sampled in a Typical Beijing Winter Pollution Case

Mixing states of aerosol particles are crucial for understanding the role of aerosols in influencing air quality and climate. However, a fundamental understanding of the complex mixing states is still lacking because most traditional analysis techniques only reveal bulk chemical and physical properties with limited surface and 3-D information. In this research, 3-D molecular imaging enabled by ToF-SIMS was used to elucidate the mixing states of PM 2.5 samples obtained from a typical Beijing winter haze event. In light pollution cases, a thin organic layer covers separated inorganic particles, while in serious pollution cases, ion exchange and an organic-inorganic mixing surface on large-area particles were observed. Finally, the new results provide key 3-D molecular information of mixing states, which is highly desirable for reducing uncertainty and bias in representing aerosol-cloud interactions in current Earth System Models, and improving the understanding of aerosols on air quality and human health.

3-D molecular imaging↗
DOE OSTI2024

Causally‐Informed Deep Learning to Improve Climate Models and Projections

Abstract Climate models are essential to understand and project climate change, yet long‐standing biases and uncertainties in their projections remain. This is largely associated with the representation of subgrid‐scale processes, particularly clouds and convection. Deep learning can learn these subgrid‐scale processes from computationally expensive storm‐resolving models while retaining many features at a fraction of computational cost. Yet, climate simulations with embedded neural network parameterizations are still challenging and highly depend on the deep learning solution. This is likely associated with spurious non‐physical correlations learned by the neural networks due to the complexity of the physical dynamical system. Here, we show that the combination of causality with deep learning helps removing spurious correlations and optimizing the neural network algorithm. To resolve this, we apply a causal discovery method to unveil causal drivers in the set of input predictors of atmospheric subgrid‐scale processes of a superparameterized climate model in which deep convection is explicitly resolved. The resulting causally‐informed neural networks are coupled to the climate model, hence, replacing the superparameterization and radiation scheme. We show that the climate simulations with causally‐informed neural network parameterizations retain many convection‐related properties and accurately generate the climate of the original high‐resolution climate model, while retaining similar generalization capabilities to unseen climates compared to the non‐causal approach. The combination of causal discovery and deep learning is a new and promising approach that leads to stable and more trustworthy climate simulations and paves the way toward more physically‐based causal deep learning approaches also in other scientific disciplines.

Meteorology & Atmospheric Sciences↗
DOE OSTI2024

An introduction to Spent Nuclear Fuel decay heat for Light Water Reactors: a review from the NEA WPNCS

This paper summarized the efforts performed to understand decay heat estimation from existing spent nuclear fuel (SNF), under the auspices of the Working Party on Nuclear Criticality Safety (WPNCS) of the OECD Nuclear Energy Agency. Needs for precise estimations are related to safety, cost, and optimization of SNF handling, storage, and repository. The physical origins of decay heat (a more correct denomination would be decay power) are then introduced, to identify its main contributors (fission products and actinides) and time-dependent evolution. Due to limited absolute prediction capabilities, experimental information is crucial; measurement facilities and methods are then presented, highlighting both their relevance and our need for maintaining the unique current full-scale facility and developing new ones. The third part of this report is dedicated to the computational aspect of the decay heat estimation: calculation methods, codes, and validation. Different approaches and implementations currently exist for these three aspects, directly impacting our capabilities to predict decay heat and to inform decision-makers. Finally, recommendations from the expert community are proposed, potentially guiding future experimental and computational developments. One of the most important outcomes of this work is the consensus among participants on the need to reduce biases and uncertainties for the estimated SNF decay heat. If it is agreed that uncertainties (being one standard deviation) are on average small (less than a few percent), they still substantially impact various applications when one needs to consider up to three standard deviations, thus covering more than 95% of cases. The second main finding is the need of new decay heat measurements and validation for cases corresponding to more modern fuel characteristics: higher initial enrichment, higher average burnup, as well as shorter and longer cooling time. Similar needs exist for fuel types without public experimental data, such as MOX, VVER, or CANDU fuels. A third outcome is related to SNF assemblies for which no direct validation can be performed, representing the vast majority of cases (due to the large number of SNF assemblies currently stored, or too short or too long cooling periods of interest). A few solutions are possible, depending on the application. For the final repository, systematic measurements of quantities related to decay heat can be performed, such as neutron or gamma emission. This would provide indications of the SNF decay heat at the time of encapsulation. For other applications (short- or long-term cooling), the community would benefit from applying consistent and accepted recommendations on calculation methods, for both decay heat and uncertainties. This would improve the understanding of the results and make comparisons easier.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Convergence acceleration of Monte Carlo many-body perturbation methods by using many control variates

Herein, the use of many control variates is proposed as a method to accelerate the second- and third-order Monte Carlo (MC) many-body perturbation (MC-MP2 and MC-MP3) calculations. A control variate is an exactly integrable function that is strongly correlated or anti-correlated with the target function to be integrated by the MC method. Evaluating both integrals as well as their covariances in the same MC run, one can effect a mutual cancellation of the statistical uncertainties and biases in the MC integrations, thereby accelerating its convergence considerably. Six and thirty-six control variates, whose integrals are known a priori, are generated for MC-MP2 and MC-MP3, respectively, by systematically replacing one or more two-electron-integral vertexes of certain configurations by zero-valued overlap-integral vertexes in their Goldstone diagrams. The variances and co- variances of these control variates are computed at a marginal cost, enhancing the overall efficiency of the MC-MP2 and MC-MP3 calculations by a factor of up to 14 and 20, respectively.

74 ATOMIC AND MOLECULAR PHYSICS↗