Search NASA⌕ Search

SEARCH · Search NASA

Results for “sampling statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

EFFECT OF DISCRETIZATION ERROR ON THE QUANTIFICATION OF MODEL UNCERTAINTY IN TWO-PHASE FLOW SIMULATIONS

Verification, validation and uncertainty quantification (VVUQ) have become a common practice in thermal-hydraulics analysis. In general, these activities deal with propagations of uncertainties in computer code simulations, e.g., through system analysis codes. However, most existing such activities in thermal-hydraulics analysis have been primarily focused on input and model uncertainties, while numerical errors were largely overlooked. Numerical errors can appear in many different forms, e.g., round-off error, statistical sampling error, and discretization error. In thermal-hydraulics analysis, especially two-phase flow simulations commonly encountered in reactor safety analysis, the lack of consideration of discretization error is mainly due to the difficulty in estimating them. Accurate estimations of discretization error require continuous mesh refinement and/or implementation of high-order numerical schemes in system analysis code, both of which are difficult to achieve in existing codes. In this work, we will build a computer code that incorporates both first-order and second-order numerical methods to solve the two-phase flow problems. The first-order method resembles the one used in many existing system analysis codes; and the second-order method works as the reference to estimate numerical errors. Numerical verification of spatial discretization schemes will be presented in the form of mesh convergence study. It will also be demonstrated via case studies that, in practical scenarios, discretization errors can be as large as, or even larger than, model uncertainties.

42 ENGINEERING↗

IAEA Facility-Level Safeguards and Implementation and Advanced Verification Technologies

IAEA Facility-Level Safeguards and Implementation - This presentation is intended to introduce the audience to the application of international safeguards by the International Atomic Energy Agency at nuclear facilities around the world. It covers the State Level Approach, random statistical sampling processes, material balance area structure, non-destructive assay techniques, and inspection areas. Addition of advanced verification technologies for the IAEA

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Advanced Graphite Creep Uncertainty Analysis

Radiation damage estimation is an important component of the post irradiation analysis of the Advanced Graphite Creep (AGC) experiment. It depends primarily on the fast fluence, which is determined using well established methods of spectral adjustment. These are based on best estimates from models such as Monte Carlo N-Particle (MCNP), input cross-sections, and measured activities from flux wires in the experiment. Each of these parameters can propagate uncertainties which will affect the uncertainty in the calculated dose levels for AGC, or any experiment irradiated within a reactor. While the methods of propagating uncertainty are well-established, the final uncertainty estimates they provide are only as good as the estimates of uncertainty in the inputs on which they are based. The purpose of this work is to outline some deficiencies in the ways these input uncertainties are presently estimated, and to outline a methodology by which they can be improved. The fast fluence and radiation damage received by graphite specimens irradiated in the Advanced Graphite Creep (AGC) experiments is presently estimated using spectral adjustment methods that are based on both flux wire activity measurements, and MCNP model predictions. This work describes an ongoing effort to quantify and propagate uncertainties in inputs to the spectral adjustment process, and thereby quantify the resultant error in radiation damage (dpa) estimates. The effort is multi-faceted, and we consider the impacts of both the set of flux wires selected, and the counting process. An expanded set of flux wires is identified that provides a more comprehensive data set on the fast spectrum. To address the counting process itself, a series of round-robin measurements in several reactor metrology laboratories across the Department of Energy (DOE) complex and nuclear industry are being undertaken to refine the American Society for Testing and Materials (ASTM) standards for flux wire measurements. To address the contribution of uncertainty in the MCNP model predictions, an uncertainty quantification (UQ) tool has been developed that statistically samples the model input parameters, runs a series of cases, and assimilates the results to provide an overall uncertainty. The impact of the MCNP UQ tool results is demonstrated by re-analyzing previous AGC flux wire and irradiation data. While the expanded flux wire set obviously cannot be added to these experiments retroactively, plans for future graphite irradiations are outlined.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantitative Phenomena Identification and Ranking Table (QPIRT) for Bayesian uncertainty quantification

Propagating parameter uncertainty for a nuclear reactor system code is a challenging problem due to often non-linear system response to the numerous parameters involved and lengthy computational times; issues that compound when a statistical sampling procedure is adopted, since the code must be run many times. The number of parameters sampled must therefore be limited to as few as possible that still accurately characterize the uncertainty in the system response. A Quantitative Phenomena Identification and Ranking Table (QPIRT) was developed to accomplish this goal. The QPIRT consists of two steps: a 'Top-Down' step focusing on identifying the dominant physical phenomena controlling the system response, and a 'Bottom-Up' step which focuses on determining the correlations from those key physical phenomena that significantly contribute to the response uncertainty. The Top-Down step evaluates phenomena using the governing equations of the system code at nominal parameter values, providing a 'fast' screening step. The Bottom-Up step then analyzes the correlations and models for the phenomena identified from the Top-Down step to find which parameters to sample. The QPIRT, through the Top-Down and Bottom-Up steps thus provides a systematic approach to determining the limited set of physically relevant parameters that influence the uncertainty of the system response. This strategy was demonstrated through an application to the RELAP5-based analysis of a PWR Total Loss of main Feedwater Flow (TLOFW) accident, also known as feed and bleed' scenario, . Ultimately, this work is the first component in a larger task of building a calibrated uncertainty propagation framework. The QPIRT is an essential piece because the uncertainty of those selected parameters will be calibrated to data from both Separate and Integral Effect Tests (SETs and IETs). Therefore the system response uncertainty will incorporate the knowledge gained from the database of past large IETs. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

ComStock: Commercial Building Stock Energy Consumption Dataset

The commercial building sector stock model, or ComStock, is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual subhourly energy consumption of the commercial building stock across the United States.

building↗

The Effects of Different Lattice Codes on Results of Sensitivity and Uncertainty Analysis

According to the UAM ('Uncertainty Analysis in Modeling') benchmark, uncertainties in the LWR system calculations at all stages should be determined and quantified. As the neutronics calculations are prerequisite for the predictions of the reactor system, and the uncertainties introduced by the neutronics calculations would be propagated to the subsequent calculations, hence uncertainty analysis has been firstly focused on the neutronics phase to quantify the uncertainties of the reactor-physics predictions in UAM. For the lattice physics, the objective of uncertainty analysis is focused on uncertainty quantifications of the few-group constants; for the core physics, uncertainties of the core steady-state stand-alone neutronics calculations are focused on. Based on the previous researches, the nuclear-data uncertainty has been treated as one of the most significant source of uncertainty and received the most focus. In the previous works, the domestic code UNICORN has the capability of performing sensitivity analysis and uncertainty analysis using the direct numerical perturbation (DNP) method and statistical sampling (SS) method. In this paper, the capability of the UNICORN code has been improved. The domestic lattice code NECP-CACTI has been added in UNICORN to perform the lattice calculations, with DRAGON5.0 and NECP-CACTI available for lattice calculations. For DRAGON5.0 and NECP-CACTI, all the methods and technologies are shared in UNICORN. Therefore, the effects of different lattice codes on the results of sensitivity and uncertainty analysis have been researched and determined in this paper. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Numerical Uncertainties vs. Model Uncertainties in Two-phase Flow Simulations

In recent years, verification, validation and uncertainty quantification (VVUQ) have become a common practice in thermal-hydraulics analysis. In general, these activities deal with propagations of uncertainties in computer code simulations, e.g., through system analysis codes. However, most existing such activities in thermal-hydraulics analysis have been primarily focused on model uncertainties, while numerical uncertainties were largely overlooked. Numerical uncertainties (or numerical errors) can appear in many different forms, e.g., round-off error, statistical sampling error, and discretization error. As pointed out by Oberkampf and Roy, discretization error is usually the largest however the most difficult type of error to estimate reliably. In thermal-hydraulics analysis, especially two-phase flow simulations commonly encountered in reactor safety analysis, the lack of consideration on discretization error is mainly due to the difficulty in estimating them. Accurate estimations on discretization error require continuous mesh refinement and/or implementation of high-order numerical schemes in system analysis code, both of which are unfortunately difficult to achieve for existing codes. At first, it should be emphasized that mesh refinement (or mesh sensitivity study) is a well-understood concept in the thermal-hydraulics field. However, it is not commonly practiced for many reasons, e.g., lack of understanding on numerical errors by code users, consideration on computational cost, deteriorated numerical stability performance with refined meshes, and etc. Secondly, high-order (e.g., second-order) numerical schemes are simply unavailable in almost any existing system analysis code. Implementation of high-order numerical schemes in these codes is difficult, if not impossible, given the complexity of these codes. On the other hand, people tend to argue that numerical uncertainties (or discretization error as we have emphasized) are not as important as the commonly large uncertainties in two-phase flow models, e.g., closure correlations. As a result, nodalization is sometimes played unintentionally, or maybe intentionally, to match experimental data, which is referred as 'user effects' or 'compensating errors' in thermal-hydraulics community. Such a practice is highly criticized by Levy. In this work, we will at first build a computer code that incorporates both first-order and second-order numerical methods to solve the two-phase flow problems. The first-order method resembles the one used in many existing system analysis codes; and the second-order method works as the reference to estimate numerical errors. Numerical verifications on spatial discretization schemes will be presented in the form of mesh convergence study. It will also be demonstrated that, in practical scenarios, discretization errors can be as large as, or even larger than, model uncertainties via case studies.

42 ENGINEERING↗

Neutron detector response modeling in NOvA

Neutrons can present a significant challenge for neutrino experiments in which energy reconstruction is critical. With the ability to escape detection completely and with a weak correlation between their kinetic energy and any eventual energy deposition, it is difficult to fully account for neutrons produced in neutrino interactions. This in turn leads to significant model dependence when evaluating neutron-related systematic uncertainties. The NOvA experiment is a long-baseline neutrino oscillation experiment with a high-statistics sample of antineutrino data collected by its near detector. We report an excess relative to data of simulated neutron candidates with low energy depositions when using standard Geant4 physics lists. The simulation excess is traced to an overabundance of secondary photons produced from interactions of neutrons with kinetic energy greater than \SI{20}{\mega\eV}. Improved agreement with data is obtained by applying the data-driven neutron-on-carbon \menate model for neutrons between \SI{20}{\mega\eV} and ${\sim}$\SI{100}{\mega\eV}. With \menate, the residual oversimulation is more uniform across the calorimetric neutron energy spectrum, suggesting possible overproduction of primary neutrons by the GENIE neutrino interaction generator. These results motivate the adoption of \menate-supplemented Geant4 simulation as the nominal simulation in the production of future \nova simulation.

Abubakar, S.↗

Multi-Scenario Extreme Weather Simulator

The Multi-scenario Extreme Weather Simulator (MEWS) takes existing historical weather data and inserts trends and extreme events such as heat waves, hurricanes, extreme precipitation, or winter storms. The code includes functionality for projecting increasing frequency and duration of such events over a large range of statistically sampled realizations of the future. These weather files can then be used in building energy simulations through the Energy Plus software created by DOE. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-8658 O

Villa, Daniel↗

(U) Correlated Sampling Using Batch Statistics to Reduce the Uncertainty of Combinations of KSEN Outputs with MCNP6

The relative sensitivity of k eff to the densities of nuclides in a material are combined to compute relative sensitivities to other inputs. When computed in a single Monte Carlo run, the nuclide density sensitivities are correlated, and the statistical uncertainties propagated to other inputs will be incorrect unless those correlations are accounted for. Equations are presented to apply correlated sampling using batch statistics for the sum of an arbitrary number of random tallies and the difference of two random tallies when each is multiplied by a different constant. When correlated sampling is used on a recent benchmark evaluation, the correct statistical uncertainties for certain combinations of sensitivities are dramatically smaller than the incorrect uncertainties. A user-controlled, regular output of MCNP6’s KSEN sensitivities that allows batch statistics to be applied to combinations would be extremely valuable.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evidence of galaxy assembly bias in SDSS DR7 galaxy samples from count statistics

We present observational constraints on the galaxy–halo connection, focusing particularly on galaxy assembly bias from a novel combination of counts-in-cylinders statistics, P(N CIC ), with the standard measurements of the projected two-point correlation function w p (r p ), and number density n gal of galaxies. We measure n gal , w p (r p ), and P(N CIC ) for volume-limited, luminosity-threshold samples of galaxies selected from SDSS DR7, and use them to constrain halo occupation distribution (HOD) models, including a model in which galaxy occupation depends upon a secondary halo property, namely halo concentration. We detect significant positive central assembly bias for the M r < -20.0 and M r <-19.5 samples. Central galaxies preferentially reside within haloes of high concentration at fixed mass. Positive central assembly bias is also favoured in the M r < -20.5 and M r < -19.0 samples. We find no evidence of central assembly bias in the M r < -21.0 sample. We observe only a marginal preference for negative satellite assembly bias in the M r < -20.0 and M r < -19.0 samples, and non-zero satellite assembly bias is not indicated in other samples. Our findings underscore the necessity of accounting for galaxy assembly bias when interpreting galaxy survey data, and demonstrate the potential of count statistics in extracting information from the spatial distribution of galaxies, which could be applied to both galaxy–halo connection studies and cosmological analyses.

79 ASTRONOMY AND ASTROPHYSICS↗

Closeout report for statistics for environmental sampling

This Project Closure Report is the final project document required to complete the project record and to close the project in the office’s web-based project management system. This report is for use by senior management to assess major project outcomes and their impact, identify best practices and other useful insights for future projects, and identify any open issues meriting attention. In accordance with DOE Order 243.1B, Records Management Program, this report will be managed in accordance with all prescribed laws, regulations, directives, and processes to ensure adequate and proper documentation of DOE’s organizations, missions, functions, policies, and decisions (See 44 U.S.C., Chapters 21, 29, 31, 33, and 35; 36 CFR Subchapter B, Records Management, and all applicable National Archives and Records Administration (NARA) mandated guidance.

97 MATHEMATICS AND COMPUTING↗

Uniform Beam Simulation Technique for Beam Scans and Machine Learning Studies at Fermilab

Fermilab's neutrino facilities, including NuMI and the upcoming LBNF, use proton beams to produce positively and negatively charged pions and kaons. Detailed simulations are necessary to study particle interactions and beam propagation. To efficiently analyze beam scan effects, we propose a technique to generate multiple simulation samples with high statistics. These samples can be used to develop beamline simulation based machine learning applications. In this technique, we generate a uniformly distributed single simulation data sample. We calculate Gaussian weights for each beam configurations and apply them to post-processing measurements. In this poster, we demonstrate the proposed simulation technique. This technique reduces simulation time and computing resources significantly.

Wickremasinghe, Athula↗

Multifidelity importance sampling

Estimating statistics of model outputs with the Monte Carlo method usually requires a large number of model evaluations. This leads to long runtimes if the model is expensive to evaluate. Importance sampling is one method that can lead to a reduction in the number of model evaluations. Importance sampling uses a biasing distribution to sample the model more efficiently, but generating such a biasing distribution can be difficult and usually also requires model evaluations. A different strategy to speed up Monte Carlo sampling is to replace the computationally expensive high-fidelity model with a computationally cheap surrogate model; however, because the surrogate model outputs are only approximations of the high-fidelity model outputs, the estimate obtained using a surrogate model is in general biased with respect to the estimate obtained using the high-fidelity model. We introduce a multifidelity importance sampling (MFIS) method, which combines evaluations of both the high-fidelity and a surrogate model. It uses a surrogate model to facilitate the construction of the biasing distribution, but relies on a small number of evaluations of the high-fidelity model to derive an unbiased estimate of the statistics of interest. We prove that the MFIS estimate is unbiased even in the absence of accuracy guarantees on the surrogate model itself. The MFIS method can be used with any type of surrogate model, such as projection-based reduced-order models and data-fit models. Moreover, the MFIS method is applicable to black-box models, i.e., where only inputs and the corresponding outputs of the high-fidelity and the surrogate model are available but not the details of the models themselves. We demonstrate on nonlinear and time-dependent problems that our MFIS method achieves speedups of up to several orders of magnitude compared to Monte Carlo with importance sampling that uses the high-fidelity model only.

42 ENGINEERING↗

Polarized Photocathodes development for the EIC: Optimizing Spin and Quantum Efficiency

GaAs/GaAsP superlattice photocathodes play a critical role for producing highly polarized electron beams for the Electron-Ion Collider (EIC) at Brookhaven National Laboratory. The electron pre-injector for the EIC requires electron bunches with high bunch charge (1-2 nC) and high polarization, from GaAs-based superlattice photocathode. Herein, we have systematically investigated a range of GaAs/GaAsP superlattice photocathodes fabricated via molecular beam epitaxy (MBE) and metal-organic chemical vapor deposition (MOCVD). Through optimization of pre-cleaning procedures and surface doping conditions, we aim to identify the most promising photocathode configurations for future EIC operations. To enhance the quantum efficiency (QE), a Distributed Bragg Reflector structure is frequently incorporated beneath the superlattice. While this approach effectively increases QE, it also introduces additional complexities that can adversely influence spin polarization and the spectral response at specific laser wavelengths. This note provides an overview of superlattice GaAs development and outlines the EIC team’s ongoing efforts to address related challenges and advance high-performance photocathode development tailored for the EIC. Over five years of multi-institutional collaboration and measurements of about 50 SL-GaAs samples, our analysis presents statistics on samples exhibiting high ESP and high QE. It will help to set the initial ESP requirements for the EIC project.

43 PARTICLE ACCELERATORS↗

Improving statistical precision in Monte Carlo samples with negative weights via reweighting and uncertainty quantification

High statistical precision is critical for Monte Carlo (MC) samples in high energy physics and is degraded by negatively weighted events. This paper investigates a procedure to learn the relationship between the negative and positive weight distributions of any sample, allowing the reduction of statistical uncertainty by reweighting kinematically equivalent events with the same sign. A robust uncertainty quantification method is required for the practical application of such method. Two methods for the estimation of the reweighting uncertainty are developed: one at the event and another one at the final observable level. The latter method is strongly favored. The gains in statistical precision are then quantified. The method is demonstrated on Sherpa vector boson plus jets samples when using all generated events and when restricted to the signal region of a mock analysis. It is demonstrated to significantly reduce stochastic behavior in sparse MC samples while decreasing the overall uncertainty with a sufficiently well-known reweighting function.

Monte Carlo methods↗

Collective mode Brownian dynamics: A method for fast relaxation of statistical ensembles

Sampling equilibrium configurations of correlated systems of particles with long relaxation times (e.g., polymeric solutions) using conventional molecular dynamics and Monte Carlo methods can be challenging. This is especially true for systems with complicated, extended bond network topologies and other interactions that make the use and design of specialized relaxation protocols infeasible. We introduce a method based on Brownian dynamics simulations that can reduce the computational time it takes to reach equilibrium and draw decorrelated samples. Importantly, the method is completely agnostic to the particle configuration and the specifics of interparticle forces. In particular, we develop a mobility matrix that excites non-local, collective motion of N particles and can be computed efficiently in $\mathcal{O}(N)$ time. Particle motion in this scheme is computed by integrating the overdamped Langevin equation with an Euler–Maruyama scheme, in which Brownian displacements are drawn efficiently using a low-rank representation of the mobility matrix in position and wave space. We demonstrate the efficacy of the method with various examples from the realm of soft condensed matter and release a massively parallel implementation of the code as a plugin for the open-source package HOOMD-blue [J. A. Anderson et al., J. Comput. Phys. 227, 5342 (2008) and J. Glaser et al., Comput. Phys. Commun. 192, 97 (2015)] which runs on graphics processing units

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗