Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Spectrophotometers for plutonium monitoring in HB-line

This report describes the equipment, control software, calibrations for total plutonium and plutonium oxidation state, and qualification studies for the instrument. It also provides a detailed description of the uncertainty analysis, which includes source terms associated with plutonium calibration standards, instrument drift, and inter-instrument variability. Also included are work instructions for instrument, flow cell, and optical fiber setup, work instructions for routine maintenance, and drawings and schematic diagrams.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Enhancements to the TOUGH2 Simulator as Implemented in iTOUGH2

iTOUGH2 is a program for parameter estimation, sensitivity analysis, and uncertainty propagation analysis. It is based on the TOUGH2 simulator for non-isothermal multiphase, multicomponent flow and transport in fractured and porous media [Pruess, 1987, 1991, 2005, 2011; Falta et al., 1995; Pruess et al., 1999, 2002, 2012; Doughty, 2013]. The core of iTOUGH2 contains slightly modified versions of TOUGH2 modules. Most code modifications are editorial and do not affect the simulation results. As a result, standard TOUGH2 input files can be used in iTOUGH2, and identical results are obtained if iTOUGH2 is run in forward mode. However, a number of modifications have been made as described in this report. They enhance the functionality, flexibilitu, and eas-of-use of the forward simulator. This report complements the reports iTOUGH2 User's Guide, iTOUGH2 Command Referecne, and the collection of tutorial examples in iTOUGH2 Sample Problems.

54 ENVIRONMENTAL SCIENCES↗

Reduced-Order Model for Leakage Through an Open Wellbore from the Reservoir due to Carbon Dioxide Injection

Potential CO 2 leakage through existing open wellbores is one of the most significant hazards that need to be addressed in geologic carbon sequestration (GCS) projects. In the framework of the National Risk Assessment Partnership (NRAP) which requires fast computations for uncertainty analysis, rigorous simulation of the coupled wellbore-reservoir system is not practical. We have developed a 7,200-point look-up table reduced-order model (ROM) for estimating the potential leakage rate up open wellbores in response to CO 2 injection nearby. The ROM is based on coupled simulations using T2Well/ECO2H which was run repeatedly for representative conditions relevant to NRAP to create a look-up table response-surface ROM. The ROM applies to a wellbore that fully penetrates a 20-m thick reservoir that is used for CO 2 storage. The radially symmetric reservoir is assumed to have initially uniform pressure, temperature, gas saturation, and brine salinity, and it is assumed these conditions are held constant at the far-field boundary (100 m away from the wellbore). In such a system, the leakage can quickly reach quasi-steady state. The ROM table can be used to estimate both the free-phase CO 2 and brine leakage rates through an open well as a function of wellbore and reservoir conditions. Results show that injection-induced pressure and reservoir gas saturation play important roles in controlling leakage. Caution must be used in the application of this ROM because well leakage is formally transient and the ROM lookup table was populated using quasi-steady simulation output after 1000 time steps which may correspond to different physical times for the various parameter combinations of the coupled wellbore-reservoir system.

54 ENVIRONMENTAL SCIENCES↗

Criticality Safety Validation of SCALE 6.2.2

The computational bias of criticality safety computer codes must be established through the validation of the codes to critical experiments. A large collection of suitable experiments has been vetted by the International Criticality Safety Benchmark Evaluation Project (ICSBEP) and made available in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook). More than 600 cases from this handbook ha ve been prepared and reviewed within the Verified, Archived Library of Inputs and Data (VALID) , which is maintained by the Reactor and Nuclear Systems Division at Oak Ridge National Laboratory. The performance of the KENO V.a and KENO-VI Monte Carlo codes within the SCALE 6.2.2 code system is assessed using the VALID models of benchmark experiments. A range of nuclear cross section libraries based on both ENDF/B-VII.1 and ENDF/B-VII.0 in both multigroup (MG) and continuous energy (CE) formats is considered. The TSUNAMI tools for sensitivity and uncertainty analysis are used to examine some systems further to try to identify potential causes of unexpected results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Connecting AmeriFlux to the Globe, Extending the Partnership with Global Flux Network FLUXNET

We propose a project that will extend and expand the activities and contributions of AmeriFlux, to the global stage by working with our international partners to continue operating and expand the functioning of global FLUXNET database. One goal is to produce the next-generation FLUXNET dataset. This will be an integrated dataset on carbon, water and energy fluxes, on meteorological conditions and on the structure and function of the ecosystems; we have to potential to construct a new database, double the size of the La Thuile dataset, with over 2000 site-years of trace gas flux measurements, and supporting meteorological and site meta-data from over 400 sites world-wide. The production of the next FLUXNET database is critical to the activities of this ROSE’s solicitation because these data will drive many of the carbon cycle synthesis activities and the model parameterization and validation activities. A second goal is to build the next-generation, data-system that will house, distribute and query data and discover new information by the broader biogeoscience user community. The third goal is to use these data in synthesis activities that improve our understanding on how climate, weather, ecological, physiological and soil factors govern the exchange of carbon, water and energy between vegetation and the atmosphere at multiple time and space scales. The fourth goal is to act as a coordinator of the project to recruit data, to organize a workshop/conference and to build a community of data sharing and interaction across vast cultural spectrum of participating scientists. The rationale for proposing this work is based on the fact that the vast databases that are produced by flux networks cannot perpetuate and evolve without continued support of the intellectual activities of scientists who produce data, expert in databases, and scientists who use data for modeling. The actuality of a flux network takes human intervention to recruit data from different countries and cultures, to build trust to share data in open-access format, to support data users, and to collaborate. Specifically, we will develop an updated data portal that is easy to navigate and conducive for distributing, visualization, evaluation and discovery of the multiple types of flux and environmental data and information. We will foster collaboration and interactions with our national and international partners and the recruitment of data by: 1) continuing the periodic publication of the newsletter, FLUXLETTER; 2) by hosting an international conference; 3) by coordinating and launching multi-investigator data synthesis activities; and 4) by developing tools that coordinate the development of research papers resulting from the dataset. Data products include raw and gap-filled data at their native time steps (30 minute averages), data products that are integrated on daily and annual time scales and value added products like ecosystem respiration and canopy photosynthesis. Uncertainty analysis and quality control metrics will be produced in coordination with AmeriFlux and ICOS. We will also work with colleagues to expand the scope of FLUXNET beyond carbon dioxide and water vapor, and start archiving the growing methane flux databases that are being collected, world-wide. The interpretation of the flux data relies on good meta-data. We will work with data providers to populate and expand the meta-data archives. We will also work with collaborators to incorporate data from remote sensing products such as MODIS and Landsat, from corresponding climate and weather stations. Another goal is to incorporate new data on canopy structure, with recent LIDAR acquisitions, to populate the data archive with automated soil respiration and understory flux measurements, where available and local climate records for corresponding sites. And, we will collaborate with the TRY database, by merging flux data with plant trait information.

54 ENVIRONMENTAL SCIENCES↗

Toward Uncertainty Quantification for Supervised Classification

Our goal is to develop a general theoretical basis for quantifying uncertainty in supervised machine learning models. Current machine learning accuracy-based validation metrics indicate how well a classifier performs on a given data set as a whole. However, these metrics do not tell us a model's efficacy in predicting particular samples. We quantify uncertainty by constructing probability distributions of the predictions made by an ensemble of classifiers. This report details our initial investigations into uncertainty quantification for supervised machine learning. We apply an uncertainty analysis to the problem of malicious website detection. Machine learning models can be trained to find suspicious characteristics in the text of a website's Uniform Resource Locator (URL). However, given the vast numbers of URLs and the ever changing tactics of malicious actors, it will always be possible to find sets of websites which are outliers with respect to a model's hypothesis. Therefore, we seek to understand a model's per-sample reliability when classifying URL data. Acknowledgements This work was funded by the Sandia National Laboratories Laboratory Directed Research and Development (LDRD) program.

97 MATHEMATICS AND COMPUTING↗

Status of the NEAMS and ARC neutronic fast reactor tools integration to the NEAMS Workbench

The Workbench initiative was launched in FY-2017 within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) Integration Product Line to facilitate the transition from conventional tools to high-fidelity tools. The Workbench provides a common user interface for model creation, real-time validation, execution, output processing, and visualization for integrated codes. The integration of the Argonne Reactor Computation (ARC) suite of codes into the NEAMS Workbench was initiated in FY-2017. The ARC codes contain both legacy codes like DIF3D and REBUS-3 that were developed with over 30 years of experience, and newer NEAMS additions like MC2-3, PERSENT and PROTEUS. The ARC integration into the NEAMS Workbench interface relies on the PyARC module which handles the pre- and post-processing of the native ARC codes input, and the runtime environment. The PyARC module together with the NEAMS Workbench interface are both released under Open Source Software licenses. In FY-2019, the effort focused on integrating the explicit assembly management logic of REBUS, the GAMSOR code for gamma heating transport, and of the NODAL solver of PROTEUS. Additional capabilities were also integrated in response to user requests, such as the assembly power peaking calculation and a 2D result plotting capability. For verification and demonstration purposes, the ARC codes were used through the Workbench for solving the Sodium-cooled Fast Reactor Uncertainty Analysis in Modelling (SFR-UAM) benchmark problems, including the newly proposed unit cells and ASTRID problem. Significant effort in FY-2019 focused on training new users from ANL, INL, NCSU, and Westinghouse. In particular, extensive training material was developed in the form of tutorials, including documentation, sample inputs, and associated presentations. The ARC codes are now actively used through the NEAMS Workbench by nuclear engineers at ANL, INL, NCSU, and Westinghouse, for LFR, MSR, micro-reactor, and SFR core design analyses. Future efforts will focus on adding new and existing modeling capabilities available with the ARC and NEAMS codes, training new users and supporting them to continue building user experience.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Essential Statistical Concepts

Statistical methods are an essential element to making quality measurements, allowing the organization and interrogation of data in a structured way. This introductory chapter describes key concepts of measurement statistics that are used in many nondestructive assay (NDA) methods and is intended as a primer to the reading list provided in the reference section. (Croft and Burr 2016; Smith 1991; Smith 2013; Taylor 1997; Triola 2017). The textbooks by Triola on elementary statistics (Figure 1), Taylor, and Smith (2013) introduce uncertainty analysis in the physical sciences. Smith (1991) provides a rigorous introduction with examples to correlated variables. These texts collectively offer an excellent foundation for understanding essential statistical concepts.

97 MATHEMATICS AND COMPUTING↗

Gemma V&V/UQ/Credibility Activities: FY2020 Progress

This report describes the credibility activities undertaken in support of Gemma code development in FY20, which include Verification & Validation (V&V), Uncertainty Quantification (UQ), and Credibility process application. The main goal of these activities is to establish capabilities and process frameworks that can be more broadly applied to new and more advanced problems as the Gemma code development effort matures. This will provide Gemma developers and analysts with the tools needed to generate credibility evidence in support of Gemma predictions for future use cases. The FY20 Gemma V&V/UQ/Credibility activities described in this report include experimental uncertainty analysis, the development and use of methods for optimal design of computer experiments, and the development of a framework for validation. These initial activities supported the development of broader credibility planning for Gemma that continued into FY21.

97 MATHEMATICS AND COMPUTING↗

Geologic Modeling and Simulation Report for the Aquistore Project

In this update, a regional-scale model extends beyond the 34-square-kilometer PTRC 3-D seismic survey area. A local grid refinement (LGR) system near both the injection and observation wells was introduced for the history-matching and uncertainty analysis. Spinner log survey and pressure test data provided by partners were used and evaluated to adjust the nearwellbore local permeability in order to history-match the field pressure data. As of January 9, 2016, approximately 24,000 tonnes of CO 2 has been injected during a series of relatively short operating periods. However, the injection rate during these short operating periods increased near the end of year 2015 to a level of 300 to 500 tonnes per day, based on the quantity of CO 2 made available from the pipeline.

54 ENVIRONMENTAL SCIENCES↗

Update of CEA DES Criticality-Safety Activities and Perspectives [Slides]

Neutronics staff at CEA DES are in charge of a whole set of modeling and simulation tools for neutronics: nuclear data evaluation and processing, transport codes development, calculation sequences edition, verification, validation and uncertainty analysis. Advanced user groups are in charge of specific nuclear analysis in reactor physics, fuel cycle, criticality-safety, radiation shielding and nuclear instrumentation for CEA and its partners, at all stages of nuclear facilities life cycle. CEA is willing to participate/collaborate on the following issues: detector design, experiments, analysis and evaluation, DH validation by combining TAGS measurements with Fission Yield variance-covariance matrices.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Validation of Nuclear Data Sensitivity Calculations by the MCNP PERT Card [Poster]

This work validates a method of estimating sensitivities that utilized the MCNP PERT card and tallies. The agreement of the PERT card and Brute Force results proves the validity of calculating nuclear data sensitivities by use of the MCNP PERT card, especially at higher energies. The overall agreement will be easier to understand once an uncertainty analysis is completed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Approach to Analyzing VTR Core Performance Sensitivities to Fuel Manufacturing Uncertainties and Application to Fuel Slug Diameter

This report documents the initial effort to characterize sensitivity of VTR core performance to fuel manufacturing uncertainties. The effects of variation in the as-fabricated fuel slug diameter on VTR neutronics performance are evaluated, using both high-fidelity Monte Carlo (OpenMC) and the main core design solver (DIF3D) for all cases. This work and follow-on work will inform the VTR Project’s fuel manufacturing processes and associated acceptable criteria, as well as detailed uncertainty analysis in later stages of VTR development and deployment. In addition, this work demonstrates the approach to performing such evaluations and provides a basis for reducing the scope of calculations in future sensitivity analysis.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Joint LLNL, LANL, SNL, and IRSN High Multiplication Subcritical (Multiplicity) Benchmark Experiments Execution Plan (IER-518 CED-3a)

As part of the experiment design and planning, the critical experiment design team (CEDT), as well as additional stakeholders, convened a series of meetings to discuss the goals and requirements of execution for this experiment. The slides from these meetings are attached in Appendix A. The following sections summarize the outcome of those discussions and present the planned experimental configurations and measurements. The stated goals of this experiment are as follows: 1) Measure time-tagged list-mode data for configurations exceeding neutron multiplication of 100; 2) Provide intercomparison between LLNL, LANL, and IRSN detector systems and methodologies; 3) Generate experiment execution report(s) useful to a fundamental physics benchmark for the ICSBEP; 4) Leverage existing critical experiment and detector system benchmarks to limit required modeling and uncertainty analysis.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Conversion of METL Diagnostic Flowmeters to Permanent Magnet Based Electromagnetic Flowmeters

The Mechanisms Engineering Test Loop (METL) uses three flowmeters to monitor sodium circulation through the main loop, the Cold Trap leg, and the Plugging Meter leg. When constructed, the Cold Trap flowmeter (CTFM) and Plugging Meter flowmeter (PMFM) were equipped with permanent magnets and Hall Sensors. By October of 2019, during normal operations, both the CTFM and PMFM failed, producing either erroneous or zero signals. Repairs to the flowmeters were attempted in January of 2020 but failed to resolve the issues. Therefore, starting in March of 2021, a plan was developed to convert the installed flowmeters to more robust permanent magnet based electromagnetic flowmeters (EMFMs). The Cold Trap EMFM (CT EMFM) and Plugging Meter EMFM (PM EMFM) were fully installed by August of 2021. Initial testing and commissioning were completed in November of 2021. Finally, the first calibration runs were finished in March of 2022. This report discusses the design, conversion, and calibration of the as-built CTFM and PMFM to robust permanent magnet based EMFMs. During the design phase, theoretical models were used to estimate the signal output and required magnet sizes. Then, the CTFM and PMFM were disassembled and converted to EMFMs. After commissioning, the CT EMFM and PM EMFM were calibrated using a ‘Time Transfer Procedure’ carried out with METL Expansion Vessels and Test Vessel Two. The accuracy of the calibration was estimated through an uncertainty analysis. Finally, the report describes some lessons learned for future flowmeter conversions and follow-up work. In total, both METL EMFM’s met the desired performance targets. Testing data showed that the METL EMFMs provide a output signal of roughly 2 mV at 1 GPM and 250 °C. During calibration, flowrates between 0.7 GPM and 2.4 GPM were achieved. In this flow range, calibration coefficients of 0.485 and 0.935 were measured as with errors ranging from 15-5% and 16-5% for the CT EMFM and PM EMFM, respectively. Above 1.5 GPM, the error was assumed to be about 5% for both METL EMFMs. Several points will be considered for future follow-up work on the METL EMFM’s. First, the signal noise issues in the PM EMFM will be addressed. It is likely the source of the noise is due to some stray EMF from a heater. Secondly, the NdFeB magnets will be replaced with a grade that has a Curie temperature above 80 °C. For example, a few grades of NeFeB magnets have Curie temperatures which exceed 150 °C and some SmCo magnets have Curie temperatures as high as 500 °C. Third, more calibration runs will be completed in the range of 0.5-2.5 GPM. This will further improve the accuracy of the calibration coefficient. Fourth, calibration runs will be completed up to 5 GPM. This requires a larger pressure relief valve to be installed on the Expansion Vessel and Test Vessel 2, as well as a revised calibration procedure. Lastly, calibration runs will be completed to account for cold spots in the system, which reduced the inlet temperature of the METL EMFMs. Overall, these points will improve the calibration coefficients derived in this work and also improve the performance of the METL EMFMs.

42 ENGINEERING↗

LLNL IPD Tasks: ICSBEP and Pulsed Spheres Benchmark [Slides]

This lecture presented benchmark of the blank and polyethylene spheres at SINBAD in April 2023. In responding to comments about the building, we uncovered a large amount of additional detailed information about the building and experimental set up. We incorporated this new information into an even higher fidelity model and are working on uncertainty analysis at a low level. Scheduled to present at SINBAD meeting in April 2024.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Samoa Updater: An Application of the Levenberg-Marquardt Method to Update DELFIC Predictions Using Field Measurements

The US Department of Energy (DOE) Forensics Operations (DFO) is a member of the Ground Collections Task Force (GCTF), which is responsible for sample collection of radiological debris for attribution should a nuclear detonation ever occur in the United States. The DFO runs the Defense Land Fallout Interpretive Code (DELFIC) Fallout Planning Tool to predict the deposition of fallout from a nuclear detonation. This prediction is refined using the DELFIC Updater tool, which takes ground measurements and adjusts DELFIC inputs to minimize the difference between prediction and observation, yielding improved predictions of fallout in locations both measured and not yet measured. Samoa, a framework for uncertainty analysis and optimization, is used to improve DELFIC predictive fallout modeling. This new capability using Samoa, dubbed “Samoa Updater,” is compared with the current DELFIC Updater, a brute-force sampling approach. Samoa Updater uses the Levenberg– Marquardt (LM) method, a gradient-based nonlinear least squares approach that uses the functional shape of the input space to increase optimization speed. In simulated test cases Samoa Updater yields faster and more accurate solutions than the current Updater.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗