Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification & Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Implementation of a Drift Flux Model into SAM with Development of a Verification and Validation Test Suite for Modeling of Noncondensable Gas Mixtures

The advanced thermal-hydraulic system code, System Analysis Module (SAM), was originally developed for the modeling of single-phase flow in advanced reactors. It has since been expanded to include a four-equation drift flux model for the modeling of two-phase flows containing a noncondensable gas. The model was expanded to support the modeling of molten salt reactor (MSR) designs in which the fuel is directly dissolved in the circulating coolant. These designs have shown that circulating gas bubbles can play an important role in the management of fission products and the operational behavior of the reactor. A drift flux model was implemented to more accurately capture the localized behavior of the void in the core and its impact on the mass transfer of fission products. A thorough assessment of the new model was performed by developing a verification and validation test suite. Verification problems were designed to test all major terms in the new governing equations. The new model converged to the correct solution at the expected order of accuracy for all verification cases. The validation cases included a wide range of flow and void conditions in different pipe geometries. Although higher void experiments show a slight underprediction of void by the drift flux model, experiments that aim to reproduce Molten Salt Reactor Experiment (MSRE) experimental conditions show good agreement with the model. The gas transport model was activated for a SAM model of the MSRE to demonstrate that it can be used in a more complex model. Finally, this gas transport model will be used along with an interfacial area transport equation being implemented in SAM for the prediction of mass transport behavior in MSR conditions.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and Validation of a Modified Numerical Algorithm for Simulation of Transient Unconfined Groundwater Flow

This report extends verification and validation testing of the NUFT package of codes (Nitao 2000a,b) to the US1P module of code designed for simulation of single-phase mixed or “coupled” saturated and unsaturated (or “variably saturated”) groundwater flow. Importantly, the verification and validation testing of US1P in this report includes performance evaluation of a modified numerical algorithm that was not included in prior quality assurance (QA) of the NUFT package by Carle et al. (2014) for Underground Test Area (UGTA) project activities, which are directed at assessment of radionuclide contamination in groundwater sourced from underground nuclear test locations at the Nevada National Security Site (NNSS). An immediate purpose of this report is to provide QA for ongoing large-scale, three-dimensional (3-D) groundwater flow modeling of transient water levels associated with longterm water supply pumping and underground nuclear testing at the NNSS (Jackson and Fenelon, 2018; Jackson et al., 2021). For UGTA activities, the QA refers to the standards of ASTM (1996) for verification and validation testing of groundwater modeling codes.

54 ENVIRONMENTAL SCIENCES↗

Summary Report Of The FY25 Reactor Physics Verification And Validation Exercises In The Advanced Reactor Technologies - Gas-cooled Reactor Program

Valdiation and verification of numerical tools is critical for ensuring reasonable predictions for design scoping, licensing, and safety analsyis. In this report, two reactor physics verification and validation exercises are presented. The first of these exercises focuses on burnup analysis with data from the Advanced Gas Reactor (AGR) program. Simulations are performed with Monte Carlo N-Particle (MCNP) and are compared with the experimental measurements for the AGR 1 and 2 experiments that utilize both UCO and UO2 fuel. The second exercises utilizes data from the HTR-Proteus experiments to perform reactor physics validation. Specifications of the experimental facility are provdied, along with a demonstration of initial modeling efforts in Serpent for one of the determistic packing experiments. Both cases are part of the Generation-IV international forum (GIF) Very High-Temperature Reactor (VHTR) Computational Methods, Validation, and Benchmarking (CMVB) program, an international collaborative organization dedicated to the verification and validation of High-Temperature Gas-Cooled Reactor (HTGR) analysis. Participation in the CMVB allows the US Department of Energy (DOE) to leverage these existing validation activities to provide extra value through benchmarking activities with other CMVB members.

and Benchmarking (CMVB) program↗

White paper on Verification and Validation for Cyber Emulation Models

All disciplines that use models to predict the behavior of real-world systems need to determine the accuracy of the models’ results. Techniques for verification, validation, and uncertainty quantification (VVUQ) focus on improving the credibility of computational models and assessing their predictive capability. VVUQ emphasizes rigorous evaluation of models and how they are applied to improve understanding of model limitations and quantify the accuracy of model predictions.

97 MATHEMATICS AND COMPUTING↗

Verification and Validation Activities of Molten Salt Reactors Multiphysics Coupling Schemes at Idaho National Laboratory

This paper presents the latest verification and validation activities in molten salt reactor modeling and simulation performed at Idaho National Laboratory. Multiphysics solutions are obtained by coupling the neutronics code Griffin, the thermal hydraulics code Pronghorn, and the system analysis code SAM, under the MOOSE framework. We present various multiphysics coupling schemes with these codes for molten salt reactor problems and provide verification and validation results. First, we present verification test results of the Griffin-Pronghorn coupled scheme for the CNRS benchmark. Then validation test results are presented for the Griffin-SAM coupled scheme for the pump startup and coast down transients of the Molten Salt Reactor Experiment. Finally, the Griffin-Pronghorn-SAM coupled scheme is demonstrated for the Molten Salt Reactor Experiment reactivity insertion transient using a domain-overlapping coupling algorithm between Pronghorn and SAM. The results of these various coupling schemes demonstrate the ability to capture the effect of fuel flow and the various feedback mechanisms important to MSRs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.0 code which has been developed to perform the steady-state thermal hydraulic safety calculation of the MIT Research Reactor required upon conversion of the reactor from high enrichment uranium fuel to low enrichment uranium fuel. The key capabilites of the code including the statistical processing, water property generation, and thermal hydraulic solution are verified independently. While the first two capabilites are checked using statistical tests and NIST data tables, each component of the thermal hydraulic solution is verified using simple geometry test problems. The comparison between results obtained by the code and hand calculations on these problems shows that each of these components work correctly. Additionally, a comprehensive comparison between STAT7 Version 1.0 and PLTEMP/ANL Version 4.2 calculations for a five-channel test problem is performed for the validation. The good agreement between the obtained results for all thermal hydraulic parameters belonging to the fuel core region is achieved. An issue in bypass flowrate calculation was detected when both fin-friction and bypass flow claculations are involved. This problem can be corrected in a later version of the code, however, does not affect the application of STAT7 code as it has been used to date where the flow distribution in the core region and bypass channel is specified as an input parameter.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.0 code which has been developed to perform the steady-state thermal hydraulic safety calculation of the MIT Research Reactor required upon conversion of the reactor from highly enriched uranium fuel to low- enriched uranium fuel. The key capabilities of the code including the statistical processing, water property generation, and thermal hydraulic solution are verified independently. While the first two capabilities are checked using statistical tests and NIST data tables, each component of the thermal hydraulic solution is verified using simple geometry test problems. The comparison between results obtained by the code and hand calculations on these problems shows that each of these components work correctly. Additionally, a comprehensive comparison between STAT7 Version 1.0 and PLTEMP/ANL Version 4.2 calculations for a five-channel test problem is performed for the validation. The good agreement between the obtained results for all thermal hydraulic parameters belonging to the fuel core region is achieved. An issue in bypass flowrate calculation was detected when both fin-friction and bypass flow calculations are involved. This problem can be corrected in a later version of the code. However, it does not affect the application of STAT7 as it has been used to date where the flow distribution in the core region and bypass channel is specified as an input parameter.

97 MATHEMATICS AND COMPUTING↗

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.1 code, which has been developed to perform the steady-state thermal hydraulics (TH) safety calculations required to support conversion of the Massachusetts Institute of Technology Research Reactor from highly enriched uranium fuel to low- enriched uranium fuel. The key capabilities of the code, including statistical processing, water property generation, and TH solution, are verified independently. While the first two capabilities are checked using statistical tests and NIST data tables, each component of the TH solution is verified using simple geometry test problems. The comparison between results obtained by the code and by hand calculations on these problems shows that each of these components works correctly. Additionally, a comprehensive comparison between STAT7 Version 1.1 and PLTEMP/ANL Version 4.3 Revision 162 calculations is performed for the validation. Good agreement is achieved between the results obtained with the two codes for all TH parameters belonging to the fuel core region.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and Validation of the PLTEMP/ANL Code for Thermal-Hydraulic Analysis of Experimental and Test Reactors

The document compiles in a single volume the verification and validation works done for the PLTEMP/ANL code during the years of its development and improvement. The verification of sixteen capabilities of the PLTEMP/ANL Version 4.3 code that were identified by research reactor analysts as frequently used in their thermal-hydraulic analysis are described and documented. Each chapter of the document deals with the verification or validation of a specific model. The model verification is usually done by comparing the code with hand calculation, Microsoft spreadsheet calculation, or Mathematica calculation. The model validation is done by comparing the code with experimental data or a widely tested code like the RELAP5 code. In addition, some PLTEMP/ANL verification works that are available in the open literature are simply referenced and not included in the document. PLTEMP/ANL has been used in conversion safety analysis reports of several US and foreign research reactors that have been licensed and converted. A list of such reactors is given.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Bison Verification and Validation Activities for TRISO

Numerical modeling and simulation (M&S) tools play a key role in the research, development, and overall safety assessments of next-generation nuclear energy systems. One such tool, Bison, is a nuclear fuel performance code that is applicable to many fuel forms (e.g., light-water reactor fuel, oxide and metallic fuel for fast reactors, tri-structural isotropic (TRISO) fuel, and plate fuel), and it uses the finite element method to model the thermo- mechanical response of nuclear fuels. One fuel form widely utilized in Generation-IV high-temperature gas-cooled and fluoride- salt-cooled nuclear reactor concepts is TRISO fuel. Recently, Bison’s capabilities were significantly expanded to enable it to model the performance of TRISO particles and compacts. It is important that Bison’s computational results be reliable and predictive, since this code is used to inform high-consequence decisions. The various processes developed to address this issue generally entail two fundamental steps: verification and validation (V&V). Verification ensures that the code functions correctly and is reliable. Code/solution verification, code benchmark, and software quality assurance exercises are examples of verification activities. On the other hand, validation is the process of assessing a code’s capability to accurately model physical problems. Comparisons between code results and experiments quantify the validation level. Application of V&V procedures is crucial to the development of computational tools that are free of coding mistakes and can accurately represent reality. The current study presents an overview of Bison V&V activities relevant to the TRISO fuel concept, which include code/solution verification exercises, CRP-6 Benchmark—a Coordinated Research Program through the International Atomic Energy Agency (IAEA)—exercises, and validation exercises with the Advanced Gas Reactor (AGR)- 1/2/3/4 experiment series.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification and Validation of Open-Source Computational Fluid Dynamics Capabilities in MOOSE

The Multiphysics Object Oriented Simulation Environment (MOOSE) advances predictive modeling in nuclear research by simplifying the application design process and making modeling more efficient and accessible to researchers and the broader community. Because of MOOSE’s critical role in the scientific computation field, verification and validation are important to evaluate the reliability and credibility of MOOSE’s code, simulations, and models. To assess MOOSE’s Navier Stokes module and turbulence models, the following verification and validation University of Manchester ERCOFTAC cases were simulated in MOOSE, and the results were compared: Case 032 Turbulent Flow in a 2D Channel Case 079 Natural Convection in an Enclosed Cavity

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Verification and validation of developed short-term forecasting models

Recent advancements in machine learning (ML) and artificial intelligence (AI) technologies provide an opportunity for leveraging data-driven algorithms to predict future nuclear power plant (NPP) operating conditions by using recorded plant process data. Successfully implementing these models can lead to cost-reducing, conditioned-based predictive maintenance through optimized maintenance schedules and a reduction of unnecessary maintenance activities. This report discusses the verification and validation of short-term forecasting processes (i.e., data cleaning, feature selection, model optimization, and forecasting) developed in previous reports. The verification and validation (V&V) process demonstrates the expected precision and accuracy when the ML model encounters new datasets from different systems. Shapley additive explanations were used as the primary means of feature selection across these different data set. Individual models were trained for each data set, then validated through a cross-validation procedure. In this report, two different ML models were tasked to predict variables from three different plant process data sets with varying prediction horizons. The results indicate that support vector regression (SVR) outperformed long short-term memory (LSTM) neural networks in regard to each data set and each prediction horizon in this study, but further tuning and optimization could improve long short-term memory results. However, each forecasting model showed reduced performance as the prediction horizon was extended from 1 hour to 1 day ahead. Research is ongoing to evaluate the optimal input variable space, which is based on a given set of process parameters, to further improve forecasting accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Verification and Validation of the PLTEMP/ANL Code for Thermal-Hydraulic Analysis of Experimental and Test Reactors (Code Version 4.3)

The document compiles in a single volume the verification and validation works done for the PLTEMP/ANL code during the years of its development and improvement. The verification of sixteen capabilities of the PLTEMP/ANL Version 4.3 code that were identified by research reactor analysts as frequently used in their thermal-hydraulic analysis are described and documented. Each chapter of the document deals with the verification or validation of a specific part of the software that calculates a specific phenomenon, e.g., channel flow calculation, coolant property calculation, heat transfer calculation, and flow instability calculation. The software verification work is usually done by comparing the code with hand calculation, Microsoft spreadsheet calculation, or Mathematica calculation. The software validation is done by comparing the code with experimental data or a widely tested code like the RELAP5 code. In addition, some PLTEMP/ANL verification works that are available in the open literature are simply referenced and not included in the document. PLTEMP/ANL has been used in conversion safety analysis reports of several US and foreign research reactors that have been licensed and converted. A list of such reactors is given.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification and Validation of High Explosive Reactive Burn Models Implemented in LANL's EAP and LAP Code Base

Reactive burn models represent a significant leap in high explosive (HE) modeling capability. The first generation of engineering models of HE detonation are called programmed burn models and they are largely based on the distance between a prescribed detonation point and each zone in a simulation. There have been many advancements to programmed burn models over the years and when the assumptions upon which they are based are met, a properly tuned programmed burn model can be highly accurate but if any of their assumptions is not met, as is the case for corner turning or weakly initiated HE burn, they will give the wrong answer. Reactive burn models represent an entirely new way of modeling HE burn. They use the local conditions of a zone – e.g. temperature, pressure or density – as calculated by a hydrocode to determine if and when the zone is going to detonate and if so, how rapidly. This difference opens up an entirely new set of capabilities for HE modeling. It makes it possible to accurately and predictively model phenomena like the effect of confinement and the formation of dead zones. Reactive burn models have seen sustained development effort at LANL for at least the last decade but several recent developments make it timely to transition reactive burn models from a research topic to a production tool. The main goal of this milestone is to facilitate and accelerate the adoption of reactive burn as a commonly available modeling option, with recommendations on the resolution that will be required and uncertainties associated with their modeling choices. To achieve this, we have performed verification, validation, and uncertainty quantification (UQ) assessments of AWSD and SURF/SURFplus in xRage and FLAG on a variety of different problems.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

ECAR-7300 Rev 1 Verification and Validation of MCNP6.2 for MARVEL Neutronic Analysis

This report documents the verification and validation (V&V) efforts of the Monte Carlo N-Particle transport code (MCNP) version 6.2 on the Sawtooth supercomputer for the Microreactor Applications Research Validation and Evaluation (MARVEL) microreactor required for the preliminary documented safety analysis. This document records V&V for a safety, hazards, analysis, and design software used for design and analysis of safety class structures, system and components (SSC)s.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Partnership Center for High-Fidelity Boundary Plasma Simulation (Final Report)

Within the Partnership Center for High-Fidelity Boundary Plasma Simulation (HBPS), work at UT-Austin was aimed at improved verification, validation, and uncertainty quantification (VVUQ) for edge plasma simulations and on performing gyrokinetics simulations of pedestal instabilities and turbulence in order to expand foundational understanding of pedestal transport. Regarding VVUQ, the accomplishments can be summarized as follows. First, it was shown that the Moment Preserving Constrained Resampling technique, when applied periodically in particle-in-cell simulations in the XGC code, can dramatically improve the accuracy of the simulation at essentially equivalent computational cost. Second, a technique for estimating model correlations, which are required to solve the model selection and sample allocation problem in multifidelity UQ techniques, without sampling the highest fidelity, most computationally expensive model, was developed and demonstrated. Third, previously developed methods for estimating statistical and discretization errors were applied to numerical methods relevant to edge plasma simulations, namely in particle-in-cell-based approaches, and shown to work. Finally, benchmark studies for comparing gyrokinetic codes were developed and performed, leading to reasonable agreement between four commonly used codes. Regarding physics studies, gyrokinetic simulations to investigate microtearing modes in the DIII-D pedestal were performed using the GENE code.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

HYBRID Modeling Validation and Verification Status Matrix

The HYBRID modeling repository is a premier resource for integrated energy systems modeling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Due to the increased size of the repository, a concise summary matrix of available models is desired. This matrix will consolidate not only the list of available models but also indicate original information sources, publications that have model examples, and level of validation and verification that exists for the models. Validation and verification (V&V) levels begin from simplified algebraic relationship and advance to dynamic data validation. Moving forward, as new models are contributed to HYBRID, their V&V level will be included, updating this matrix.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Challenges and opportunities in verification and validation of low temperature plasma simulations and experiments

This paper describes the verification and validation (V&V) framework developed for the stochastic Particle-in-Cell, Direct Simulation Monte Carlo code Aleph. An ideal framework for V&V from the viewpoint of the authors is described where a physics problem is defined, and relevant physics models and parameters to the defined problem are assessed and captured in a Phenomena Identification and Ranking Table (PIRT). Furthermore, numerous V&V examples guided by the PIRT for a simple gas discharge are shown to demonstrate the V&V process applied to a real-world simulation tool with the overall goal to demonstrably increase the confidence in the results for the simulation tool and its predictive capability. Although many examples are provided here to demonstrate elements of the framework, the primary goal of this work is to introduce this framework and not to provide a fully complete implementation, which would be a much longer document. Comparisons and contrasts are made to more usual approaches to V&V, and techniques new to the low-temperature plasma community are introduced. Specific challenges relating to the sufficiency of available data (e.g., cross sections), the limits of ad hoc validation approaches, the additional difficulty of utilizing a stochastic simulation tool, and the extreme cost of formal validation are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗