Verification & Validation: Uniting Simulations, Theory, and Experiments
Abstract Not Provided
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract Not Provided
The Wave Energy Converter Simulator (WEC-Sim) is an open-source code jointly developed by Sandia National Laboratories and the National Renewable Energy Laboratory. It is used to model wave energy converters subjected to operational and extreme waves. In order for the WEC-Sim code to be beneficial to the wave energy community, code verification and physical model validation is necessary. This paper describes numerical modeling of the wave tank testing for the 1:33-scale experimental testing of the floating oscillating surge wave energy converter. The comparison between WEC-Sim and the Phase 1 experimental data set serves as code validation. This paper is a follow-up to the WEC-Sim paper on experimental testing, and describes the WEC-Sim numerical simulations for the floating oscillating surge wave energy converter.
Verification and validation results of the SCALE 6.2 lattice physics codes TRITON/NEWT and Polaris are presented. The SCALE/KENO continuous energy Monte-Carlo code is used as a reference to compare results of more than 2,000 combinations of pressurized water reactor and boiling water reactor lattice designs and state points. Radiochemical assay measurements were also used to assess the accuracy of depletion calculations. Results show that Polaris and TRITON/NEWT using ENDF/B_VII.1 produce accurate lattice physics calculations and cross section data for core simulators.
The project objective is to verify and validate a suite of high-fidelity multi-physics simulation methods and codes developed during the previous I-NERI projects, against Monte Carlo solutions and experimental measurements for LWR and VHTR cores. Using benchmark problems developed during the previous year, ANL and KAERI continued to work on verifying the neutronics code DeCART and associated cross section libraries. Initial progress was also made on validating the code against experimental data. KAERI focused on verifying the DeCART code against numerical benchmark problems such as a PMR200 2-D pin cell/core and a HTTR 2-D block/core as well as improving DeCART capabilities such as the cross-section library group structure optimization, the fundamental and generalized adjoint equation solver, cylindrical boundary treatment, improved ray tracing, and implementing the direct resonance integral table method for resonance treatment. Verification test results for the updated capabilities showed substantial improvements in the estimation of eigenvalue and reaction rates.
To push the modeling and simulation to a new level in simulating realistic problems, a common practice is to couple different single-physics codes together to simulate problems involving multiple physics. Although the method of manufactured solutions (MMS) has been shown to be a powerful tool in code verification, there has been little work on applying MMS to a multi-physics code system. Additionally, due to the scarcity of multi-physics validation data, the significance of code verification becomes more prominent as an important part in software quality assurance. With this, the application of MMS to a coupled code system, e.g. VERA-CS, has become a crucial step, which helps identify bugs affecting the order of accuracy, thus increasing the credibility and reliability of the code. In this work, we investigate the application of MMS to verify a multi-physics code system and establish a framework for this application, and we demonstrate this with a neutronics code coupled with a thermal hydraulics (TH) code. The convection module is not yet added to this work, so by TH, only conduction is considered.
Core modeling of the Advanced Test Reactor (ATR) at INL is currently undergoing a significant update through the Core Modeling Update Project1. The intent of the project is to bring ATR core modeling in line with today’s standard of computational efficiency and verification and validation practices. The HELIOS-2 lattice physics code2 is the lead code of several reactor physics codes to be dedicated to modernize ATR core analysis. This presentation is concerned with an independent verification of the HELIOS-2 spectral representation including the slowing down and thermalization algorithm and its data dependency. Here, we will describe and demonstrate a recently developed simple cross section generation algorithm based entirely on analytical multigroup parameters for both the slowing down and thermal spectrum. The new capability features fine group detail to assess the flux and multiplication factor dependencies on cross section data sets using the fundamental infinite medium as an example.
EMPHASIS™/NEVADA is the SIERRA/NEVADA toolkit implementation of portions of the EMPHASIS TM code suite. The purpose of the toolkit implementation is to facilitate coupling to other physics drivers such as radiation transport as well as to better manage code design, implementation, complexity, and important verification and validation processes. This document describes the theory and implementation of the unstructured finite- element method solver, associated algorithms, and selected verification and validation.
A large number of previous studies suggest that the behavior of the near-wall liquid micro-layer plays a key role in boiling heat transfer and boiling crisis; see examples. The thin liquid layer interacts with heater surface and 'external' two-phase flow. The net effects of these interactions define the micro-hydrodynamics that leads to dryout. As a result, a good understanding of the thin-layer hydrodynamics is significant for the accurate prediction of CHF. Recently, with the advent of nanotechnology including micro-scale manufacturing, it becomes possible to perform high heat-flux boiling experiments with controlled surface conditions. Although many reports show rich observations about the effects of surface characteristics on CHF, physical mechanisms remain not fully understood. In order to have better understanding of the above phenomena, several computational models are developed, ranging from the lubrication theory to CFD methods. The former models are limited to one-dimensional formulation and unable to deal with the dry-out phenomena. It turns out that CFD methods have a greater potential for the mechanistic study of boiling. Towards the study objective, a particle-based CFD method called Smoothed Particle Hydrodynamics (SPH) is adopted. SPH is a Lagrangian particle method for solving systems of partial differential equations. Originally SPH is proposed for fluid dynamics in the context of astrophysical problems. Because mass and density are introduced during the particle approximation, SPH is also applied in fluid dynamic problems, where mass and density are important parameters to determine, without mass loss (a limitation of interface capturing schemes in mesh-based methods). Besides, geometrically complex and/or dynamic boundaries and interfaces can be handled without undue difficulty in SPH. Currently, most SPH simulations focus on large-scale scenarios (meter scale), like flooding and solitary wave. Also some works have been done with SPH in pore-scale. As for micro- or nano-scale simulation, people usually apply Dissipative Particle Dynamics (DPD) and Molecular Dynamics (MD) for particle-based simulation. Almost no work has been done on micro-scale with SPH, so assessments are needed to investigate the capability of SPH in application of micro-hydrodynamics. The Phenomena Identification and Ranking Table (PIRT) is applied to align application's technical requirements with associated physics and materials, models, simulation code capabilities and verification, validation and uncertainty quantification activities. The figures of merit are determined as: (1) Timing of micro-layer rewetting dry surface; (2) Effects of surface features. The corresponding key phenomena are determined as: (1) Hydrodynamics; (2) Interface Dynamics; (3) Energy; (4) Surface Effect. This study deals with isothermal scenario and no energy term is considered. Based on the current needs, a new SPH package, Micro-SPH, is compiled based on SPHysics with surface tension and wettability built in. Test cases are performed with Micro-SPH to assess the capability of SPH to each phenomenon identified. NEUTRINO with incompressible SPH solver is employed to investigate micro-fluid dynamics on a surface with uniformly distributed cylindrical pillars for application purposes. (authors)
The simulation of multiphase flow is a difficult physical, computational, and numerical problem. Sophisticated tools are necessary to provide results encompassing a wide range of physical phenomena. The development of these tools must be supported by rigorous analysis and ongoing efforts of verification and validation to ensure the accuracy of simulations. The Nek-2P multiphase code is being developed at Argonne with the general goal of simulating a wide range of multiphase flows and the primary goal of simulating boiling flows in LWR fuel assemblies. As part of this, there is an ongoing effort to verify the code and validate the underlying physical models. The objective of this work is to present recent results in the verification of Nek-2P. As a starting point, this work is focused on adiabatic flows for the sake of simplicity with the immediate next planned step to expand the effort to include heat and mass transfer. Details of the verification of the implemented mass fraction transport, momentum conservation, and pressure equations in Nek-2P are presented. Results of simulations are compared to analytic solutions when possible, however due to the complexity of multiphase flows, these are seldom available. To overcome this difficulty, an independent model is used to provide solutions for comparison.
The main objective of the Offshore Code Comparison Collaboration Continuation, with Correlation (OC5) project, is validation of aero-hydro-servo-elastic simulation tools for offshore wind turbines (OWTs) through comparison of simulated results to the response data of physical systems. Phase III of the OC5 project analyzes the Senvion 5M wind turbine supported by the OWEC Quattropod from the alpha ventus offshore wind farm. This paper shows results of the verification of the OWT models (code-to-code comparison). A subsequent publication will focus on their validation (comparison of simulated results to measured physical system response data). Based on the available data, the participants of Phase III set up numerical models of the OWT in their simulation tools. It was necessary to verify and to tune these models. The verification and tuning were performed against an OWT model available at the University of Stuttgart - Stuttgart Wind Energy (SWE) and documentation provided by Senvion and OWEC Tower. A very good match was achieved between the results from the reference SWE model and models set up by OC5 Phase III participants.
The main objective of the Offshore Code Comparison Collaboration Continuation, with Correlation (OC5) project, is validation of aero-hydro-servo-elastic simulation tools for offshore wind turbines (OWTs) through comparison of simulated results to the response data of physical systems. Phase III of the OC5 project analyzes the Senvion 5M wind turbine supported by the OWEC Quattropod from the alpha ventus offshore wind farm. This paper shows results of the verification of the OWT models (code-to-code comparison). A subsequent publication will focus on their validation (comparison of simulated results to measured physical system response data). Based on the available data, the participants of Phase III set up numerical models of the OWT in their simulation tools. It was necessary to verify and to tune these models. The verification and tuning were performed against an OWT model available at the University of Stuttgart - Stuttgart Wind Energy (SWE) and documentation provided by Senvion and OWEC Tower. A very good match was achieved between the results from the reference SWE model and models set up by OC5 Phase III participants.
The Idaho National Laboratory (INL) has initiated a focused effort to upgrade legacy computational reactor physics software tools and protocols used for support of core fuel management and experiment management in the Advanced Test Reactor (ATR) and its companion critical facility (ATRC) at the INL.. This will be accomplished through the introduction of modern high-fidelity computational software and protocols, with appropriate new Verification and Validation (V&V) protocols, over the next 12-18 months. Stochastic and deterministic transport theory based reactor physics codes and nuclear data packages that support this effort include MCNP5[1], SCALE/KENO6[2], HELIOS[3], SCALE/NEWT[2], and ATTILA[4]. Furthermore, a capability for sensitivity analysis and uncertainty quantification based on the TSUNAMI[5] system has also been implemented. Finally, we are also evaluating the Serpent[6] and MC21[7] codes, as additional verification tools in the near term as well as for possible applications to full three-dimensional Monte Carlo based fuel management modeling in the longer term. On the experimental side, several new benchmark-quality code validation measurements based on neutron activation spectrometry have been conducted using the ATRC. Results for the first four experiments, focused on neutron spectrum measurements within the Northwest Large In-Pile Tube (NW LIPT) and in the core fuel elements surrounding the NW LIPT and the diametrically opposite Southeast IPT have been reported [8,9]. A fifth, very recent, experiment focused on detailed measurements of the element-to-element core power distribution is summarized here and examples of the use of the measured data for validation of corresponding MCNP5, HELIOS, NEWT, and Serpent computational models using modern least-square adjustment methods are provided.
This report describes the preliminary implementation of the sodium thermophysical properties and the design documentation for the sodium models of CONTAIN-LMR to be implemented into MELCOR 2.1. In the past year, the implementation included two separate sodium properties from two different sources. The first source is based on the previous work done by Idaho National Laboratory by modifying MELCOR to include liquid lithium equation of state as a working fluid to model the nuclear fusion safety research. To minimize the impact to MELCOR, the implementation of the fusion safety database (FSD) was done by utilizing the detection of the data input file as a way to invoking the FSD. The FSD methodology has been adapted currently for this work, but it may subject modification as the project continues. The second source uses properties generated for the SIMMER code. Preliminary testing and results from this implementation of sodium properties are given. In this year, the design document for the CONTAIN-LMR sodium models, such as the two condensable option, sodium spray fire, and sodium pool fire is being developed. This design document is intended to serve as a guide for the MELCOR implementation. In addition, CONTAIN-LMR code used was based on the earlier version of CONTAIN code. Many physical models that were developed since this early version of CONTAIN may not be captured by the code. Although CONTAIN 2, which represents the latest development of CONTAIN, contains some sodium specific models, which are not complete, the utilizing CONTAIN 2 with all sodium models implemented from CONTAIN-LMR as a comparison code for MELCOR should be done. This implementation should be completed in early next year, while sodium models from CONTAIN-LMR are being integrated into MELCOR. For testing, CONTAIN decks have been developed for verification and validation use.
The U.S. Department of Energy (DOE) Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program develops models of advanced reactor phenomena to demonstrate code applicability to challenging physics problems, drive code development through user assessment, and perform code verification and validation. Meanwhile, the U.S. DOE’s National Reactor Innovation Center (NRIC) hosts an open-source website and associated GitHub repository called the Virtual Test Bed (VTB) on which computational models for advanced reactors are documented and shared with the reactor community. This work documents NEAMS efforts to support industry adoption of advanced modeling tools through contribution of 10 NEAMS models to the NRIC Virtual Test Bed including models for the High Temperature Test Facility (HTTF), TRISO fuel failure in a microreactor, and multiphysics models of a molten chloride fast reactor, among others. The open sharing of these models benefits the reactor community by providing “best practice” examples using NEAMS tools for advanced reactor physics problems. In particular, the HTTF model is being used for code validation and benchmarking activities. The microreactor and molten chloride fast reactor models are representative of analysis that may be useful for current candidates of DOME and LOTUS, NRIC’s physical testbeds. This report summarizes and provides links to these new models, among others.
The U.S. Department of Energy (DOE) Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program develops models of advanced reactor phenomena to demonstrate code applicability to challenging physics problems, drive code development through user assessment, and perform code verification and validation. Meanwhile, the U.S. DOE’s National Reactor Innovation Center (NRIC) hosts an open-source website and associated GitHub repository called the Virtual Test Bed (VTB) on which computational models for advanced reactors are documented and shared with the reactor community. Several NEAMS advanced reactor models (including input files, documentation, and discussion of results) have recently been contributed to the NRIC VTB. The open sharing of these models benefits the reactor community by providing “best practice” examples using NEAMS tools for advanced reactor physics problems. This report summarizes and provides links to these new models, which include modeling phenomena important to liquid metal cooled fast reactors, molten salt reactors, high temperature gas-cooled reactors, and microreactors.
Reactor cavity concrete, the primary support structure for the reactor pressure vessel (RPV), is exposed to chronic neutron/gamma radiation during normal operation. During long term operation, the interaction of neutron irradiation with the concrete’s constituents may cause premature degradation of the concrete structure, as highlighted by a review of concrete properties in nuclear power plant environments. At high fluence levels, as in biological shielding, neutron irradiation may cause amorphization of the crystalline components of concrete, i.e., mineral aggregates, and volume changes, which are typically expansive in nature. Volume expansion can generate tensile stresses within concrete which can induce microcracking and/or result in debonding of aggregate with the matrix. On the other hand, structural disordering can result in changes in the stability of the phase in aqueous environments. This report presents the findings of investigations performed over 3 years through the collaboration of researchers from University of California, Los Angeles, Arizona State University, and Oak Ridge National Laboratory. The first part of the study addresses the effect of neutron irradiation on the durability of aggregates. Comparisons of aqueous dissolution rates, as a function of pH and temperature, were performed for aggregates that are either pristine (i.e., non-irradiated) or exposed to Ar+ ion irradiation at specified doses. These experimental results were coupled with molecular dynamics simulations of atomic scale changes in the crystallographic structure of the mineral and any resulting changes in physical properties (e.g., density) that result. The second section focuses on macroscopic effects of such changes in aggregate behavior in concrete degradation, primarily through changes in the concrete’s microstructure. Particularly, the effects akin to those originating from alkali-silica reaction (ASR) were evaluated. The project is structured to encompass 6 main tasks, as follows: Task 1: Selection of aggregates in relation to their abundance and mineralogy, and their irradiation Task 2: Molecular dynamics (MD): The effects of irradiation on the atomic disordering of aggregates Task 3: The influences of irradiation on aggregate reactivity Task 4: Reactive-transport simulation of expansive product formation in concrete microstructures Task 5: X-FEM-based modeling of damage evolution due to irradiation-induced aggregates reactions Task 6: Benchmarking, verification and validation of the simulation modules Thus, a rigorous understanding of irradiation-assisted mineral alterations was used to develop a mechanistic degradation model for concrete exposed to neutrons, while considering aspects of: chemical reaction (dissolution and precipitation), mass and ion transport, and damage evolutions. The models developed were embedded in a multi-physics aging code for nuclear components and structures called Grizzly, which allows for benchmarking, verification, and validation against expansion data acquired on concrete undergoing alkali-silica reaction, a physically/chemically equivalent form of degradation that develops in the absence of radiation. These findings provide insight into the sensitivities of minerals to irradiation, by highlighting characteristics of concretes and power plants subject to such risks. The research will aid the nuclear power industry to anticipate and mitigate such risks in light of second license renewals.
This report describes the high-level accomplishments from the Plasma Science and Engineering Grand Challenge LDRD at Sandia National Laboratories. The Laboratory has a need to demonstrate predictive capabilities to model plasma phenomena in order to rapidly accelerate engineering development in several mission areas. The purpose of this Grand Challenge LDRD was to advance the fundamental models, methods, and algorithms along with supporting electrode science foundation to enable a revolutionary shift towards predictive plasma engineering design principles. This project integrated the SNL knowledge base in computer science, plasma physics, materials science, applied mathematics, and relevant application engineering to establish new cross-laboratory collaborations on these topics. As an initial exemplar, this project focused efforts on improving multi-scale modeling capabilities that are utilized to predict the electrical power delivery on large-scale pulsed power accelerators. Specifically, this LDRD was structured into three primary research thrusts that, when integrated, enable complex simulations of these devices: (1) the exploration of multi-scale models describing the desorption of contaminants from pulsed power electrodes, (2) the development of improved algorithms and code technologies to treat the multi-physics phenomena required to predict device performance, and (3) the creation of a rigorous verification and validation infrastructure to evaluate the codes and models across a range of challenge problems. These components were integrated into initial demonstrations of the largest simulations of multi-level vacuum power flow completed to-date, executed on the leading HPC computing machines available in the NNSA complex today. These preliminary studies indicate relevant pulsed power engineering design simulations can now be completed in (of order) several days, a significant improvement over pre-LDRD levels of performance.
The System Analysis Module (SAM), developed at Argonne National Laboratory and by collaborators at other organizations, is for advanced non–light water reactor safety analysis. SAM aims to provide fast-running, modest-fidelity, whole-plant transient analysis capabilities that are essential for fast-turnaround design scoping and engineering analyses of advanced reactor concepts. To facilitate code development, SAM utilizes the MOOSE object-oriented application framework, its underlying finite element library, and linear and nonlinear solvers to leverage modern advanced software environments and numerical methods. SAM aims to solve tightly coupled physical phenomena, including fission reaction, heat transfer, fluid dynamics, and thermal-mechanical responses in advanced reactor structures, systems, and components with high accuracy and efficiency. Finally, this paper gives an overview of the SAM code development, including goals and functional requirements, physical models, current capabilities, verification and validation, software quality assurance, and examples of simulations for advanced nuclear reactor applications.