Search NASA⌕ Search

SEARCH · Search NASA

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Final Report for "Verification and Validation of Radiation Hydrodynamics for Astrophysical Applications"

The motivation for this work is to gain experience in the methodology of verification and validation (V&V) of astrophysical radiation hydrodynamics codes. In the first period of this work, we focused on building the infrastructure to test a single astrophysical application code, Castro, developed in collaboration between Lawrence Livermore National Laboratory (LLNL) and Lawrence Berkeley Laboratory (LBL). We delivered several hydrodynamic test problems, in the form of coded initial conditions and documentation for verification, routines to perform data analysis, and a generalized regression test suite to allow for continued automated testing. Astrophysical simulation codes aim to model phenomena that elude direct experimentation. Our only direct information about these systems comes from what we observe, and may be transient. Simulation can help further our understanding by allowing virtual experimentation of these systems. However, to have confidence in our simulations requires us to have confidence in the tools we use. Verification and Validation is a process by which we work to build confidence that a simulation code is accurately representing reality. V&V is a multistep process, and is never really complete. Once a single test problem is working as desired (i.e. that problem is verified), one wants to ensure that subsequent code changes do not break that test. At the same time, one must also search for new verification problems that test the code in a new way. It can be rather tedious to manually retest each of the problems, so before going too far with V&V, it is desirable to have an automated test suite. Our project aims to provide these basic tools for astrophysical radiation hydrodynamics codes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Verification and Validation Process for Progressive Damage and Failure Analysis Methods in the NASA Advanced Composites Consortium

The Advanced Composites Consortium is a US Government/Industry partnership supporting technologies to enable timeline and cost reduction in the development of certified composite aerospace structures. A key component of the consortium's approach is the development and validation of improved progressive damage and failure analysis methods for composite structures. These methods will enable increased use of simulations in design trade studies and detailed design development, and thereby enable more targeted physical test programs to validate designs. To accomplish this goal with confidence, a rigorous verification and validation process was developed. The process was used to evaluate analysis methods and associated implementation requirements to ensure calculation accuracy and to gage predictability for composite failure modes of interest. This paper introduces the verification and validation process developed by the consortium during the Phase I effort of the Advanced Composites Project. Specific structural failure modes of interest are first identified, and a subset of standard composite test articles are proposed to interrogate a progressive damage analysis method's ability to predict each failure mode of interest. Test articles are designed to capture the underlying composite material constitutive response as well as the interaction of failure modes representing typical failure patterns observed in aerospace structures.

Wanthal, Steven↗

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.0 code which has been developed to perform the steady-state thermal hydraulic safety calculation of the MIT Research Reactor required upon conversion of the reactor from high enrichment uranium fuel to low enrichment uranium fuel. The key capabilities of the code including the statistical processing, water property generation, and thermal hydraulic solution are verified independently. While the first two capabilities are checked using statistical tests and NIST data tables, each component of the thermal hydraulic solution is verified using simple geometry test problems. The comparison between results obtained by the code and hand calculations on these problems shows that each of these components work correctly. Additionally, a comprehensive comparison between STAT7 Version 1.0 and PLTEMP/ANL_4.2 calculations for a five-channel test problem is performed for the validation. The good agreement between the obtained results for all thermal hydraulic parameters belonging to the fuel core region is achieved. An issue in bypass flowrate calculation was detected when both fin-friction and bypass flow calculations are involved. This problem can be corrected in a later version of the code, however, does not affect the application of STAT7 code as it has been used to date where the flow distribution in the core region and bypass channel is specified as an input parameter.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.0 code which has been developed to perform the steady-state thermal hydraulic safety calculation of the MIT Research Reactor required upon conversion of the reactor from high enrichment uranium fuel to low enrichment uranium fuel. The key capabilites of the code including the statistical processing, water property generation, and thermal hydraulic solution are verified independently. While the first two capabilites are checked using statistical tests and NIST data tables, each component of the thermal hydraulic solution is verified using simple geometry test problems. The comparison between results obtained by the code and hand calculations on these problems shows that each of these components work correctly. Additionally, a comprehensive comparison between STAT7 Version 1.0 and PLTEMP/ANL Version 4.2 calculations for a five-channel test problem is performed for the validation. The good agreement between the obtained results for all thermal hydraulic parameters belonging to the fuel core region is achieved. An issue in bypass flowrate calculation was detected when both fin-friction and bypass flow claculations are involved. This problem can be corrected in a later version of the code, however, does not affect the application of STAT7 code as it has been used to date where the flow distribution in the core region and bypass channel is specified as an input parameter.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.0 code which has been developed to perform the steady-state thermal hydraulic safety calculation of the MIT Research Reactor required upon conversion of the reactor from highly enriched uranium fuel to low- enriched uranium fuel. The key capabilities of the code including the statistical processing, water property generation, and thermal hydraulic solution are verified independently. While the first two capabilities are checked using statistical tests and NIST data tables, each component of the thermal hydraulic solution is verified using simple geometry test problems. The comparison between results obtained by the code and hand calculations on these problems shows that each of these components work correctly. Additionally, a comprehensive comparison between STAT7 Version 1.0 and PLTEMP/ANL Version 4.2 calculations for a five-channel test problem is performed for the validation. The good agreement between the obtained results for all thermal hydraulic parameters belonging to the fuel core region is achieved. An issue in bypass flowrate calculation was detected when both fin-friction and bypass flow calculations are involved. This problem can be corrected in a later version of the code. However, it does not affect the application of STAT7 as it has been used to date where the flow distribution in the core region and bypass channel is specified as an input parameter.

97 MATHEMATICS AND COMPUTING↗

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.1 code, which has been developed to perform the steady-state thermal hydraulics (TH) safety calculations required to support conversion of the Massachusetts Institute of Technology Research Reactor from highly enriched uranium fuel to low- enriched uranium fuel. The key capabilities of the code, including statistical processing, water property generation, and TH solution, are verified independently. While the first two capabilities are checked using statistical tests and NIST data tables, each component of the TH solution is verified using simple geometry test problems. The comparison between results obtained by the code and by hand calculations on these problems shows that each of these components works correctly. Additionally, a comprehensive comparison between STAT7 Version 1.1 and PLTEMP/ANL Version 4.3 Revision 162 calculations is performed for the validation. Good agreement is achieved between the results obtained with the two codes for all TH parameters belonging to the fuel core region.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and validation of integrated simulation of energetic particles in fusion plasmas

Here, we report on verification and validation of linear simulations of Alf´ven eigenmodes in the current ramp phase of DIII-D L-mode discharge #159243 using gyrokinetic, gyrokinetic-MHD hybrid, and eigenvalue codes. Using a classical fast ion profile, all simulation codes find that reversed shear Alf´ven eigenmodes (RSAE) are the dominant instability. The real frequencies from all codes have a coefficient of variation of less than 5% for the most unstable modes with toroidal mode number n = 4 and 5. Due to uncertainty in the experimentally measured minimum safety factor (q min ) and the sensitivity of the RSAE’s frequency to q min , the average difference in frequency between simulated and measured is df/f = 14.7%, 22.6%, for n = 4 and 5, respectively. If qmin is adjusted slightly, within experimental errors, an agreement of within 4.5% and 3.1%, for n = 4 and 5 respectively, is found for all codes. The simulated growth rates exhibit greater variation, and simulations find that pressure gradients of thermal plasmas make a significant contribution to the growth rates. Mode structures of the dominant modes agree well among all codes. Using a calculated fast ion profile that takes into account the action of the spectrum of multiple unstable modes, a toroidal Alf´ven eigenmode (TAE) with n = 6 is found to be unstable in the outer edge, consistent with the experimental data. Variations of the real frequencies and growth rates of the TAE are slightly larger than those of the RSAE. Lastly, electron temperature fluctuations and radial phase shifts from simulations show no significant differences with the experimental data for the strong n = 4 RSAE, but significant differences for the weak n = 6 TAE. The verification and validation for the linear simulations of Alf´ven eigenmodes is the first step to determine an integrated simulation of energetic particles confinement in burning plasmas incorporating multiple physical processes with kinetic effects of both energetic and thermal particles on an equal footing.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Independent Verification and Validation Of SAPHIRE 8 Software Quality Assurance Plan Project Number: N6423 U.S. Nuclear Regulatory Commission

This report provides an evaluation of the Software Quality Assurance Plan. The Software Quality Assurance Plan is intended to ensure all actions necessary for the software life cycle; verification and validation activities; documentation and deliverables; project management; configuration management, nonconformance reporting and corrective action; and quality assessment and improvement have been planned and a systematic pattern of all actions necessary to provide adequate confidence that a software product conforms to established technical requirements; and to meet the contractual commitments prepared by the sponsor; the Nuclear Regulatory Commission.

99 GENERAL AND MISCELLANEOUS↗

Verification and Validation of the PLTEMP/ANL Code for Thermal-Hydraulic Analysis of Experimental and Test Reactors

The document compiles in a single volume the verification and validation works done for the PLTEMP/ANL code during the years of its development and improvement. The verification of sixteen capabilities of the PLTEMP/ANL Version 4.3 code that were identified by research reactor analysts as frequently used in their thermal-hydraulic analysis are described and documented. Each chapter of the document deals with the verification or validation of a specific model. The model verification is usually done by comparing the code with hand calculation, Microsoft spreadsheet calculation, or Mathematica calculation. The model validation is done by comparing the code with experimental data or a widely tested code like the RELAP5 code. In addition, some PLTEMP/ANL verification works that are available in the open literature are simply referenced and not included in the document. PLTEMP/ANL has been used in conversion safety analysis reports of several US and foreign research reactors that have been licensed and converted. A list of such reactors is given.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Survey of Product-line Verification and Validation Techniques

This report presents the results from the first task of the SARP Center Initiative, 'Product Line Verification of Safety-Critical Software.' Task 1 is a literature survey of available techniques for product line verification and validation. Section 1 of the report provides an introduction to product lines and motivates the survey of verification techniques. It describes what is reused in product-line engineering and explains the goal of verifiable conformance of the developed system to its product-line specifications. Section 2 of the report describes six lifecycle steps in product-line verification and validation. This description is based on, and refers to, the best practices extracted from the readings. It ends with a list of verification challenges for NASA product lines (2.7) and verification enablers for NASA product lines (2.8) derived from the survey. Section 3 provides resource lists of related conferences, workshops, industrial and defense industry experiences and case studies of product lines, and academic/industrial consortiums. Section 4 is a bibliography of papers and tutorials with annotated entries for relevant papers not previously discussed in sections 2 or 3.

testing↗

CFD Verification and Validation of Wire-Wrapped Pin Assemblies

TerraPower is participating in a cooperative project among industry, the national lab system, and academia to perform Verification and Validation (V and V) of Computational Fluid Dynamics (CFD) methods for predicting the flow and heat transfer within liquid-metal-cooled nuclear fuel assemblies with wire-wrapped fuel pins. This project, consisting of both experimental and numerical components, uses surrogate fluids and electrically heated fuel pins to substitute for the liquid metal coolant and the nuclear heat source. The experiments include both unheated assemblies to measure the flow velocities with Laser Doppler Velocimetry (LDV) and Particle Image Velocimetry (PIV), as well as heated assemblies to measure the temperatures of the fluid and the simulated fuel pins with thermocouples. Both sets of experiments also measure the pressure at multiple locations in the system. The numerical component of this work involves high-fidelity Large-Eddy Simulation (LES) modeling and industry-standard Reynolds-Averaged Navier-Stokes (RANS) modeling of the experiments. Furthermore, the experiments and simulations will be conducted on two duct geometries: the first is a non-deformed hexagonal duct that has flat internal duct faces that represents a beginning of life geometry. The other is a deformed duct where the internal hexagonal flow area enlarges then decreases along the axial height to represent the changes that occur to the duct geometry from pressure and irradiation effects in the core. This paper describes the methods and results of the industrial, RANS-based CFD code verification, solution verification, and solution validation. The V and V simulations are being performed for the following experiment test geometries: - Isothermal non-deformed bundle; - Heated non-deformed bundle; - Isothermal deformed bundle; - Heated deformed bundle. These flows have been computed at first with the pre-test design specifications, without the aid of any experimental results. Later, post-test calculations will be performed incorporating the actual test conditions and input from some of the experimental results. These RANS simulations of helically wire-wrapped fuel assemblies employ meshes of bare pins without the wire-wrap in the bundle. The effect of wire-wrap on the flow is accounted for by introducing a momentum source into the governing fluid equations. The momentum source is only applied to cells corresponding to the location of the wire-wrap, and its components in each cell are based on the local flow field. This methodology simplifies the geometry and mesh generation and reduces the cell count, while still capturing the effects of the wire-wrap. The momentum source approach is used for all of the assembly simulations performed in this study. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

MPACT Verification and Validation Manual (rev 6)

The MPACT code provides the capability to calculate the steady-state and transient reactor core neutron distribution for operating nuclear power plant (PWR) conditions across multiple fuel cycles. As required in the CASL SQA plan, it is the responsibility of UM and ORNL as joint owners of MPACT to ensure that verification and validation activities are performed and documented in a V&V manual with supporting publications and CASL technical reports which can be distributed for reference and distribution within VERA. This document provides the fifth revision of the MPACT verification and validation (V&V) manual and describes the current state of MPACT V&V and updates the framework for future MPACT V&V activities. During FY19 MPACT V&V activities in the areas of code / solution verification and code validation have continued to mature. Several specific tasks have also been completed to include the Ganapol and IPEN Benchmarks which have provided significant improvements in MPACT verification and validation, respectively. Based on the results of V&V efforts this past year, the confidence level has increased in the ability of MPACT to model an operational Pressurized Water Reactor. Specific areas in both verification and validation were identified which require increased emphasis during FY20.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Bison Verification and Validation Activities for TRISO

Numerical modeling and simulation (M&S) tools play a key role in the research, development, and overall safety assessments of next-generation nuclear energy systems. One such tool, Bison, is a nuclear fuel performance code that is applicable to many fuel forms (e.g., light-water reactor fuel, oxide and metallic fuel for fast reactors, tri-structural isotropic (TRISO) fuel, and plate fuel), and it uses the finite element method to model the thermo- mechanical response of nuclear fuels. One fuel form widely utilized in Generation-IV high-temperature gas-cooled and fluoride- salt-cooled nuclear reactor concepts is TRISO fuel. Recently, Bison’s capabilities were significantly expanded to enable it to model the performance of TRISO particles and compacts. It is important that Bison’s computational results be reliable and predictive, since this code is used to inform high-consequence decisions. The various processes developed to address this issue generally entail two fundamental steps: verification and validation (V&V). Verification ensures that the code functions correctly and is reliable. Code/solution verification, code benchmark, and software quality assurance exercises are examples of verification activities. On the other hand, validation is the process of assessing a code’s capability to accurately model physical problems. Comparisons between code results and experiments quantify the validation level. Application of V&V procedures is crucial to the development of computational tools that are free of coding mistakes and can accurately represent reality. The current study presents an overview of Bison V&V activities relevant to the TRISO fuel concept, which include code/solution verification exercises, CRP-6 Benchmark—a Coordinated Research Program through the International Atomic Energy Agency (IAEA)—exercises, and validation exercises with the Advanced Gas Reactor (AGR)- 1/2/3/4 experiment series.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification and Validation of Open-Source Computational Fluid Dynamics Capabilities in MOOSE

The Multiphysics Object Oriented Simulation Environment (MOOSE) advances predictive modeling in nuclear research by simplifying the application design process and making modeling more efficient and accessible to researchers and the broader community. Because of MOOSE’s critical role in the scientific computation field, verification and validation are important to evaluate the reliability and credibility of MOOSE’s code, simulations, and models. To assess MOOSE’s Navier Stokes module and turbulence models, the following verification and validation University of Manchester ERCOFTAC cases were simulated in MOOSE, and the results were compared: Case 032 Turbulent Flow in a 2D Channel Case 079 Natural Convection in an Enclosed Cavity

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Methodologies for Verification and Validation of Space Launch System (SLS) Structural Dynamic Models: Appendices

Verification and validation (V&V) is a highly challenging undertaking for SLS structural dynamics models due to the magnitude and complexity of SLS subassemblies and subassemblies. Responses to challenges associated with V&V of Space Launch System (SLS) structural dynamics models are presented in Volume I of this paper. Four methodologies addressing specific requirements for V&V are discussed. (1) Residual Mode Augmentation (RMA). (2) Modified Guyan Reduction (MGR) and Harmonic Reduction (HR, introduced in 1976). (3) Mode Consolidation (MC). Finally, (4) Experimental Mode Verification (EMV). This document contains the appendices to Volume I.

Coppolino, Robert N.↗

Computational solution verification and validation applied to a thermal model of a ruggedized instrumentation package

This study details a methodology for quantification of errors and uncertainties of a finite element heat transfer model applied to a Ruggedized Instrumentation Package (RIP). The proposed verification and validation (V&V) process includes solution verification to examine errors associated with the code's solution techniques, and model validation to assess the model's predictive capability for quantities of interest. The model was subjected to mesh resolution and numerical parameters sensitivity studies to determine reasonable parameter values and to understand how they change the overall model response and performance criteria. To facilitate quantification of the uncertainty associated with the mesh, automatic meshing and mesh refining/coarsening algorithms were created and implemented on the complex geometry of the RIP. Automated software to vary model inputs was also developed to determine the solution’s sensitivity to numerical and physical parameters. The model was compared with an experiment to demonstrate its accuracy and determine the importance of both modelled and unmodelled physics in quantifying the results' uncertainty. An emphasis is placed on automating the V&V process to enable uncertainty quantification within tight development schedules.

97 MATHEMATICS AND COMPUTING↗

Verification and validation of the PLTEMP/ANL code for thermal hydraulic analysis of experimental and test reactors

The document compiles in a single volume several verification and validation works done for the PLTEMP/ANL code during the years of its development and improvement. Some works that are available in the open literature are simply referenced at the outset, and are not included in the document. PLTEMP has been used in conversion safety analysis reports of several US and foreign research reactors that have been licensed and converted. A list of such reactors is given. Each chapter of the document deals with the verification or validation of a specific model. The model verification is usually done by comparing the code with hand calculation, Microsoft spreadsheet calculation, or Mathematica calculation. The model validation is done by comparing the code with experimental data or a more validated code like the RELAP5 code.

Kalimullah, M.↗