Search NASA⌕ Search

SEARCH · Search NASA

Results for “code verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Sockeye Heat Pipe Analysis Code Verification and Validation

Some of the most promising microreactor designs currently under development utilize heat pipe technology to transfer heat from the reactor core to the secondary side heat exchanger, due to the technology’s compactness, efficiency, passivity, and reliability. Sockeye is an engineering-scale heat pipe tool developed under the Nuclear Energy Advanced Modeling and Simulation Program to be used for the design and safety analysis of microreactors. Sockeye’s core capability lies in a 1D, two-phase, compressible flow model, used to simulate the working fluid inside the heat pipe. Sockeye is built on the Multiphysics Object-Oriented Simulation Environment framework, which allows for seamless multiphysics coupling with other Nuclear Energy Advanced Modeling and Simulation tools and can thus be used in a full-scale simulation of a microreactor assembly, which can include hundreds of heat pipes. This paper presents some initial verification and validation assessments performed for Sockeye. We demonstrate good agreement between Sockeye’s numerical results and steady-state analytic solutions for velocity and pressure drop, with differences attributable to the underlying assumptions made by the analytic solutions. We also show that Sockeye reproduces analytic predictions of key operational limits, such as the capillary limit and the sonic limit. Finally, we compare Sockeye results to experimental data for the SAFE-30 heat pipe module test.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Nonintrusive manufactured solutions for ablation

The study of heat transfer and ablation plays an important role in many problems of scientific and engineering interest. As with the computational simulation of any physical phenomenon, the first step toward establishing credibility in ablation simulations involves code verification. Code verification is typically performed using exact and manufactured solutions. However, manufactured solutions generally require the invasive introduction of an artificial forcing term within the source code such that the code solves a modified problem for which the solution is known. In this paper, we present a nonintrusive method for manufacturing solutions for a non-decomposing ablation code, which does not require the addition of a source term.

42 ENGINEERING↗

Computational Evaluation of Thermal Response of Open-Cell Foam With Circular Pore (Computional Evaluation of Thermal Response of Open-Cell Foam with Circular Pore)

The evaluation of effective material properties in heterogeneous materials (e.g., composites or multicomponent structures) critically relevant to a wide spectrum of applications, including nuclear power, electronic packaging, flame retardants, hypersonics, and gas turbine power. The work described in this paper is centered around the numerical assessment of the thermal behavior of porous materials obtained from finite element thermal modeling and simulation. Here, two-dimensional, steady state analyses were performed on unit cells with centered, circular pores using a second order accurate Galerkin finite element method (FEM). The effective thermal conductivities of the porous systems were examined, encompassing a range of porosities from 4.9% to 60.1%. The geometries of the models were generated based on ordered circular pores for each modeled porosity level. The system response quantity (SRQ) under investigation was the dimensionless effective thermal conductivity across the unit cell. The dimensionless effective thermal conductivity was compared across all simulated cases, producing a trend between porosity and effective thermal conductivity. In the presented investigation, the method of manufactured solutions (MMS) was used to perform code verification, and the grid convergence index (GCI) was employed to estimate discretization uncertainty as solution verification. Code verification concluded an approximately second order accurate Galerkin FEM solver. It was found that the introduction of porosity to the unit cell material structure reduces effective thermal conductivity, as anticipated. Numerical results obtained in this study are compared to an analytical solution and to a sample of empirical data.

36 MATERIALS SCIENCE↗

Linear and nonlinear verification of gyrokinetic microstability codes

Verification of nonlinear microstability codes is a necessary step before comparisons or predictions of turbulent transport in toroidal devices can be justified. By verification we mean demonstrating that a code correctly solves the mathematical model upon which it is based. Some degree of verification can be accomplished indirectly from analytical instability threshold conditions, nonlinear saturation estimates, etc., for relatively simple plasmas. However, verification for experimentally relevant plasma conditions and physics is beyond the realm of analytical treatment and must rely on code-to-code comparisons, i.e., benchmarking. The premise is that the codes are verified for a given problem or set of parameters if they all agree within a specified tolerance. True verification requires comparisons for a number of plasma conditions, e.g., different devices, discharges, times, and radii. Running the codes and keeping track of linear and nonlinear inputs and results for all conditions could be prohibitive unless there was some degree of automation. We have written software to do just this and have formulated a metric for assessing agreement of nonlinear simulations. We present comparisons, both linear and nonlinear, between the gyrokinetic codes GYRO[J. Candy and R. E. Waltz, J. Comput. Phys. 186, 545 (2003)] and GS2[W. Dorland, F. Jenko, M. Kotschenreuther, and B. N. Rogers, Phys. Rev. Lett. 85, 5579 (2000)]. We do so at the mid-radius for the same discharge as in earlier work [C. Holland, A. E. White, G. R. McKee, M. W. Shafer, J. Candy, R. E. Waltz, L. Schmitz, and G. R. Tynan, Phys. Plasmas 16, 052301 (2009)]. The comparisons include electromagnetic fluctuations, passing and trapped electrons, plasma shaping, one kinetic impurity, and finite Debye-length effects. Results neglecting and including electron collisions (Lorentz model) are presented. We find that the linear frequencies with or without collisions agree well between codes, as do the time averages of the nonlinear fluxes without collisions. With collisions, the differences between the time-averaged fluxes are larger than the uncertainties defined as the oscillations of the fluxes, with the GS2 fluxes consistently larger (or more positive) than those from GYRO. However, the electrostatic fluxes are much smaller than those without collisions (the electromagnetic energy flux is negligible in both cases). In fact, except for the electron energy fluxes, the absolute magnitudes of the differences in fluxes with collisions are the same or smaller than those without. None of the fluxes exhibit large absolute differences between codes. Beyond these results, the specific linear and nonlinear benchmarks proposed here, as well as the underlying methodology, provide the basis for a wide variety of future verification efforts.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Verification of a Multiphysics Code with Method of Manufactured Solutions

To push the modeling and simulation to a new level in simulating realistic problems, a common practice is to couple different single-physics codes together to simulate problems involving multiple physics. Although the method of manufactured solutions (MMS) has been shown to be a powerful tool in code verification, there has been little work on applying MMS to a multi-physics code system. Additionally, due to the scarcity of multi-physics validation data, the significance of code verification becomes more prominent as an important part in software quality assurance. With this, the application of MMS to a coupled code system, e.g. VERA-CS, has become a crucial step, which helps identify bugs affecting the order of accuracy, thus increasing the credibility and reliability of the code. In this work, we investigate the application of MMS to verify a multi-physics code system and establish a framework for this application, and we demonstrate this with a neutronics code coupled with a thermal hydraulics (TH) code. The convection module is not yet added to this work, so by TH, only conduction is considered.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Exploration of Uncertainty in Glacier Modelling

There are procedures and methods for verification of coding algebra and for validations of models and calculations that are in use in the aerospace computational fluid dynamics (CFD) community. These methods would be efficacious if used by the glacier dynamics modelling community. This paper is a presentation of some of those methods, and how they might be applied to uncertainty management supporting code verification and model validation for glacier dynamics. The similarities and differences between their use in CFD analysis and the proposed application of these methods to glacier modelling are discussed. After establishing sources of uncertainty and methods for code verification, the paper looks at a representative sampling of verification and validation efforts that are underway in the glacier modelling community, and establishes a context for these within overall solution quality assessment. Finally, an information architecture and interactive interface is introduced and advocated. This Integrated Cryospheric Exploration (ICE) Environment is proposed for exploring and managing sources of uncertainty in glacier modelling codes and methods, and for supporting scientific numerical exploration and verification. The details and functionality of this Environment are described based on modifications of a system already developed for CFD modelling and analysis.

Thompson, David E.↗

Verification of a Viscous Computational Aeroacoustics Code Using External Verification Analysis

The External Verification Analysis approach to code verification is extended to solve the three-dimensional Navier-Stokes equations with constant properties, and is used to verify a high-order computational aeroacoustics (CAA) code. After a brief review of the relevant literature, the details of the EVA approach are presented and compared to the similar Method of Manufactured Solutions (MMS). Pseudocode representations of EVA's algorithms are included, along with the recurrence relations needed to construct the EVA solution. The code verification results show that EVA was able to convincingly verify a high-order, viscous CAA code without the addition of MMS-style source terms, or any other modifications to the code.

Computational↗

Verification of a Viscous Computational Aeroacoustics Code using External Verification Analysis

The External Verification Analysis approach to code verification is extended to solve the three-dimensional Navier-Stokes equations with constant properties, and is used to verify a high-order computational aeroacoustics (CAA) code. After a brief review of the relevant literature, the details of the EVA approach are presented and compared to the similar Method of Manufactured Solutions (MMS). Pseudocode representations of EVA's algorithms are included, along with the recurrence relations needed to construct the EVA solution. The code verification results show that EVA was able to convincingly verify a high-order, viscous CAA code without the addition of MMS-style source terms, or any other modifications to the code.

Computational↗

Review and verification of CARE 3 mathematical model and code

The CARE-III mathematical model and code verification performed by Boeing Computer Services were documented. The mathematical model was verified for permanent and intermittent faults. The transient fault model was not addressed. The code verification was performed on CARE-III, Version 3. A CARE III Version 4, which corrects deficiencies identified in Version 3, is being developed.

Rose, D. M.↗

Code and Solution Verification Assessment of the CTF Thermal Hydraulic Subchannel Code

CTF is a thermal-hydraulics subchannel code jointly developed by Oak Ridge National Laboratory and North Carolina State University. Over the past seven years, the Consortium for Advanced Simulation of Light Water Reactors (CASL) has made a significant investment in developing CTF so it can be used to model light water reactors, including nominal operating conditions, departure from nucleate boiling analysis, and transients ranging from loss of flow to reactivity insertion accidents. In addition to implementing new modeling capabilities and developing the user input and output interface, extensive work has been performed to improve the code’s quality assurance program, resulting in a development process that conforms with NQA-1 requirements. The CASL program follows the Predictive Capability Maturity Model (PCMM) approach for assessing code quality, which emphasizes performing code verification(ensuring the code converges to the correct answer) and solution verification (ensuring the code converges for the intended application). Code and solution verification are used to identify uncertainty errors introduced by numerical approximations in the code and are important for demonstrating that the model is coded without error, which is an important aspect of the Best Estimate plus Uncertainty method. This paper presents a comprehensive overview of the code and solution verification testing that has been performed on CTF. A top-down approach is taken in which the intended CTF applications are presented, followed by the code features required for their modeling. These features are then linked to the applicable code and solution verification tests that demonstrate proper functioning. Past testing efforts are summarized, and new tests are added to help close gaps in the presented test matrix. Rather than performing “one-off” exercises, these tests are added to the automated CTF regression test suite to ensure continual code quality.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

An Overview of Gemma FY20 Verification Activities

Gemma verification activities for FY20 can be divided into three categories: the development of specialized quadrature rules, initial progress towards the development of manufactured solutions for code verification, and automated code-verification testing. In the method-of-moments implementation of the electric-field integral equation, the presence of a Green’s function in the four-dimensional integrals yields singularities in the integrand when two elements are nearby. To address these challenges, we have developed quadrature rules to integrate the functions through which the singularities can be characterized. Code verification is necessary to develop confidence in the implementation of the numerical methods in Gemma. Therefore, we have begun investigating the use of manufactured solutions to more thoroughly verify Gemma. Manufactured solutions provide greater flexibility for testing aspects of the code; however, the aforementioned singularities provide challenges, and existing work is limited in rigor and quantity. Finally, we have implemented automated code-verification testing using the VVTest framework to automate the mesh refinement and execution of a Gemma simulation to generate mesh convergence data. This infrastructure computes the observed order of accuracy from these data and compares it with the theoretical order of accuracy to either develop confidence in the implementation of the numerical methods or detect coding errors.

97 MATHEMATICS AND COMPUTING↗

Pre-engineering Spaceflight Validation of Environmental Models and the 2005 HZETRN Simulation Code

The HZETRN code has been identified by NASA for engineering design in the next phase of space exploration highlighting a return to the Moon in preparation for a Mars mission. In response, a new series of algorithms beginning with 2005 HZETRN, will be issued by correcting some prior limitations and improving control of propagated errors along with established code verification processes. Code validation processes will use new/improved low Earth orbit (LEO) environmental models with a recently improved International Space Station (ISS) shield model to validate computational models and procedures using measured data aboard ISS. These validated models will provide a basis for flight-testing the designs of future space vehicles and systems of the Constellation program in the LEO environment.

Nealy, John E.↗

ExactPack Documentation

For code verification, one compares the code output against known exact solutions. There are many standard test problems used in this capacity, such as the Noh and Sedov problems. ExactPack is a utility that integrates many of these exact solution codes into a common API (application program interface), and can be used as a stand-alone code or as a python package. ExactPack consists of python driver scripts that access a library of exact solutions written in Fortran or Python. The spatial profiles of the relevant physical quantities, such as the density, fluid velocity, sound speed, or internal energy, are returned at a time specified by the user. The solution profiles can be viewed and examined by a command line interface or a graphical user interface, and a number of analysis tools and unit tests are also provided. We have documented the physics of each problem in the solution library, and provided complete documentation on how to extend the library to include additional exact solutions. ExactPack’s code architecture makes it easy to extend the solution-code library to include additional exact solutions in a robust, reliable, and maintainable manner.

97 MATHEMATICS AND COMPUTING↗

Verification and Demonstration of One-Dimensional Freezing Model in SAM for Salt-Cooled Reactor Analysis Applications

This work presented the development and implementation of the one-dimensional freezing model in system analysis code, SAM, as well as code verification, and code demonstration during a postulated overcooling transient, for fluoride salt-cooled high-temperature reactor (FHR) system and safety analysis applications. The paper at first summarized the freezing model, finite element numerical method, and special numerical treatment for handling phase appearance/disappearance. Analytical solutions were derived for two cases (with and without solid walls) for code verifications purpose. As expected, numerical results predicted by the SAM code agreed very well with the analytical solution. A code demonstration was then performed on a postulated protected overcooling event transient of a generic reference PB-FHR design. The code was found to successfully predict salt freezing during such a postulated event. However, due to lack of salt freezing testing data, code validation has not been performed in this work, which will be pursued in later studies when such data becomes available.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Preliminary Analysis of the Transient Reactor Test Facility (TREAT) with PROTEUS

The neutron transport code PROTEUS has been used to perform preliminary simulations of the Transient Reactor Test Facility (TREAT). TREAT is an experimental reactor designed for the testing of nuclear fuels and other materials under transient conditions. It operated from 1959 to 1994, when it was placed on non-operational standby. The restart of TREAT to support the U.S. Department of Energy’s resumption of transient testing is currently underway. Both single assembly and assembly-homogenized full core models have been evaluated. Simulations were performed using a historic set of WIMS-ANL-generated cross-sections as well as a new set of Serpent-generated cross-sections. To support this work, further analyses were also performed using additional codes in order to investigate particular aspects of TREAT modeling. DIF3D and the Monte-Carlo codes MCNP and Serpent were utilized in these studies. MCNP and Serpent were used to evaluate the effect of geometry homogenization on the simulation results and to support code-to-code comparisons. New meshes for the PROTEUS simulations were created using the CUBIT toolkit, with additional meshes generated via conversion of selected DIF3D models to support code-to-code verifications. All current analyses have focused on code-to-code verifications, with additional verification and validation studies planned. The analysis of TREAT with PROTEUS-SN is an ongoing project. This report documents the studies that have been performed thus far, and highlights key challenges to address in future work.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Argonne Reactor Code Software Verification and Validation Plan for the Versatile Test Reactor

This Argonne Reactor Code (ARC) software has taken a pivotal role in the design work of the Versatile Test Reactor. The ARC software itself consists of several independent or semiindependent pieces of software that are used in concert to carry out specific analysis and design objectives. In this report, we discuss the validation that is needed for the ARC software overall and discuss available, usable experimental data and how it relates to the VTR project. We also discuss the verification that is required for the ARC software with respect to its usage in the VTR project and give some concrete examples as to what it must accomplish. A list of goals for the verification and validation work are presented as the general procedure that will be implemented for every individual piece of software in ARC. The ARC software has been continuously developed for over 50 years and many of the features used for the VTR project have thus been rigorously tested for accuracy during that timeframe. The ARC software is presently under source code control and undergoes nightly regression testing of not only the individual pieces, but the interconnected aspects that are common to most analysis projects. Its greatest weakness, from a software verification and validation perspective, is both a lack of documentation and outdated documentation. As an example, much of the previous validation work will require contemporary effort to re-evaluate given the updated base data libraries and modifications to the software that have occurred since. This requires new documentation to be produced to support the usage of the software in the VTR project. The bulk of the ARC software is focused on steady state neutronics and TH behavior of a reactor system. In this regard, we have identified the ZPPR, FFTF, and EBR-II programs as the best candidates for sources of validation data for the VTR project. The ZPPR-15 series in the ZPPR program was chosen as it is the best representation of the VTR fuel form and reactor core layout of all of the ZPPR measurements. Additional support for it comes from the fact that most of the data has already been processed into usable ARC models for VTR validation. The FFTF and EBR-II reactors were both functional reactors that provide reactor scale measurements. FFTF is clearly a closer match to VTR and its startup measurements would be a very valuable validation basis. EBR-II has invaluable burnup related measurements that will play a key role in the ARC software validation work. Each piece of ARC software will require a report detailing the software verification. The validation work will be logically split into the results of modeling each identified experimental resource (ZPPR, EBR-II, FFTF). The intended timeline for the VTR project is to have the ARC software verified and validated by the end of fiscal year 2020. This is incumbent on sufficient funding allocated to V&V activities and no change in programmatic priorities.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DEVELOPMENT OF A VERIFICATION BENCHMARK SUITE FOR THE ATR REACTOR PHYSICS UPGRADE

The result of a numerical algorithm is only as good as the effort made toward its verification. Comprehensive computer codes, especially for application to nuclear reactors, require in-depth assessment of the numerical methods used and their computational implementation. This presentation describes a suite of semi-analytical benchmarks for the ATR Reactor Physics Upgrade as part of the ATR Life Extension Project (LEP). Several neutron transport codes including deterministic codes HELIOS, NEWT and probabilistic codes MCNP6, SERPANT and MC21 are upgrade candidates. To properly evaluate code performance capabilities, code verification is an essential element. A credible verification program requires education to guide proper application, training in proper input preparation and output expectation and verification to instill confidence in the coded numerical procedures. The subset of the benchmark suite to be described here is primarily of the 1D transport variety (however, a 2D case does indeed exist) with the intent to provide unquestionably high order accurate semi-analytical numerical solutions to the transport equation. We base the analytical solutions on analytical Fourier series and discrete ordinates representations. Here we present two 1D benchmarks based on Fourier series.

99 GENERAL AND MISCELLANEOUS↗