Search NASA⌕ Search

SEARCH · Search NASA

Results for “code verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Review of Experimental Data for Validating Computer Codes Used in Shielding Calculations for Spent Fuel Storage and Transportation Systems

This report presents a review of available radiochemical assay data and shielding benchmarks applicable to spent nuclear fuel (SNF) shielding calculations. The relevant information reviewed herein includes the Spent Fuel Composition (SFCOMPO) database, the Shielding Integral Benchmark Archive and Database (SINBAD), the International Handbook of Evaluated Criticality Safety Benchmark Experiments, and published measurements of external dose rates of casks loaded with SNF. The relevant experimental data identified in this report may be used to support verification and validation of computer codes used in SNF cask/transport shielding applications, as well as development of calculation uncertainties. It should be noted that a relatively small subset of the identified experimental data (e.g., criticality alarm experiments) is available in a standard format established by the international community participating in experimental isotopic and shielding data evaluations. An effort of the SFCOMPO Technical Review Group (TRG) is underway to publish first isotopic evaluations of individual assay data using a standard data evaluation format. The SINBAD TRG has recently initiated benchmark evaluations and modernization of the database. Therefore, more relevant information is expected in the future that will enable users to select quality experimental data in depletion code and shielding code validations for SNF applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

FY12 Quarter 3 Computing Utilization Report – LANL

DSW continues to dominate the capacity workload, with a focus in Q3 on common model baselining runs in preparation for the Annual Assessment Review (AAR) of the weapon systems. There remains unmet demand for higher fidelity simulations, and for increased throughput of simulations. Common model baselining activities would benefit from doubling the resolution of the models and running twice as many simulations. Capacity systems were also utilized during the quarter to prepare for upcoming Level 2 milestones. Other notable DSW activities include validation of new physics models and safety studies. The safety team used the capacity resources extensively for projects involving 3D computer simulations for the Furrow series of experiments at DARHT (a Level 2 milestone), fragment impact, surety theme, PANTEX assessments, and the 120-day study. With the more than tripling of classified capacity computing resources with the addition of the Luna system and the safety team's imminent access to the Cielo system, demand has been met for current needs. The safety team has performed successful scaling studies on Luna up to 16K PE size-jobs with linear scaling, running the large 3D simulations required for the analysis of Furrow. They will be investigating scaling studies on the Cielo system with the Lustre file system in Q4. Overall average capacity utilization was impacted by negative effects of the LANL Voluntary Separation Program (VSP) at the beginning of Q3, in which programmatic staffing was reduced by 6%, with further losses due to management backfills and attrition, resulting in about 10% fewer users. All classified systems were impacted in April by a planned 2 day red network outage. ASC capacity workload continues to focus on code development, regression testing, and verification and validation (V&V) studies. Significant capacity cycles were used in preparation for a JOWOG in May and several upcoming L2 milestones due in Q4. A network transition has been underway on the unclassified networks to increase access of all ASC users to the unclassified systems through the Yellow Turquoise Integration (YeTI) project. This will help to alleviate the longstanding shortage of resources for ASC unclassified code development and regression testing, and also make a broader palette of machines available to unclassified ASC users, including PSAAP Alliance users. The Moonlight system will be the first capacity resource to be made available through the YETI project, and will make available a significant increase in cycles, as well as GPGPU accelerator technology. The Turing and Lobo machines will be decommissioned in the next quarter. ASC projects running on Cielo as part of the CCC-3 include turbulence, hydrodynamics, burn, asteroids, polycrystals, capability and runtime performance improvements, and materials including carbon and silicone.

43 PARTICLE ACCELERATORS↗

Verification of the ideal magnetohydrodynamic response at rational surfaces in the VMEC code

The VMEC nonlinear ideal MHD equilibrium code [S. P. Hirshman and J. C. Whitson, Phys. Fluids 26, 3553 (1983)] is compared against analytic linear ideal MHD theory in a screw-pinch-like configuration. The focus of such analysis is to verify the ideal MHD response at magnetic surfaces which possess magnetic transform (ι) which is resonant with spectral values of the perturbed boundary harmonics. A large aspect ratio circular cross section zero-beta equilibrium is considered. This equilibrium possess a rational surface with safety factor q = 2 at a normalized flux value of 0.5. A small resonant boundary perturbation is introduced, exciting a response at the resonant rational surface. The code is found to capture the plasma response as predicted by a newly developed analytic theory that ensures the existence of nested flux surfaces by allowing for a jump in rotational transform (ι=1/q). The VMEC code satisfactorily reproduces these theoretical results without the necessity of an explicit transform discontinuity (Δι) at the rational surface. It is found that the response across the rational surfaces depends upon both radial grid resolution and local shear (dι/dΦ, where ι is the rotational transform and Φ the enclosed toroidal flux). Calculations of an implicit Δι suggest that it does not arise due to numerical artifacts (attributed to radial finite differences in VMEC) or existence conditions for flux surfaces as predicted by linear theory (minimum values of Δι). Scans of the rotational transform profile indicate that for experimentally relevant levels of transform shear the response becomes increasing localised. Furthermore, careful examination of a large experimental tokamak equilibrium, with applied resonant fields, indicates that this shielding response is present, suggesting the phenomena is not limited to this verification exercise.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

In Situ Data Infrastructure for Scientific Unit Testing Platform

Testing is a significant software development process for the management of software systems and scientific code. However, as the complexity of scientific codes increases, extra checks are needed to monitor impacts to dependent models and to verify system constraints. The software complexity also impedes the efforts of module developers and software engineers to rapidly develop and extend their code. Recently, we have developed an automatic methodology and prototype platform to facilitate scientific verification of individual functions within complex scientific codes. With this system, the scientific module builders are able to track variables conveniently in one module or track variables’ changes among different modules. In this paper, we present a procedure for automatic unit testing generation. For the interest of a general audience of this conference, we are emphasizing the technical details of integrating the In Situ data infrastructure into our platform. At the end of this paper, we have included an implementation of unit testing for the ACME Land Model (ALM) to demonstrate the usefulness and correctness of the platform. We have also used single- and multipoint checks to demonstrate the efficient variable tracking capability of this platform.

97 MATHEMATICS AND COMPUTING↗

Modeling of Macroscopic Dynamics in Three-Dimensional Plasma Configurations (Final Technical Report)

A numerical simulation-based study to investigate the stability properties of inherently three-dimensional plasma magnetic configurations is presented. These configurations, called stellarators and heliotrons, use external helical coils to provide the twisting magnetic field that is required to confine ionized plasma particles. In contrast to the tokamak configuration, which nominally has the property of axisymmetry, electrical current does not need to be induced in stellarator and heliotron plasma. Experiments have shown that these three-dimensional configurations are remarkably robust to macroscopic instability, even when driven to relatively high levels of plasma pressure. Our understanding of how the plasma is able to withstand macroscopic instability will be enhanced by the work proposed here. The effort will generalize existing numerical modeling capability, and it will apply the new capability to model macroscopic dynamics in these three-dimensional configurations. The development work has been applied to the NIMROD simulation code (https://nimrodteam.org) that was originally based on axisymmetric problem domains. It has been generalized to accommodate the three-dimensional shaping of the plasma volume in stellarators and heliotrons. Its use of equilibrium data has also been generalized, and the implementation allows different numerical representation of the magnetic field. Analysis has been performed to inform the selection of numerical methods, and a method to accelerate the iterative solution of the necessary algebraic systems has been developed and implemented. Verification of the new NIMSTELL code on benchmark problems has also been an important part of the effort.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Verification and Validation Approach for COMSOL Multiphysics to Support High Flux Isotope Reactor (HFIR)

Over the last several decades, many reactors have successfully been converted from high enriched uranium (HEU) to low enriched uranium (LEU) fuels in United States in support of its global non-proliferation objectives. Of the reactors slated for conversion, five high-performance research reactors (HPRRs) remain. The high-flux isotope reactor (HFIR) at Oak Ridge National Laboratory (ORNL) is one of the five. Conversion of HFIR requires the qualification of a new fuel. To aid in the conversion process as well as improve safety margins, COMSOL Multiphysics was chosen to support and eventually supplement the steady-state heat-transfer code (SSHTC). In order to use COMSOL as a supplementary tool, i.e. one used for safety basis calculations, the code needs to undergo a verification and validation process. Verification and validation are important processes for the use of any software; however, physics-based solvers have a unique challenge, in that the validation is much more rigorous and its domain is only applicable to the general scope of the problem. This document details the verification and validation of COMOSL for analysis of HFIR. This report is intended for two different users: (1) current and future users of COMSOL for HFIR and (2) for individuals interested in assessing the scope of the validation of COMSOL for HFIR. This report is divided into six sections. The first of which details the process of verification and validation. Section one provides an overview of key concepts from ASME V&V 10, 20, and 40 and how these concepts are used to provide a validation of any multiphysics software. Section two covers the approach needed in order to validate multiphysics software for a given HFIR analysis. Parts three through five split up the key concepts highlighted in section two. The final section provides concluding remarks which demonstrate the scope and limitations of the validation study and how these may be expanded and improved.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

BlueCRAB Domain Overlapping Coupling: Theory & Verification

Coupling low- and high-fidelity codes is a useful way to model complex engineering systems. Thanks to the high-fidelity code, complex phenomena can be resolved in areas of the system where this is required, yet the efficiency of the lower-fidelity code is still retained in modeling the rest of the system. This document details the theory and implementation of coupling two different thermal-hydraulic codes: the system thermal-hydraulics (STH) code System Analysis Module (SAM) and the coarse-mesh computational fluid dynamics (CFD) code Pronghorn. Both applications are included in the Comprehensive Reactor Analysis Bundle (BlueCRAB) code suite and are based on the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework. The domain overlapping (DO) coupling approach was adopted, as it offers proven advantages over more conventional domain decomposition methods. In the DO coupling, SAM provides Pronghorn with boundary conditions that depend on the system-level simulation of the entire plant. In return, the overlapping coupled SAM components–termed “surrogate components”–receive friction factors and source terms computed online based on the Pronghorn simulation. The framework is designed to be generic and enable coupling regardless of geometry and the number of inlet/outlet boundaries in the DO coupled domain. The developed method leads to consistent pressure drops, enthalpies, and scalar concentrations when comparing the coupled SAM and Pronghorn simulations. This document presents the DO coupling approach, along with two verification and two demonstration cases. The proposed problems explore different physical aspects relevant to nuclear reactor analysis, including buoyancy-driven flows, complex flow patterns, and multiple inlets and outlets. Periodically, new versions of this “BlueCRAB Domain Overlapping Coupling: Theory & Verification” report will be issued to reflect future developments and verification tests.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Computer Modeling and Simulation: Increasing Reliability by Disentangling Verification and Validation

Verification and validation (V&V) of computer codes and models used in simulations are two aspects of the scientific practice of high importance that recently have been discussed widely by philosophers of science. While verification is predominantly associated with the correctness of the way a model is represented by a computer code or algorithm, validation more often refers to the model’s relation to the real world and its intended use. Because complex simulations are generally opaque to a practitioner, the Duhem problem can arise with verification and validation due to their entanglement; such an entanglement makes it impossible to distinguish whether a coding error or the model’s general inadequacy to its target should be blamed in the case of a failure. I argue that a clear distinction between computer modeling and simulation has to be made to disentangle verification and validation. Drawing on that distinction, I suggest to associate modeling with verification and simulation, which shares common epistemic strategies with experimentation, with validation. To explain the reasons for their entanglement in practice, I propose a Weberian ideal–typical model of modeling and simulation as roles in practice. I examine an approach to mitigate the Duhem problem for verification and validation that is generally applicable in practice and is based on differences in epistemic strategies and scopes. Based on this analysis, I suggest two strategies to increase the reliability of simulation results, namely, avoiding alterations of verified models at the validation stage as well as performing simulations of the same target system using two or more different models. In response to Winsberg’s claim that verification and validation are entangled I argue that deploying the methodology proposed in this work it is possible to mitigate inseparability of V&V in many if not all domains where modeling and simulation are used.

97 MATHEMATICS AND COMPUTING↗

ON THE ANALATICAL SOLUTIONS AND NUMERICAL VERIFICATIONS OF THE TWO-PHASE WATER FAUCET PROBLEM

The two-phase water faucet problem is one of the benchmark problems originally proposed by Ransom. The test consists of a vertical pipe, which is initially filled with a uniform column of liquid moving with an initial velocity and an annulus of gas sitting still. At the top boundary, liquid is supplied at the same velocity as the initial velocity, and the bottom of the pipe opens to the ambient. Due to the gravity effect, the liquid column accelerates and becomes thinner. With simplifications, such as massless gas phase and no wall and interfacial frictions, an analytical solution could be obtained for the transient liquid velocity and void fraction distribution. The test has been widely used for the purposes of code assessment, benchmark and numerical verifications. This exact solution was used in this work to verify the numerical accuracy of a high-resolution spatial discretization scheme. The high-resolution spatial discretization scheme is based on the commonly used staggered grid mesh, and slope limiter was introduced to achieve high resolutions in space. It was found that, at the steady state, an expected second-order spatial accuracy could not be achieved. A further investigation showed that this exact solution does not actually satisfy the commonly used two-fluid single pressure two-phase flow equations. More importantly, we have also found that a steady-state exact solution could be obtained for the water faucet problem. In this work, we have demonstrated the derivation of the steady-state exact solution for the water faucet problem. The exact solution was then used to verify a first-order and a high-resolution spatial discretization scheme, from which expected order of accuracy was achieved by doing mesh refinement.

42 ENGINEERING↗

An Educational Guide for 2D Stellar Structure Calculations of Rapidly Rotating Stars using the ESTER code

The Evolution STEllaire en Rotation (ESTER) code is the first 2D stellar structure code to be made open-source and freely available to the astronomy and astrophysics community. An important and novel advancement of this code is that it can reproduce the distorted shape and observable signatures (e.g., gravity darkening) of rapidly rotating stars. ESTER also calculates the steady-state large-scale flows within the star, namely their differential rotation and associated meridional circulation. In this report, we explore and document the physics implemented within version 1.1.0rc2 of the ESTER code, in a way that complements published descriptions. We illustrate this physics by plotting how stellar structure parameters vary through stellar interiors at a range of latitudes and at different angular velocities. We investigate how the thin convective envelopes of intermediate mass stars vary with latitude when rapidly rotating, becoming deeper and thicker near the equator. Simple comparisons of ESTER model predictions (e.g., central temperature and density, luminosity) with the output from the Modules for Experiments in Stellar Astrophysics (MESA) code [Paxton et al., 2010] shows generally good agreement. Additional comparisons provide important benchmarking and verification for ESTER as a comparatively young code. Finally, we provide a guide for installing and running the code on our local university cluster, aimed at helping students to begin work.

79 ASTRONOMY AND ASTROPHYSICS↗

Simulation of Gas Production from Multilayered Hydrate-Bearing Media with Fully Coupled Flow, Thermal, Chemical and Geomechanical Processes Using TOUGH + Millstone. Part 1: Numerical Modeling of Hydrates

TOUGH + Millstone has been developed for the analysis of coupled flow, thermal and geomechanical processes associated with the formation and/or dissociation of CH4-hydrates in geological media. It is composed of two constituent codes: (a) a significantly enhanced version of the TOUGH + HYDRATE simulator, V2.0, that accounts for all known flow, physical, thermodynamic and chemical processes associated with the behavior of hydrate-bearing systems undergoing changes and includes the most recent advances in the description of the system properties, coupled seamlessly with (b) Millstone V1.0, a new code that addresses the conceptual, computational and mathematical shortcomings of earlier codes used to describe the geomechanical response of these systems. The capabilities of TOUGH + Millstone are demonstrated in the simulation and analysis of the system flow, thermal and geomechanical behavior during gas production from a realistic complex offshore hydrate deposit. In the first paper of this series, we discuss the physics underlying the T + H hydrate simulator, the constitutive relationships describing the physical, chemical (equilibrium and kinetic) and thermal processes, the states of the CH 4 + H 2 O system and the sources of critically important data, as well as the mathematical approaches used for the development of the of mass and energy balance equations and their solution. Finally, we provide verification examples of the hydrate code against numerical results from the simulation of laboratory and field experiments.

58 GEOSCIENCES↗

Summary for the Next Generation Nuclear Plant Project in Review

This paper reports on the major progress that the NGNP Project has made toward developing and commercializing the HTGR technology. Significant R&D progress has been made in addressing key technical issues for qualification of the HTGR fuel and graphite, codification of high temperature materials and verification and validation of design codes. Work is also progressing in heat transfer/transport design and testing and in development of the high temperature steam electrolysis hydrogen production process. A viable licensing strategy has been formulated in coordination with the NRC and DOE. White papers covering key licensing issues have been and will continue to be submitted and necessary discussions of these key issues have begun with the NRC. Continued government support is needed to complete the Project objectives as established in the 2005 Energy Policy Act.

99 GENERAL AND MISCELLANEOUS↗

A framework for assessment of predictive capability maturity and its application in nuclear thermal hydraulics

Here this work presents a formalized and computerized framework for the assessment of decision regarding the adequacy of a simulation tool for a nuclear reactor application. The decision regarding a code’s adequacy for an application is dependent on the assessment of different attributes that govern verification, validation, and uncertainty quantification of the code. In this work, the focus is on code validation. Therefore, the framework is developed and illustrated from the perspective of decision regarding the validation assessment of a code. Code validation assessment is performed based on the validation test results, data applicability, and process quality assurance factors. The process quality assurance factors warrant the trustworthiness of the evidence and help in checking people and process compliance with respect to the standard requirements. The proposed framework is developed using an argument modeling technique called Goal Structuring Notation (GSN). Goal structuring notation facilitates structural knowledge representation, information abstraction, evidence incorporation, and provides a skeletal structure for quantitative maturity assessment. The decision schema for the development of the decision model is based on the Predictive Capability Maturity Model (PCMM) and Analytic Hierarchy Process (AHP) and formalized using Goal structuring notation. Each decision attribute is formulated as a claim, where the degree of validity of the claim (attribute’s assessment) is expressed using different maturity levels. The GSN representation of the decision model is transformed into a confidence network to provide evidence-based quantitative maturity assessment using the Bayesian network. A metric based on the expected utility of maturity levels, called expected distance metric, is proposed to measure the distance between target maturity and achieved maturity on a scale of zero to one. Expected distance metric helps in comparing the assessment of different attributes and identification of major areas of concern in terms of modeling capability, data needs, and quality of assessment process. The practical application of the framework is demonstrated by a case study on validation assessment of a thermal-hydraulic code for a challenge problem called Departure from Nucleate Boiling (DNB).

42 ENGINEERING↗

Improving Limit Surface Search Algorithms in RAVEN Using Acceleration Schemes: Level II Milestone

The RAVEN code is becoming a comprehensive tool to perform Probabilistic Risk Assessment (PRA); Uncertainty Quantification (UQ) and Propagation; and Verification and Validation (V&V). The RAVEN code is being developed to support the Risk-Informed Safety Margin Characterization (RISMC) pathway by developing an advanced set of methodologies and algorithms for use in advanced risk analysis. The RISMC approach uses system simulator codes applied to stochastic analysis tools. The fundamental idea behind this coupling approach to perturb (by employing sampling strategies) timing and sequencing of events, internal parameters of the system codes (i.e., uncertain parameters of the physics model) and initial conditions to estimate values ranges and associated probabilities of figures of merit of interest for engineering and safety (e.g. core damage probability, etc.). This approach applied to complex systems such as nuclear power plants requires performing a series of computationally expensive simulation runs. The large computational burden is caused by the large set of (uncertain) parameters characterizing those systems. Consequently, exploring the uncertain/parametric domain, with a good level of confidence, is generally not affordable, considering the limited computational resources that are currently available. In addition, the recent tendency to develop newer tools, characterized by higher accuracy and larger computational resources (if compared with the presently used legacy codes, that have been developed decades ago), has made this issue even more compelling. In order to overcome to these limitations, the strategy for the exploration of the uncertain/parametric space needs to use at best the computational resources focusing the computational effort in those regions of the uncertain/parametric space that are “interesting” (e.g., risk-significant regions of the input space) with respect the targeted Figures Of Merit (FOM): for example, the failure of the system, subject of the analysis. These methodologies are named, in the RAVEN environment, adaptive sampling strategies. These methodologies infer system responses from surrogate models constructed from already existing samples (produced using high fidelity simulations) and suggest the most relevant location (coordinate in the input space) of the next sampling point to be explored in the uncertain/parametric domain. When using those methodologies, it is possible to understand features of the system response with a small number of carefully selected samples. This report focuses on the development and improvement of the limit surface search. The limit surface is an important concept in system reliability analysis. Without going into the details, which will be covered later in the report, the limit surface could be briefly described as an hyper-surface in the system uncertainty/parametric space separating the regions leading to a prescribed system outcome. For example, if the uncertainty/parametric space is the one generated by the reactor power level and the duration of the batteries, the system is a nuclear power plant and the system outcome discriminating variable is the clad failure in a station blackout scenario, then the limit surface separates the combinations of reactor power level and battery duration that lead to clad failure from the ones that do not.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

MPACT Verification and Validation: Status and Plans

The MPACT code provides the capability to calculate the steady-state reactor core neutron distribution for operating nuclear power plant (PWR) conditions across multiple fuel cycles. This document provides an initial plan and summarizes the current status of the verification and validation (V&V) of MPACT.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗