Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification and Validation (V&V)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

MOSCATO Development and Integration in Fiscal Year 2022

During FY21, we conducted ongoing development work for the MOSCATO (Molten Salt Chemistry and Transport) solver. The code development work primarily consisted of transitioning capabilities from the original version of the solver, which was written in OpenFOAM, into Nek5000. In doing so, a fast, highly parallelizable solver was created that is capable of complex chemistry and corrosion simulations for engineering-scale molten salt systems. The Nek5000 version of MOSCATO is now fully featured and capable of higher-fidelity simulations than were previously possible. Demonstration cases including a thermal convection loop have been simulated to test these new capabilities. We built upon the work for FY22 and improved the code from several different perspectives. First, we improved the user interface by adding a new component to the official Nek5000 input file (.par). This new part contains documents parameters like, salt properties (density, viscosity, Cp, thermal conductivity), diffusion coefficients, standard potential, etc. Second, we built a conversion script to extract salt properties from the MSTDB-TP salt database and write to MOSCATO input file. Third, we migrated the code to NekRS, which is the GPU branch of Nek5000 and suitable for next generation supercomputers. Verification and Validation (V&V) work was also continued in FY22. Two tasks were performed. The first V&V task involved the validation of the Poisson-Nernst-Planck equation solver and Butler-Volmer electrode kinetics, by comparing with numerical and experimental data about thermoelectric cells. The second task involved the comparisons to corrosion results from a thermal convection loop run during the MSRE era. Satisfactory agreement was obtained from both tasks.

Yuan, Haomin↗
DOE OSTI2020

Risk-Informed MultiPphysics BestEestimate Plus Uncertainties (BEPU) Application Development of RELAP5-3D Perturbation Model

The United States nuclear industry is facing a strong challenge to ensure maximum safety while enhancing economic benefit. Safety is a key parameter to all aspects related to light water reactor (LWR) nuclear power plants (NPPs), especially cost savings. Since the goal is to extend the lifetimes of these NPPs, the traditional deterministic safety concept may not guarantee a current economic asset. The Light Water Reactor Sustainability (LWRS) Program has been promoting a wide range of research and development (R&D) in this field to maximize the safety, economics, and performance of these NPPs through improved scientific understanding. One of the best practices to achieve this goal is to identify and optimize safety margins, which can lead to cost reduction. To do this, under the LWRS framework, the Risk-Informed Systems Analysis (RISA) Pathway will focus on the optimization of safety margin and minimization of uncertainties to ensure both safety and economics at the highest level. The RISA Pathway will provide enhanced capabilities for analyzing and characterizing LWR systems performance by developing and demonstrating methods, tools, and data to enable risk-informed margins management (RIMM). The goals of the RISA Pathway are twofold: (1) deploy the risk-informed tools and methods that enable better representation of safety margins and factors that contribute to cost and safety; and (2) conduct advanced risk assessment applications with industry to support margin management strategies that enable more cost-effective plant operation. The tools and methods provided by the RISA Pathway will support effective margin management for both active and passive safety systems, structures, and components (SSC) of an NPP. The tools and methods used in the RISA Pathway should have high confidence and highest technical maturity for and implementation to industry at its current setting. They should also have a capability to support risk-informed decision making for both probabilistic and deterministic elements of safety. The RISA Pathway will, therefore, perform a comprehensive assessment of verification and validation (V&V) status of RISA Toolkit to enhance credibility RISA Toolkit which be used by industry. This report summarizes RELAP5-3D development activities for best estimated and uncertainty (BEPU) capability to support ongoing RISA Pathway pilot projects for risk informed uncertainty quantification applications. Work scope includes (1) development of initial perturbation model for selected closure laws and (2) testing of suitable probability distribution functions (PDF) for the selected correlations. Developed BEPU modules are tested with selected separate effect cases and compared with conventional thermal-hydraulics model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Digital Twin Development of FASTR

This work package is focused on creating a digital twin (DT) of the Facility to Alleviate Salt Technology Risks (FASTR) experiment. FASTR is a high-profile facility tasked with maturing molten salt applications such as liquid salt energy storage, concentrated solar power facilities, and molten salt cooling systems supporting other advanced reactor technologies, all of which may be incorporated as components within the Integrated Energy Systems (IES) program. As part of creating a digital twin (DT), verification and validation (V&V) has been performed for the physics-based model, and gaps have been identified. Additionally, a preliminary integration of the FASTR model has been completed with the existing physics-based model of the Thermal Energy Distribution System (TEDS)/Microreactor AGile Non-nuclear Experimental Testbed (MAGNET) facility at Idaho National Laboratory (INL). A Functional Mock-up Unit (FMU) of the physics-based system model and a reduced-order model (ROM) were both used to test for a preliminary hardware in the loop operation when the physical loop was offline. Future tasks could include improving the physics-based model to better match the available experimental data, improving the hardware in the loop integration, and improving the integration with the TEDS model.

14 SOLAR ENERGY↗
DOE OSTI2023

Turbulence Modeling with Nek5000/RS, SOD2D and Alya

We present Validation and Verification (V & V) study of two high-order spectral element method (SEM) based Computational Fluid Dyanimcs (CFD) codes that we will utilize for work on turbulence modeling: Nek5000 and SOD2D. While the former solves the incompressible form of Navier-Stokes equation, the latter works with compressible set of equations and uses an entropy-viscosity formulation to account for the discontinuities for high Mach number flows. We demonstrate the accuracy of these codes for two benchmark sub-sonic turbulent flows: periodic channel and pipe flow, by carrying out first and second order statistical analysis, grid convergence and turbulent structure analysis using wall-resolved large eddy simulations (WRLES). Later, we report on the implementation and testing of various wall-modeling strategies for large eddy simulation of turbulent flows in Nek5000. These include both classical log-law based and decision-tree based machine-learning models. Accuracy of these closure strategies are analyzed and necessary future work is outlined.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Considerations regarding the Use of Computer Vision Machine Learning in Safety-Related or Risk-Significant Applications in Nuclear Power Plants

With the advancements made to date in the field of artificial intelligence (AI), significant potential exists to utilize AI capabilities for nuclear power plant (NPP) applications. AI can replicate human decision making and it is usually faster and more accurate than humans. For implementations that impact critical NPP applications (e.g., safety-related or non-safety systems that potentially affect overall plant risk), a deeper safety analysis of the AI methods is necessary. AI applied to NPP operations could resemble the use of digital I&C (DI&C) because such applications involve digital computer hardware and custom-designed software that input plant data, execute complex software algorithms, and output the results to a system or licensed human operator to potentially provoke an action. For AI methods to be compliant with current safety requirements for DI&C, AI compatibility must be evaluated, and AI-related gaps may exist that prevent the prompt deployment of AI in NPPs. This effort aims to evaluate how example AI technologies align with the DI&C safety framework, and discusses how they could be analyzed, modeled, tested, and validated in a manner similar to typical DI&C technologies. Because AI is a broad field that encompasses areas such as machine learning (ML), natural language processing, and computer vision, this research focused on a subset of methods categorized as the computer vision ML (CVML) methods. This report explores two CVML use cases, gauge reading and fire watch, considered relevant to the DI&C standards, as they could play a safety-critical role. For the gauge reading use case, a CVML-enabled technology that can read gauges at oblique angles is utilized. For the fire watch use case, a CVML-enabled technology is utilized that migrates fire watch from a manual (human) approach to automated fire detection. These use cases are mainly intended to give context to the CVML system discussion. This effort assumes the worst-case scenario, with the CVML system being used to replace a safety-related or risk-significant system, thus requiring evaluation. Evaluating CVML against most of the relevant safety requirements for DI&C yielded several CVML-specific considerations due to the uniqueness of its characteristics in comparison with typical DI&C systems. For example, CVML models often employ commonly used (open-source) datasets, and it is not always possible to determine the level of overlap among open-source datasets. Therefore, the independence of the developed CVML models when demonstrating diversity is questionable, therefore creating vulnerability to common cause failure (CCF). The design verification process is also impacted since the data overlap could result in overestimation of the software validation and verification (V&V) performance results. Section 2 of this report evaluates a list of the identified CVML-specific characteristics and discusses the resulting considerations and potential solutions in the context of each referenced requirement. A summation is provided in Section 3. This report is not to be used as a guideline. It was developed to identify and consider issues in the implementation of ML technologies used to augment activities that may have a bearing on plant operation. The report draws parallels to the use of DI&C technologies, for which many standards are available to guide their use in nuclear plant operation. It considers the technologies and some of the potential implications of their use in safety-related applications but is not intended to address regulatory or licensing related issues.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Enhance BISON Metal Fuel Transient Models and Enable Assessment Based on Out-of-Pile Transient Experiments

In this report, the activities and achievements made by Argonne National Laboratory for the Nuclear Energy Advanced Modeling and Simulation (NEAMS) BISON code metallic fuel validation and verification (V&V) project in FY2023, with a focus on the capability development and assessment case development for the out-of-pile transient experiments, are summarized. The liquid cladding penetration model was improved based on a comprehensive set of fuel behavior test apparatus (FBTA) test results. The new model was implemented into BISON along with a simple model to account for fuel melting effects. The metallic fuel meshing capability was also upgraded to allow local refinement using unstructured triangular mesh. Based on the previous success in developing the BISON-FIPD integration powered BISON assessment case, this database enabled BISON evaluation and V&V capability was expanded to the out-of-pile transient experiments by introducing BISON-OPTD integration. A series of initial out-of-pile transient assessment cases were implemented into BISON to provide powerful platforms to evaluate current BISON’s capabilities in simulating metallic fuel performance during out-of-pile transients. The established capabilities will also benefit the calibration and V&V of future advanced mechanistic models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

The Release of the Simplified Radionuclide Transport (SRT) Code (V.2.1)

Reactor licensing centers on the protection of the public and environment from the inadvertent release of radioactive material. Therefore, mechanistic source term analysis, or the realistic evaluation of radionuclide transport from the source to the environment for specific transient scenarios, is vital to reactor licensing efforts. Developed to resolve a gap in mechanistic source term modeling capabilities for sodium fast reactors (SFRs), the Simplified Radionuclide Transport (SRT) code created by Argonne National Laboratory (Argonne) is now utilized by advanced reactor vendors, universities, and research institutions to support a multitude of design, licensing, and research efforts. Recently, SRT version 2.1 was released, which includes improvements to code models and verification and validation (V&V) suite to support the SRT user community. The following work provides an overview of the improvements made as part of the release of SRT version 2.1. This effort is supported by the U.S. Department of Energy Office of Nuclear Energy (DOE:NE) Advanced Reactor Technologies (ART) Fast Reactor Program (FRP), as part of the program’s support of national laboratory design and safety analysis computer codes utilized by the fast reactor industry. The expansion of SRT code capabilities and improvements to code V&V associated with version 2.1 are in response to user requests and lessons learned from recent source term analyses performed by Argonne and advanced reactor vendors. They also align with the evolving role of SRT, from research and development tool to software utilized for reactor licensing calculations. The report is structured in alignment with the code improvements, as outlined in Figure 1-1. Section 2 provides background information on SRT, including its history, capabilities, and utilization. Section 3 details new code capabilities as part of version 2.1, while Section 4 focuses on the expansion of the code’s V&V suite. Lastly, Section 5 provides a summary and discussion of next steps.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Sensitivity Analysis of Irradiated Fueled Experiments using the MOOSE Framework [Slides]

Modeling and simulation (M&S) methods are able to predict uncertainties in experimental parameters (e.g., power and fission density) during irradiation. A shortfall exists in predicting how sensitive some of the parameters will behave during the experimental process. Sensitivity and Uncertainty Quantification (SUQ) is critical in support of qualification and licensing reactor fuels. The application of a method to quantify the uncertainty in these experiments is critical to the prediction of their performance. In this work, we propose the use of a polynomial chaos expansion (PCE) method to quantify the sensitive parameters in these simulations and, in an extension, their experimental surrogates. We propose to perform M&S using PCE uncertainty quantification on a previously irradiated fueled experiment in order to provide a validation case for Griffin and expand its use as a verification and validation (V&V) tool for experiments with a neutronics component. Griffin is an advanced, deterministic neutronics analysis code built using the MOOSE (multiphysics object-oriented simulation environment) framework which can provide state-of-the-art neutronic analysis on M&S of experiments. We will use the stochastic tools module (STM) in MOOSE to provide PCE uncertainty quantification on the proposed experimental setup. Idaho National Laboratory (INL) does not yet have an in-house developed code with V&V approval for experiments performed on-site; this work would provide a necessary addition of support for experiments performed at INL. The Nuclear Regulatory Commission (NRC) has explicitly requested uncertainties in calculated values such as fuel power and burnup, and the development of this capability would benefit the relationship between INL and the NRC.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Capability Enhancements for System-level thermal Hydraulic Modeling of Lead Fast Reactors

This project has focused on the use, assessment, and development of the SAS4A/SASSYS-1 (SAS) safety analysis software. Although SAS was originally intended as a safety analysis tool for Liquid Metal cooled Fast Reactors (LMFRs), which includes both Sodium Fast Reactors (SFRs) and Lead Fast Reactors (LFRs), the vast majority of its recent development and customization has been tailored to SFRs. In general, enhancements that are made to the software for SFRs are applicable to LFRs, however, the fuel composition and corrosive nature of lead requires careful consideration when performing safety analysis of an LFR. In this project an emphasis was placed on closing gaps that are associated with modeling LFRs using SAS. The principal objective of the project was to enhance the ability of SAS as a licensing tool for LFRs. This objective was to be accomplished through three tasks: 1) Enhance the ability of SAS to couple with external software; 2) Improve the underlying physics models in SAS, with priority given to models that are highly relevant to LFRs; 3) Extend the Verification and Validation (V&V) basis of the software

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Predictive Capability Maturity Model Demonstration for Cylindrical Cavity Coupling Using Gemma in the Next Generation Workflow

The predictive capability maturity model (PCMM) uses the expert elicitation process to generate credibility evidence for a particular analysis. To ensure Gemma has the capability to efficiently produce this credibility evidence, next generation workflows (NGW) are created for the solution verification, calibration/validation, and input uncertainty quantification portions of the PCMM assessment. These workflows are then used on the Higgins cylinder problem, which is representative of applications involving external-to-internal electromagnetic field coupling through a slot. The uncertainties calculated using these workflows are then used to calculate the validation comparison error and the validation uncertainty for the model following the American Society of Mechanical Engineers (ASME) verification and validation (V&V) 20 standard. These workflows will enable analysts to iterate each element of PCMM more efficiently than if completed without using a NGW workflow. An example of this iterative process is shown in Section 7.2.

42 ENGINEERING↗
DOE OSTI2025

Package Testing Program Process for Validation and Verification of Software

The purpose of this document is to define the process for validation and verification (V&V) of software used to test the thermal data acquisition equipment in the Oak Ridge National Laboratory (ORNL) Package Testing Program (PTP) as part of the testing configuration(s). This process adheres to all applicable ORNL Standards Based Management System requirements and correlates with the PTP Quality Management System and the Software Quality Assurance Plan.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1987

A formal approach to validation and verification for knowledge-based control systems

As control systems become more complex in response to desires for greater system flexibility, performance and reliability, the promise is held out that artificial intelligence might provide the means for building such systems. An obstacle to the use of symbolic processing constructs in this domain is the need for verification and validation (V and V) of the systems. Techniques currently in use do not seem appropriate for knowledge-based software. An outline of a formal approach to V and V for knowledge-based control systems is presented.

Castore, Glen↗
NASA NTRS1988

Knowledge based system verification and validation as related to automation of space station subsystems: Rationale for a knowledge based system lifecycle

The role of verification and validation (V and V) in software has been to support and strengthen the software lifecycle and to ensure that the resultant code meets the standards of the requirements documents. Knowledge Based System (KBS) V and V should serve the same role, but the KBS lifecycle is ill-defined. The rationale of a simple form of the KBS lifecycle is presented, including accommodation to certain critical KBS differences from software development.

Richardson, Keith↗
NASA NTRS1988

Workshop on Verification and Validation of Knowledge Based Systems. I - Overview and meeting summary

An overview is presented of a workshop held on May 14-15, 1987. Presentations included overviews of knowledge-based system (KBS) fundamentals, introductions to verification and validation (V&V) methods currently being used, and theoretical V&V work. The findings of three working groups are considered, involving: (1) KBS V&V feasibility within current NASA software constraints, (2) V&V methods suited to KBS constraints, and future KBS V&V research goals.

Richardson, Keith↗
NASA NTRS1988

Knowledge based system verification and validation as related to automation of Space Station subsystems - Rationale for a knowledge based system lifecycle

The role of verification and validation (V and V) in software has been to support and strengthen the software lifecycle and to ensure that the resultant code meets the standards of the requirements documents. Knowledge-based system (KBS) V and V should serve the same role, but the KBS lifecycle is ill-defined. The rationale of a simple form of the KBS lifecycle is presented, including accommodation to certain critical KBS differences from software development.

Richardson, Keith↗
NASA NTRS1987

An expert system development methodology which supports verification and validation

Expert systems have demonstrated commercial viability in a wide range of applications, but still face some obstacles to widespread use. A major stumbling block is the lack of well defined verification and validation (V and V) techniques. The primary difficulty with expert system V and V is the use of development methodologies which do not support V and V. As with conventional code, the key to effective V and V is the development methodology. An expert system development methodology is described which is based upon a panel review approach, that allows input from all parties concerned with the expert system.

Culbert, Chris↗
NASA NTRS1990

Space station advanced automation

In the development of a safe, productive and maintainable space station, Automation and Robotics (A and R) has been identified as an enabling technology which will allow efficient operation at a reasonable cost. The Space Station Freedom's (SSF) systems are very complex, and interdependent. The usage of Advanced Automation (AA) will help restructure, and integrate system status so that station and ground personnel can operate more efficiently. To use AA technology for the augmentation of system management functions requires a development model which consists of well defined phases of: evaluation, development, integration, and maintenance. The evaluation phase will consider system management functions against traditional solutions, implementation techniques and requirements; the end result of this phase should be a well developed concept along with a feasibility analysis. In the development phase the AA system will be developed in accordance with a traditional Life Cycle Model (LCM) modified for Knowledge Based System (KBS) applications. A way by which both knowledge bases and reasoning techniques can be reused to control costs is explained. During the integration phase the KBS software must be integrated with conventional software, and verified and validated. The Verification and Validation (V and V) techniques applicable to these KBS are based on the ideas of consistency, minimal competency, and graph theory. The maintenance phase will be aided by having well designed and documented KBS software.

Woods, Donald↗
NASA NTRS1990

Expert system verification and validation survey. Delivery 2: Survey results

The purpose is to determine the state-of-the-practice in Verification and Validation (V and V) of Expert Systems (ESs) on current NASA and industry applications. This is the first task of the series which has the ultimate purpose of ensuring that adequate ES V and V tools and techniques are available for Space Station Knowledge Based Systems development. The strategy for determining the state-of-the-practice is to check how well each of the known ES V and V issues are being addressed and to what extent they have impacted the development of ESs.

Source record↗