SEARCH · Search NASA

Results for “Verification and Validation methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRS2012

Progress Towards a Cartesian Cut-Cell Method for Viscous Compressible Flow

We present preliminary development of an approach for simulating high Reynolds number steady compressible flow in two space dimensions using a Cartesian cut-cell finite volume method. We consider both laminar and turbulent flow with both low and high cell Reynolds numbers near the wall. The approach solves the full Navier-Stokes equations in all cells, and uses a wall model to address the resolution requirements near boundaries and to mitigate mesh irregularities in cut cells. We present a quadratic wall model for low cell Reynolds numbers. At high cell Reynolds numbers, the quadratic is replaced with a newly developed analytic wall model stemming from solution of a limiting form of the Spalart-Allmaras turbulence model which features a forward evaluation for flow velocity and exactly matches characteristics of the SA turbulence model in the field. We develop multigrid operators which attain convergence rates similar to inviscid multigrid. Investigations focus on preliminary verification and validation of the method. Flows over flat plates and compressible airfoils show good agreement with both theoretical results and experimental data. Mesh convergence studies on sub- and transonic airfoil flows show convergence of surface pressures with wall spacings as large as approx.0.1% chord. With the current analytic wall model, one or two additional refinements near the wall are required to obtain mesh converged values of skin friction.

Berger, Marsha↗

NASA NTRS2013

Verification and Validation Studies for the LAVA CFD Solver

The verification and validation of the Launch Ascent and Vehicle Aerodynamics (LAVA) computational fluid dynamics (CFD) solver is presented. A modern strategy for verification and validation is described incorporating verification tests, validation benchmarks, continuous integration and version control methods for automated testing in a collaborative development environment. The purpose of the approach is to integrate the verification and validation process into the development of the solver and improve productivity. This paper uses the Method of Manufactured Solutions (MMS) for the verification of 2D Euler equations, 3D Navier-Stokes equations as well as turbulence models. A method for systematic refinement of unstructured grids is also presented. Verification using inviscid vortex propagation and flow over a flat plate is highlighted. Simulation results using laminar and turbulent flow past a NACA 0012 airfoil and ONERA M6 wing are validated against experimental and numerical data.

Validation↗

DOE OSTI2025

Practical Introduction to Benchmarking and Characterization of Quantum Computers

Rapid progress in quantum technology has transformed quantum computing and quantum information science from theoretical possibilities into tangible engineering challenges. Breakthroughs in quantum algorithms, quantum simulations, and quantum error correction are bringing useful quantum computation closer to fruition. These remarkable achievements have been facilitated by advances in quantum characterization, verification, and validation (QCVV). QCVV methods and protocols enable scientists and engineers to scrutinize, understand, and enhance the performance of quantum information-processing devices. In this tutorial, we review the fundamental principles underpinning QCVV, and introduce a diverse array of QCVV tools used by quantum researchers. We define and explain QCVV’s core models and concepts—quantum states, measurements, and processes—and illustrate how these building blocks are leveraged to examine a target system or operation. We survey and introduce protocols ranging from simple qubit characterization to advanced benchmarking methods. Along the way, we provide illustrated examples and detailed descriptions of the protocols, highlight the advantages and disadvantages of each, and discuss their potential scalability to future large-scale quantum computers. This tutorial serves as a guidebook for researchers unfamiliar with the benchmarking and characterization of quantum computers, and also as a detailed reference for experienced practitioners.

open quantum systems & decoherence↗

DOE OSTI2026

Verification and Validation of Flow Confinement Modeling using OpenFAST Source Panel Method

Blockage or flow confinement effects in scale wind and water turbine testing in experimental facilities, including wind and water tunnels and tow tanks, can significantly alter incident aerodynamic and hydrodynamic loads, turbine performance (thrust, torque, power output), and wake dynamics compared to unconfined conditions. As scale model tests are key sources of OpenFAST model validation measurements, directly modeling flow confinement and its effects in OpenFAST enables improved model validat

Kim, Dongyoung [Sandia National Laboratories (SNL-↗

NASA NTRS1986

Investigation of an advanced fault tolerant integrated avionics system

Presented is an advanced, fault-tolerant multiprocessor avionics architecture as could be employed in an advanced rotorcraft such as LHX. The processor structure is designed to interface with existing digital avionics systems and concepts including the Army Digital Avionics System (ADAS) cockpit/display system, navaid and communications suites, integrated sensing suite, and the Advanced Digital Optical Control System (ADOCS). The report defines mission, maintenance and safety-of-flight reliability goals as might be expected for an operational LHX aircraft. Based on use of a modular, compact (16-bit) microprocessor card family, results of a preliminary study examining simplex, dual and standby-sparing architectures is presented. Given the stated constraints, it is shown that the dual architecture is best suited to meet reliability goals with minimum hardware and software overhead. The report presents hardware and software design considerations for realizing the architecture including redundancy management requirements and techniques as well as verification and validation needs and methods.

Dunn, W. R.↗

NASA NTRS1988

Workshop on Verification and Validation of Knowledge Based Systems. I - Overview and meeting summary

An overview is presented of a workshop held on May 14-15, 1987. Presentations included overviews of knowledge-based system (KBS) fundamentals, introductions to verification and validation (V&V) methods currently being used, and theoretical V&V work. The findings of three working groups are considered, involving: (1) KBS V&V feasibility within current NASA software constraints, (2) V&V methods suited to KBS constraints, and future KBS V&V research goals.

Richardson, Keith↗

NASA NTRS1995

Making intelligent systems team players. A guide to developing intelligent monitoring systems

This reference guide for developers of intelligent monitoring systems is based on lessons learned by developers of the DEcision Support SYstem (DESSY), an expert system that monitors Space Shuttle telemetry data in real time. DESSY makes inferences about commands, state transitions, and simple failures. It performs failure detection rather than in-depth failure diagnostics. A listing of rules from DESSY and cue cards from DESSY subsystems are included to give the development community a better understanding of the selected model system. The G-2 programming tool used in developing DESSY provides an object-oriented, rule-based environment, but many of the principles in use here can be applied to any type of monitoring intelligent system. The step-by-step instructions and examples given for each stage of development are in G-2, but can be used with other development tools. This guide first defines the authors' concept of real-time monitoring systems, then tells prospective developers how to determine system requirements, how to build the system through a combined design/development process, and how to solve problems involved in working with real-time data. It explains the relationships among operational prototyping, software evolution, and the user interface. It also explains methods of testing, verification, and validation. It includes suggestions for preparing reference documentation and training users.

Land, Sherry A.↗

NASA NTRS2012

Design of Low Complexity Model Reference Adaptive Controllers

Flight research experiments have demonstrated that adaptive flight controls can be an effective technology for improving aircraft safety in the event of failures or damage. However, the nonlinear, timevarying nature of adaptive algorithms continues to challenge traditional methods for the verification and validation testing of safety-critical flight control systems. Increasingly complex adaptive control theories and designs are emerging, but only make testing challenges more difficult. A potential first step toward the acceptance of adaptive flight controllers by aircraft manufacturers, operators, and certification authorities is a very simple design that operates as an augmentation to a non-adaptive baseline controller. Three such controllers were developed as part of a National Aeronautics and Space Administration flight research experiment to determine the appropriate level of complexity required to restore acceptable handling qualities to an aircraft that has suffered failures or damage. The controllers consist of the same basic design, but incorporate incrementally-increasing levels of complexity. Derivations of the controllers and their adaptive parameter update laws are presented along with details of the controllers implementations.

Hanson, Curt↗

NASA NTRS2019

Static Analysis Using Abstract Interpretation

Lecture about abstract interpretation. This lecture starts with a brief introduction to validation and verification using formal methods. It then demonstrates IKOS (Inference Kernel for Open Static Analyzers), a static analyzer for C/C++ based on Abstract Interpretation. Then, it describes in details the theory of Abstract Interpretation, a mathematical framework to over-approximate the reachable states of a program.

Arthaud, Maxime↗

DOE OSTI2020

SCALE capabilities for high temperature gas-cooled reactor analysis

The SCALE code system’s ability to address stochastic distributions of fuel particles within a graphite matrix has been revisited in both multigroup (MG) features and continuous-energy (CE) Monte Carlo methods. Furthermore, this paper describes current and emergent SCALE capabilities within the CSAS sequence to address double-heterogeneous systems and presents verification and validation studies of these methods and data. Good agreement was obtained for a high temperature gas-cooled reactor (HTGR) fuel pebble model between CSAS MG eigenvalue calculations and corresponding CE reference solutions. Code-to-code comparisons for this HTGR pebble model showed good agreement of CSAS-KENO and CSAS-Shift CE calculations and the Serpent and MCNP codes in terms of eigenvalues and reaction rate ratios. Validation studies based on two HTGR experiments resulted in good agreement between MG and CE results, as well as between experiment and calculation, although the level of agreement was significantly influenced by the applied ENDF/B nuclear data library.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRSDate not supplied

Recent Advances in Discrete Crack Modeling Applied to Laminated Composites with Emphasis on: Floating Node Method, VCCT and Cohesive Zone Modeling

The present talk will provide an overview of the work performed during the Advanced Composites Project (ACP) on the development, and verification and validation of the Floating Node Method (FNM) as well as the Virtual Crack Closure Technique (VCCT) and cohesive zone modeling (CZM). The FNM is a finite element-based technique to represent crack networks. The complex nature of matrix crack-delamination interactions observed in unidirectional (UD) tape laminates suggests that a methodology such as the FNM method may be required to be able to accurately simulate damage progression in these laminates. Simulating crack onset and growth within the context of the FNM relies on techniques such as VCCT and CZM. The talk is organized to provide, via select examples, an overview of the breadth of the Verification & Validation (V&V) exercises performed during the ACP, and how these challenged the state-of-the art and guided further developments in discrete crack modeling, while helping to establish confidence in the progress made and map the challenges ahead. The performance of the VCCT and CZM individually, and in combination with the FNM can be assessed through verification exercises. These exercises typically consist of a comparison of simulation results to known numerical or analytical solutions. Verification is key to identify implementation issues and limitations that, otherwise, may remain undetected and cloud any subsequent validation efforts. Indeed, a subset of these numerical exercises led to further developments of the VCCT and the FNM method as will be illustrated. Before embarking on the subsequent validation of the framework, it is critical to have adequate characterization data. However, the testing campaign conducted revealed material responses that challenged the state-of-the-art and required further developments. The developments in CZM technology associated with the modeling of the responses of hybrid interfaces (fabric/UD) will be given as an example. Finally, the talk will conclude with a summary of the validation exercises performed under quasi-static and fatigue loadings, highlighting some of the key achievements, outstanding challenges and lessons learned.

finite elements↗

NASA NTRS2004

Verification of Emergent Behaviors in Swarm-based Systems

The emergent properties of swarms make swarm-based missions powerful, but at the same time more difficult to design and to assure that the proper behaviors will emerge. We are currently investigating formal methods and techniques for verification and validation of swarm-based missions. The Autonomous Nano-Technology Swarm (ANTS) mission is being used as an example and case study for swarm-based missions to experiment and test current formal methods with intelligent swarms. Using the ANTS mission, we have evaluated multiple formal methods to determine their effectiveness in modeling and assuring swarm behavior. This paper introduces how intelligent swarm technology is being proposed for NASA missions, and gives the results of a comparison of several formal methods and approaches for specifying intelligent swarm-based systems and their effectiveness for predicting emergent behavior.

Rouff, Christopher↗

NASA NTRS1991

Meteorological radar methods for validating space observations of precipitation

Meteorological approaches to verification of space measurements of rainfall are examined; validation of Tropical Rainfall Measuring Mission (TRMM) observations is expected to depend significantly on ground-based radars. Two methods of comparison are initially contemplated. TRMM rainfall data over time periods of a month for large areas (500 x 500 km) are averaged and compared with similarly averaged ground truth measurements. Both the rainfall and height distribution data from TRMM are compared with the instantaneous values observed at one or more 'ground truth' stations and from airborne radar and radiometers as available.

Thiele, Otto W.↗

NASA NTRS1997

Experiences Using Lightweight Formal Methods for Requirements Modeling

This paper describes three case studies in the lightweight application of formal methods to requirements modeling for spacecraft fault protection systems. The case studies differ from previously reported applications of formal methods in that formal methods were applied very early in the requirements engineering process, to validate the evolving requirements. The results were fed back into the projects, to improve the informal specifications. For each case study, we describe what methods were applied, how they were applied, how much effort was involved, and what the findings were. In all three cases, formal methods enhanced the existing verification and validation processes, by testing key properties of the evolving requirements, and helping to identify weaknesses. We conclude that the benefits gained from early modeling of unstable requirements more than outweigh the effort needed to maintain multiple representations.

Easterbrook, Steve↗

DOE OSTI2025

An Open-Source Python Package for CFD Solution Verification

Informed decision-making using computational fluid dynamics (CFD) results requires quantifying the errors and uncertainties of a simulation. Verification, validation, and uncertainty quantification (VVUQ) methods were developed to address this need and have matured. However, these VVUQ analyses are often non-trivial and require CFD analysts and practitioners to have specific skill sets. This has led to the uneven adoption of VVUQ analyses, in part, based on the availability of software tools to aid CFD analysts and practitioners. Solution verification, a procedure to evaluate the accuracy of a simulation by estimating potential errors arising from the computational model and computing the uncertainties without comparing to results from a physical system, is one of the lagging VVUQ analyses as the absence of software has forced CFD analysts and practitioners to develop their own codes or piece together incomplete software from across the internet. This work presents an opensource Python package, CFDverify, to lower the barrier of entry and fill in the technological gap in solution verification. CFDverify also provides a streamlined framework to remove some potential errors in post-processing CFD results. The hope is that CFDverify can improve the quality and quantity of CFD solution verification in scientific and research studies and attract interest in developing a communal tool. This paper describes the design, features, and an example use of CFDverify.

Weinmeister, Justin [ORNL] (ORCID:0000000160090237↗

NASA NTRS1990

Software safety - A user's practical perspective

Software safety assurance philosophy and practices at the NASA Ames are discussed. It is shown that, to be safe, software must be error-free. Software developments on two digital flight control systems and two ground facility systems are examined, including the overall system and software organization and function, the software-safety issues, and their resolution. The effectiveness of safety assurance methods is discussed, including conventional life-cycle practices, verification and validation testing, software safety analysis, and formal design methods. It is concluded (1) that a practical software safety technology does not yet exist, (2) that it is unlikely that a set of general-purpose analytical techniques can be developed for proving that software is safe, and (3) that successful software safety-assurance practices will have to take into account the detailed design processes employed and show that the software will execute correctly under all possible conditions.

Dunn, William R.↗

DOE OSTI2020

Independent Verification Plan for Clearance of Real Property of the Operation Roller Coaster Sites

The U.S. Department of Energy (DOE) is pursuing release of the Operation Roller Coaster sites under DOE O 458.1, “Radiation Protection of the Public and the Environment.” The requirements for clearance and release of property under DOE O 458.1 are implemented when DOE intends to facilitate transfer of responsibility or control of real property from DOE. DOE O 458.1 prescribes that all radiological monitoring or surveys performed in support of clearance of property must use methods such as the Multi-Agency Radiation Survey and Site Investigation Manual (MARSSIM) method or other methods approved by DOE. DOE O 458.1 requires an Independent Verification for the clearance of real property. This Independent Verification Plan outlines the process for validating the method and implementation of the MARRSIM process for release of the Operation Roller Coaster sites.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2020

Involute Working Group – Validation of CFD Turbulence Models for Steady-State Safety Analysis

There are three research reactors in the world having fuel plates curved as circle-involute (a spiral generated around a circle): The Oak Ridge National Laboratory (ORNL) High Flux Isotope Reactor (HFIR) located in Tennessee, U.S.A. [ORNL, 2018]; The Laue-Langevin Institute (ILL) High Flux Reactor (RHF) located in Grenoble, France [ILL, 2018]; and, The Technical University of Munich (TUM) Research Neutron Source Heinz Maier-Leibnitz (FRM II) located in Garching, Germany [TUM, 2018]. All three reactors are currently using Highly Enriched Uranium (HEU, 235U/U ≥ 20 wt. %) as fuel and all three are actively engaged in activities to convert to Low Enriched Uranium (LEU, 235U/U < 20 wt. %) fuel. More information on these reactors can be found in Section two. For various reasons, these reactors have expressed interest in using Computational Fluid Dynamics (CFD) tools to perform their Steady-State Thermal-Hydraulic (SSTH) safety calculations. Using CFD tools for SSTH analysis represents generally a significant departure from traditional methods and requires thorough verification and validation (V&V) to be accepted by regulators. This is why Argonne National Laboratory (ANL) and the involute reactors formed an informal group to help each other in this endeavor. This so-called Involute Working Group (IWG) aims at supporting the qualification of CFD tools for SSTH safety calculations. Activities include benchmarking, code-to-code comparison, Verification and Validation (V&V) as well as technical support. More information on the IWG and the reasons why involute-plate reactors are interested in CFD can be found in Section three. The present study aims at testing three turbulence models commonly implemented in commercial software (namely K-Epsilon, K-Omega and Reynolds-Stress) and assessing their relevance for involute-plate reactor application. An experiment performed by Gambill and Bundy in 1961 was performed to measure heat transfer coefficients in conditions prototypic of the HFIR reactor [Gambill, 1961]. More details on this experiment are provided in Section four. Based on the information available, CFD models of this experiment have been created and the experimental results have been compared to the ones obtained with these CFD models. CFD models and the results of this comparison are provided in Section five.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗