Search NASA⌕ Search

SEARCH · Search NASA

Results for “V&V Document”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

TSAFE Interface Control Document v 2.0

This document specifies the data interface for TSAFE, the Tactical Separation-Assured Flight Environment. TSAFE is a research prototype of a software application program for alerting air traffic controllers to imminent conflicts in enroute airspace. It is intended for Air Route Traffic Control Centers ("Centers") in the U.S. National Airspace System. It predicts trajectories for approximately 3 minutes into the future, searches for conflicts, and sends data about predicted conflicts to the client, which uses the data to alert an air traffic controller of conflicts. TSAFE itself does not provide a graphical user interface.

Paielli, Russell A.↗

Seascape Interface Control Document (V. 2)

This paper serves as the Interface Control Document (ICD) for the Seascape automated test harness developed at Sandia National Laboratories. The primary purposes of the Seascape system are: (1) provide a place for accruing large, curated, labeled data sets useful for developing and evaluating detection and classification algorithms (including, but not limited to, supervised machine learning applications) (2) provide an automated structure for specifying, running and generating reports on algorithm performance. Seascape uses GitLab, Nexus, Solr, and Banana, open source codes, together with code written in the Python language, to automatically provision and configure computational nodes, queue up jobs to accomplish algorithms test runs against the stored data sets, gather the results and generate reports which are then stored in the Nexus artifact server.

97 MATHEMATICS AND COMPUTING↗

NASA Orbital Debris Engineering Model (ORDEM) 3.1: Model Verification and Validation

The NASA Orbital Debris Engineering Model (ORDEM) 3.1 Model Verification and Validation (V&V) document accompanies the delivery of the latest ORDEM 3.1 model (Vavrin & Manis, 2019) and provides a detailed description of the V&V activities used to verify that the model was built correctly and validate the model against independent, real world sources of data obtained from sampling the orbital debris environment. This ORDEM 3.1 Model V&V document, along with the related ORDEM 3.1 Model Process document – which covers details of the mathematical, statistical, and physical basis of the model – are intended to inform credibility assessments, risk analyses, uncertainty characterizations, and other applications derived from use of the model by the ORDEM 3.1 user community.

Timothy Kennedy↗

MCNP6 Developments: A 2022-23 Year in Review [Slides]

A separate MCNP6.3 V&V document reports on all the default calculations for all test suites is touched on. This report does not include the subcritical multiplication benchmark suite. After some additional clean-up and finalizing the post-processing and documentation steps, the subcritical multiplication benchmark suite will be released in the next version of our vnvstats repository. We tested the new HDF5 PTRAC feature in MCNP6.3 and found encouraging outcomes. Identical results coming out of the simulation with respect to the legacy PTRAC results. The overall runtime for all simulations is reduced by ~20% with the new HDF5 PTRAC capability. We consider giving the new HDF5 PTRAC features a try and using it for all subcritical multiplication and any other relevant (PTRAC) calculations.

97 MATHEMATICS AND COMPUTING↗

Validation of New MCNP6.3 Features for Critical and Subcritical Benchmark Simulations [Slides]

A separate MCNP6.3 V&V document reports on all the default calculations for all test suites was introduced. Here, we look at new optional features of the MCNP6.3 code. Then, Fission-matrix-based options with Convergence and population testing and Automated acceleration of the fission source and Doppler Broadening Resonance Correction and HDF5 Particle Track Output (PTRAC) and Validation benchmarks: criticality, Rossi-α, and subcritical multiplication. All the new MCNP6.3 options give statistically equivalent results and should be considered for default usage in criticality and subcritical multiplication calculation work. Discussed are two separate papers at the upcoming 2023 International Conference on Nuclear Criticality Safety (ICNC 2023) that give more details on the results presented here.

97 MATHEMATICS AND COMPUTING↗

Realizing High-Accuracy Low-Cost Measurement and Verification for Deep Cost Savings (BPA Cost Share CRADA)

Developed practitioner workflows that integrate advanced M&V tools with supplementary automated routines for non-routine adjustments and for quantification of savings uncertainty to indicate rigor. Demonstrated these workflows with Seattle City Light, in collaboration with their implementers and evaluators – determine labor and time/cost savings, and uncertainty of the results obtained. Engaged the Pacific Northwest regulatory community to determine acceptance criteria for the required accuracy and reporting of advanced whole-building M&V. Documented the findings to facilitate broad industry uptake of the solutions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Verification and Validation of the New MCNP6.3 Criticality Features [Slides]

This presentation touches on a separate MCNP6.3 V&V document reports on all the default calculations for all test suites. Here, we look at new optional features of the MCNP6.3 code with Fission-matrix-based options, Convergence and population testing, and Automated acceleration of the fission source additionally Doppler Broadening Resonance Correction. Also touched on are validation benchmarks: criticality, crit_expanded, and Rossi-α. All the new MCNP6.3 options give statistically equivalent results and either provide a reduction or no change in computational cost. We consider giving these new features a try and using them for all criticality calculations.

97 MATHEMATICS AND COMPUTING↗

Verification and Performance Impact of the New Parallel MCNP6.3 Particle Track Output Capability for Subcritical Multiplication Simulations [Slides]

A separate MCNP6.3 V&V document reports on all the default calculations for all test suites. This report does not include the subcritical multiplication benchmark suite. After some additional clean-up and finalizing the post-processing and documentation steps, the subcritical multiplication benchmark suite will be released in the next version of our vnvstats repository. We tested the new HDF5 PTRAC feature in MCNP6.3 and found encouraging outcomes. Identical results coming out of the simulation with respect to the legacy PTRAC results. The overall runtime for all simulations is reduced by ~20% with the new HDF5 PTRAC capability. We consider giving the new HDF5 PTRAC features a try and using it for all subcritical multiplication and any other relevant (PTRAC) calculations.

97 MATHEMATICS AND COMPUTING↗

Advances in the Ocean Color Component of the Aerosol Robotic Network (AERONET-OC)

The Ocean Color Component of the Aerosol Robotic Network(AERONET-OC) supports activities related to ocean color such as validation of satellite data products, assessment of atmospheric correction schemes, and evaluation of bio-optical models through globally distributed standardized measurements of water-leaving radiance and aerosol optical depth. In view of duly assisting the AERONET-OC data user community, this work (i) summarizes the latest investigations on a number of scientific issues related to above-water radiometry, (ii) emphasizes the network expansion that from 2002 until the end of 2020 integrated 31 effective measurement sites, (iii) shows the equivalence of data product accuracy across sites and time for measurements performed with different instrument series, (iv) illustrates the variety of water types represented by the network sites ensuring validation activities across a diversity of observation conditions, and (v) documents the availability of water-leaving radiance data corrected for bidirectional effects by applying a method specifically developed for chlorophyll-a-dominated waters and an alternative one that is likely suitable for any water type.

In situ oceanic observations↗

Approaches to the verification of rule-based expert systems

Expert systems are a highly useful spinoff of artificial intelligence research. One major stumbling block to extended use of expert systems is the lack of well-defined verification and validation (V and V) methodologies. Since expert systems are computer programs, the definitions of verification and validation from conventional software are applicable. The primary difficulty with expert systems is the use of development methodologies which do not support effective V and V. If proper techniques are used to document requirements, V and V of rule-based expert systems is possible, and may be easier than with conventional code. For NASA applications, the flight technique panels used in previous programs should provide an excellent way to verify the rules used in expert systems. There are, however, some inherent differences in expert systems that will affect V and V considerations.

Culbert, Chris↗

Certifying Auto-Generated Flight Code

Model-based design and automated code generation are being used increasingly at NASA. Many NASA projects now use MathWorks Simulink and Real-Time Workshop for at least some of their modeling and code development. However, there are substantial obstacles to more widespread adoption of code generators in safety-critical domains. Since code generators are typically not qualified, there is no guarantee that their output is correct, and consequently the generated code still needs to be fully tested and certified. Moreover, the regeneration of code can require complete recertification, which offsets many of the advantages of using a generator. Indeed, manual review of autocode can be more challenging than for hand-written code. Since the direct V&V of code generators is too laborious and complicated due to their complex (and often proprietary) nature, we have developed a generator plug-in to support the certification of the auto-generated code. Specifically, the AutoCert tool supports certification by formally verifying that the generated code is free of different safety violations, by constructing an independently verifiable certificate, and by explaining its analysis in a textual form suitable for code reviews. The generated documentation also contains substantial tracing information, allowing users to trace between model, code, documentation, and V&V artifacts. This enables missions to obtain assurance about the safety and reliability of the code without excessive manual V&V effort and, as a consequence, eases the acceptance of code generators in safety-critical contexts. The generation of explicit certificates and textual reports is particularly well-suited to supporting independent V&V. The primary contribution of this approach is the combination of human-friendly documentation with formal analysis. The key technical idea is to exploit the idiomatic nature of auto-generated code in order to automatically infer logical annotations. The annotation inference algorithm itself is generic, and parametrized with respect to a library of coding patterns that depend on the safety policies and the code generator. The patterns characterize the notions of definitions and uses that are specific to the given safety property. For example, for initialization safety, definitions correspond to variable initializations while uses are statements which read a variable, whereas for array bounds safety, definitions are the array declarations, while uses are statements which access an array variable. The inferred annotations are thus highly dependent on the actual program and the properties being proven. The annotations, themselves, need not be trusted, but are crucial to obtain the automatic formal verification of the safety properties without requiring access to the internals of the code generator. The approach has been applied to both in-house and commercial code generators, but is independent of the particular generator used. It is currently being adapted to flight code generated using MathWorks Real-Time Workshop, an automatic code generator that translates from Simulink/Stateflow models into embedded C code.

Denney, Ewen↗

LLOFX earth orbit to lunar orbit delta V estimation program user and technical documentation

The LLOFX computer program calculates in-plane trajectories from an Earth-orbiting space station to Lunar orbit in such a way that the journey requires only two delta V burns (one to leave Earth circular orbit and one to circularize into Lunar orbit). The program requires the user to supply the Space Station altitude and Lunar orbit altitude (in km above the surface), and the desired time of flight for the transfer (in hours). It then determines and displays the trans-Lunar injection (TLI) delta V required to achieve the transfer, the Lunar orbit insertion (LOI) delta V required to circularize the orbit around the Moon, the actual time of flight, and whether the transfer orbit is elliptical or hyperbolic. Return information is also displayed. Finally, a plot of the transfer orbit is displayed.

Source record↗

PLANECHG: Earth orbit to lunar orbit delta V estimation program. User and technical documentation

The PLANECNG computer program calculates velocities for Earth-to-Mooon and Moon-to-Earth trajectories. The flight to be analyzed originates in a circular orbit of any inclination and altitude about one of the bodies, and culminates in a circular orbit of any inclination and altitude about the other body. An intermedate delta V and plane change occurs at the Lunar Sphere of Influence (SOI), the region where the vehicle is near its lowest velocity in the trajectory, and therefore where it is able to make the plane change with the lowest delta V. A given flight may penetrate the SOI at a number of points. Each point has associated with it a unique set of delta V's and total velocity. The program displays the velocities, in matrix form, for a representative set of SOI penetration points. An SOI point is identified by projecting Lunar latitude and longitude onto the SOI. The points recorded for a given flight are defined by the user, who provides a starting longitude and latitude, and an increment for each. A matrix is built with 10 longitudes forming the columns and 19 latitudes forming the rows. This matrix is presented in six reports, each containing different velocity or node information in the body of the matrix.

Source record↗

MPACT Verification and Validation Manual (V.4.3)

As the VERA SQA plan requires, it is the responsibility of the University of Michigan (UM) and Oak Ridge National Laboratory (ORNL), as co-owners of MPACT, to ensure that verification and validation activities are performed and documented in a V&V manual with supporting publications and CASL technical reports which can be provided for reference and distribution within VERA. This document provides the current revision of the MPACT verification and validation (V&V) manual and describes the current state of MPACT V&V and updates the plans for future MPACT V&V activities. The following sections provide an overview of the V&V process used in MPACT, as well as a summary of the status of each component of V&V in the code.

97 MATHEMATICS AND COMPUTING↗

MPACT Verification and Validation Manual Version 4.4

As the VERA SQA plan requires, it is the responsibility of the University of Michigan (UM) and Oak Ridge National Laboratory (ORNL), as co-owners of MPACT, to ensure that verification and validation activities are performed and documented in a V&V manual with supporting publications and CASL technical reports which can be provided for reference and distribution within VERA. This document provides the current revision of the MPACT verification and validation (V&V) manual and describes the current state of MPACT V&V and updates the plans for future MPACT V&V activities. The following sections provide an overview of the V&V process used in MPACT, as well as a summary of the status of each component of V&V in the code.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Analysis of Phoenix Anomalies and IV & V Findings Applied to the GRAIL Mission

NASA IV&V was established in 1993 to improve safety and cost-effectiveness of mission critical software. Since its inception the tools and strategies employed by IV&V have evolved. This paper examines how lessons learned from the Phoenix project were developed and applied to the GRAIL project. Shortly after selection, the GRAIL project initiated a review of the issues documented by IV&V for Phoenix. The motivation was twofold: the learn as much as possible about the types of issues that arose from the flight software product line slated for use on GRAIL, and to identify opportunities for improving the effectiveness of IV&V on GRAIL. The IV&V Facility provided a database dump containing 893 issues. These were categorized into 16 bins, and then analyzed according to whether the project responded by changing the affected artifacts or using as-is. The results of this analysis were compared to a similar assessment of post-launch anomalies documented by the project. Results of the analysis were discussed with the IV&V team assigned to GRAIL. These discussions led to changes in the way both the project and IV&V approached the IV&V task, and improved the efficiency of the activity.

Larson, Steve↗

ECAR-7300 Rev 1 Verification and Validation of MCNP6.2 for MARVEL Neutronic Analysis

This report documents the verification and validation (V&V) efforts of the Monte Carlo N-Particle transport code (MCNP) version 6.2 on the Sawtooth supercomputer for the Microreactor Applications Research Validation and Evaluation (MARVEL) microreactor required for the preliminary documented safety analysis. This document records V&V for a safety, hazards, analysis, and design software used for design and analysis of safety class structures, system and components (SSC)s.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Deep Underground Neutrino Experiment (DUNE) Near Detector Conceptual Design Report

The Deep Underground Neutrino Experiment (DUNE) is an international, world-class experiment aimed at exploring fundamental questions about the universe that are at the forefront of astrophysics and particle physics research. DUNE will study questions pertaining to the preponderance of matter over antimatter in the early universe, the dynamics of supernovae, the subtleties of neutrino interaction physics, and a number of beyond the Standard Model topics accessible in a powerful neutrino beam. A critical component of the DUNE physics program involves the study of changes in a powerful beam of neutrinos, i.e., neutrino oscillations, as the neutrinos propagate a long distance. The experiment consists of a near detector, sited close to the source of the beam, and a far detector, sited along the beam at a large distance. This document, the DUNE Near Detector Conceptual Design Report (CDR), describes the design of the DUNE near detector and the science program that drives the design and technology choices. The goals and requirements underlying the design, along with projected performance are given. It serves as a starting point for a more detailed design that will be described in future documents.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗