Results for “Verification Analysis” — Page 17

NASA NTRSDate not supplied

Feature-Guided Analysis of Neural Networks

Applying standard software engineering practices to neural networks is challenging due to the lack of high-level abstractions describing a neural network’s behavior. To address this challenge, we propose to extract high-level task-specific features from the neural network internal representation, based on monitoring the neural network activations.The extracted feature representations can serve as a link to high-level requirements and can be leveraged to enable fundamental software engineering activities, such as automated testing, debugging, requirements analysis, and formal verification, leading to better engineering of neural networks. Using two case studies, we present initial empirical evidence demonstrating the feasibility of our ideas.

Features↗

NASA NTRSDate not supplied

Gateway Program Safety And Mission Assurance Integration - The Future Of Safe Deep Space Human Exploration

This next wave of lunar exploration will be fundamentally different than the past. The goal today is long term human presence in Earth orbit, exploration around the Moon, exploration anywhere on the Moon, and challenging exploration missions beyond the Moon. Sustainability is the key to enabling human expansion across the solar system and bringing back to Earth new knowledge and opportunities, and requires the early engagement of scientific, international, and U.S. commercial interests, innovations, and new approaches. The Gateway’s agile acquisition strategy will shape the entire system life cycle, from design and analysis through production, verification, launch, logistics and operations. This strategy will encourage new ways of doing business to accommodate new techniques, technologies and approaches; improving affordability and maximizing Gateway utility. The full range of acquisition authorities and contracting mechanisms available to NASA will be considered and appropriately tailored in response to the unique demands of each procurement activity. Gateway will provide scientific and research benefits, in addition to providing a sustainable staging location for crewed lunar surface landings and technology demonstrations that help NASA develop the knowledge and technology needed for Mars missions. These payloads are expected to provide operational and scientific benefit for the duration of their stay on Gateway, as the hardware will provide data during the transit to the Gateway and while in lunar orbit as changes in solar activity occur over time. Gateway is designed to support a variety of utilization activities during both crewed and uncrewed periods and is planned for continuous operations throughout its lifetime. These operations include demonstrating key exploration capabilities in a relevant deep space environment, conducting science beyond the influence of Earth, and providing opportunities for Gateway partners and customers for deep space exploration. Located in cislunar orbit, the Gateway capabilities can be further leveraged to enhance lunar and Mars exploration. With the Gateway and other elements of the Artemis Program, NASA is encouraging new ways of doing business to accommodate new techniques, technologies and approaches, consider affordability, and encourage innovation from U.S. industry.

Helen Vaccaro↗

NASA NTRSDate not supplied

Gateway Program Safety and Mission Assurance IAASS Conference Keynote Presentation

This next wave of lunar exploration will be fundamentally different than the past. The goal today is long term human presence in Earth orbit, exploration around the Moon, exploration anywhere on the Moon, and challenging exploration missions beyond the Moon. Sustainability is the key to enabling human expansion across the solar system and bringing back to Earth new knowledge and opportunities, and requires the early engagement of scientific, international, and U.S. commercial interests, innovations, and new approaches. The Gateway’s agile acquisition strategy will shape the entire system life cycle, from design and analysis through production, verification, launch, logistics and operations. This strategy will encourage new ways of doing business to accommodate new techniques, technologies and approaches; improving affordability and maximizing Gateway utility. The full range of acquisition authorities and contracting mechanisms available to NASA will be considered and appropriately tailored in response to the unique demands of each procurement activity. Gateway will provide scientific and research benefits, in addition to providing a sustainable staging location for crewed lunar surface landings and technology demonstrations that help NASA develop the knowledge and technology needed for Mars missions. These payloads are expected to provide operational and scientific benefit for the duration of their stay on Gateway, as the hardware will provide data during the transit to the Gateway and while in lunar orbit as changes in solar activity occur over time. Gateway is designed to support a variety of utilization activities during both crewed and uncrewed periods and is planned for continuous operations throughout its lifetime. These operations include demonstrating key exploration capabilities in a relevant deep space environment, conducting science beyond the influence of Earth, and providing opportunities for Gateway partners and customers for deep space exploration. Located in cislunar orbit, the Gateway capabilities can be further leveraged to enhance lunar and Mars exploration. With the Gateway and other elements of the Artemis Program, NASA is encouraging new ways of doing business to accommodate new techniques, technologies and approaches, consider affordability, and encourage innovation from U.S. industry.

Terri Castillo↗

NASA NTRS2017

Fuzzy Logic Controller Stability Analysis Using a Satisfiability Modulo Theories Approach

While many widely accepted methods and techniques exist for validation and verification of traditional controllers, at this time no solutions have been accepted for Fuzzy Logic Controllers (FLCs). Due to the highly nonlinear nature of such systems, and the fact that developing a valid FLC does not require a mathematical model of the system, it is quite difficult to use conventional techniques to prove controller stability. Since safety-critical systems must be tested and verified to work as expected for all possible circumstances, the fact that FLC controllers cannot be tested to achieve such requirements poses limitations on the applications for such technology. Therefore, alternative methods for verification and validation of FLCs needs to be explored. In this study, a novel approach using formal verification methods to ensure the stability of a FLC is proposed. Main research challenges include specification of requirements for a complex system, conversion of a traditional FLC to a piecewise polynomial representation, and using a formal verification tool in a nonlinear solution space. Using the proposed architecture, the Fuzzy Logic Controller was found to always generate negative feedback, but inconclusive for Lyapunov stability.

Fuzzy Logic Controller↗

NASA NTRS1994

Precision cleaning verification of fluid components by air/water impingement and total carbon analysis

NASA personnel at Kennedy Space Center's Material Science Laboratory have developed new environmentally sound precision cleaning and verification techniques for systems and components found at the center. This technology is required to replace existing methods traditionally employing CFC-113. The new patent-pending technique of precision cleaning verification is for large components of cryogenic fluid systems. These are stainless steel, sand cast valve bodies with internal surface areas ranging from 0.2 to 0.9 sq m. Extrapolation of this technique to components of even larger sizes (by orders of magnitude) is planned. Currently, the verification process is completely manual. In the new technique, a high velocity, low volume water stream impacts the part to be verified. This process is referred to as Breathing Air/Water Impingement and forms the basis for the Impingement Verification System (IVS). The system is unique in that a gas stream is used to accelerate the water droplets to high speeds. Water is injected into the gas stream in a small, continuous amount. The air/water mixture is then passed through a converging/diverging nozzle where the gas is accelerated to supersonic velocities. These droplets impart sufficient energy to the precision cleaned surface to place non-volatile residue (NVR) contaminants into suspension in the water. The sample water is collected and its NVR level is determined by total organic carbon (TOC) analysis at 880 C. The TOC, in ppm carbon, is used to establish the NVR level. A correlation between the present gravimetric CFC113 NVR and the IVS NVR is found from experimental sensitivity factors measured for various contaminants. The sensitivity has the units of ppm of carbon per mg/sq ft of contaminant. In this paper, the equipment is described and data are presented showing the development of the sensitivity factors from a test set including four NVRs impinged from witness plates of 0.05 to 0.75 sq m.

Barile, Ronald G.↗

NASA NTRS1995

Precision Cleaning Verification of Fluid Components by Air/Water Impingement and Total Carbon Analysis

NASA personnel at Kennedy Space Center's Material Science Laboratory have developed new environmentally sound precision cleaning and verification techniques for systems and components found at the center. This technology is required to replace existing methods traditionally employing CFC-113. The new patent-pending technique of precision cleaning verification is for large components of cryogenic fluid systems. These are stainless steel, sand cast valve bodies with internal surface areas ranging from 0.2 to 0.9 m(exp 2). Extrapolation of this technique to components of even larger sizes (by orders of magnitude) is planned. Currently, the verification process is completely manual. In the new technique, a high velocity, low volume water stream impacts the part to be verified. This process is referred to as Breathing Air/Water Impingement and forms the basis for the Impingement Verification System (IVS). The system is unique in that a gas stream is used to accelerate the water droplets to high speeds. Water is injected into the gas stream in a small, continuous amount. The air/water mixture is then passed through a converging-diverging nozzle where the gas is accelerated to supersonic velocities. These droplets impart sufficient energy to the precision cleaned surface to place non-volatile residue (NVR) contaminants into suspension in the water. The sample water is collected and its NVR level is determined by total organic carbon (TOC) analysis at 880 C. The TOC, in ppm carbon, is used to establish the NVR level. A correlation between the present gravimetric CFC-113 NVR and the IVS NVR is found from experimental sensitivity factors measured for various contaminants. The sensitivity has the units of ppm of carbon per mg-ft(exp 2) of contaminant. In this paper, the equipment is described and data are presented showing the development of the sensitivity factors from a test set including four NVR's impinged from witness plates of 0.05 to 0.75 m(exp 2).

Barile, Ronald G.↗

NASA NTRS1981

Blade loss transient dynamics analysis, volume 2. Task 2: Theoretical and analytical development. Task 3: Experimental verification

The component element method was used to develop a transient dynamic analysis computer program which is essentially based on modal synthesis combined with a central, finite difference, numerical integration scheme. The methodology leads to a modular or building-block technique that is amenable to computer programming. To verify the analytical method, turbine engine transient response analysis (TETRA), was applied to two blade-out test vehicles that had been previously instrumented and tested. Comparison of the time dependent test data with those predicted by TETRA led to recommendations for refinement or extension of the analytical method to improve its accuracy and overcome its shortcomings. The development of working equations, their discretization, numerical solution scheme, the modular concept of engine modelling, the program logical structure and some illustrated results are discussed. The blade-loss test vehicles (rig full engine), the type of measured data, and the engine structural model are described.

Gallardo, V. C.↗

NASA NTRS2005

Structural Verification of the Redesigned Space Shuttle Bipod Foam Closeout

This document outlines the structural verification approach for the Space Shuttle External Tank Forward Bipod Foam Closeout. Due to the Space Shuttle Columbia accident, debris has become a major concern. The intent of the structural verification is to ensure that any debris shed from the bipod is within acceptable limits. Since cohesive failure due to internal defects was identified as the most likely cause of the STS-107 bipod ramp foam failure, verification for this failure mode receives particular emphasis. However, all failure modes for TPS are considered and appropriate verification rationale is developed for each failure mode. Figure 1 depicts the structural verification of a production design where analysis and test are the primary methods of verification. It can be seen that the successful completion of structural verification is dependent on three main areas: 1. Production process control and quality assurance must ensure that test articles and/or analytical models are representative of (or conservatively envelope) production hardware in terms of geometry, materials and processing. Variability and defects must be considered. 2. Flight environments must be sufficiently characterized to bound driving environments for all failure modes. Applied environments, either test or analytical, must be representative of flight environments and have a load factor that satisfies design requirements. 3. Structural verification must include all failure modes. A comprehensive list of failure modes and the underlying failure mechanisms has been generated based on flight and test experience. Verification tests and / or analyses must address each failure mode. ET TPS Verification is accomplished by a combination of analysis, test, and similarity.

Poole, Eric L.↗

NASA NTRS1993

Formal methods for life-critical software

The use of computer software in life-critical applications, such as for civil air transports, demands the use of rigorous formal mathematical verification procedures. This paper demonstrates how to apply formal methods to the development and verification of software by leading the reader step-by-step through requirements analysis, design, implementation, and verification of an electronic phone book application. The current maturity and limitations of formal methods tools and techniques are then discussed, and a number of examples of the successful use of formal methods by industry are cited.

Butler, Ricky W.↗

NASA NTRS1997

Development of a Software Safety Process and a Case Study of Its Use

Research in the year covered by this reporting period has been primarily directed toward the following areas: (1) Formal specification of user interfaces; (2) Fault-tree analysis including software; (3) Evaluation of formal specification notations; (4) Evaluation of formal verification techniques; (5) Expanded analysis of the shell architecture concept; (6) Development of techniques to address the problem of information survivability; and (7) Development of a sophisticated tool for the manipulation of formal specifications written in Z. This report summarizes activities under the grant. The technical results relating to this grant and the remainder of the principal investigator's research program are contained in various reports and papers. The remainder of this report is organized as follows. In the next section, an overview of the project is given. This is followed by a summary of accomplishments during the reporting period and details of students funded. Seminars presented describing work under this grant are listed in the following section, and the final section lists publications resulting from this grant.

Knight, J. C.↗

NASA NTRS1993

Formal Methods for Life-Critical Software

The use of computer software in life-critical applications, such as for civil air transports, demands the use of rigorous formal mathematical verification procedures. This paper demonstrates how to apply formal methods to the development and verification of software by leading the reader step-by-step through requirements analysis, design, implementation, and verification of an electronic phone book application. The current maturity and limitations of formal methods tools and techniques are then discussed, and a number of examples of the successful use of formal methods by industry are cited.

Butler, Ricky W.↗

NASA NTRSDate not supplied

Verification and Validation of Progressive Damage and Failure Analysis Methods for Intralaminar Failure Modes in Thermoplastic Composites

Current progressive damage and failure analysis (PDFA) methods were developed around thermoset material systems and their physical behavior. However, the applicability of these analysis methods has not been evaluated for use in modeling thermoplastic material systems. As part of the Hi-Rate Composite Aircraft Manufacturing (HiCAM) Project sponsored by NASA, intralaminar failure characterization was completed on a thermoplastic material system, AS4D/PEKK-FC, with off-axis tension (OAT) and off-axis compression (OAC) testing. The experiments were able to capture matrix non-linear shear behavior and the failure envelope of the material system. Two PDFA methods, LS-DYNA MAT299 and NASA’s CompDam-DGD, were then employed to simulate individual coupon behavior and simulation results were compared to published verification and validation guidelines from the CMH-17 crashworthiness working group. The results found that the two modeling methods provided suitable representation of material behavior of thermoplastics.

PDFA↗

NASA NTRSDate not supplied

Verification and Validation of Progressive Damage and Failure Analysis Methods for Intralaminar Failure Modes in Thermoplastic Composites

Current progressive damage and failure analysis (PDFA) methods were developed around thermoset material systems and their physical behavior. However, the applicability of these analysis methods has not been evaluated for use in modeling thermoplastic material systems. As part of the Hi-Rate Composite Aircraft Manufacturing (HiCAM) Project sponsored by NASA, intralaminar failure characterization was completed on a thermoplastic material system, AS4D/PEKK-FC, with off-axis tension (OAT) and off-axis compression (OAC) testing. The experiments were able to capture matrix non-linear shear behavior and the failure envelope of the material system. Two PDFA methods, LS-DYNA MAT299 and NASA’s CompDam-DGD, were then employed to simulate individual coupon behavior and simulation results were compared to published verification and validation guidelines from the CMH-17 crashworthiness working group. The results found that the two modeling methods provided suitable representation of material behavior of thermoplastics.

PDFA↗

NASA NTRS1977

Viking and STP P78-2 electrostatic charging designs and testing

The design provisions of the Viking and the P78-2 (SCATHA) vehicles and a mathematical analysis of the effect of arcing on typical interface circuits are given. Results of verification testing of the analysis are presented as well as vehicle testing for tolerance to arcing.

Lewis, R. O., Jr.↗

NASA NTRS2016

Z-2 Architecture Description and Requirements Verification Results

The Z-2 Prototype Planetary Extravehicular Space Suit Assembly is a continuation of NASA's Z series of spacesuits. The Z-2 is another step in NASA's technology development roadmap leading to human exploration of the Martian surface. The suit was designed for maximum mobility at 8.3 psid, reduced mass, and to have high fidelity life support interfaces. As Z-2 will be man-tested at full vacuum in NASA JSC's Chamber B, it was manufactured as Class II, making it the most flight-like planetary walking suit produced to date. The Z-2 suit architecture is an evolution of previous EVA suits, namely the ISS EMU, Mark III, Rear Entry I-Suit and Z-1 spacesuits. The suit is a hybrid hard and soft multi-bearing, rear entry spacesuit. The hard upper torso (HUT) is an all-composite structure and includes a 2-bearing rolling convolute shoulder with Vernier sizing mechanism, removable suit port interface plate (SIP), elliptical hemispherical helmet and self-don/doff shoulder harness. The hatch is a hybrid aluminum and composite construction with Apollo style gas connectors, custom water pass-thru, removable hatch cage and interfaces to primary and auxiliary life support feed water bags. The suit includes Z-1 style lower arms with cam brackets for Vernier sizing and government furnished equipment (GFE) Phase VI gloves. The lower torso includes a telescopic waist sizing system, waist bearing, rolling convolute waist joint, hard brief, 2 bearing soft hip thigh, Z-1 style legs with ISS EMU style cam brackets for sizing, and conformal walking boots with ankle bearings. The Z-2 Requirements Verification Plan includes the verification of more than 200 individual requirements. The verification methods include test, analysis, inspection, demonstration or a combination of methods. Examples of unmanned requirements include suit leakage, proof pressure testing, operational life, mass, isometric man-loads, sizing adjustment ranges, internal and external interfaces such as in-suit drink bag, partial pressure relief valve, purge valve, donning stand and ISS Body Restraint Tether (BRT). Examples of manned requirements include verification of anthropometric range, suit self-don/doff, secondary suit exit method, donning stand self-ingress/egress and manned mobility covering eight functional tasks. The eight functional tasks include kneeling with object pick-up, standing toe touch, cross-body reach, walking, reach to the SIP and helmet visor. This paper will provide an overview of the Z-2 design. Z-2 requirements verification testing was performed with NASA at the ILC Houston test facility. This paper will also discuss pre-delivery manned and unmanned test results as well as analysis performed in support of requirements verification.

Graziosi, Dave↗

DOE OSTI2024

Verification and Demonstration of One-Dimensional Freezing Model in SAM for Salt-Cooled Reactor Analysis Applications

This work presented the development and implementation of the one-dimensional freezing model in system analysis code, SAM, as well as code verification, and code demonstration during a postulated overcooling transient, for fluoride salt-cooled high-temperature reactor (FHR) system and safety analysis applications. The paper at first summarized the freezing model, finite element numerical method, and special numerical treatment for handling phase appearance/disappearance. Analytical solutions were derived for two cases (with and without solid walls) for code verifications purpose. As expected, numerical results predicted by the SAM code agreed very well with the analytical solution. A code demonstration was then performed on a postulated protected overcooling event transient of a generic reference PB-FHR design. The code was found to successfully predict salt freezing during such a postulated event. However, due to lack of salt freezing testing data, code validation has not been performed in this work, which will be pursued in later studies when such data becomes available.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRSDate not supplied

FRET Tutorial

In this tutorial, we present the FRET tool for writing, understanding, formalizing and analyzing requirements. In practice, requirements are typically written in natural language, which is ambiguous and consequently not amenable to formal analysis. Since formal, mathematical notations are unintuitive, requirements in FRET are entered in a restricted, natural language, called FRETish with precise unambiguous meaning. This tutorial explains how requirements can be captured in FRETish and subsequently formalized in temporal logics and in the synchronous data flow language Lustre. We show, through multiple examples, how FRET assists users in understanding FRETish requirements and clarifying subtle semantic issues through English and diagrammatic explanations as well as interactive simulation. FInally, this tutorial describes how FRET can be used to perform realizability checking for identifying conflicting requirements and the connection of FRET with (1) the CoCoSim automated analysis tool for the verification of Simulink and Stateflow models, and (2) the Copilot runtime monitoring tool for the analysis of C programs.

FRET↗

NASA NTRS1986

The 15 meter hoop-column antenna dynamics: Test and analysis

A 15 meter model of the hoop-column antenna concept has been vibration tested for model characterization and analytical model verification. Linear finite element analysis predicted the global vibration frequencies accurately. Good agreement between analysis and test data was obtained only after the analytical model was refined using static test data. As structures become more flexible, structural properties determined from static data become more accurate and should be used to update analytical models. Global vibration modes are not significantly affected by the surface mesh which permits simplified analytical models to be used for prediction of global behavior. These reduced models are believed sufficient for preliminary design and controls simulations where only global behavior is desired. The mesh modes were highly damped due to the knit mesh used for the reflector surface. These modes were also highly coupled and very difficult to measure in the laboratory. The inability to fully characterize the antenna mesh modes in the laboratory indicates robust methods for active surface vibration suppression will be needed. Fortunately, the surface mesh exhibits high passive damping which should be beneficial to active control systems.

Belvin, W. Keith↗