Search NASA⌕ Search

SEARCH · Search NASA

Results for “test approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

An error-specific approach to testing

The main objective of software testing in the software development life cycle is to verify conformance of the implemented software with its intended requirements. Such requirements include system requirements, and programming requirements. Non-conformance with such requirements causes what are known as software errors. Specifying an appropriate testing strategy to expose software errors is still an art. Traditional approaches do succeed in revealing many errrors but none is powerful enough to expose all errors. The best that is hoped for is to use a specific test strategy to expose a specific error type in specific program locations. This limitation is exploited to develop a new approach to software testing which is called an error-specific testing (EST) strategy. Error specific testing is in fact a dual to the traditional testing approaches.

Valdes, P. M.↗

Adaptive Stress Testing of Trajectory Predictions in Flight Management Systems

To find failure events and their likelihoods in flight-critical systems, we investigate the use of an advanced black-box stress testing approach called adaptive stress testing. We analyze a trajectory predictor from a developmental commercial flight management system which takes as input a collection of lateral waypoints and en-route environmental conditions. Our aim is to search for failure events relating to inconsistencies in the predicted lateral trajectories. The intention of this work is to find likely failures and report them back to the developers so they can address and potentially resolve shortcomings of the system before deployment. To improve search performance, this work extends the adaptive stress testing formulation to be applied more generally to sequential decision-making problems with episodic reward by collecting the state transitions during the search and evaluating at the end of the simulated rollout. We use a modified Monte Carlo tree search algorithm with progressive widening as our adversarial reinforcement learner. The performance is compared to direct Monte Carlo simulations and to the cross-entropy method as an alternative importance sampling baseline. The goal is to find potential problems otherwise not found by traditional requirements-based testing. Results indicate that our adaptive stress testing approach finds more failures and finds failures with higher likelihood relative to the baseline approaches.

adaptive stress testing↗

A New Approach in Force-Limited Vibration Testing of Flight Hardware

The force-limited vibration test approaches discussed in NASA-7004C were developed to reduce overtesting associated with base shake vibration tests of aerospace hardware where the interface responses are excited coherently. This handbook outlines several different methods of specifying the force limits. The rationale for force limiting is based on the disparity between the impedances of typical aerospace mounting structures and the large impedances of vibration test shakers when the interfaces in general are coherently excited. Among these approaches, the semi-empirical method is presently the most widely used method to derive the force limits. The inclusion of the incoherent excitation of the aerospace structures at mounting interfaces has not been accounted for in the past and provides the basis for more realistic force limits for qualifying the hardware using shaker testing. In this paper current methods for defining the force limiting specifications discussed in the NASA handbook are reviewed using data from a series of acoustic and vibration tests. A new approach based on considering the incoherent excitation of the structural mounting interfaces using acoustic test data is also discussed. It is believed that the new approach provides much more realistic force limits that may further remove conservatism inherent in shaker vibration testing not accounted for by methods discussed in the NASA handbook. A discussion on using FEM/BEM analysis to obtain realistic force limits for flight hardware is provided.

force limiting responses↗

Thermal Gradient Cyclic Behavior of a Thermal/Environmental Barrier Coating System on SiC/SiC Ceramic Matrix Composites

Thermal barrier and environmental barrier coatings (TBCs and EBCs) will play a crucial role in future advanced gas turbine engines because of their ability to significantly extend the temperature capability of the ceramic matrix composite (CMC) engine components in harsh combustion environments. In order to develop high performance, robust coating systems for effective thermal and environmental protection of the engine components, appropriate test approaches for evaluating the critical coating properties must be established. In this paper, a laser high-heat-flux, thermal gradient approach for testing the coatings will be described. Thermal cyclic behavior of plasma-sprayed coating systems, consisting of ZrO2-8wt%Y2O3 thermal barrier and NASA Enabling Propulsion Materials (EPM) Program developed mullite+BSAS/Si type environmental barrier coatings on SiC/SiC ceramic matrix composites, was investigated under thermal gradients using the laser heat-flux rig in conjunction with the furnace thermal cyclic tests in water-vapor environments. The coating sintering and interface damage were assessed by monitoring the real-time thermal conductivity changes during the laser heat-flux tests and by examining the microstructural changes after the tests. The coating failure mechanisms are discussed based on the cyclic test results and are correlated to the sintering, creep, and thermal stress behavior under simulated engine temperature and heat flux conditions.

Zhu, Dongming↗

Actuator and Motor Control End-to-End V&V on the Mars 2020 Rover

The Mars 2020 Perseverance rover is the most advanced robotic exploration system ever sent to another planet. To support the complex scientific and mobility needs of the mission, the rover utilizes 33 actuators, three multi-degree-of-freedom force-torque sensors, fifteen single or dual-speed resolvers, two solenoid valves, and twelve contact switches. The control for these actuators and sensors is achieved by several levels of flight software, coordinated between two computers with varying bandwidth control loops. Furthermore, the actuators and sensors were integrated into multiple larger robotic mechanisms that were delivered by different organizations at various points in the Integration and Test (I&T) timeline. All of this created a very complex Verification and Validation (V&V) scenario involving multiple subsystems and teams, several hardware and software testbeds with varying levels of fidelity, and significant systems engineering to ensure the overall I&T schedule could be maintained while ensuring system hardware safety.This paper details the integrated V&V effort across multiple teams and venues to provide full coverage of all necessary functionality, performance, and fault protection. First, it provides an overview of how the V&V campaign was subdivided among teams and venues and provides descriptions of the various hardware configurations used to support the testing. The Mars 2020 implementation of the plan incorporates many of the lessons learned from Mars Science Laboratory’s test campaign, and these value-added modifications are discussed here. Also included in this section is the system-level environmental testing approach used for mechanisms. Second, the paper describes the phased approach used by the teams to support new hardware and software deliveries to testbed and Systems I&T. In this approach the test campaign was built upon higher-level mechanism needs for performance, functionality, and safety at specific times in the campaign. Finally, the paper discusses lessons learned from the V&V campaign that should be applied to future large-scale motion control testing efforts.

Borne, Davis↗

A Time History of Control Operation of a C-54 Airplane in Blind Landing Approaches

Tests were made with a C-54 airplane in which airline pilots made several blind approaches to determine whether any special flying techniques were used in blind landings and whether any special handling-qualities requirements would have to be formulated because of such special techniques. It was found that the airplane was flown at all times in the normal manner; that is, all turns were banked turns that were nearly coordinated by use of the rudder so that the sideslip was held close to zero. The pilot expended considerable physical work in continually moving the controls but this wake was due in part to the large friction in the three control systems. The actual control deflections used were small compared to the maximum deflections available.

Talmage, Donald B.↗

Navigation and flight director guidance for the NASA/FAA helicopter MLS curved approach flight test program

The navigation and flight director guidance systems implemented in the NASA/FAA helicopter microwave landing system (MLS) curved approach flight test program is described. Flight test were conducted at the U.S. Navy's Crows Landing facility, using the NASA Ames UH-lH helicopter equipped with the V/STOLAND avionics system. The purpose of these tests was to investigate the feasibility of flying complex, curved and descending approaches to a landing using MLS flight director guidance. A description of the navigation aids used, the avionics system, cockpit instrumentation and on-board navigation equipment used for the flight test is provided. Three generic reference flight paths were developed and flown during the test. They were as follows: U-Turn, S-turn and Straight-In flight profiles. These profiles and their geometries are described in detail. A 3-cue flight director was implemented on the helicopter. A description of the formulation and implementation of the flight director laws is also presented. Performance data and analysis is presented for one pilot conducting the flight director approaches.

Phatak, A. V.↗

Board Level Proton Testing Book of Knowledge for NASA Electronic Parts and Packaging Program

This book of knowledge (BoK) provides a critical review of the benefits and difficulties associated with using proton irradiation as a means of exploring the radiation hardness of commercial-off-the-shelf (COTS) systems. This work was developed for the NASA Electronic Parts and Packaging (NEPP) Board Level Testing for the COTS task. The fundamental findings of this BoK are the following. The board-level test method can reduce the worst case estimate for a board's single-event effect (SEE) sensitivity compared to the case of no test data, but only by a factor of ten. The estimated worst case rate of failure for untested boards is about 0.1 SEE/board-day. By employing the use of protons with energies near or above 200 MeV, this rate can be safely reduced to 0.01 SEE/board-day, with only those SEEs with deep charge collection mechanisms rising this high. For general SEEs, such as static random-access memory (SRAM) upsets, single-event transients (SETs), single-event gate ruptures (SEGRs), and similar cases where the relevant charge collection depth is less than 10 μm, the worst case rate for SEE is below 0.001 SEE/board-day. Note that these bounds assume that no SEEs are observed during testing. When SEEs are observed during testing, the board-level test method can establish a reliable event rate in some orbits, though all established rates will be at or above 0.001 SEE/board-day. The board-level test approach we explore has picked up support as a radiation hardness assurance technique over the last twenty years. The approach originally was used to provide a very limited verification of the suitability of low cost assemblies to be used in the very benign environment of the International Space Station (ISS), in limited reliability applications. Recently the method has been gaining popularity as a way to establish a minimum level of SEE performance of systems that require somewhat higher reliability performance than previous applications. This sort of application of the method suggests a critical analysis of the method is in order. This is also of current consideration because the primary facility used for this type of work, the Indiana University Cyclotron Facility (IUCF) (also known as the Integrated Science and Technology (ISAT) hall), has closed permanently, and the future selection of alternate test facilities is critically important. This document reviews the main theoretical work on proton testing of assemblies over the last twenty years. It augments this with review of reported data generated from the method and other data that applies to the limitations of the proton board-level test approach. When protons are incident on a system for test they can produce spallation reactions. From these reactions, secondary particles with linear energy transfers (LETs) significantly higher than the incident protons can be produced. These secondary particles, together with the protons, can simulate a subset of the space environment for particles capable of inducing single event effects (SEEs). The proton board-level test approach has been used to bound SEE rates, establishing a maximum possible SEE rate that a test article may exhibit in space. This bound is not particularly useful in many cases because the bound is quite loose. We discuss the established limit that the proton board-level test approach leaves us with. The remaining possible SEE rates may be as high as one per ten years for most devices. The situation is actually more problematic for many SEE types with deep charge collection. In cases with these SEEs, the limits set by the proton board-level test can be on the order of one per 100 days. Because of the limited nature of the bounds established by proton testing alone, it is possible that tested devices will have actual SEE sensitivity that is very low (e.g., fewer than one event in 1 × 10(exp 4) years), but the test method will only be able to establish the limits indicated above. This BoK further examines other benefits of proton board-level testing besides hardness assurance. The primary alternate use is the injection of errors. Error injection, or fault injection, is something that is often done in a simulation environment. But the proton beam has the benefit of injecting the majority of actual SEEs without risk of something being missed, and without the risk of simulation artifacts misleading the SEE investigation.

Guertin, Steven M.↗

Space Shuttle Orbiter Approach and Landing Test Program

The approach and landing tests of the orbiter vehicle, planned for early 1977, will be the first actual flight activity in the NASA Space Shuttle Program. The tests are to include air-launched unpowered glide, approach, and landing tests. A review is presented of the basic Shuttle program and a description of the orbiter design is given, taking into account the flight control systems. Details of the actual test program will be partly based on the results to be obtained with an orbiter aeroflight simulator.

Fullerton, C. G.↗

Multiple boundary condition test (MBCT) approach to update mathematical models of large flexible structures

A major challenge to the structural dynamicist is to validate mathematical models of large space structures which cannot be ground tested because of its size and/or flexibility. The paper presents a Multiple Boundary Condition Test (MBCT) approach which allows a systematic validation of the mathematical model by performing a number of ground tests on a large structure with variable boundary conditions. A numerical simulation is presented which illustrates the validity of the MBCT including some of the potential limitations.

Wada, B. K.↗

Frequency modulation system test procedure shuttle task 501 approach and landing test configuration

Shuttle Task 501 is an in-line task to test the performance and compatibility of radiofrequency links between the SSO and ground, and relay via a satellite. Under Shuttle Task 501 approach and landing test (ALT) phase only a limited portion of the communication and tracking (C&T) equipment is to be tested. The principal item to be tested is a frequency modulated (FM) data link. To test this RF link, an ALT FM System was designed, constructed, and the console wiring verified. A step-by-step procedure to be used to perform the ALT FM system is presented. The ALT FM system test is to be performed prior to delivery of the equipment to the Electronic Systems Test Laboratory (ESTL).

Doland, G. D.↗

Space Shuttle Orbiter Approach and Landing Test

The Space Shuttle Orbiter Approach and Landing Test is part of the Space Shuttle Orbiter Project development testing that will precede the first Space Shuttle Orbital Flight Test. The approach and landing test will be accomplished during a 1-year period beginning in early 1977. The first Space Shuttle Orbiter to be assembled will be used to perform the approach and landing tests. A modified Boeing 747 aircraft will be used as a carrier for in-flight testing and launching of the Orbiter. The primary objectives of the approach and landing test are to verify the Orbiter/Shuttle Carrier Aircraft test configuration, to verify Orbiter manual approach and landing in the first Orbital Flight Test configuration, and to demonstrate an Orbiter Automatic Terminal Area Energy Management/Autoland capability.

Oglesby, T. L.↗

The General Mission Analysis Tool (GMAT) System Test Plan

This document serves as the System Test Approach for the GMAT Project. Preparation for system testing consists of three major stages: 1) The Test Approach sets the scope of system testing, the overall strategy to be adopted, the activities to be completed, the general resources required and the methods and processes to be used to test the release. It also details the activities, dependencies and effort required to conduct the System Test. 2) Test Planning details the activities, dependencies and effort required to conduct the System Test. 3) Test Cases documents the tests to be applied, the data to be processed, the automated testing coverage and the expected results. This document covers the first two of these items, and established the framework used for the GMAT test case development. The test cases themselves exist as separate components, and are managed outside of and concurrently with this System Test Plan.

Conway, Darrel J.↗

Magnetic Testing, and Modeling, Simulation and Analysis for Space Applications

The Aerospace Corporation (Aerospace) and Lockheed Martin Space Systems (LMSS) participated with Jet Propulsion Laboratory (JPL) in the implementation of a magnetic cleanliness program of the NASA/JPL JUNO mission. The magnetic cleanliness program was applied from early flight system development up through system level environmental testing. The JUNO magnetic cleanliness program required setting-up a specialized magnetic test facility at Lockheed Martin Space Systems for testing the flight system and a testing program with facility for testing system parts and subsystems at JPL. The magnetic modeling, simulation and analysis capability was set up and performed by Aerospace to provide qualitative and quantitative magnetic assessments of the magnetic parts, components, and subsystems prior to or in lieu of magnetic tests. Because of the sensitive nature of the fields and particles scientific measurements being conducted by the JUNO space mission to Jupiter, the imposition of stringent magnetic control specifications required a magnetic control program to ensure that the spacecraft's science magnetometers and plasma wave search coil were not magnetically contaminated by flight system magnetic interferences. With Aerospace's magnetic modeling, simulation and analysis and JPL's system modeling and testing approach, and LMSS's test support, the project achieved a cost effective approach to achieving a magnetically clean spacecraft. This paper presents lessons learned from the JUNO magnetic testing approach and Aerospace's modeling, simulation and analysis activities used to solve problems such as remnant magnetization, performance of hard and soft magnetic materials within the targeted space system in applied external magnetic fields.

magnetics↗

Space Shuttle Program Orbiter Approach and Landing Test

The orbiter approach and landing test (ALT) reports are published to provide senior NASA management with timely information on ALT program plans and accomplishments. The ALT reports will be comprised of this pre-ALT report, ALT pre-flight memoranda, and an ALT post-flight report following each flight. The purpose of this pre-ALT report is to provide an overview of the ALT program, describing the flight vehicles involved and summarizing the planned flights.

Source record↗

Risks of Depress as a Fire Suppression Technique in Spacecraft

Spacecraft are designed to prevent fires through careful material selection and configuration control combined with electrical design controls and isolation of ignition sources. Despite these best efforts, fire risk still exists due to the potential for configuration changes with the introduction of crew and the potential for a ‘failure of imagination’ by designers in anticipating all fuel and ignition sources. Therefore, fire suppression is a critical capability for any crewed spacecraft as a last resort for crew survival. Many spacecraft suppression methods have relied on fire suppressants such as compressed carbon dioxide, nitrogen, and water. A proposed alternative is depressurization of the cabin as a method to extinguish a fire. Limited testing was conducted during Skylab and showed that depress could result in stirring the air flow and aggravating a fire before extinguishing. However, limited information was available on how the test was conducted. To better characterize the approach, testing was conducted at NASA’s White Sands Test Facility to evaluate the effect of depressurization on material extinguishment. The results showed that depressurization does not provide a safe and effective fire suppression capability. The testing approach, results, and conclusions are described and discussed.

Toni Griego↗