Search NASA⌕ Search

SEARCH · Search NASA

Results for “testing complex systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1977

Shuttle communication systems compatibility and performance testing

The Shuttle communications system consists of major space and ground elements. The compatibility and performance of each of these major elements functioning as a complete system must be certified prior to operational missions. This paper discusses the Shuttle communication systems compatibility and performance testing. The system test philosophy for the complex communication channels is described in terms of the major phases, which include early breadboard system design evaluation tests, system development tests with prototype hardware, and system certification testing with qualifiable (flight) hardware. The system hardware configuration, facility requirements, test and evaluation techniques, and operational approaches required to accomplish each major phase of testing are reviewed. Results of recently completed space-to-space and space-to-ground system tests are presented. Test techniques and measurement accuracies proven over ten years of unique system-evaluation experience are reviewed. Techniques used in relating experimental and predicted system performance, and conclusions regarding the effectiveness of system level testing of such complex hardware, are addressed.

Seyl, J. W.↗
NASA NTRS1981

The ac propulsion system for an electric vehicle, phase 1

A functional prototype of an electric vehicle ac propulsion system was built consisting of a 18.65 kW rated ac induction traction motor, pulse width modulated (PWM) transistorized inverter, two speed mechanically shifted automatic transmission, and an overall drive/vehicle controller. Design developmental steps, and test results of individual components and the complex system on an instrumented test frame are described. Computer models were developed for the inverter, motor and a representative vehicle. A preliminary reliability model and failure modes effects analysis are given.

Geppert, S.↗
DOE OSTI2022

A framework for evaluating power electronic systems for grid integration

As power electronic systems (PESs) grow increasingly complex, integrating and testing these systems in the development stages is becoming more crucial and more challenging. New modes and resource integration strategies are in development and must be tested before pilot demonstrations and mass production. This paper proposes a framework for testing of PES technologies including early validation with integration of simulated resources. The framework is demonstrated to work in two example configurations as proof of principle.

Dean, Ben↗
NASA NTRS1987

The application of emulation techniques in the analysis of highly reliable, guidance and control computer systems

Emulation techniques can be a solution to a difficulty that arises in the analysis of the reliability of guidance and control computer systems for future commercial aircraft. Described here is the difficulty, the lack of credibility of reliability estimates obtained by analytical modeling techniques. The difficulty is an unavoidable consequence of the following: (1) a reliability requirement so demanding as to make system evaluation by use testing infeasible; (2) a complex system design technique, fault tolerance; (3) system reliability dominated by errors due to flaws in the system definition; and (4) elaborate analytical modeling techniques whose precision outputs are quite sensitive to errors of approximation in their input data. Use of emulation techniques for pseudo-testing systems to evaluate bounds on the parameter values needed for the analytical techniques is then discussed. Finally several examples of the application of emulation techniques are described.

Migneault, Gerard E.↗
DOE OSTI2025

Testing convolutional neural network based deep learning systems: a statistical metamorphic approach

Machine learning technology spans many areas and today plays a significant role in addressing a wide range of problems in critical domains,i.e., healthcare, autonomous driving, finance, manufacturing, cybersecurity,etc. Metamorphic testing (MT) is considered a simple but very powerful approach in testing such computationally complex systems for which either an oracle is not available or is available but difficult to apply. Conventional metamorphic testing techniques have certain limitations in verifying deep learning-based models (i.e., convolutional neural networks (CNNs)) that have a stochastic nature (because of randomly initializing the network weights) in their training. In this article, we attempt to address this problem by using a statistical metamorphic testing (SMT) technique that does not require software testers to worry about fixing the random seeds (to get deterministic results) to verify the metamorphic relations (MRs). We propose seven MRs combined with different statistical methods to statistically verify whether the program under test adheres to the relation(s) specified in the MR(s). We further use mutation testing techniques to show the usefulness of the proposed approach in the healthcare space and test two CNN-based deep learning models (used for pneumonia detection among patients). The empirical results show that our proposed approach uncovers 85.71% of the implementation faults in the classifiers under test (CUT). Furthermore, we also propose an MRs minimization algorithm for the CUT, thus saving computational costs and organizational testing resources.

Computer Science↗
DOE OSTI2019

Transmission Expansion Planning Test System for AC/DC Hybrid Grid With High Variable Renewable Energy Penetration

Test systems are important tools and benchmark for power system research. Currently, there is a lack of standard test systems for modern transmission expansion planning (TEP) research, especially under high variable renewable energy (VRE) penetrations. This article describes a 38-bus test system named the HRP-38 system dedicated to TEP. “HRP” stands for high renewable penetration. The objective of establishing such a system is to provide a consistent platform for different TEP methods to be tested and compared. The test system considers high VRE penetration of more than 30% energy share, which will be an important feature in many power systems in the future. Both AC and DC candidate lines are given to provide sufficient transmission planning alternatives. The complexity of the test system is well balanced considering calculation tractability and the ability to test the performance of the TEP planning model. The network topology, generation mix and load characteristics are described in detail. Year-round time series of VRE (wind power and PV) output and load curves for each bus are provided to facilitate a detailed evaluation of the transmission grid configuration under high VRE penetration. Finally, four benchmark results with different optimization settings are provided for the HRP-38 system.

AC/DC hybrid↗
NASA NTRS1979

Evaluation Applied to Reliability Analysis of Reconfigurable, Highly Reliable, Fault-Tolerant, Computing Systems for Avionics

Emulation techniques are proposed as a solution to a difficulty arising in the analysis of the reliability of highly reliable computer systems for future commercial aircraft. The difficulty, viz., the lack of credible precision in reliability estimates obtained by analytical modeling techniques are established. The difficulty is shown to be an unavoidable consequence of: (1) a high reliability requirement so demanding as to make system evaluation by use testing infeasible, (2) a complex system design technique, fault tolerance, (3) system reliability dominated by errors due to flaws in the system definition, and (4) elaborate analytical modeling techniques whose precision outputs are quite sensitive to errors of approximation in their input data. The technique of emulation is described, indicating how its input is a simple description of the logical structure of a system and its output is the consequent behavior. The use of emulation techniques is discussed for pseudo-testing systems to evaluate bounds on the parameter values needed for the analytical techniques.

Migneault, G. E.↗
NASA NTRS1979

Emulation applied to reliability analysis of reconfigurable, highly reliable, fault-tolerant computing systems

Emulation techniques applied to the analysis of the reliability of highly reliable computer systems for future commercial aircraft are described. The lack of credible precision in reliability estimates obtained by analytical modeling techniques is first established. The difficulty is shown to be an unavoidable consequence of: (1) a high reliability requirement so demanding as to make system evaluation by use testing infeasible; (2) a complex system design technique, fault tolerance; (3) system reliability dominated by errors due to flaws in the system definition; and (4) elaborate analytical modeling techniques whose precision outputs are quite sensitive to errors of approximation in their input data. Next, the technique of emulation is described, indicating how its input is a simple description of the logical structure of a system and its output is the consequent behavior. Use of emulation techniques is discussed for pseudo-testing systems to evaluate bounds on the parameter values needed for the analytical techniques. Finally an illustrative example is presented to demonstrate from actual use the promise of the proposed application of emulation.

Migneault, G. E.↗
NASA NTRS1986

COFS 1: Beam dynamics and control technology overview

The Control of Flexible Structures (COFS) 1 Project provides the invaluable opportunity to test, validate, and measure the effectiveness of theories, structural concepts, control systems, and flight certification processes for future missions through a research program focusing on multiple issues in large flexible structures, dynamics, and controls. The COFS 1 Project consists of a series of ground and flight activities building progressively from modeling and dynamic characterization of large space systems to the more complex issues of flexible-body control. The program objectives are to: determine the degree to which theory and ground testing can predict flight performance of next-generation low-frequency structures; evaluate structural fidelity of representative next-generation large deployable precision structure; assess math modeling requirements for large lightweight complex systems on which ground test results are questionable; determine degree to which scale model analysis and tests can be correlated to full-scale performance; evaluate system identification and state estimation algorithms on complex lightweight structures in the space environment; evaluate and verify controls/structures modeling capability; evaluate control laws and control systems; and evaluate damping effects in micro-g environment.

Allen, John L.↗
NASA NTRS1988

Intelligent test integration system

A new test technology is described which was developed for space system integration. The ultimate purpose of the system is to support the automatic generation of test systems in real time, distributed computing environments. The Intelligent Test Integration System (ITIS) is a knowledge based layer above the traditional test system components which can generate complex test configurations from the specification of test scenarios.

Sztipanovits, J.↗
NASA NTRS2011

Testing Strategies and Methodologies for the Max Launch Abort System

The National Aeronautics and Space Administration (NASA) Engineering and Safety Center (NESC) was tasked to develop an alternate, tower-less launch abort system (LAS) as risk mitigation for the Orion Project. The successful pad abort flight demonstration test in July 2009 of the "Max" launch abort system (MLAS) provided data critical to the design of future LASs, while demonstrating the Agency s ability to rapidly design, build and fly full-scale hardware at minimal cost in a "virtual" work environment. Limited funding and an aggressive schedule presented a challenge for testing of the complex MLAS system. The successful pad abort flight demonstration test was attributed to the project s systems engineering and integration process, which included: a concise definition of, and an adherence to, flight test objectives; a solid operational concept; well defined performance requirements, and a test program tailored to reducing the highest flight test risks. The testing ranged from wind tunnel validation of computational fluid dynamic simulations to component ground tests of the highest risk subsystems. This paper provides an overview of the testing/risk management approach and methodologies used to understand and reduce the areas of highest risk - resulting in a successful flight demonstration test.

Schaible, Dawn M.↗
NASA NTRS2007

Analysis of Complex Valve and Feed Systems

A numerical framework for analysis of complex valve systems supports testing of propulsive systems by simulating key valve and control system components in the test loop. In particular, it is designed to enhance the analysis capability in terms of identifying system transients and quantifying the valve response to these transients. This system has analysis capability for simulating valve motion in complex systems operating in diverse flow regimes ranging from compressible gases to cryogenic liquids. A key feature is the hybrid, unstructured framework with sub-models for grid movement and phase change including cryogenic cavitations. The multi-element unstructured framework offers improved predictions of valve performance characteristics under steady conditions for structurally complex valves such as pressure regulator valve. Unsteady simulations of valve motion using this computational approach have been carried out for various valves in operation at Stennis Space Center such as the split-body valve and the 10-in. (approx.25.4-cm) LOX (liquid oxygen) valve and the 4-in. (approx.10 cm) Y-pattern valve (liquid nitrogen). Such simulations make use of variable grid topologies, thereby permitting solution accuracy and resolving important flow physics in the seat region of the moving valve. An advantage to this software includes possible reduction in testing costs incurred due to disruptions relating to unexpected flow transients or functioning of valve/flow control systems. Prediction of the flow anomalies leading to system vibrations, flow resonance, and valve stall can help in valve scheduling and significantly reduce the need for activation tests. This framework has been evaluated for its ability to predict performance metrics like flow coefficient for cavitating venturis and valve coefficient curves, and could be a valuable tool in predicting and understanding anomalous behavior of system components at rocket propulsion testing and design sites.

Ahuja, Vineet↗
NASA NTRS1987

On sine dwell or broadband methods for modal testing

For large, complex spacecraft structural systems, the objectives of the modal test are outlined. Based on these objectives, the comparison criteria for the modal test methods, namely, the broadband excitation and the sine dwell methods are established. Using the Galileo spacecraft modal test and the Centaur G Prime upper stage vehicle modal test as examples, the relative advantages or disadvantages of each method are examined. The usefulness or shortcoming of the methods are given from a practicing engineer's view point.

Chen, Jay-Chung↗
NASA NTRS2004

The MELISSA pilot plant facility as as integration test-bed for advanced life support systems

The different advances in the Micro Ecological Life Support System Alternative project (MELISSA), fostered and coordinated by the European Space Agency, as well as in other associated technologies, are integrated and demonstrated in the MELISSA Pilot Plant laboratory. During the first period of operation, the definition of the different compartments at an individual basis has been achieved, and the complete facility is being re-designed to face a new period of integration of all these compartments. The final objective is to demonstrate the potentiality of biological systems such as MELISSA as life support systems. The facility will also serve as a test bed to study the robustness and stability of the continuous operation of a complex biological system. This includes testing of the associated instrumentation and control for a safe operation, characterization of the chemical and microbial safety of the system, as well as tracking the genetic stability of the microbial strains used. The new period is envisaged as a contribution to the further development of more complete biological life support systems for long-term manned missions, that should be better defined from the knowledge to be gained from this integration phase. This contribution summarizes the current status of the Pilot Plant and the planned steps for the new period. c2004 COSPAR. Published by Elsevier Ltd. All rights reserved.

Waste Management/instrumentation/methods↗
NASA NTRS2012

Nemesis Autonomous Test System

A generalized framework has been developed for systems validation that can be applied to both traditional and autonomous systems. The framework consists of an automated test case generation and execution system called Nemesis that rapidly and thoroughly identifies flaws or vulnerabilities within a system. By applying genetic optimization and goal-seeking algorithms on the test equipment side, a "war game" is conducted between a system and its complementary nemesis. The end result of the war games is a collection of scenarios that reveals any undesirable behaviors of the system under test. The software provides a reusable framework to evolve test scenarios using genetic algorithms using an operation model of the system under test. It can automatically generate and execute test cases that reveal flaws in behaviorally complex systems. Genetic algorithms focus the exploration of tests on the set of test cases that most effectively reveals the flaws and vulnerabilities of the system under test. It leverages advances in state- and model-based engineering, which are essential in defining the behavior of autonomous systems. It also uses goal networks to describe test scenarios.

Barltrop, Kevin J.↗
NASA NTRS1990

Realtime multi-plot graphics system

The increased complexity of test operations and customer requirements at Langley Research Center's National Transonic Facility (NTF) surpassed the capabilities of the initial realtime graphics system. The analysis of existing hardware and software and the enhancements made to develop a new realtime graphics system are described. The result of this effort is a cost effective system, based on hardware already in place, that support high speed, high resolution, generation and display of multiple realtime plots. The enhanced graphics system (EGS) meets the current and foreseeable future realtime graphics requirements of the NTF. While this system was developed to support wind tunnel operations, the overall design and capability of the system is applicable to other realtime data acquisition systems that have realtime plot requirements.

Shipkowski, Michael S.↗
NASA NTRS1979

Test-configuration identifiers

Distributed computer system, which allows great deal of interaction within totally synchronized environment, comprises test system that presents systematic approach for identifying test configurations for large complex systems such as submarines, aircraft, or air traffic controllers.

Sumrall, W. D.↗