Search NASA⌕ Search

SEARCH · Search NASA

Results for “testing complex systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, a fleet of unmanned ground vehicles (UGVs) was developed as a test and evaluation (T\&E) platform to reduce system integration gaps between simulation and live flight hardware. While simulation and hardware-in-the-loop bench testing provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure increase the risks to safety, property, and the project. Given ATTRACTOR’s goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, bridging these gaps was critical to successful project execution and feasibility assessment. In this paper we present the UGV fleet and its role in speeding up system integration, smoothing the transition from simulation to flight, and providing researchers an easy-to-use hardware test bed. An overview of the hardware and software on-board the vehicles is provided along with supporting infrastructure. The system integration process is documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted since the creation of the fleet. Finally, we discuss the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P. Vaughan↗
NASA NTRSDate not supplied

Statistical Approach on Utilizing Ground-based Experiments to Model Break-up Events

Two laboratory-based impact tests have been conducted to develop and extend the capability of NASA satellite breakup models. The first experiment, the Satellite Orbital Debris Characterization Impact Test (SOCIT), was conducted by the U.S. Department of Defense and NASA in 1992. It employed a fully functional U.S. Navy Transit spacecraft, fabricated from materials commonly used in the 1960s. SOCIT fragmentation data formed the basis of the current NASA Standard Satellite Breakup Model (SSBM). A second experiment, DebriSat, was conducted in 2014 by the DebriSat consortium: the NASA Orbital Debris Program Office; the United States Space Force Space Systems Command, formerly the Air Force Space and Missile Systems Center, the Air Force Arnold Engineering Development Complex, and the University of Florida. This impact test was performed on a high-fidelity mock-up satellite assembled from modern components. Data from both experiments are expected to contribute to the next-generation models for on-orbit breakup analyses, long-term environment predictions, and debris risk assessment. This paper uses the direct statistical sampling of the SOCIT and DebriSat data ensembles to model an on-orbit breakup event, rather than the analytic expressions estimated from the samples as with as with the NASA SSBM and its predecessor. This direct method involves drawing fragments (i.e., sampling with replacement) from each fragmentation data-subset containing mass, shape category, material density, characteristic length, mass, and cross-sectional area. As part of the sampling process, the properties of sampled fragment data (e.g., area-to-mass ratios) are numerically checked to ensure they do not contain unrealistic quantities. The process to simulate a breakup cloud composed of fragments from SOCIT and DebriSat datasets is discussed. The methodology for ensuring that conservation of overall mass of the sampled fragment cloud under this sampling approach is highlighted. Finally, the results are compared with simulated clouds generated from SSBM for specific historical breakup events.

Andrew Vavrin↗
NASA NTRS2023

Statistical Approach on Utilizing Ground-Based Experiments to Model Break-Up Events

Two laboratory-based impact tests have been conducted to develop and extend the capability of NASA satellite breakup models. The first experiment, the Satellite Orbital Debris Characterization Impact Test (SOCIT), was conducted by the U.S. Department of Defense and NASA in 1992. It employed a fully functional U.S. Navy Transit spacecraft, fabricated from materials commonly used in the 1960s. SOCIT fragmentation data formed the basis of the current NASA Standard Satellite Breakup Model (SSBM). A second experiment, DebriSat, was conducted in 2014 by the DebriSat consortium: the NASA Orbital Debris Program Office, the United States Space Force Space Systems Command, formerly the Air Force Space and Missile Systems Center, the Air Force Arnold Engineering Development Complex, and the University of Florida. This impact test was performed on a high-fidelity mock-up satellite assembled from modern components. Data from both experiments are expected to contribute to the next-generation models for on-orbit breakup analyses, long-term environment predictions, and debris risk assessment. This paper uses the direct statistical sampling of the SOCIT and DebriSat data ensembles to model an on-orbit breakup event, rather than the analytic expressions estimated from the samples in the SSBM and its predecessor. This direct method involves drawing fragments (i.e., sampling with replacement) from each fragmentation data-subset containing mass, shape category, material density, characteristic length, mass, and cross-sectional area. As part of the sampling process, the properties of sampled fragment data (e.g., area-to-mass ratios) are numerically checked to ensure they do not contain unrealistic quantities. The process to simulate a breakup cloud composed of fragments from SOCIT and DebriSat datasets is discussed. The methodology for ensuring that conservation of overall mass of the sampled fragment cloud under this sampling approach is highlighted. Finally, the results are compared with simulated clouds generated from SSBM for specific historical breakup events.

Andrew Vavrin↗
NASA NTRS2009

(Quickly) Testing the Tester via Path Coverage

The configuration complexity and code size of an automated testing framework may grow to a point that the tester itself becomes a significant software artifact, prone to poor configuration and implementation errors. Unfortunately, testing the tester by using old versions of the software under test (SUT) may be impractical or impossible: test framework changes may have been motivated by interface changes in the tested system, or fault detection may become too expensive in terms of computing time to justify running until errors are detected on older versions of the software. We propose the use of path coverage measures as a "quick and dirty" method for detecting many faults in complex test frameworks. We also note the possibility of using techniques developed to diversify state-space searches in model checking to diversify test focus, and an associated classification of tester changes into focus-changing and non-focus-changing modifications.

evaluation of test systems↗
NASA NTRS2011

Embedded Acoustic Sensor Array for Engine Fan Noise Source Diagnostic Test: Feasibility of Noise Telemetry via Wireless Smart Sensors

Aircraft engines have evolved into a highly complex system to meet ever-increasing demands. The evolution of engine technologies has primarily been driven by fuel efficiency, reliability, as well as engine noise concerns. One of the sources of engine noise is pressure fluctuations that are induced on the stator vanes. These local pressure fluctuations, once produced, propagate and coalesce with the pressure waves originating elsewhere on the stator to form a spinning pressure pattern. Depending on the duct geometry, air flow, and frequency of fluctuations, these spinning pressure patterns are self-sustaining and result in noise which eventually radiate to the far-field from engine. To investigate the nature of vane pressure fluctuations and the resulting engine noise, unsteady pressure signatures from an array of embedded acoustic sensors are recorded as a part of vane noise source diagnostics. Output time signatures from these sensors are routed to a control and data processing station adding complexity to the system and cable loss to the measured signal. "Smart" wireless sensors have data processing capability at the sensor locations which further increases the potential of wireless sensors. Smart sensors can process measured data locally and transmit only the important information through wireless communication. The aim of this wireless noise telemetry task was to demonstrate a single acoustic sensor wireless link for unsteady pressure measurement, and thus, establish the feasibility of distributed smart sensors scheme for aircraft engine vane surface unsteady pressure data transmission and characterization.

Zaman, Afroz↗
NASA NTRS2019

High Velocity Impact Performance of a Dual Layer Thermal Protection System for the Mars Sample Return Earth Entry Vehicle

The Mars Sample Return (MSR) Earth Entry Vehicle (EEV) is currently planned on being released from its Micro-Meteorite/Orbital Debri (MM/OD) shielding housing about two days before the Earth entry phase. This leaves the EEV exposed to incoming MM/OD impacts, potentially damaging the heat shield and compromising its Entry, Decent, and Landing (EDL) integrity. Currently, two materials are proposed to comprise the MSR-EEV heat shield, a dual layer material Heat-shield for Extreme Entry Environment Technology (HEEET) and Phenolic Impregnated Carbon Ablator (PICA). PICA has been well characterized for OD class impacts, ~7km/s high mass impacts, from previous testing done in the Orion program, but hasn't under-gone extensive MM impact testing. HEEET is a rela-tively new material with minimal prior testing in re-gards to High Velocity Impacts (HVI). In order to in-form selectability of a material, it is crucial to under-stand the material performance when faced with an HVI, directly affecting mission success probability.The current measure of a Thermal Protection Sys-tem's (TPS) performance against an HVI is evaluating a thermally sized material against its derived Balistic Limit Equation (BLE). A BLE is generated empirically from multiple shots of HVI testing, and is used as a first order method in evaluating TPS's performance against the expected MM/OD environment. This method has proved useful for previous uniform densi-ty TPS materials, but has never been validated against a dual layer recession material such as HEEET. Testing in the MSR program for FY19 has a re-quirement to assess the effects of a dual layer TPS by testing various thicknesses of HEEET's Recession Layer, seen in Figure 1. From this data, BLE's will be derived for the individual thickness ratio samples, as well as the material as a whole to evaluate if a heritage form of the BLE can capture the complex physics associated with a dual layer system. Crater morpholo-gy will also be assessed with post-test Non-Destructive Evaluation (NDE) methods such as CT scanning to visualize if a BLE can well predict the associated pene-tration depths, since a BLE assumes full disinigration of the impacting particle and is generally only used to size a spherical crater ? disregarding any shrapenel effects from a high density impactor.To inform this analysis, expected MM environ-ments from the Meteoroid Engineering Model (MEM) and analytical equations for mass flux of incoming MM were evaluated against the notional MSR-EEV trajectory [1]. Using those dispersions, a monte-carlo was run to determine the most probable particle pa-rameters, as well as the riskiest in terms of full bondline penetration. From these probabilities, a test matrix was designed to test against bounding cases for the various parameters of the BLE: projectile density, projectile mass, projectile velocity, and the impact angle.This presentation will discuss the performance of the dual layer TPS material HEEET against a wide range of impact kinetic energies and densitites, as well as the comparison of HEEET to PICA in terms of MM/OD performance and selectability criteria.

Libben, B. J.↗
NASA NTRS2003

Increasing software testability with standard access and control interfaces

Testing is the most common method of determining whether a software system satisfies its requirements. Traditionally, testing starts with the detailed examination of individual functions or methods, progresses through the integration of functions or methods into subsystems, and ends with testing the functionality and behavior of the completely integrated system. At each stage of testing, the amount of functionality and behavior of the artifact being tested is increasingly limited. One reason for this is that it becomes impossible to test all paths through the system within a reasonable amount of time. However, another reason for this progressive decrease of test coverage has to do with increasingly limited control of and visibility into the state of the artifact being tested. During unit test, it is rather simple to control the inputs of individual functions or methods or view their internal state - modem development environments provide adequate facilities for doing so. However, these facilities do not scale up to the testing of partially or completely integrated systems. Control of and visibility into the system's state is then limited to the input and output facilities provided by the software itself as well as the hardware on which the software is hosted during the test. These facilities are usually insufficient to precisely control the state of individual components or sets of components of the system; they are also inadequate to the task of displaying on demand the state of specific components. We describe an approach to improving the testability of complex software systems with software constructs modeled after the hardware JTAG bus, used to provide visibility and controllability in testing digital circuits.

Tamir, Yuval↗
NASA NTRS1987

Evaluate the application of modal test and analysis processes to structural fault detection in MSFC - STS project elements

The Space Transportation System (STS) is a complex and expensive flight system intended to carry unique payloads into low Earth orbit and return. A catastrophic failure, such as STS 51-L, resulted in the loss of both human life as well as expensive and unique hardware. The impact of this incident reaffirms the need to do everything possible to ensure the integrity and reliability of STS. One means of achieving this goal is to expand the number of inspection technologies available. Reported here is the evaluation of the use of modal analysis and test techniques for the purpose of assessing the structural integrity of STS components for which Marshall Space Flight Center has responsibility. This entailed reviewing existing literature and developing a low-level experimental program determine the feasibility of using this technology for structural fault detection.

Springer, William T.↗
NASA NTRS2005

Development of a Work Control System for Propulsion Testing at NASA Stennis

In 1996 Stennis Space Center was given management authority for all Propulsion Testing for NASA. Over the next few years several research and development (R&D) test facilities were completed and brought up to full operation in what is known as the E-Complex Test Facility at Stennis Space Center. To construct, activate and operate these test facilities, a manual paper-based work control system was created. After utilizing this paper-based work control system for approximately three years, it became apparent that the research and development test area needed a better method to execute, monitor, and report on tasks required to further propulsion testing. The paper based system did not provide the engineers adequate visibility into work tasks or the tracking of testing or hardware discrepancies. This system also restricted the engineer s ability to utilize and access past knowledge and experiences given the severe schedule limitations for most R&D propulsion testing projects. Therefore a system was developed to meet the growing need of Test Operations called the Propulsion Test Directorate (PTD) Work Control System. This system is used to plan, perform, and track tasks that support testing and also to capture lessons learned while doing so.

Messer, Elizabeth A.↗
NASA NTRS1989

NASA CSI suspension methods overview

New suspension techniques will be necesary for ground testing the flexible spacecraft anticipated in NASA's future space activity. The most complex spacecraft involve nonlinear maneuvering (i.e., large angle slewing) with articulating substructures such as remote manipulating systems. The NASA control-structure interaction (CSI) ground test method team has begun researching and developing methodology to suspend the future class of spacecraft. This overview describes the work completed thus far. The research objective and technical approach will be presented first. Second, will be a suspension device overview followed by an assessment of existing hardware. Two different mechanical zero-spring-rate mechanisms will be compared for optimal performance. Next, will be a description of how existing hardware can be evolved to meet more general suspension requirements. A comparison of suspending articulating structures overhead vs underneath will follow. After a few experimental results from the zero-spring-rate mechanism/air suspension cart will be concluding remarks and future work.

Woodard, Stanley E.↗
NASA NTRS1984

A flight test evaluation of the pilot interface with a digital advanced avionics system

A flight study was conducted to study pilot workload and the pilot interface with high levels of avionics capability and automation. The study was done in the context of general aviation, single-pilot IFR operations and utilized an experimental, digital, integrated avionics system. Results indicate that such advanced systems can provide improved information to the pilot and increased functional capability. The results also indicate that additional research is needed to increase the knowledge base required to design the pilot interfaces with highly capable systems. A CRT-based moving map display format tested provided excellent navigational situational awareness but was inferior to an HSI for manual path tracking. The complexity of navigation data management, autopilot management, and maintaining awareness of system status contributed to pilot workload and errors. Suggested guidelines for the design of the pilot/avionics interface for advanced avionics systems are given.

Hinton, D. A.↗
NASA NTRS2012

SiGe Based Low Temperature Electronics for Lunar Surface Applications

The temperature at the permanently shadowed regions of the moon's surface is approximately -240 C. Other areas of the lunar surface experience temperatures that vary between 120 C and -180 C during the day and night respectively. To protect against the large temperature variations of the moon surface, traditional electronics used in lunar robotics systems are placed inside a thermally controlled housing which is bulky, consumes power and adds complexity to the integration and test. SiGe Based electronics have the capability to operate over wide temperature range like that of the lunar surface. Deploying low temperature SiGe electronics in a lander platform can minimize the need for the central thermal protection system and enable the development of a new generation of landers and mobility platforms with highly efficient distributed architecture. For the past five years a team consisting of NASA, university and industry researchers has been examining the low temperature and wide temperature characteristic of SiGe based transistors for developing electronics for wide temperature needs of NASA environments such as the Moon, Titan, Mars and Europa. This presentation reports on the status of the development of wide temperature SiGe based electronics for the landers and lunar surface mobility systems.

electonics↗
NASA NTRS1979

Evaluation of improved algorithms for nonlinear transient structural heat transfer

The paper presents the evaluation of algorithms having potential for reducing computer time to integrate large systems of equations governing nonlinear transient heat transfer in complex structures. A series of test problems is being developed to test two algorithms. The Shuttle Orbiter frame model having 190 nodes was the subject of an analytical/experimental study. Plans are to perform calculations for the complete wing model having about 4000 nodes as well as a regional (plug) model having about 200 nodes.

Adelman, H. M.↗
NASA NTRS1992

Intelligent fault management for the Space Station active thermal control system

The Thermal Advanced Automation Project (TAAP) approach and architecture is described for automating the Space Station Freedom (SSF) Active Thermal Control System (ATCS). The baseline functionally and advanced automation techniques for Fault Detection, Isolation, and Recovery (FDIR) will be compared and contrasted. Advanced automation techniques such as rule-based systems and model-based reasoning should be utilized to efficiently control, monitor, and diagnose this extremely complex physical system. TAAP is developing advanced FDIR software for use on the SSF thermal control system. The goal of TAAP is to join Knowledge-Based System (KBS) technology, using a combination of rules and model-based reasoning, with conventional monitoring and control software in order to maximize autonomy of the ATCS. TAAP's predecessor was NASA's Thermal Expert System (TEXSYS) project which was the first large real-time expert system to use both extensive rules and model-based reasoning to control and perform FDIR on a large, complex physical system. TEXSYS showed that a method is needed for safely and inexpensively testing all possible faults of the ATCS, particularly those potentially damaging to the hardware, in order to develop a fully capable FDIR system. TAAP therefore includes the development of a high-fidelity simulation of the thermal control system. The simulation provides realistic, dynamic ATCS behavior and fault insertion capability for software testing without hardware related risks or expense. In addition, thermal engineers will gain greater confidence in the KBS FDIR software than was possible prior to this kind of simulation testing. The TAAP KBS will initially be a ground-based extension of the baseline ATCS monitoring and control software and could be migrated on-board as additional computation resources are made available.

Hill, Tim↗
NASA NTRS1995

Smoke detection in low-G fires

Fires in spacecraft are considered a credible risk. To respond to this risk, NASA flew fire detectors on Skylab and the Space Shuttle (STS) and included them in the design for International Space Station Alpha (ISSA). In previous missions (Mercury, Gemini and Apollo), the crew quarters were so cramped that it was not considered credible that the astronauts could fail to observe a fire. The Skylab nodule included approximately 20 UV fire detectors. The space shuttle has 9 ionization detectors in the mid deck and flight deck and Spacelab has six additional ionization detectors. The planned detectors for ISSA are laser-diode, forward-scattering, smoke or particulate detectors. Current plans for the ISSA call for two detectors in the open area of the module and detectors in racks that have both cooling air flow and electrical power. Due to the complete absence of data concerning the nature of particulate and radiant emission from low-g fires, all three of these detector systems were designed based upon 1-g test data. As planned mission durations and complexity increase and the volume of spacecraft increases, the need for and importance of effective, crew independent, fire detection grows significantly. This requires more knowledge concerning low-gravity fires and how they might be detected. To date, no combustion-generated particulate samples have been collected for well-developed microgravity flames. All of the extant data come from drop tower tests and therefore only correspond to the early stages of a fire. The fuel sources were restricted to laminar gas-jet diffusion flames and rapidly overheated wire insulation. These gas-jet drop tower tests indicate, through thermophoretic sampling, that soot primaries and aggregates (groups of primary particles) in micro-g may be significantly larger than those in normal-g (ng). This raises new scientific questions about soot processes as well as practical issues for particulate detection/alarm threshold levels used in on-orbit smoke detectors. Furthermore, it is widely speculated but unverified that the aggregates will grow to very large scales in a microgravity fire of longer duration than available on the ground. Preliminary tests in the 2.2 second drop tower suggest that particulate generated by overheated wire insulation will also be larger in microgravity than in normal gravity. TEM grids downstream of the fire region in the WIF experiment as well as visual observation of long string-like aggregates, further confirm this suggestion. The combined impact of these limited results and theoretical predictions is that direct knowledge of low-g combustion particulate as opposed to extrapolation from 1-g data is needed for a more confident design of smoke detectors for spacecraft.

Urban, David L.↗
NASA NTRS2004

Environmental Monitoring for Situation Assessment using Mobile and Fixed Sensors

This project was co-led by Dr. Sheila McIlraith and Prof. Richard Fikes. Substantial research results and published papers describing those results were produced in multiple technology areas, including the following: 1) Monitoring a Complex Physical System using a Hybrid Dynamic Bayes Net; 2) A Formal Theory of Testing for Dynamical Systems; 3) Diagnosing Hybrid Systems Using a Bayesian Model Selection Approach.

Fikes, Richard↗
NASA NTRS2010

The Roles of Beneficiation in Lunar Work

Natural feedstocks used for any process are intrinsically variable. They may also contain deleterious components or low concentrations of desired fractions. For these three reasons it is standard industrial practice to beneficiate feedstocks. This is true across all industries which trans-form raw materials into standardized units. On the Moon there are three natural resources: vacuum, radiation and regolith. To utilize in situ resources on the Moon it is reasonable to presume some beneficiation of the regolith (ground rock) resource will be desirable if not essential. As on Earth, this will require fundamental understanding of the physics and chemistry of the relevant processes, which are exceeding complex in detail. Further, simulants are essential test articles for evaluation of components and systems planned for lunar deployment. Simulants are of course made from geologic feedstocks. Therefore, there is variation, deleterious components and incorrect concentrations of desired fractions in the feedstocks used for simulants. Thus, simulant production can benefit from beneficiation of the input feedstocks. Beneficiation of geologic feedstocks is the subject of extractive metallurgy. Clearly, NASA has two discrete interests pertaining to the science and technology of extractive metallurgy.

Rickman, Doug L.↗