Search NASA⌕ Search

SEARCH · Search NASA

Results for “testing and evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Test and Evaluation of Systems with Embedded Machine Learning Components

As Machine Learning (ML) continues to advance, it is being integrated into more systems. Often, the ML component represents a significant portion of the system that reduces the burden on the end user or significantly improves task performance. However, the ML component represents an unknown complex phenomenon that is learned from collected data without the need to be explicitly programmed. Despite the improvement in task performance, the models are often black boxes. Evaluating the credibility and the vulnerabilities of ML models poses a gap in current test and evaluation practice. For high consequence applications, the lack of testing and evaluation procedures represents a significant source of uncertainty and risk. To help reduce that risk, here we present considerations to evaluate systems embedded with an ML component within a red-teaming inspired methodology. We focus on (1) cyber vulnerabilities to an ML model, (2) evaluating performance gaps, and (3) adversarial ML vulnerabilities.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2011

Timescale Correlation between Marine Atmospheric Exposure and Accelerated Corrosion Testing

Evaluation of metal-based structures has long relied on atmospheric exposure test sites to determine corrosion resistance in marine environments. Traditional accelerated corrosion testing relies on mimicking the exposure conditions, often incorporating salt spray and ultraviolet (UV) radiation, and exposing the metal to continuous or cyclic conditions of the corrosive environment. Their success for correlation to atmospheric exposure is often a concern when determining the timescale to which the accelerated tests can be related. Accelerated laboratory testing, which often focuses on the electrochemical reactions that occur during corrosion conditions, has yet to be universally accepted as a useful tool in predicting the long term service life of a metal despite its ability to rapidly induce corrosion. Although visual and mass loss methods of evaluating corrosion are the standard and their use is imperative, a method that correlates timescales from atmospheric exposure to accelerated testing would be very valuable. This work uses surface chemistry to interpret the chemical changes occurring on low carbon steel during atmospheric and accelerated corrosion conditions with the objective of finding a correlation between its accelerated and long-term corrosion performance. The current results of correlating data from marine atmospheric exposure conditions at the Kennedy Space Center beachside corrosion test site, alternating seawater spray, and immersion in typical electrochemical laboratory conditions, will be presented. Key words: atmospheric exposure, accelerated corrosion testing, alternating seawater spray, marine, correlation, seawater, carbon steel, long-term corrosion performance prediction, X-ray photoelectron spectroscopy.

Montgomery, Eliza L.↗
DOE OSTI2025

Ship Motion Testing Needs Evaluation

The American Bureau of Shipping performed an evaluation of national maritime nuclear testing capabilities and determined there currently is an inability to test maritime nuclear power plants in a ship motion environment. A Ship Motion Test Facility (SMTF) is proposed to fill this gap. To inform design of this facility, this report documents an evaluation performed by a panel of technical experts that identifies key physical phenomena associated with maritime nuclear power plant operation that are important to safety and reliability and have a low state of knowledge. This evaluation concluded that all of the major test needs to understand a nuclear plant's behavior in a ship motion environment are for thermal-hydraulics related phenomena. Based on this finding, the evaluation panel concluded that the SMTF would not be required to use nuclear fuel to provide a heat source for the fluids. This would significantly decrease the cost, timeline, and complexity for this test facility to enable the advancement of maritime nuclear technology.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1978

Strain gage system evaluation program

A program was conducted to determine the reliability of various strain gage systems when applied to rotating compressor blades in an aircraft gas turbine engine. A survey of current technology strain gage systems was conducted to provide a basis for selecting candidate systems for evaluation. Testing and evaluation was conducted in an F 100 engine. Sixty strain gage systems of seven different designs were installed on the first and third stages of an F 100 engine fan. Nineteen strain gage failures occurred during 62 hours of engine operation, for a survival rate of 68 percent. Of the failures, 16 occurred at blade-to-disk leadwire jumps (84 percent), two at a leadwire splice (11 percent), and one at a gage splice (5 percent). Effects of erosion, temperature, G-loading, and stress levels are discussed. Results of a post-test analysis of the individual components of each strain gage system are presented.

Dolleris, G. W.↗
NASA NTRS2007

Testing for Software Safety

This research focuses on testing whether or not the hazardous conditions identified by design-level fault tree analysis will occur in the target implementation. Part 1: Integrate fault tree models into functional specifications so as to identify testable interactions between intended behaviors and hazardous conditions. Part 2: Develop a test generator that produces not only functional tests but also safety tests for a target implementation in a cost-effective way. Part 3: Develop a testing environment for executing generated functional and safety tests and evaluating test results against expected behaviors or hazardous conditions. It includes a test harness as well as an environment simulation of external events and conditions.

Chen, Ken↗
NASA NTRS2011

The 2010 Desert Rats Science Operations Test: Outcomes and Lessons Learned

The Desert RATS 2010 Team tested a variety of science operations management techniques, applying experience gained during the manned Apollo missions and the robotic Mars missions. This test assessed integrated science operations management of human planetary exploration using real-time, tactical science operations to oversee daily crew science activities, and a night shift strategic science operations team to conduct strategic level assessment of science data and daily traverse results. In addition, an attempt was made to collect numerical metric data on the outcome of the science operations to assist test evaluation. The two most important outcomes were 1) the production of significant (almost overwhelming) volume of data produced during daily traverse operations with two rovers, advanced imaging systems and well trained, scientifically proficient crew-members, and 2) the degree to which the tactical team s interaction with the surface crew enhanced science return. This interaction depended on continuous real-time voice and data communications, and the quality of science return from any human planetary exploration mission will be based strongly on the aggregate interaction between a well trained surface crew and a dedicated science operations support team using voice and imaging data from a planet s surface. In addition, the scientific insight developed by both the science operations team and the crews could not be measurable by simple numerical quantities, and its value will be missed by a purely metric-based evaluation of test outcome. In particular, failure to recognize the critical importance of this qualitative type interaction may result in mission architecture choices that will reduce science return.

Eppler, D. B.↗
NASA NTRS1975

Wavefront error simulator for evaluating optical testing instrumentation

A wavefront error simulator has been designed and fabricated to evaluate experimentally test instrumentation for the Large Space Telescope (LST) program. The principal operating part of the simulator is an aberration generator that introduces low-order aberrations of several waves magnitude with an incremented adjustment capability of lambda/100. Each aberration type can be introduced independently with any desired spatial orientation.

Golden, L. J.↗
NASA NTRS1976

Preliminary results from screening tests of commercial catalysts with potential use in gas turbine combustors. Part 2: Combustion test rig evaluation

Several commercial monolithic catalysts were tested in a combustion test rig to determine their suitability for use in a gas turbine combuster primary zone. The catalyst test bed consisted of two to four elements of 12-centimeter diameter by 2.5-centimeter long monolith. Results are presented of the measured combustion efficiency and catalyst bed temperature history for an inlet propane-air mixture temperature of 800 K, a pressure of 300,000 newtons per square meter, inlet velocities of 10 to 25 meters per second and equivalence ratios of 0.1 to 0.3. The best catalysts tested gave combustion efficiencies of virtually 100 percent for reaction temperatures ranging from 1,325 K at 10 meters per second to 1,400 K at 25 meters per second. This performance was only possible with fresh catalysts. The catalysts tested were not specifically developed for use at these conditions and showed some loss in activity after about 3 hours' testing.

Anderson, D. N.↗
NASA NTRS1976

Preliminary results from screening tests of commercial catalysts with potential use in gas turbine combustors. II - Combustion test rig evaluation

Several commercial monolithic catalysts were tested in a combustion test rig to determine their suitability for use in a gas-turbine combustor primary zone. The catalyst test bed consisted of two to four elements of 12-centimeter diameter by 2.5-centimeter long monolith. Results are presented of the measured combustion efficiency and catalyst bed temperature history for an inlet propane-air mixture temperature of 800 K, a pressure of 300,000 newtons per square meter, inlet velocities of 10 to 25 meters per second and equivalence ratios of 0.1 to 0.3. The best catalysts tested gave combustion efficiencies of virtually 100% for reaction temperatures ranging from 1325 K at 10 meters per second to 1400 K at 25 meters per second. This performance was only possible with fresh catalysts. The catalysts tested were not specifically developed for use at these conditions and showed some loss in activity after about 3 hours' testing.

Anderson, D. N.↗
NASA NTRS1978

Space Shuttle Orbiter Approach and Landing Test: Final Evaluation Report

The Approach and Landing Test Program consisted of a series of steps leading to the demonstration of the capability of the Space Shuttle orbiter to safely approach and land under conditions similar to those planned for the final phases of an orbital flight. The tests were conducted with the orbiter mounted on top of a specially modified carrier aircraft. The first step provided airworthiness and performance verification of the carrier aircraft after modification. The second step consisted of three taxi tests and five flight tests with an inert unmanned orbiter. The third step consisted of three mated tests with an active manned orbiter. The fourth step consisted of five flights in which the orbiter was separated from the carrier aircraft. For the final two flights, the orbiter tail cone was replaced by dummy engines to simulate the actual orbital configuration. Landing gear braking and steering tests were accomplished during rollouts following the free flight landings. Ferry testing was integrated into the Approach and Landing Test Program to the extent possible. In addition, four ferry test flights were conducted with the orbiter mated to the carrier aircraft in the ferry configuration after the free-flight tests were completed.

Source record↗