Search NASASearch

SEARCH · Search NASA

Results for “Automated Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Interactive specification acquisition via scenarios: A proposal

Some reactive systems are most naturally specified by giving large collections of behavior scenarios. These collections not only specify the behavior of the system, but also provide good test suites for validating the implemented system. Due to the complexity of the systems and the number of scenarios, however, it appears that automated assistance is necessary to make this software development process workable. Interactive Specification Acquisition Tool (ISAT) is a proposed interactive system for supporting the acquisition and maintenance of a formal system specification from scenarios, as well as automatic synthesis of control code and automated test generation. This paper discusses the background, motivation, proposed functions, and implementation status of ISAT.

Hall, Robert J.

Computer automation of ultrasonic testing

Report describes a prototype computer-automated ultrasonic system developed for the inspection of weldments. This system can be operated in three modes: manual, automatic, and computer-controlled. In the computer-controlled mode, the system will automatically acquire, process, analyze, store, and display ultrasonic inspection data in real-time. Flaw size (in cross-section), location (depth), and type (porosity-like or crack-like) can be automatically discerned and displayed. The results and pertinent parameters are recorded.

Yee, B. G. W.

Fault injection based automatic testing - Practice and examples

This report addresses the problem of ascertaining the quantitative properties of dependable distributed systems. The approach is based on fault injection experimentation with two distinct real-time workloads using a fault-injection-based automated testing environment. Experimental results are presented which indicate dependability properties (e.g., error detection coverage, error latency) based on a limited number of fault injections.

Segall, Z.

Persistent Elevated Soot Emissions Induced by Clustered Stochastic Preignition Events

Stochastic Preignition (SPI) is an abnormal combustion phenomenon that can occur in spark-ignition engines particularly under high-load operation. SPI is characterized by uncontrolled initiation of combustion prior to spark discharge, an abnormal combustion process that can lead to severe knock events and significant engine damage. SPI has been associated with fuel properties, lubricant composition, and engine design and operation. Here, in this work, a single-cylinder test engine with a dry-sump oil system was utilized to study the SPI response of E10 and E25 fuels with a range of Reid Vapor Pressure (RVP). An automated test procedure was employed, consisting of ten square-waved load profile segments, with each segment composed of 5 min of low-load operation followed by 25 min of sustained high-load operation. These tests were replicated across multiple days of testing including a lubricant triple flush between tests, and an online Fuel in Oil diagnostic measurement. Exhaust particulate emissions were continuously measured by an AVL microsoot sensor (MSS). Elevated particulate matter emissions were observed to occur concurrently with SPI events as blooms of soot. Particularly after clustered events (i.e., multiple SPI cycles occurring within 10 consecutive engine cycles), high soot emissions were observed to persist over several days of sequential operation despite daily lubricant changes, a complete warm-up procedure, and sustained low-load operation between test segments. This result implies that the particulate emissions trends may be dominated by deposit-based effects, where higher load operation is needed to alter deposition and formation processes. The observed soot blooms were also found to correspond to a reduction in the engine fueling and the fuel engine oil dilution rate despite the engine exhaust remaining at stoichiometric exhaust operation. These observations suggest that post-SPI events, pathways for lubricant migration and consumption into the combustion chamber may occur until these pathways are closed from deposit formation or ring dynamics during extended operation. These observed sooting propensity persisted with all fuels tests, but a linear correlation was observed between the summation of soot and particulate matter index (PMI) value for each fuel as well as SPI events, proving that PMI is a crucial fuel property for reducing SPI.

Splitter, Derek [Oak Ridge National Laboratory (OR

Recent Productivity Improvements to the National Transonic Facility

Productivity gains have recently been made at the National Transonic Facility wind tunnel at NASA Langley Research Center. A team was assigned to assess and set productivity goals to achieve the desired operating cost and output of the facility. Simulations have been developed to show the sensitivity of selected process productivity improvements in critical areas to reduce overall test cycle times. The improvements consist of an expanded liquid nitrogen storage system, a new fan drive, a new tunnel vent stack heater, replacement of programmable logic controllers, an increased data communications speed, automated test sequencing, and a faster model changeout system. Where possible, quantifiable results of these improvements are presented. Results show that in most cases, improvements meet the productivity gains predicted by the simulations.

Popernack, Thomas G., Jr.

Helping System Engineers Bridge the Peaks

In our experience at NASA, system engineers generally follow the Twin Peaks approach when developing safety-critical systems. However, iterations between the peaks require considerable manual, and in some cases duplicate, effort. A significant part of the manual effort stems from the fact that requirements are written in English natural language rather than a formal notation. In this work, we propose an approach that enables system engineers to leverage formal requirements and automated test generation to streamline iterations, effectively "bridging the peaks". The key to the approach is a formal language notation that a) system engineers are comfortable with, b) is supported by a family of automated V&V tools, and c) is semantically rich enough to describe the requirements of interest. We believe the combination of formalizing requirements and providing tool support to automate the iterations will lead to a more efficient Twin Peaks implementation at NASA.

Requirements

Test Driven Development of Scientific Models

Test-Driven Development (TDD) is a software development process that promises many advantages for developer productivity and has become widely accepted among professional software engineers. As the name suggests, TDD practitioners alternate between writing short automated tests and producing code that passes those tests. Although this overly simplified description will undoubtedly sound prohibitively burdensome to many uninitiated developers, the advent of powerful unit-testing frameworks greatly reduces the effort required to produce and routinely execute suites of tests. By testimony, many developers find TDD to be addicting after only a few days of exposure, and find it unthinkable to return to previous practices. Of course, scientific/technical software differs from other software categories in a number of important respects, but I nonetheless believe that TDD is quite applicable to the development of such software and has the potential to significantly improve programmer productivity and code quality within the scientific community. After a detailed introduction to TDD, I will present the experience within the Software Systems Support Office (SSSO) in applying the technique to various scientific applications. This discussion will emphasize the various direct and indirect benefits as well as some of the difficulties and limitations of the methodology. I will conclude with a brief description of pFUnit, a unit testing framework I co-developed to support test-driven development of parallel Fortran applications.

Clune, Thomas L.

Requirements-Driven Log Analysis Extended Abstract

Imagine that you are tasked to help a project improve their testing effort. In a realistic scenario it will quickly become clear, that having an impact is diffcult. First of all, it will likely be a challenge to suggest an alternative approach which is significantly more automated and/or more effective than current practice. The reality is that an average software system has a complex input/output behavior. An automated testing approach will have to auto-generate test cases, each being a pair (i; o) consisting of a test input i and an oracle o. The test input i has to be somewhat meaningful, and the oracle o can be very complicated to compute. Second, even in case where some testing technology has been developed that might improve current practice, it is then likely difficult to completely change the current behavior of the testing team unless the technique is obviously superior and does everything already done by existing technology. So is there an easier way to incorporate formal methods-based approaches than the full edged test revolution? Fortunately the answer is affirmative. A relatively simple approach is to benefit from possibly already existing logging infrastructure, which after all is part of most systems put in production. A log is a sequence of events, generated by special log recording statements, most often manually inserted in the code by the programmers. An event can be considered as a data record: a mapping from field names to values. We can analyze such a log using formal methods, for example checking it against a formal specification. This separates running the system for analyzing its behavior. It is not meant as an alternative to testing since it does not address the important in- put generation problem. However, it offers a solution which testing teams might accept since it has low impact on the existing process. A single person might be assigned to perform such log analysis, compared to the entire testing team changing behavior.

log analysis

Test Driven Development of Scientific Models

Test-Driven Development (TDD), a software development process that promises many advantages for developer productivity and software reliability, has become widely accepted among professional software engineers. As the name suggests, TDD practitioners alternate between writing short automated tests and producing code that passes those tests. Although this overly simplified description will undoubtedly sound prohibitively burdensome to many uninitiated developers, the advent of powerful unit-testing frameworks greatly reduces the effort required to produce and routinely execute suites of tests. By testimony, many developers find TDD to be addicting after only a few days of exposure, and find it unthinkable to return to previous practices.After a brief overview of the TDD process and my experience in applying the methodology for development activities at Goddard, I will delve more deeply into some of the challenges that are posed by numerical and scientific software as well as tools and implementation approaches that should address those challenges.

Overview of TDD Process

Development of automated electromagnetic compatibility test facilities at Marshall Space Flight Center

The efforts to automate the electromagentic compatibility (EMC) test facilites at Marshall Flight Center were examined. A battery of nine standard tests is to be integrated by means of a desktop computer-controller in order to provide near real-time data assessment, store the data acquired during testing on flexible disk, and provide computer production of the certification report.

Harrison, Cecil A.

Oculomotor Assessment of Diurnal Arousal Variations

Saccadic and pupillary responses are reliable indices of arousal decrement (e.g. fatigue), that might be exploited to improve work schedule guidelines. In this study, we tested the sensitivity of a short 30-s oculomotor test to detect diurnal arousal variations. Twelve participants (5 females, 7 males, 37.7+-11.9 years) volunteered to be assessed every hour (66+-20 min) for three consecutive working days, during their regular office-hours. We used a fully automated testing system, the FIT 2000 Fitness Impairment Tester (Pulse Medical Instruments Inc., Rockville, MD, USA), to measure and record saccadic peak velocity, pupil diameter, and latency and amplitude of the pupillary light reflex. In addition, we collected subjective levels of arousal using the Stanford Sleepiness Scale, and body core temperature. We analyzed the data using a linear mixed model approach for longitudinal data. Both saccadic velocity and subjective alertness decreased over the course of a day, while body core temperature increased (all p-values.05). The data also weakly suggested an increase of the pupil diameter (p 07). The findings support the use of oculomotor indices in the assessment of arousal and fatigue in applied settings.

saccadic velocity

Results of accelerated thermal cycle tests of solar cells modules

Various candidate solar panel designs were evaluated, both theoretically and experimentally, with respect to their thermal cycling survival capability, and in particular with respect to an accelerated simulation of thermal cycles representative of Viking '75 mission requirements. The experimental results were obtained on 'mini-panels' thermally cycled in a newly installed automated test facility herein described. The resulting damage was analyzed physically and theoretically, and on the basis of these analyses the panel design was suitably modified to significantly improve its ability to withstand the thermal environment. These successful modifications demonstrate the value of the complementary theoretical-experimental approach adopted, and discussed in detail in this paper.

Berman, P.

Sample Processor for Life on Icy Worlds (SPLIce): Design and Test Results

We report the design, development, and testing of the Sample Processor for Life on Icy Worlds (SPLIce) system, a microfluidic sample processor to enable autonomous detection of signatures of life and measurements of habitability parameters in Ocean Worlds. This monolithic fluid processing-and-handling system (Figure 1; mass 0.5 kg) retrieves a 50-L-volume sample and prepares it to supply a suite of detection instruments, each with unique preparation needs. SPLIce has potential applications in orbiter missions that sample ocean plumes, such as found in Saturns icy moon Enceladus, or landed missions on the surface of icy satellites, such as Jupiters moon Europa. Answering the question Are we alone in the universe? is captivating and exceptionally challenging. Even general criteria that define life very broadly include a significant role for water [1,2]. Searches for extinct or extant life therefore prioritize locations of abundant water whether in ancient (Mars), or present (Europa and Enceladus) times. Only two previous planetary missions had onboard fluid processing: the Viking Biology Experiments [3] and Phoenixs Wet Chemistry Laboratory (WCL) [4]. SPLIce differs crucially from those systems, including its capability to process and distribute L-volume samples and the integration autonomous control of a wide range of fluidic functions, including: 1) retrieval of fluid samples from an evacuated sample chamber; 2) onboard multi-year storage of dehydrated reagents; 3) integrated pressure, pH, and conductivity measurement; 4) filtration and retention of insoluble particles for microscopy; 5) dilution or vacuum-driven concentration of samples to accommodate instrument working ranges; 6) removal of gas bubbles from sample aliquots; 7) unidirectional flow (check valves); 8) active flow-path selection (solenoid-actuated valves); 9) metered pumping in 100 nL volume increments. The SPLIce manifold, made of three thermally fused layers of precision-machined cyclo-olefin polymer, supports all fluidic components (Figure 1) and integrated microchannels (125 x 250 m). Fluid is pumped by a stepper-motor-driven pump (Lee Co.). The functionality of the integrated MEMS pressure sensor (Honeywell) and passive check valves (Figure 2) were tested in conjunction with our newly designed integral bubble traps (Figure 3) and hydrophobic membrane-based concentrator (Figure 4). The concentrator (initially tested as a standalone component) demonstrated 5-fold vacuum-evaporative concentration. Polyethylene fused bead beds (PEFBBs; 50 porosity) store drylyophilized buffers, calibrants, and fluorescent dyes, and also promote mixing of sample with calibrant, dye, or H2O. Software-controlled automated tests demonstrated successful 1) fluid delivery to each component 2) valve and pump synchronization 3) sample aliquot delivery to instrument interface ports, and 4) rehydration of vacuum-dried fluorescent dye. In Figure 5, fluorescein on PEFBBs was rehydrated for 15 min using a pump-delivered water aliquot; it is displaced as H2O enters the bottom of the channel and pushes the dye into a check valve. Ultimately, SPLIce will fluorescently label amino acids in the sample for microchip-based electrophoretic (MCE) chiral separation and detection to seek and quantify key organic bio-signatures [5]; it will also deliver sample to a microfluidic version of WCL (mWCL) to measure soluble ions and redox-active species.

Life detection

Field-Emission Properties of Vertically Aligned Carbon Nanotube Cathodes of Varying Geometries

This work characterizes the bulk emission properties of carbon nanotube (CNT) forest cathodes fabricated with various geometries. Geometries explored include dense nanotube forests of varying height grown on 5×5 mm silicon (Si) substrates and discrete, patterned CNT pillars fabricated using UV photolithography. Dense forests heights ranged from 526 μ m to 1.41 mm, with packing fraction for dense forest calculated to be 4e10 nanotubes/cm2 based on an average nanotube separation distance of 100 nm for fixed growth dense forests. Patterned sample micro pillar heights ranged from 47 to 393 μ m with pillar widths on tested samples ranging from 250 to 270 μ m . Properties explored include emission current, turn-on field, and emission current performance over time. A parallel plate electron beam diode with a 100- μ m A-K gap and an automated test apparatus were developed to provide a configurable experiment that provides accurate and repeatable measurements for dc, dc sweep, and timed performance testing. Operating voltages for the voltage sweeps spanned from 0 to −350 V. Furthermore, testing has shown evidence of a hysteresis effect on the emission current tied to the applied field history as well as shifting of the turn-on field magnitude throughout the testing period, suggesting a conditioning effect during use. Three separate emission regions in the I–V curves during sweep testing have also been observed. In the geometric study, dense forests and patterned samples were sweep tested up to a peak applied voltage of −250 V, with the taller samples generally performing better. Currents produced in the geometric study from the dense forest emitters ranged from 36.8 to 572.34 μ A , with current densities ranging from 15 to 2.29 mA/cm2. Currents produced from the patterned micropillar emitters ranged from 39.4 to 317.51 μ A , with current densities ranging from 67 to 3 mA/cm2. DC time testing s...

36 MATERIALS SCIENCE

Mars Science Laboratory Flight Software Internal Testing

The Mars Science Laboratory (MSL) team is sending the rover, Curiosity, to Mars, and therefore is physically and technically complex. During my stay, I have assisted the MSL Flight Software (FSW) team in implementing functional test scripts to ensure that the FSW performs to the best of its abilities. There are a large number of FSW requirements that have been written up for implementation; however I have only been assigned a few sections of these requirements. There are many stages within testing; one of the early stages is FSW Internal Testing (FIT). The FIT team can accomplish this with simulation software and the MSL Test Automation Kit (MTAK). MTAK has the ability to integrate with the Software Simulation Equipment (SSE) and the Mission Processing and Control System (MPCS) software which makes it a powerful tool within the MSL FSW development process. The MSL team must ensure that the rover accomplishes all stages of the mission successfully. Due to the natural complexity of this project there is a strong emphasis on testing, as failure is not an option. The entire mission could be jeopardized if something is overlooked.

entry, descent, and landing (EDL)

Automation of electromagnetic compatability (EMC) test facilities

Efforts to automate electromagnetic compatibility (EMC) test facilities at Marshall Space Flight Center are discussed. The present facility is used to accomplish a battery of nine standard tests (with limited variations) deigned to certify EMC of Shuttle payload equipment. Prior to this project, some EMC tests were partially automated, but others were performed manually. Software was developed to integrate all testing by means of a desk-top computer-controller. Near real-time data reduction and onboard graphics capabilities permit immediate assessment of test results. Provisions for disk storage of test data permit computer production of the test engineer's certification report. Software flexibility permits variation in the tests procedure, the ability to examine more closely those frequency bands which indicate compatibility problems, and the capability to incorporate additional test procedures.

Harrison, C. A.

First On-Wafer Power Characterization of MMIC Amplifiers at Sub-Millimeter Wave Frequencies

Recent developments in semiconductor technology have enabled advanced submillimeter wave (300 GHz) transistors and circuits. These new high speed components have required new test methods to be developed for characterizing performance, and to provide data for device modeling to improve designs. Current efforts in progressing high frequency testing have resulted in on-wafer-parameter measurements up to approximately 340 GHz and swept frequency vector network analyzer waveguide measurements to 508 GHz. On-wafer noise figure measurements in the 270-340 GHz band have been demonstrated. In this letter we report on on-wafer power measurements at 330 GHz of a three stage amplifier that resulted in a maximum measured output power of 1.78mW and maximum gain of 7.1 dB. The method utilized demonstrates the extension of traditional power measurement techniques to submillimeter wave frequencies, and is suitable for automated testing without packaging for production screening of submillimeter wave circuits.

monolithic microwave integrated circircuit