Search NASASearch

SEARCH · Search NASA

Results for “random testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Random Test Run Length and Effectiveness

A poorly understood but important factor in many applications of random testing is the selection of a maximum length for test runs. Given a limited time for testing, it is seldom clear whether executing a small number of long runs or a large number of short runs maximizes utility. It is generally expected that longer runs are more likely to expose failures -- which is certainly true with respect to runs shorter than the shortest failing trace. However, longer runs produce longer failing traces, requiring more effort from humans in debugging or more resources for automated minimization. In testing with feedback, increasing ranges for parameters may also cause the probability of failure to decrease in longer runs. We show that the choice of test length dramatically impacts the effectiveness of random testing, and that the patterns observed in simple models and predicted by analysis are useful in understanding effects observed.

software testing

An experimental evaluation of the effectiveness of random testing of fault-tolerant software

Results of a fault-tolerant software (FTS) experiment are used to show deficiencies of the simple random testing approach. Testing was performed using randomly generated test cases supplemented with extremal and special value (ESV) cases. Error detection efficiency of the random testing approach, with emphasis on correlated errors, was compared to the error detecting capabilities of the ESV data and found deficient. The use of carefully designed test cases as a supplement to random testing, as well as the use of structure based testing are recommended.

Vouk, Mladen A.

Random Testing and Model Checking: Building a Common Framework for Nondeterministic Exploration

Two popular forms of dynamic analysis, random testing and explicit-state software model checking, are perhaps best viewed as search strategies for exploring the state spaces introduced by nondeterminism in program inputs. We present an approach that enables this nondeterminism to be expressed in the SPIN model checker's PROMELA language, and then lets users generate either model checkers or random testers from a single harness for a tested C program. Our approach makes it easy to compare model checking and random testing for models with precisely the same input ranges and probabilities and allows us to mix random testing with model checking's exhaustive exploration of non-determinism. The PROMELA language, as intended in its design, serves as a convenient notation for expressing nondeterminism and mixing random choices with nondeterministic choices. We present and discuss a comparison of random testing and model checking. The results derive from using our framework to test a C program with an effectively infinite state space, a module in JPL's next Mars rover mission. More generally, we show how the ability of the SPIN model checker to call C code can be used to extend SPIN's features, and hope to inspire others to use the same methods to implement dynamic analyses that can make use of efficient state storage, matching, and backtracking.

dynamic analysis

Off-line data analysis and data reduction from digitally controlled random test systems.

This paper discusses the merits of employing the new computer-controlled random environment control systems for fast and efficient large-scale data analysis when they are not being used for test control. Hardware and software requirements are stated. Several of the more familiar frequency functions are defined from the Fourier coefficients, the main product of the Fourier processors used in these control systems. Another function, the probability density function, is defined and suggestions for its application are made. An analysis example is presented. Some programming tips are listed, and the accuracy and reliability of frequency analysis measurements are considered.

Chapman, C. P.

Three-dimensional test requirement for random vibration testing

An approach to defining and evaluating three-dimensional vibration test requirements is discussed. The approach is used to develop the three-dimensional space random-vibration test requirements for missile components subjected to truck transportation environments. One-dimensional testing parameters such as power spectral density and overall g rms values for three mutually perpendicular directions represent the test requirements. The coherence characteristics between each input axis were established and adjusted empirically in an attempt to simulate the cross-correlation in three-dimensional random vibration excitation.

Chang, Kurng

Pareto-optimal target definition for multi-axis random vibration testing

In random vibration testing with multiple control channels, existing control laws require specification of a complete spectral density matrix at each control frequency. Spectral density matrices include autospectral densities on the diagonal and cross-spectral densities on the off-diagonal. In practice, the off-diagonal terms are often unknown, and recent vibration testing research has focused on fixing the diagonal and specifying the off-diagonal to minimize the required control energy, subject to a constraint that the target matrix is positive semidefinite. This paper shows that, even with a fixed diagonal, off-diagonal terms strongly affect control residuals. This overlooked effect occurs in both square and rectangular systems. By jointly considering input energy and control residuals, open-loop inputs are derived directly from the diagonal without specifying the off-diagonal terms. Vibration targets that can be used in closed-loop control are then derived using the optimal inputs, with positive semidefinite constraints applied during the derivation. The result is a set of Pareto-optimal control solutions. For each solution in the set, any other possible solution produces greater control error, greater input energy, or both. A balanced solution is selected automatically, though others can be chosen based on test needs. Simulations and experiments show that the proposed method outperforms state-of-the-art energy-minimizing approaches, achieving significant reductions in both control error and input energy.

Autospectral density

A Procedure for Accurately Measuring the Shaker Overturning Moment During Random Vibration Tests

Motivation: For large system level random vibration tests, there may be some concerns about the shaker's capability for the overturning moment. It is the test conductor's responsibility to predict and monitor the overturning moment during random vibration tests. If the predicted moment is close to the shaker's capability, test conductor must measure the instantaneous moment at low levels and extrapolate to higher levels. That data will be used to decide whether it is safe to proceed to the next test level. Challenge: Kistler analog formulation for computing the real-time moment is only applicable to very limited cases in which we have 3 or 4 load cells installed at shaker interface with hardware. Approach: To overcome that limitation, a simple procedure was developed for computing the overturning moment time histories using the measured time histories of the individual load cells.

predict overturning

Verification of force and acceleration specifications for random vibration tests of Cassini spacecraft equipment

The use of force limiting in the random vibration testing of the Cassini spacecraft's subsystems is reported on. A verification of the Cassini equipment random vibration test acceleration and force specifications is provided by interface acceleration and force data measured in acoustic tests of the Cassini spacecraft development test model (DTM). Acoustic tests were performed on the DTM structure with different structural and equipment configurations. The acceleration and force spectra at the interface between the equipment items and the spacecraft DTM structure were measured in the acoustic tests and compared with the equipment random vibration test specifications. The spacecraft's apparent masses were measured at the equipment mounting points and used in force limit predictions.

Chang, Kurng Y.

Random Vibration Testing of Advanced Wet Tantalum Capacitors

Advanced wet tantalum capacitors allow for improved performance of power supply systems along with substantial reduction of size and weight of the systems that is especially beneficial for space electronics. Due to launch-related stresses, acceptance testing of all space systems includes random vibration test (RVT). However, many types of advanced wet tantalum capacitors cannot pass consistently RVT at conditions specified in MIL-PRF-39006, which impedes their use in space projects. This requires a closer look at the existing requirements, modes and mechanisms of failures, specifics of test conditions, and acceptance criteria. In this work, different lots of advanced wet tantalum capacitors from four manufacturers have been tested at step stress random vibration conditions while their currents were monitored before, during, and after the testing. It has been shown that the robustness of the parts and their reliability are mostly due to effective self-healing processes and limited current spiking or minor scintillations caused by RVT do not increase the risk of failures during operation. A simple model for scintillations events has been used to simulate current spiking during RVT and optimize test conditions. The significance of scintillations and possible effects of gas generation have been discussed and test acceptance criteria for limited current spiking have been suggested.

cracking