Search NASA⌕ Search

SEARCH · Search NASA

Results for “test effectiveness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Control structural interaction testbed: A model for multiple flexible body verification

Conventional end-to-end ground tests for verification of control system performance become increasingly complicated with the development of large, multiple flexible body spacecraft structures. The expense of accurately reproducing the on-orbit dynamic environment and the attendant difficulties in reducing and accounting for ground test effects limits the value of these tests. TRW has developed a building block approach whereby a combination of analysis, simulation, and test has replaced end-to-end performance verification by ground test. Tests are performed at the component, subsystem, and system level on engineering testbeds. These tests are aimed at authenticating models to be used in end-to-end performance verification simulations: component and subassembly engineering tests and analyses establish models and critical parameters, unit level engineering and acceptance tests refine models, and subsystem level tests confirm the models' overall behavior. The Precision Control of Agile Spacecraft (PCAS) project has developed a control structural interaction testbed with a multibody flexible structure to investigate new methods of precision control. This testbed is a model for TRW's approach to verifying control system performance. This approach has several advantages: (1) no allocation for test measurement errors is required, increasing flight hardware design allocations; (2) the approach permits greater latitude in investigating off-nominal conditions and parametric sensitivities; and (3) the simulation approach is cost effective, because the investment is in understanding the root behavior of the flight hardware and not in the ground test equipment and environment.

Chory, M. A.↗
NASA NTRS1987

Comparing the effectiveness of software testing strategies

This study compares the results of code reading, functional testing, and structural testing in three aspects of software testing: fault detection effectiveness, fault detection cost, and classes of faults detected. Thirty two professional programmers and 42 advanced students applied the three techniques to four unit-sized programs in a fractional experimental design. The major results of this study are the following: (1) With the professional programmers, code reading detected more software faults and had a higher detection rate than did functional or structural testing, while functional testing detected more faults than did structural testing, but functional and structural testing were not different in fault detection rate. (2) In one advanced student subject group, code reading and functional testing were not different in faults found, but were superior to structural testing, while in the other advanced student subject group there was no difference among the techniques. (3) With the advanced student subjects, the three techniques were not different in fault deteciton rate. (4) Number of faults observed, fault detection rate, and total effort in detection depended on the type of software tested. (5) Code reading detected more interface faults than did the other methods. (6) Functional testing detected more control faults than did the other methods. (7) When asked to estimate the percentage of faults detected, code readers gave the most accurate estimates while functional testers gave the least accurate estimates. Appendix B includes the source code for the word.

Basili, Victor R.↗
DOE OSTI2024

UNCERTAINTIES FOR IN-REACTOR TESTING OF TRITIUM LOADED GETTERS WITH TEMPERATURE CONTROL

The fourth experiment in TPBAR Materials Irradiation Separate-Effects Test (TMIST) series (TMIST-4) is planned to experimentally determine the effect of neutron irradiation on the equilibrium vapor pressure of tritium over a tritium loaded Nickel-Plated Zirconium (NPZ) getter in a simulated TPBAR service environment. This pressure will be used to estimate the tritium permeation rate. In the thermal design in the TMIST-4, two evaluations are required. 1) The cladding temperature is calculated to estimate the feasibility of detecting potential irradiation enhancement of the partial pressure for an NPZ getter. This work is required to obtain a precise cladding temperature for measurement of a low tritium partial pressure. This work has been completed and indicated that the required/target cladding temperatures based on the TMIST-4 test plan can be satisfied under the test condition range by modifying the capsule component shapes and inserting a thermally conductive metal sleeve. 2) The evaluation of uncertainties associated with the test design and operation is performed. This includes fabrication tolerances, and power and nuclear operating conditions. These factors will impact the component temperatures inside capsules and resulting the tritium partial pressure. The tritium permeation rate is a function of temperature and tritium partial pressure. The prediction of tritium permeation rates affects the feasibility of obtaining measurement resolutions required to reach reasonable conclusion for potential irradiation enhanced performance. This work will investigate the uncertainties.

TTP, TPBAR, TMIST-4, TPBAR Materials Irradiation S↗
NASA NTRS1990

Dynamic ground-effect measurements on the F-15 STOL and Maneuver Technology Demonstrator (S/MTD) configuration

A moving-model ground-effect testing method was used to study the influence of rate-of-descent on the aerodynamic characteristics for the F-15 STOL and Maneuver Technology Demonstrator (S/MTD) configuration for both the approach and roll-out phases of landing. The approach phase was modeled for three rates of descent, and the results were compared to the predictions from the F-15 S/MTD simulation data base (prediction based on data obtained in a wind tunnel with zero rate of descent). This comparison showed significant differences due both to the rate of descent in the moving-model test and to the presence of the ground boundary layer in the wind tunnel test. Relative to the simulation data base predictions, the moving-model test showed substantially less lift increase in ground effect, less nose-down pitching moment, and less increase in drag. These differences became more prominent at the larger thrust vector angles. Over the small range of rates of descent tested using the moving-model technique, the effect of rate of descent on longitudinal aerodynamics was relatively constant. The results of this investigation indicate no safety-of-flight problems with the lower jets vectored up to 80 deg on approach. The results also indicate that this configuration could employ a nozzle concept using lower reverser vector angles up to 110 deg on approach if a no-flare approach procedure were adopted and if inlet reingestion does not pose a problem.

Kemmerly, Guy T.↗
NASA NTRS1996

Comparison of Hover/Ground-Effect Characteristics for a Joint Strike Fighter Configuration

Hover and ground-effect tests were conducted with the Lockheed-Martin Large Scale Powered Model (LSPM) during June-November 1995 at the NASA Ames Research Center's Outdoor Aerodynamics Research Facility (OARF). This was done in support of the Joint Strike Fighter (JSF) Program being lead by the Department of Defense. The program was previously metered to as the Joint Advanced Strike Technology (JAST) Program. The tests at the OARF included: engine thrust calibrations out of ground effect, measurements of individual nozzle jet pressure decay characteristics, and jet-induced hover force and moment measurements in and out of ground effect. The engine calibrations provide data correlating propulsion system throttle and nozzle settings to thrust forces and moments for the bare fuselage with the wings, canards, and tails removed. This provides propulsive forces and moments while minimizing any of the effects due to the presence of the airframe. The engine calibrations were used later to determine thrust for hover testing at the OARF and for transition testing which took place in the NASA Ames 80 by 120 foot Wind Tunnel. The jet decay characteristics reflect the jet entrainment properties and are related to the aircraft suckdown characteristics. The JSF program provided the opportunity to obtain model scale effects using two models; one at small scale and one at large scale. Examples of data from these tests will be presented out of ground effect which will demonstrate the effect of scale. For one JSF configuration, two small-scale models and one large-scale model were tested and obtained different values for the lift loss out of ground effect. These differences were examined and are found to be largely dependent on the jet efflux characteristics. The jet-induced hover forces and moments are presented in and out of ground effect. For the hover testing the model is methodically built up from the bare fuselage, to include the wings, canards, and vertical tails, to determine the effects of each. Other components such as weapons bay doors, landing gear doors, and other lift improvement devices and their effect on the jet-induced forces and moments are examined.

Hange, Craig↗
DOE OSTI2025

Mechanistic Multiscale Uncertainty Propagation in Support of Accelerated Fuel Qualification

Taking a nuclear fuel concept through the research, development, and qualification stages has historically taken on the order of 20 to 25 years because of extensive irradiation tests required for a variety of conditions. The concept of accelerated fuel qualification (AFQ) has been proposed to increase the innovation pace for nuclear fuels. The goal of AFQ is not to replace the traditional qualification approach but rather to reduce the total number of experiments required to ensure approval from the regulatory authority. Of the many AFQ approaches being explored, advanced modeling—and, in particular, mechanistic modeling—is in a uniquely cross-cutting position to reduce the number of required integral tests through the inclusion of separate-effects testing, while helping to extrapolate reactor performance during rare events. We make the case that propagation of uncertainty through various computational length scales helps contextualize mechanistic modeling. We will utilize UO 2 fission gas diffusion predictions from the atomistically informed cluster dynamics code Centipede to inform fuel performance rodlet simulations using the BISON finite element code as the metric for showing how multiscale mechanistic uncertainty quantification can help reduce uncertainty in fuel performance. In conclusion, by quantifying uncertainty and its reduction through multiscale modeling, the qualification process may be accelerated through the reduction of costly irradiation experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Direct sensitivity analysis on the parameterization of crystal plasticity models

Various methods for calibrating crystal plasticity finite element (CPFE) models lead to non-unique input parameter values, which subsequently introduce uncertainty in the predicted mechanical response. Sensitivity analysis (SA) conducted on crystal plasticity models is used to identify how variability in these parameters contribute to output uncertainty. Traditional SA on CPFE parameters uses simplified surrogate models to save computational time. However, the accuracy of the surrogate models depends on the quantity of training data used, and any modeling error can propagate into the SA results, potentially affecting their reliability. In this work, the elementary effects test (EET) method, a global SA technique using direct CPFE simulations was employed, and the results obtained were compared with the First Order Second Moment (FOSM) method. ExaConstit, an open-source GPU-enabled CPFE code, was used to perform the simulations and direct SA. The EET method was accurately able to capture the non-linear effects of all the input parameters on the output and is a valuable approach for reliably attributing parameter sensitivities in CPFE models. Based on the results, efficient strategies to perform future parameter calibration and SA are discussed. Additionally, the SA trends observed in different single crystal orientations closely mirrored the activity of the slip systems.

Elementary Effects Test↗
NASA NTRS2010

Coverage Metrics for Requirements-Based Testing: Evaluation of Effectiveness

In black-box testing, the tester creates a set of tests to exercise a system under test without regard to the internal structure of the system. Generally, no objective metric is used to measure the adequacy of black-box tests. In recent work, we have proposed three requirements coverage metrics, allowing testers to objectively measure the adequacy of a black-box test suite with respect to a set of requirements formalized as Linear Temporal Logic (LTL) properties. In this report, we evaluate the effectiveness of these coverage metrics with respect to fault finding. Specifically, we conduct an empirical study to investigate two questions: (1) do test suites satisfying a requirements coverage metric provide better fault finding than randomly generated test suites of approximately the same size?, and (2) do test suites satisfying a more rigorous requirements coverage metric provide better fault finding than test suites satisfying a less rigorous requirements coverage metric? Our results indicate (1) only one coverage metric proposed -- Unique First Cause (UFC) coverage -- is sufficiently rigorous to ensure test suites satisfying the metric outperform randomly generated test suites of similar size and (2) that test suites satisfying more rigorous coverage metrics provide better fault finding than test suites satisfying less rigorous coverage metrics.

Staats, Matt↗
NASA NTRS2007

Space Flight Requirements for Fiber Optic Components; Qualification Testing and Lessons Learned

"Qualification" of fiber optic components holds a very different meaning than it did ten years ago. In the past, qualification meant extensive prolonged testing and screening that led to a programmatic method of reliability assurance. For space flight programs today, the combination of using higher performance commercial technology, with shorter development schedules and tighter mission budgets makes long term testing and reliability characterization unfeasible. In many cases space flight missions will be using technology within years of its development and an example of this is fiber laser technology. Although the technology itself is not a new product the components that comprise a fiber laser system change frequently as processes and packaging changes occur. Once a process or the materials for manufacturing a component change, even the data that existed on its predecessor can no longer provide assurance on the newer version. In order to assure reliability during a space flight mission, the component engineer must understand the requirements of the space flight environment as well as the physics of failure of the components themselves. This can be incorporated into an efficient and effective testing plan that "qualifies" a component to specific criteria defined by the program given the mission requirements and the component limitations. This requires interaction at the very initial stages of design between the system design engineer, mechanical engineer, subsystem engineer and the component hardware engineer. Although this is the desired interaction what typically occurs is that the subsystem engineer asks the components or development engineers to meet difficult requirements without knowledge of the current industry situation or the lack of qualification data. This is then passed on to the vendor who can provide little help with such a harsh set of requirements due to high cost of testing for space flight environments. This presentation is designed to guide the engineers of design, development and components, and vendors of commercial components with how to make an efficient and effective qualification test plan with some basic generic information about many space flight requirements. Issues related to the ~ physics of failure, acceptance criteria and lessons learned will also be discussed to assist with understanding how to approach a space flight mission in an ever changing commercial photonics industry.

Ott, Melanie N.↗
NASA NTRS1975

Testing of lift/cruise fan exhaust deflector

A lift/cruise exhaust deflector system for the LF336/A tip turbine lift fan was designed, built, and tested to determine the design and performance characteristics of a large-scale, single swivel nozzle thrust vectoring system. The exhaust deflector static testing was performed at the Ames Research Center outside static test stand facilities. The test hardware was installed on a hydraulic lift platform to permit both in and out of ground effect testing. The exhaust flow of the LF336/A lift fan was vectored from 0 degrees through 130 degrees during selected fan speeds to obtain performance at different operating conditions. The system was operated with and without flow vanes installed in the small radius bends to evaluate the system performance based on a proposed method of improving the internal flow losses. The program also included testing at different ground heights, to the nozzle exhaust plane, to obtain ground effect data, and the testing of two methods of thrust spoiling using a duct bypass door system and nozzle flap system.

Schlundt, D. W.↗
NASA NTRS2011

Characterizing the Joint Effect of Diverse Test-Statistic Correlation Structures and Effect Size on False Discovery Rates in a Multiple-Comparison Study of Many Outcome Measures

In their 2009 Annals of Statistics paper, Gavrilov, Benjamini, and Sarkar report the results of a simulation assessing the robustness of their adaptive step-down procedure (GBS) for controlling the false discovery rate (FDR) when normally distributed test statistics are serially correlated. In this study we extend the investigation to the case of multiple comparisons involving correlated non-central t-statistics, in particular when several treatments or time periods are being compared to a control in a repeated-measures design with many dependent outcome measures. In addition, we consider several dependence structures other than serial correlation and illustrate how the FDR depends on the interaction between effect size and the type of correlation structure as indexed by Foerstner s distance metric from an identity. The relationship between the correlation matrix R of the original dependent variables and R~, the correlation matrix of associated t-statistics is also studied. In general R~ depends not only on R, but also on sample size and the signed effect sizes for the multiple comparisons.

Feiveson, Alan H.↗
NASA NTRS2013

Jet Engine Bird Ingestion Simulations: Comparison of Rotating to Non-Rotating Fan Blades

Bird strike events in commercial airliners are a fairly common occurrence. According to data collected by the US Department of Agriculture, over 80,000 bird strikes were reported in the period 1990 to 2007 in the US alone (Ref. 1). As a result, bird ingestion is an important factor in aero engine design and FAA certification. When it comes to bird impacts on engine fan blades, the FAA requires full-scale bird ingestion tests on an engine running at full speed to pass certification requirements. These rotating tests are complex and very expensive. To reduce development costs associated with new materials for fan blades, it is desirable to develop more cost effective testing procedures than full-scale rotating engine tests for material evaluation. An impact test on a nonrotating single blade that captures most of the salient physics of the rotating test would go a long way towards enabling large numbers of evaluative material screening tests. NASA Glenn Research Center has been working to identify a static blade test procedure that would be effective at reproducing similar results as seen in rotating tests. The current effort compares analytical simulations of a bird strike on various non-rotating blades to a bird strike simulation on a rotating blade as a baseline case. Several different concepts for simulating the rotating loads on a non-rotating blade were analyzed with little success in duplicating the deformation results seen in the rotating case. The rotating blade behaves as if it were stiffer than the non-rotating blade resulting in less plastic deformation from a given bird impact. The key factor limiting the success of the non-rotating blade simulations is thought to be the effect of gyroscopics. Prior to this effort, it was anticipated the difficulty would be in matching the prestress in the blade due to centrifugal forces Additional work is needed to verify this assertion, and to determine if a static test procedure can simulate the gyroscopic effects in a suitable manner. This paper describes the various non-rotating concepts analyzed, and demonstrates the effect believed to be gyroscopic in nature on the results

Howard, Samuel A.↗
NASA NTRS2013

Jet Engine Bird Ingestion Simulations: Comparison of Rotating to Non-Rotating Fan Blades

Bird strike events in commercial airliners are a fairly common occurrence. According to data collected by the US Department of Agriculture, over 80,000 bird strikes were reported in the period 1990-2007 in the US alone [1]. As a result, bird ingestion is an important factor in aero engine design and FAA certification. When it comes to bird impacts on engine fan blades, the FAA requires full-scale bird ingestion tests on an engine running at full speed to pass certification requirements. These rotating tests are complex and very expensive. To reduce development costs associated with new materials for fan blades, it is desirable to develop more cost effective testing procedures than full-scale rotating engine tests for material evaluation. An impact test on a non-rotating single blade that captures most of the salient physics of the rotating test would go a long way towards enabling large numbers of evaluative material screening tests. NASA Glenn Research Center has been working to identify a static blade test procedure that would be effective at reproducing similar results as seen in rotating tests. The current effort compares analytical simulations of a bird strike on various nonrotating blades to a bird strike simulation on a rotating blade as a baseline case. Several different concepts for simulating the rotating loads on a non-rotating blade were analyzed with little success in duplicating the deformation results seen in the rotating case. The rotating blade behaves as if it were stiffer than the non-rotating blade resulting in less plastic deformation from a given bird impact. The key factor limiting the success of the non-rotating blade simulations is thought to be the effect of gyroscopics. Prior to this effort, it was anticipated the difficulty would be in matching the pre-stress in the blade due to centrifugal forces Additional work is needed to verify this assertion, and to determine if a static test procedure can simulate the gyroscopic effects in a suitable manner. This paper describes the various non-rotating concepts analyzed, and demonstrates the effect believed to be gyroscopic in nature on the results.

Howard, Samuel A.↗
NASA NTRS2018

A First Look at 22 nm FDSOI SRAM Single-Event Test Results

We will present the first ever single-event effects testing results on a 22 nm fully-depleted silicon-on-insulator test chip. The 128 MB SRAMs were irradiated with heavy ions and the results are compared to previous technology generations.

Silicon-on-insulator↗
DOE OSTI2024

EV SALaD 2023 Demonstration: Best Practices and Mitigations for Protecting EVSE Infrastructure

The Electric Vehicle Secure Architecture Laboratory Demonstration (EV SALaD) program is a demonstration of cybersecurity best practices for high-power electric vehicle (EV) charging infrastructure led by Idaho National Laboratory (INL), in collaboration with other DOE National Laboratories participating in the EVs at Scale Consortium.a Sandia National Laboratories (SNL) and Pacific Northwest National Laboratory (PNNL) participated in the first 2-year (FY22-23) demonstration cycle for EV SALaD. This report documents the FY23 demonstration, the second in a series of demonstrations and collaborations in deploying and operating cybersecure EV charging infrastructure. It includes a summary of improvements from the FY22 demonstration, technical analysis of the FY23 demonstration, how the research demonstrates cyber-physical and cybersecurity best practices for high-power EV charging infrastructure, and related impacts to national and energy security. For EV SALaD, the FY22 demonstration focused on the detection, ranking, and prioritization of anomalous events for high-power EV charging. The FY23 demonstration additionally included the demonstration of cybersecurity best practices, which included protection and mitigation solutions to prevent, respond, and recover from anomalous events. During the demonstrations, the multi-lab EV SALaD team conducted a Test Effect Payload (TEP)b evaluation on extreme fast charger (XFC) hardware equipped with Cerberus, a detection and response solution, to demonstrate anomaly detection and mitigation cybersecurity best practices against cyber-enabled events.

33 ADVANCED PROPULSION SYSTEMS↗
NASA NTRS1979

Powered low-aspect-ratio Wing In Ground effect (WIG) aerodynamic characteristics

A wing-in-ground effect configuration was investigated. The configuration used large diameter, low pressure ratio fans mounted about 0.76 wing chord ahead of the wing leading edge to achieve a power augmented ram wing during operation in ground effect. Tests of both in and out of ground effect aerodynamic transition characteristics from very low speeds to cruise speeds are described. The investigation provided a number of conclusions concerning the aerodynamic/propulsive performance interaction. While power augmented lift is required for low speed flight, there is a thrust loss when the efflux is trapped under the wing which reduced the effective thrust to weight available for acceleration by about a third of the installed thrust to weight ratio.

Thomas, J. L.↗