Search NASA⌕ Search

SEARCH · Search NASA

Results for “test effectiveness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS1979

Vacuum Die Casting of Silicon Sheet for Photovoltaic Applications

The development of a vacuum die-casting process for producing silicon sheet suitable for photovoltaic cells with a terrestrial efficiency greater than 12 percent and having the potential to be scaled for large quantity production is considered. The initial approach includes: (1) obtaining mechanical design parameters by using boron nitride, which has been shown to non-wetting to silicon; (2) optimizing silicon nitride material composition and coatings by sessile drop experiments; (3) testing effectiveness of fluoride salt interfacial media with a graphite mold; and (4) testing the effect of surface finish using both boron nitride and graphite. When the material and mechanical boundary conditions are established, a finalized version of the prototype assembly will be constructed and the casting variables determined.

Source record↗
NASA NTRS1997

Antifuse FPGA for Space Applications

This paper presents viewgraphs of Antifuse FPGA (Field Programmable Gate Array) for Space Applications. The topics include: 1) A32140DX TID Test; 2) A1280XL Proton Test; 3) SEU (Single Event Upsets) Rate Calculation; 4) Recent Products Test; 5) A1460A TID (Traveling Ionospheric Disturbances) Test; 6) I100 Proton Test; 7) 100/RHI100 SEU Test; 8) I100/RH100 TID Test; 9) A1020S TID Test; 10) TID Charge Pump Failure; 11) Radiation Testing; and SEE (Single Event Effects) Test Setup.

Wang, Jih-Jong↗
NASA NTRS2016

Modeling in the State Flow Environment to Support Launch Vehicle Verification Testing for Mission and Fault Management Algorithms in the NASA Space Launch System

Analysis methods and testing processes are essential activities in the engineering development and verification of the National Aeronautics and Space Administration's (NASA) new Space Launch System (SLS). Central to mission success is reliable verification of the Mission and Fault Management (M&FM) algorithms for the SLS launch vehicle (LV) flight software. This is particularly difficult because M&FM algorithms integrate and operate LV subsystems, which consist of diverse forms of hardware and software themselves, with equally diverse integration from the engineering disciplines of LV subsystems. M&FM operation of SLS requires a changing mix of LV automation. During pre-launch the LV is primarily operated by the Kennedy Space Center (KSC) Ground Systems Development and Operations (GSDO) organization with some LV automation of time-critical functions, and much more autonomous LV operations during ascent that have crucial interactions with the Orion crew capsule, its astronauts, and with mission controllers at the Johnson Space Center. M&FM algorithms must perform all nominal mission commanding via the flight computer to control LV states from pre-launch through disposal and also address failure conditions by initiating autonomous or commanded aborts (crew capsule escape from the failing LV), redundancy management of failing subsystems and components, and safing actions to reduce or prevent threats to ground systems and crew. To address the criticality of the verification testing of these algorithms, the NASA M&FM team has utilized the State Flow environment6 (SFE) with its existing Vehicle Management End-to-End Testbed (VMET) platform which also hosts vendor-supplied physics-based LV subsystem models. The human-derived M&FM algorithms are designed and vetted in Integrated Development Teams composed of design and development disciplines such as Systems Engineering, Flight Software (FSW), Safety and Mission Assurance (S&MA) and major subsystems and vehicle elements such as Main Propulsion Systems (MPS), boosters, avionics, Guidance, Navigation, and Control (GN&C), Thrust Vector Control (TVC), liquid engines, and the astronaut crew office. Since the algorithms are realized using model-based engineering (MBE) methods from a hybrid of the Unified Modeling Language (UML) and Systems Modeling Language (SysML), SFE methods are a natural fit to provide an in depth analysis of the interactive behavior of these algorithms with the SLS LV subsystem models. For this, the M&FM algorithms and the SLS LV subsystem models are modeled using constructs provided by Matlab which also enables modeling of the accompanying interfaces providing greater flexibility for integrated testing and analysis, which helps forecast expected behavior in forward VMET integrated testing activities. In VMET, the M&FM algorithms are prototyped and implemented using the same C++ programming language and similar state machine architectural concepts used by the FSW group. Due to the interactive complexity of the algorithms, VMET testing thus far has verified all the individual M&FM subsystem algorithms with select subsystem vendor models but is steadily progressing to assessing the interactive behavior of these algorithms with LV subsystems, as represented by subsystem models. The novel SFE applications has proven to be useful for quick look analysis into early integrated system behavior and assessment of the M&FM algorithms with the modeled LV subsystems. This early MBE analysis generates vital insight into the integrated system behaviors, algorithm sensitivities, design issues, and has aided in the debugging of the M&FM algorithms well before full testing can begin in more expensive, higher fidelity but more arduous environments such as VMET, FSW testing, and the Systems Integration Lab7 (SIL). SFE has exhibited both expected and unexpected behaviors in nominal and off nominal test cases prior to full VMET testing. In many findings, these behavioral characteristics were used to correct the M&FM algorithms, enable better test coverage, and develop more effective test cases for each of the LV subsystems. This has improved the fidelity of testing and planning for the next generation of M&FM algorithms as the SLS program evolves from non-crewed to crewed flight, impacting subsystem configurations and the M&FM algorithms that control them. SFE analysis has improved robustness and reliability of the M&FM algorithms by revealing implementation errors and documentation inconsistencies. It is also improving planning efficiency for future VMET testing of the M&FM algorithms hosted in the LV flight computers, further reducing risk for the SLS launch infrastructure, the SLS LV, and most importantly the crew.

Trevino, Luis↗
NASA NTRS1993

Control structural interaction testbed: A model for multiple flexible body verification

Conventional end-to-end ground tests for verification of control system performance become increasingly complicated with the development of large, multiple flexible body spacecraft structures. The expense of accurately reproducing the on-orbit dynamic environment and the attendant difficulties in reducing and accounting for ground test effects limits the value of these tests. TRW has developed a building block approach whereby a combination of analysis, simulation, and test has replaced end-to-end performance verification by ground test. Tests are performed at the component, subsystem, and system level on engineering testbeds. These tests are aimed at authenticating models to be used in end-to-end performance verification simulations: component and subassembly engineering tests and analyses establish models and critical parameters, unit level engineering and acceptance tests refine models, and subsystem level tests confirm the models' overall behavior. The Precision Control of Agile Spacecraft (PCAS) project has developed a control structural interaction testbed with a multibody flexible structure to investigate new methods of precision control. This testbed is a model for TRW's approach to verifying control system performance. This approach has several advantages: (1) no allocation for test measurement errors is required, increasing flight hardware design allocations; (2) the approach permits greater latitude in investigating off-nominal conditions and parametric sensitivities; and (3) the simulation approach is cost effective, because the investment is in understanding the root behavior of the flight hardware and not in the ground test equipment and environment.

Chory, M. A.↗
NASA NTRS1987

Comparing the effectiveness of software testing strategies

This study compares the results of code reading, functional testing, and structural testing in three aspects of software testing: fault detection effectiveness, fault detection cost, and classes of faults detected. Thirty two professional programmers and 42 advanced students applied the three techniques to four unit-sized programs in a fractional experimental design. The major results of this study are the following: (1) With the professional programmers, code reading detected more software faults and had a higher detection rate than did functional or structural testing, while functional testing detected more faults than did structural testing, but functional and structural testing were not different in fault detection rate. (2) In one advanced student subject group, code reading and functional testing were not different in faults found, but were superior to structural testing, while in the other advanced student subject group there was no difference among the techniques. (3) With the advanced student subjects, the three techniques were not different in fault deteciton rate. (4) Number of faults observed, fault detection rate, and total effort in detection depended on the type of software tested. (5) Code reading detected more interface faults than did the other methods. (6) Functional testing detected more control faults than did the other methods. (7) When asked to estimate the percentage of faults detected, code readers gave the most accurate estimates while functional testers gave the least accurate estimates. Appendix B includes the source code for the word.

Basili, Victor R.↗
NASA NTRS1990

Dynamic ground-effect measurements on the F-15 STOL and Maneuver Technology Demonstrator (S/MTD) configuration

A moving-model ground-effect testing method was used to study the influence of rate-of-descent on the aerodynamic characteristics for the F-15 STOL and Maneuver Technology Demonstrator (S/MTD) configuration for both the approach and roll-out phases of landing. The approach phase was modeled for three rates of descent, and the results were compared to the predictions from the F-15 S/MTD simulation data base (prediction based on data obtained in a wind tunnel with zero rate of descent). This comparison showed significant differences due both to the rate of descent in the moving-model test and to the presence of the ground boundary layer in the wind tunnel test. Relative to the simulation data base predictions, the moving-model test showed substantially less lift increase in ground effect, less nose-down pitching moment, and less increase in drag. These differences became more prominent at the larger thrust vector angles. Over the small range of rates of descent tested using the moving-model technique, the effect of rate of descent on longitudinal aerodynamics was relatively constant. The results of this investigation indicate no safety-of-flight problems with the lower jets vectored up to 80 deg on approach. The results also indicate that this configuration could employ a nozzle concept using lower reverser vector angles up to 110 deg on approach if a no-flare approach procedure were adopted and if inlet reingestion does not pose a problem.

Kemmerly, Guy T.↗
NASA NTRS1996

Comparison of Hover/Ground-Effect Characteristics for a Joint Strike Fighter Configuration

Hover and ground-effect tests were conducted with the Lockheed-Martin Large Scale Powered Model (LSPM) during June-November 1995 at the NASA Ames Research Center's Outdoor Aerodynamics Research Facility (OARF). This was done in support of the Joint Strike Fighter (JSF) Program being lead by the Department of Defense. The program was previously metered to as the Joint Advanced Strike Technology (JAST) Program. The tests at the OARF included: engine thrust calibrations out of ground effect, measurements of individual nozzle jet pressure decay characteristics, and jet-induced hover force and moment measurements in and out of ground effect. The engine calibrations provide data correlating propulsion system throttle and nozzle settings to thrust forces and moments for the bare fuselage with the wings, canards, and tails removed. This provides propulsive forces and moments while minimizing any of the effects due to the presence of the airframe. The engine calibrations were used later to determine thrust for hover testing at the OARF and for transition testing which took place in the NASA Ames 80 by 120 foot Wind Tunnel. The jet decay characteristics reflect the jet entrainment properties and are related to the aircraft suckdown characteristics. The JSF program provided the opportunity to obtain model scale effects using two models; one at small scale and one at large scale. Examples of data from these tests will be presented out of ground effect which will demonstrate the effect of scale. For one JSF configuration, two small-scale models and one large-scale model were tested and obtained different values for the lift loss out of ground effect. These differences were examined and are found to be largely dependent on the jet efflux characteristics. The jet-induced hover forces and moments are presented in and out of ground effect. For the hover testing the model is methodically built up from the bare fuselage, to include the wings, canards, and vertical tails, to determine the effects of each. Other components such as weapons bay doors, landing gear doors, and other lift improvement devices and their effect on the jet-induced forces and moments are examined.

Hange, Craig↗
NASA NTRS2010

Coverage Metrics for Requirements-Based Testing: Evaluation of Effectiveness

In black-box testing, the tester creates a set of tests to exercise a system under test without regard to the internal structure of the system. Generally, no objective metric is used to measure the adequacy of black-box tests. In recent work, we have proposed three requirements coverage metrics, allowing testers to objectively measure the adequacy of a black-box test suite with respect to a set of requirements formalized as Linear Temporal Logic (LTL) properties. In this report, we evaluate the effectiveness of these coverage metrics with respect to fault finding. Specifically, we conduct an empirical study to investigate two questions: (1) do test suites satisfying a requirements coverage metric provide better fault finding than randomly generated test suites of approximately the same size?, and (2) do test suites satisfying a more rigorous requirements coverage metric provide better fault finding than test suites satisfying a less rigorous requirements coverage metric? Our results indicate (1) only one coverage metric proposed -- Unique First Cause (UFC) coverage -- is sufficiently rigorous to ensure test suites satisfying the metric outperform randomly generated test suites of similar size and (2) that test suites satisfying more rigorous coverage metrics provide better fault finding than test suites satisfying less rigorous coverage metrics.

Staats, Matt↗
NASA NTRS2007

Space Flight Requirements for Fiber Optic Components; Qualification Testing and Lessons Learned

"Qualification" of fiber optic components holds a very different meaning than it did ten years ago. In the past, qualification meant extensive prolonged testing and screening that led to a programmatic method of reliability assurance. For space flight programs today, the combination of using higher performance commercial technology, with shorter development schedules and tighter mission budgets makes long term testing and reliability characterization unfeasible. In many cases space flight missions will be using technology within years of its development and an example of this is fiber laser technology. Although the technology itself is not a new product the components that comprise a fiber laser system change frequently as processes and packaging changes occur. Once a process or the materials for manufacturing a component change, even the data that existed on its predecessor can no longer provide assurance on the newer version. In order to assure reliability during a space flight mission, the component engineer must understand the requirements of the space flight environment as well as the physics of failure of the components themselves. This can be incorporated into an efficient and effective testing plan that "qualifies" a component to specific criteria defined by the program given the mission requirements and the component limitations. This requires interaction at the very initial stages of design between the system design engineer, mechanical engineer, subsystem engineer and the component hardware engineer. Although this is the desired interaction what typically occurs is that the subsystem engineer asks the components or development engineers to meet difficult requirements without knowledge of the current industry situation or the lack of qualification data. This is then passed on to the vendor who can provide little help with such a harsh set of requirements due to high cost of testing for space flight environments. This presentation is designed to guide the engineers of design, development and components, and vendors of commercial components with how to make an efficient and effective qualification test plan with some basic generic information about many space flight requirements. Issues related to the ~ physics of failure, acceptance criteria and lessons learned will also be discussed to assist with understanding how to approach a space flight mission in an ever changing commercial photonics industry.

Ott, Melanie N.↗
NASA NTRS1975

Testing of lift/cruise fan exhaust deflector

A lift/cruise exhaust deflector system for the LF336/A tip turbine lift fan was designed, built, and tested to determine the design and performance characteristics of a large-scale, single swivel nozzle thrust vectoring system. The exhaust deflector static testing was performed at the Ames Research Center outside static test stand facilities. The test hardware was installed on a hydraulic lift platform to permit both in and out of ground effect testing. The exhaust flow of the LF336/A lift fan was vectored from 0 degrees through 130 degrees during selected fan speeds to obtain performance at different operating conditions. The system was operated with and without flow vanes installed in the small radius bends to evaluate the system performance based on a proposed method of improving the internal flow losses. The program also included testing at different ground heights, to the nozzle exhaust plane, to obtain ground effect data, and the testing of two methods of thrust spoiling using a duct bypass door system and nozzle flap system.

Schlundt, D. W.↗
NASA NTRS2011

Characterizing the Joint Effect of Diverse Test-Statistic Correlation Structures and Effect Size on False Discovery Rates in a Multiple-Comparison Study of Many Outcome Measures

In their 2009 Annals of Statistics paper, Gavrilov, Benjamini, and Sarkar report the results of a simulation assessing the robustness of their adaptive step-down procedure (GBS) for controlling the false discovery rate (FDR) when normally distributed test statistics are serially correlated. In this study we extend the investigation to the case of multiple comparisons involving correlated non-central t-statistics, in particular when several treatments or time periods are being compared to a control in a repeated-measures design with many dependent outcome measures. In addition, we consider several dependence structures other than serial correlation and illustrate how the FDR depends on the interaction between effect size and the type of correlation structure as indexed by Foerstner s distance metric from an identity. The relationship between the correlation matrix R of the original dependent variables and R~, the correlation matrix of associated t-statistics is also studied. In general R~ depends not only on R, but also on sample size and the signed effect sizes for the multiple comparisons.

Feiveson, Alan H.↗
NASA NTRS2013

Jet Engine Bird Ingestion Simulations: Comparison of Rotating to Non-Rotating Fan Blades

Bird strike events in commercial airliners are a fairly common occurrence. According to data collected by the US Department of Agriculture, over 80,000 bird strikes were reported in the period 1990 to 2007 in the US alone (Ref. 1). As a result, bird ingestion is an important factor in aero engine design and FAA certification. When it comes to bird impacts on engine fan blades, the FAA requires full-scale bird ingestion tests on an engine running at full speed to pass certification requirements. These rotating tests are complex and very expensive. To reduce development costs associated with new materials for fan blades, it is desirable to develop more cost effective testing procedures than full-scale rotating engine tests for material evaluation. An impact test on a nonrotating single blade that captures most of the salient physics of the rotating test would go a long way towards enabling large numbers of evaluative material screening tests. NASA Glenn Research Center has been working to identify a static blade test procedure that would be effective at reproducing similar results as seen in rotating tests. The current effort compares analytical simulations of a bird strike on various non-rotating blades to a bird strike simulation on a rotating blade as a baseline case. Several different concepts for simulating the rotating loads on a non-rotating blade were analyzed with little success in duplicating the deformation results seen in the rotating case. The rotating blade behaves as if it were stiffer than the non-rotating blade resulting in less plastic deformation from a given bird impact. The key factor limiting the success of the non-rotating blade simulations is thought to be the effect of gyroscopics. Prior to this effort, it was anticipated the difficulty would be in matching the prestress in the blade due to centrifugal forces Additional work is needed to verify this assertion, and to determine if a static test procedure can simulate the gyroscopic effects in a suitable manner. This paper describes the various non-rotating concepts analyzed, and demonstrates the effect believed to be gyroscopic in nature on the results

Howard, Samuel A.↗
NASA NTRS2013

Jet Engine Bird Ingestion Simulations: Comparison of Rotating to Non-Rotating Fan Blades

Bird strike events in commercial airliners are a fairly common occurrence. According to data collected by the US Department of Agriculture, over 80,000 bird strikes were reported in the period 1990-2007 in the US alone [1]. As a result, bird ingestion is an important factor in aero engine design and FAA certification. When it comes to bird impacts on engine fan blades, the FAA requires full-scale bird ingestion tests on an engine running at full speed to pass certification requirements. These rotating tests are complex and very expensive. To reduce development costs associated with new materials for fan blades, it is desirable to develop more cost effective testing procedures than full-scale rotating engine tests for material evaluation. An impact test on a non-rotating single blade that captures most of the salient physics of the rotating test would go a long way towards enabling large numbers of evaluative material screening tests. NASA Glenn Research Center has been working to identify a static blade test procedure that would be effective at reproducing similar results as seen in rotating tests. The current effort compares analytical simulations of a bird strike on various nonrotating blades to a bird strike simulation on a rotating blade as a baseline case. Several different concepts for simulating the rotating loads on a non-rotating blade were analyzed with little success in duplicating the deformation results seen in the rotating case. The rotating blade behaves as if it were stiffer than the non-rotating blade resulting in less plastic deformation from a given bird impact. The key factor limiting the success of the non-rotating blade simulations is thought to be the effect of gyroscopics. Prior to this effort, it was anticipated the difficulty would be in matching the pre-stress in the blade due to centrifugal forces Additional work is needed to verify this assertion, and to determine if a static test procedure can simulate the gyroscopic effects in a suitable manner. This paper describes the various non-rotating concepts analyzed, and demonstrates the effect believed to be gyroscopic in nature on the results.

Howard, Samuel A.↗
NASA NTRS2018

A First Look at 22 nm FDSOI SRAM Single-Event Test Results

We will present the first ever single-event effects testing results on a 22 nm fully-depleted silicon-on-insulator test chip. The 128 MB SRAMs were irradiated with heavy ions and the results are compared to previous technology generations.

Silicon-on-insulator↗
NASA NTRS1979

Powered low-aspect-ratio Wing In Ground effect (WIG) aerodynamic characteristics

A wing-in-ground effect configuration was investigated. The configuration used large diameter, low pressure ratio fans mounted about 0.76 wing chord ahead of the wing leading edge to achieve a power augmented ram wing during operation in ground effect. Tests of both in and out of ground effect aerodynamic transition characteristics from very low speeds to cruise speeds are described. The investigation provided a number of conclusions concerning the aerodynamic/propulsive performance interaction. While power augmented lift is required for low speed flight, there is a thrust loss when the efflux is trapped under the wing which reduced the effective thrust to weight available for acceleration by about a third of the installed thrust to weight ratio.

Thomas, J. L.↗