Search NASA⌕ Search

SEARCH · Search NASA

Results for “pass/fail data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Comparing Methods for Assessing Reliability Uncertainty Based on Pass/Fail Data Collected Over Time

In this paper, we compare statistical methods for analyzing pass/fail data collected over time; some methods are traditional and one (the RADAR or Rationale for Assessing Degradation Arriving at Random) was recently developed. These methods are used to provide uncertainty bounds on reliability. We make observations about the methods' assumptions and properties. Finally, we illustrate the differences between two traditional methods, logistic regression and Weibull failure time analysis, and the RADAR method using a numerical example.

97 MATHEMATICS AND COMPUTING↗

Comparisons of population subgroups performance on a keyboard psychomotor task

Response time and pass/fail data were obtained from 163 subjects performing a psychomotor task. The basic task comprised a random five digit number briefly displayed to the subject at the start of each trail, and the keyboard on which the subject was to enter the number as fast as he could accurately do so after the display was extinguished. Some tests were run with the addition of a secondary task which required the subject to respond to a displayed light appearing at a random time. Matched pairs of subjects were selected from the group to analyze the effects of age, sex, intelligence, prior keyboard skill, and drinking habits. There was little or no effect due to age or drinking habits. Differences in response time were: average IQ subjects faster than low IQ subjects by 0.5 to 0.6 sec; subjects with prior keyboard skill faster by 0.4 to 0.5 sec; and female subjects faster by 0.2 to 0.3 sec. These effects were generally insensitive to the presence of the secondary task.

Stapleford, R. L.↗

Test and extraction methods for the QC parameters of silicon strip sensors for ATLAS upgrade tracker

The Quality Control (QC) of pre-production strip sensors for the Inner Tracker (ITk) of the ATLAS Inner Detector upgrade has finished, and the collaboration has embarked on the QC test programme for production sensors. This programme will last more than 3 years and comprises the evaluation of approximately 22000 sensors. 8 Types of sensors, 2 barrel and 6 endcap, will be measured at many different collaborating institutes. The sustained throughput requirement of the combined QC processes is around 500 sensors per month in total. Measurement protocols have been established and acceptance criteria have been defined in accordance with the terms agreed with the supplier. For effective monitoring of test results, common data file formats have been agreed upon across the collaboration. To enable evaluation of test results produced by many different test setups at the various collaboration institutes, common algorithms have been developed to collate, evaluate, plot and upload measurement data. This allows for objective application of pass/fail criteria and compilation of corresponding yield data. These scripts have been used to process the data of more than 3000 sensors so far, and have been instrumental for identification of faulty sensors and monitoring of QC testing progress.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Maximizing Efficiency and Quality: Leveraging Automated Testing for Laboratory Commissioning

The traditional commissioning process uses sampling to select equipment for functional acceptance testing when large quantities of equipment are present. Although this approach is generally effective in identifying wide-spread issues, it has several shortcomings: it fails to evaluate equipment not included in the sample, provides only a one-time validation of equipment operation, and the standard documentation is a simple checklist of pass/fail questions. During the construction and commissioning process of the new Research and Innovation Laboratory (RAIL) in Golden, CO, the National Renewable Energy Laboratory team engaged Group14 Engineering to implement a Connected Commissioning process using fault detection and diagnostic software for automated functional acceptance testing. This presentation highlights the advantages offered by automated functional testing in this critical laboratory setting: (1) sampling 100% of BAS-connected equipment during functional testing, (2) testing results backed by data beyond the traditional pass/fail checklist, and (3) an automated test process that can be regularly executed by the building management team for ongoing commissioning throughout the life of the building. The presentation will also cover technical challenges associated with Connected Commissioning and the important conversations with key stakeholders that need to occur well before functional acceptance testing in order to successfully implement the automated testing processes.

automated testing↗

Maximizing Efficiency and Quality: Leveraging Automated Testing for Laboratory Commissioning

The traditional commissioning process for a building often implements sampling rates to select equipment for functional acceptance testing when large quantities of equipment are present. While this approach is generally effective in identifying wide-spread issues, it has several key shortfalls. (1) It provides a one-time validation of equipment operation in which the standard documentation is a simple checklist of pass/fail questions. (2) It fails to evaluate equipment not included in the sample rate selection. During the construction and commissioning process of the new Research and Innovation Laboratory (RAIL) in Golden, CO, the National Renewable Energy Laboratory team engaged Group14 Engineering to implement a Connected Commissioning process using fault detection and diagnostic software for automated functional acceptance testing. The goal of this presentation will be to highlight the advantages offered by automated functional testing in this critical laboratory setting. These are primarily (1) sampling 100% of BAS-connected equipment during functional testing, (2) testing results backed by data beyond the traditional pass/fail checklist, and (3) an automated test process that can be regularly executed by the building management team for ongoing commissioning throughout the life of the building. The presentation will also cover technical challenges associated with connected commissioning and the important conversations with the key stakeholders that need to occur well before functional acceptance testing in order to successfully implement the automated testing processes.

automated testing↗

SOLAr Critical Infrastructure Energization (SOLACE): Leveraging Distributed Energy Resources to Provide Local Power

This document is a technical report based on a large-scale DOE-funded project conducted between 2019 and 2022. The project, called SOLAr Critical infrastructure Energization (SOLACE), is aimed at leveraging distributed energy resources (DERs) to provide local power to communities, feeders, or other regions. The project included a particular focus on high-value critical loads such as municipal water supply, telecommunication hubs, and disaster shelters. The key developments of the project were: (1) A comprehensive pre-event power system analysis methodology that identifies and characterizes the viable local power options. (2) A DMS-based example control system for activating and operating the local power solution during a time of crisis. (3) Grid-forming inverter technology to enable isolated local power operation and black-starting. (4) Cyber-security considerations for isolated systems when wider-area communication may be offline. This report describes the overall process that identifies and assesses the viable DER-based local power solutions for a given facility, region, or community. The report documents the process, including the key analysis steps, tools required, data requirements, and recommended pass/fail criteria for each step. It also provides a sample implementation of this process through a test case. Finally, it provides details of how a viable pre-event plan can be selected and activated at go-time when an event has occurred.

14 SOLAR ENERGY↗

Accelerated Stress-Corrosion Testing

Test procedures for accelerated stress-corrosion testing of high-strength aluminum alloys faster and provide more quantitative information than traditional pass/fail tests. Method uses data from tests on specimen sets exposed to corrosive environment at several levels of applied static tensile stress for selected exposure times then subsequently tensile tested to failure. Method potentially applicable to other degrading phenomena (such as fatigue, corrosion fatigue, fretting, wear, and creep) that promote development and growth of cracklike flaws within material.

Source record↗

Constructing the "Best" Reliability Data for the Job

Modern business and technical decisions are based on the results of analyses. When considering assessments using "reliability data", the concern is how long a system will continue to operate as designed. Generally, the results are only as good as the data used. Ideally, a large set of pass/fail tests or observations to estimate the probability of failure of the item under test would produce the best data. However, this is a costly endeavor if used for every analysis and design. Developing specific data is costly and time consuming. Instead, analysts rely on available data to assess reliability. Finding data relevant to the specific use and environment for any project is difficult, if not impossible. Instead, we attempt to develop the "best" or composite analog data to support our assessments. One method used incorporates processes for reviewing existing data sources and identifying the available information based on similar equipment, then using that generic data to derive an analog composite. Dissimilarities in equipment descriptions, environment of intended use, quality and even failure modes impact the "best" data incorporated in an analog composite. Once developed, this composite analog data provides a "better" representation of the reliability of the equipment or component can be used to support early risk or reliability trade studies, or analytical models to establish the predicted reliability data points. Data that is more representative of reality and more project specific would provide more accurate analysis, and hopefully a better final decision.

DeMott, D. L.↗

Constructing the Best Reliability Data for the Job

Modern business and technical decisions are based on the results of analyses. When considering assessments using "reliability data", the concern is how long a system will continue to operate as designed. Generally, the results are only as good as the data used. Ideally, a large set of pass/fail tests or observations to estimate the probability of failure of the item under test would produce the best data. However, this is a costly endeavor if used for every analysis and design. Developing specific data is costly and time consuming. Instead, analysts rely on available data to assess reliability. Finding data relevant to the specific use and environment for any project is difficult, if not impossible. Instead, we attempt to develop the "best" or composite analog data to support our assessments. One method used incorporates processes for reviewing existing data sources and identifying the available information based on similar equipment, then using that generic data to derive an analog composite. Dissimilarities in equipment descriptions, environment of intended use, quality and even failure modes impact the "best" data incorporated in an analog composite. Once developed, this composite analog data provides a "better" representation of the reliability of the equipment or component can be used to support early risk or reliability trade studies, or analytical models to establish the predicted reliability data points. Data that is more representative of reality and more project specific would provide more accurate analysis, and hopefully a better final decision.

Kleinhammer, R. K.↗

Injecting Errors for Testing Built-In Test Software

Two algorithms have been conceived to enable automated, thorough testing of Built-in test (BIT) software. The first algorithm applies to BIT routines that define pass/fail criteria based on values of data read from such hardware devices as memories, input ports, or registers. This algorithm simulates effects of errors in a device under test by (1) intercepting data from the device and (2) performing AND operations between the data and the data mask specific to the device. This operation yields values not expected by the BIT routine. This algorithm entails very small, permanent instrumentation of the software under test (SUT) for performing the AND operations. The second algorithm applies to BIT programs that provide services to users application programs via commands or callable interfaces and requires a capability for test-driver software to read and write the memory used in execution of the SUT. This algorithm identifies all SUT code execution addresses where errors are to be injected, then temporarily replaces the code at those addresses with small test code sequences to inject latent severe errors, then determines whether, as desired, the SUT detects the errors and recovers

Gender, Thomas K.↗

Evaluating Failures and near Misses in Human Spaceflight History for Lessons for Future Human Spaceflight

Studies done in the past have drawn on lessons learned with regard to human loss-of-life events. However, an examination of near-fatal accidents can be equally useful, not only in detecting causes, both proximate and systemic, but also for determining what factors averted disaster, what design decisions and/or operator actions prevented catastrophe. Binary pass/fail launch history is often used for risk, but this also has limitations. A program with a number of near misses can look more reliable than a consistently healthy program with a single out-of-family failure. Augmenting reliability evaluations with this near miss data can provide insight and expand on the limitations of a strictly pass/fail evaluation. This paper intends to show how near-miss lessons learned can provide crucial data for any new human spaceflight programs that are interested in sending man into space

Barr, Stephanie↗

CMM Data Analysis Tool

Due to the increase in the use of Coordinate Measuring Machines (CMMs) to measure fine details and complex geometries in manufacturing, many programs have been made to compile and analyze the data. These programs typically require extensive setup to determine the expected results in order to not only track the pass/fail of a dimension, but also to use statistical process control (SPC). These extra steps and setup times have been addressed through the CMM Data Analysis Tool, which only requires the output of the CMM to provide both pass/fail analysis on all parts run to the same inspection program as well as provide graphs which help visualize where the part measures within the allowed tolerances. This provides feedback not only to the customer for approval of a part during development, but also to machining process engineers to identify when any dimension is drifting towards an out of tolerance condition during production. This program can handle hundreds of parts with complex dimensions and will provide an analysis within minutes.

Source record↗

Halogen occultation experiment (HALOE) performance verification test procedure

The Performance Verification Test Procedure is given for the Halogen Occultation Experiment (HALOE) instrument, which is being developed in house at the Langley Research Center for the Upper Atmosphere Research Satellite (UARS). This procedure is used for comprehensive performance testing of the HALOE instrument which occurs before, during, and after flight environmental tests. The radiometric performance tests include noise, drift, linearity, instantaneous field-of-view, cal wheel gas cell characterization, and self thermal emissions. Pointer/tracker performance tests include sun sensor performance, gimbal performance, control system performance, and boresight alignment. In addition, the instrument is tested functionally in simulated orbit sequences and all command operating modes are exercised. The data analysis required for each test is specified and pass/fail criteria are given where applicable. This test will fully demonstrate the HALOE instrument's ability to achieve science mission requirements. The HALOE instrument is a gas correlation radiometer that measures vertical distribution of eight upper atmospheric constituents: O3, HCl, HF, NO, CH4, H2O, NO2, and CO2.

Mauldin, L. E., III↗

Establishment of a PID Pass/Fail Test for Crystalline Silicon Modules by Examining Field Performance for Five Years: Preprint

In an experiment with five module designs and multiple replicas, it is found that crystalline silicon cell modules that can pass a criterion of less than 5 percent power degradation in stress test conditions of 60 degrees Celsius, 85 percent relative humidity (RH), 96 h, and nameplate-rated system voltage bias show no power degradation by potential induced degradation in the range of 4-6 years duration in the Florida, USA environment. This data suggests that this chamber stress level is useful as a pass/fail criterion for PID, and will help ensure against degradation by system voltage stress in Florida, or less stressful climates, for at least 5 years.

14 SOLAR ENERGY↗

Orion Capsule Parachute Assembly System (CPAS) Overload Testing Approach and Results

The qualification of the Orion Capsule Parachute Assembly System (CPAS) system includes exposure to loads and dynamic pressures above the required values as validation of the parachutes' structural integrity. As outlined in the certification plan, each of the four parachutes of the system are to be subjected to 110% of their respective maximum dynamic pressure requirements. The Main and Drogue parachutes have satisfied this overload condition in drop testing and due to cost and schedule constraints, the Forward Bay Cover Parachute (FBCP) and Pilot parachute were subjected to the overload condition in the ground testing described in this document. The test objectives and pass/fail criteria were established and require the parachutes to achieve and maintain a target riser load (associated with a minimum of 110% dynamic pressure overload) for a minimum of three seconds while sustaining no failures of any structural members (vent hoop, radials, suspension line) or any damage which propagates into catastrophic failure of the canopy. Considering the assumptions and limitations associated with the ground testing (primarily non-uniform flow field of the ground test system and variations in parachute manufacturing), a method of establishing the desired overload condition was determined by the technical community and covers the 2-sigma bounds of the drag area distribution derived from drop testing. On June 27, 2017 the testing was executed at the High Velocity Airflow System (HiVAS) facility located at the Weapon Survivability Laboratory (WSL) at the Naval Air Warfare Center, Weapons Division (NAWCWD) China Lake. Engineering Development Unit (EDU) parachutes were used as pathfinders to gain experience with achieving the test conditions. Additional runs were executed to measure the airflow at the same location as the canopy skirt, although this data is not required to satisfy the test objectives and parachute pass/fail criteria. The qualification parachutes were successfully exposed to the target conditions and sustained only minor damage.

Daum, Jared S.↗

Connectivity and functional verification for the LSST science raft towers

The LSST Camera focal plane will be constructed with 21 144-Mpixel modules (\Raft Tower Module", RTM). An extensive operational test is performed to confirm the integrity of all connections and to verify the basic functionality. Each RTM undergoes at least four connectivity tests. A python script communicates with Java- based control software and performs the test. A python script parses the test data and generates a PDF report. The report includes a summary PASS/FAIL table, several hundred current, voltage and temperature parameters, and images taken with the CCD array at room temperature.

79 ASTRONOMY AND ASTROPHYSICS↗

Electrostatic testing of thin plastic materials

Ten thin plastic materials (Velostat, RCAS 1200, Llumalloy, Herculite 80, RCAS 2400, Wrightlon 7000, PVC, Aclar 22A, Mylar, and Polyethylene) were tested for electrostatic properties by four different devices: (1) The static decay meter, (2) the manual triboelectric testing device, (3) the robotic triboelectric testing device, and (4) the resistivity measurement adapter device. The static decay meter measured the electrostatic decay rates in accordance with the Federal Test Method Standard 101B, Method 4046. The manual and the robotic triboelectric devices measured the triboelectric generated peak voltages and the five-second decay voltages in accordance with the criteria for acceptance standards at Kennedy Space Center. The resistivity measurement adapter measured the surface resistivity of each material. An analysis was made to correlate the data among the four testing devices. For the material tested the pass/fail results were compared for the 4046 method and the triboelectric testing devices. For the limited number of materials tested, the relationship between decay rate and surface resistivity was investigated as well as the relationship between triboelectric peak voltage and surface resistivity.

Skinner, S. Ballou↗

Evaluating Failures and Near Misses in Human Spaceflight History for Lessons for Future Human Spaceflight

There have been a number of studies done in the past drawn on lessons learned with regard to human loss-of-life events. Generally, the systemic causes and proximate causes for fatal events have both been examined in considerable detail. However, an examination of near-fatal accidents and failures that narrowly missed being fatal could be equally useful, not only in detecting causes, both proximate and systemic, but also for determining what factors averted disaster, what design decisions and/or operator actions prevented catastrophe. Additionally, review of risk factors for upcoming or future programs will often look at trending statistics, generally focusing on failure/success statistics. Unfortunately, doing so can give a skewed or misleading view of past reliability or a reliability that cannot be presumed to apply to a new program. One reason for this might be that failure/success criteria aren't the same across programs, but also that apparent success can hide systemic faults that, under other circumstances, can be fatal to a program with different parameters. A program with a number of near misses can look more reliable than a consistently healthy program with a single out-of-family failure and provide very misleading data if it is not examined in detail. This is particularly true for a manned space program where failure/success includes more than making a particular orbit. Augmenting reliability evaluations with this near miss data can provide insight and expand on the limitations of a strictly pass/fail evaluation. Even more importantly, a thorough understanding of these near miss events can identify conditions that prevented fatalities. Those conditions may be key to a programs reliability, but, without insight to the repercussions if such conditions were not in place, their importance may not be readily clear. As programs mature and political and fiscal responsibilities come to the fore, often there is considerable incentive to eliminate unnecessary conservatism, design margin, redundancy, operational support, testing, training, or safety oversight. An evaluation that demonstrates how these features and capabilities averted disaster can ensure processes that saved lives or missions are not discarded without appropriate review and understanding. Close examination of accidents that almost were can also highlight differences in design from one program to another, either justifying reliability comparisons or negating them. It can also provide considerable insight into how those saving factors were developed and implemented so that similar methods can be used to ensure appropriate life-saving and mission saving factors can be developed, even for a dissimilar space program. The lessons are appropriate for seasoned manned space programs and agencies, but crucial for untried agencies and organizations that are interested in sending man into space. The large body of publicly available near miss and accident data available provide invaluable insight into programmatic, technical, and even political issues that can be addressed before they impact safety. In this paper, we examine a number of these near misses and accidents and steps a program, agency, or potential spacefaring company might take to improve their chances of success and avoid mission or safety disasters using this data.

Barr, Stephanie↗