Search NASA⌕ Search

SEARCH · Search NASA

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Applications of model structure determination to flight test data

Several statistical and information criteria need to be considered when selecting an adequate model. Incorrect stability and control derivates result from inadequate aerodynamic model structure. Stepwise regression is used to determine the structure for an adequate model. Flight data which covers a nonlinear aerodynamic model range may be analyzed as a single data set or partitioned into several distinct sets. Stepwise regression for model structure detemination and parameter estimation was successfully applied to three aircraft types (single engine general aviation, unaugmented modern jet fighter, jet transport).

Batterson, J. G.↗

Fitting Leak Test Report: Ground-Based Cryogenic Leak Test of Fittings for Cryogenic Fluid Management

EXECUTIVE SUMMARY Mechanically connected joints used in cryogenic fluid lines as part of space flight elements need to survive launch vibrations and remain leak-free to minimize the loss of on-board commodity and hazardous gas accumulation. In 2020, a cryogenic test apparatus was developed which can evaluate the leak performance of pressurized threaded fluid fittings. The fittings were mounted in the TVAC and cooled to cryogenic test temperature and pressurized with helium while the leak rate was measured using a calibrated GHe leak detector. The test articles for the initial proof of concept testing were ¼ and 1 inch Swagelok VCR fittings with three different types of seal rings copper, nickel, and Ni. Each fitting configuration (size/seal material) was subjected to two consecutive cryogenic thermal cycles, followed by exposure to a launch vibration profile at ambient temperature, after which two additional TVAC cycle tests were performed. The testing reported here is a continuation of the 2020 tests with a statistically significant large number of samples and test runs. Three Swagelok VCR fitting sizes were tested ¼, ½ and 1 inch, and five (5) samples of each fitting size, each sample was tested with SST and Ni seal rings (Total of 30 unique test articles). Each test article was subjected to four (4) thermal cycles. Half of these cycles were performed before vibration testing and half were performed after vibration testing. The vibration testing was performed to evaluate the ability of the fittings to survive launch-type vibration profiles and remain leak-free. Leak checking of each fitting was completed at temperatures between 20K – 30K. The test procedure in Section 8.0 was designed to facilitate a qualification test program by allowing a higher test throughput rate coupled with repeatable test profiles. Results were very positive and show that out of the 30 samples they all passed with leak rates a factor of 2-3 lower than the established 10-6sccs GHe leak threshold. The result showed the Ni seals had lower leak rate, but the SST was more rugged. There were two deviations where damage to the Ni seal ring during assembly resulted in a leaky fitting, this is discussed in Section 10.7 Test Deviations. These fittings show great promise for space flight use and further testing is recommended to fully qualify the fittings per the ASTM F1387-19 and/or other relevant NASA specifications. The test equipment hardware and software capability developed for this testing is generic and not restricted to VCR fittings. It can be employed to evaluate/qualify the leak performance of other types of fittings and a wide range of other cryogenic fluid components such as valves, gages, connectors, etc.

Cryogenic↗

Testing convolutional neural network based deep learning systems: a statistical metamorphic approach

Machine learning technology spans many areas and today plays a significant role in addressing a wide range of problems in critical domains,i.e., healthcare, autonomous driving, finance, manufacturing, cybersecurity,etc. Metamorphic testing (MT) is considered a simple but very powerful approach in testing such computationally complex systems for which either an oracle is not available or is available but difficult to apply. Conventional metamorphic testing techniques have certain limitations in verifying deep learning-based models (i.e., convolutional neural networks (CNNs)) that have a stochastic nature (because of randomly initializing the network weights) in their training. In this article, we attempt to address this problem by using a statistical metamorphic testing (SMT) technique that does not require software testers to worry about fixing the random seeds (to get deterministic results) to verify the metamorphic relations (MRs). We propose seven MRs combined with different statistical methods to statistically verify whether the program under test adheres to the relation(s) specified in the MR(s). We further use mutation testing techniques to show the usefulness of the proposed approach in the healthcare space and test two CNN-based deep learning models (used for pneumonia detection among patients). The empirical results show that our proposed approach uncovers 85.71% of the implementation faults in the classifiers under test (CUT). Furthermore, we also propose an MRs minimization algorithm for the CUT, thus saving computational costs and organizational testing resources.

Computer Science↗

Statistical Issues for Uncontrolled Reentry Hazards Empirical Tests of the Predicted Footprint for Uncontrolled Satellite Reentry Hazards

A number of statistical tools have been developed over the years for assessing the risk of reentering objects to human populations. These tools make use of the characteristics (e.g., mass, material, shape, size) of debris that are predicted by aerothermal models to survive reentry. The statistical tools use this information to compute the probability that one or more of the surviving debris might hit a person on the ground and cause one or more casualties. The statistical portion of the analysis relies on a number of assumptions about how the debris footprint and the human population are distributed in latitude and longitude, and how to use that information to arrive at realistic risk numbers. Because this information is used in making policy and engineering decisions, it is important that these assumptions be tested using empirical data. This study uses the latest database of known uncontrolled reentry locations measured by the United States Department of Defense. The predicted ground footprint distributions of these objects are based on the theory that their orbits behave basically like simple Kepler orbits. However, there are a number of factors in the final stages of reentry - including the effects of gravitational harmonics, the effects of the Earth s equatorial bulge on the atmosphere, and the rotation of the Earth and atmosphere - that could cause them to diverge from simple Kepler orbit behavior and possibly change the probability of reentering over a given location. In this paper, the measured latitude and longitude distributions of these objects are directly compared with the predicted distributions, providing a fundamental empirical test of the model assumptions.

Matney, Mark↗

Statistical correlation of structural mode shapes from test measurements and NASTRAN analytical values

The software and procedures of a system of programs used to generate a report of the statistical correlation between NASTRAN modal analysis results and physical tests results from modal surveys are described. Topics discussed include: a mathematical description of statistical correlation, a user's guide for generating a statistical correlation report, a programmer's guide describing the organization and functions of individual programs leading to a statistical correlation report, and a set of examples including complete listings of programs, and input and output data.

Purves, L.↗

Effects of Long-Term Thermal Exposure on Commercially Pure Titanium Grade 2 Elevated-Temperature Tensile Properties

Elevated-temperature tensile testing of commercially pure titanium (CP Ti) Grade 2 was conducted for as-received commercially produced sheet and following thermal exposure at 550 and 650 K (531 and 711 F) for times up to 5000 h. The tensile testing revealed some statistical differences between the 11 thermal treatments, but most thermal treatments were statistically equivalent. Previous data from room temperature tensile testing was combined with the new data to allow regression and development of mathematical models relating tensile properties to temperature and thermal exposure. The results indicate that thermal exposure temperature has a very small effect, whereas the thermal exposure duration has no statistically significant effects on the tensile properties. These results indicate that CP Ti Grade 2 will be thermally stable and suitable for long-duration space missions.

Ellis, David L.↗

A method for developing design diagrams for ceramic and glass materials using fatigue data

The service lifetime of glass and ceramic materials can be expressed as a plot of time-to-failure versus applied stress whose plot is parametric in percent probability of failure. This type of plot is called a design diagram. Confidence interval estimates for such plots depend on the type of test that is used to generate the data, on assumptions made concerning the statistical distribution of the test results, and on the type of analysis used. This report outlines the development of design diagrams for glass and ceramic materials in engineering terms using static or dynamic fatigue tests, assuming either no particular statistical distribution of test results or a Weibull distribution and using either median value or homologous ratio analysis of the test results.

Heslin, T. M.↗

Statistical Treatment of Earth Observing System Pyroshock Separation Test Data

The Earth Observing System (EOS) AM-1 spacecraft for NASA's Mission to Planet Earth is scheduled to be launched on an Atlas IIAS vehicle in June of 1998. One concern is that the instruments on the EOS spacecraft are sensitive to the shock-induced vibration produced when the spacecraft separates from the launch vehicle. By employing unique statistical analysis to the available ground test shock data, the NASA Lewis Research Center found that shock-induced vibrations would not be as great as the previously specified levels of Lockheed Martin. The EOS pyroshock separation testing, which was completed in 1997, produced a large quantity of accelerometer data to characterize the shock response levels at the launch vehicle/spacecraft interface. Thirteen pyroshock separation firings of the EOS and payload adapter configuration yielded 78 total measurements at the interface. The multiple firings were necessary to qualify the newly developed Lockheed Martin six-hardpoint separation system. Because of the unusually large amount of data acquired, Lewis developed a statistical methodology to predict the maximum expected shock levels at the interface between the EOS spacecraft and the launch vehicle. Then, this methodology, which is based on six shear plate accelerometer measurements per test firing at the spacecraft/launch vehicle interface, was used to determine the shock endurance specification for EOS. Each pyroshock separation test of the EOS spacecraft simulator produced its own set of interface accelerometer data. Probability distributions, histograms, the median, and higher order moments (skew and kurtosis) were analyzed. The data were found to be lognormally distributed, which is consistent with NASA pyroshock standards. Each set of lognormally transformed test data produced was analyzed to determine if the data should be combined statistically. Statistical testing of the data's standard deviations and means (F and t testing, respectively) determined if data sets were significantly different at a 95-percent confidence level. If two data sets were found to be significantly different, these families of data were not combined for statistical purposes. This methodology produced three separate statistical data families of shear plate data. For each population, a P99.1/50 (probability/confidence) per-separation-nut firing level was calculated. By using the binomial distribution, Lewis researchers determined that this pernut firing level was equivalent to a P95/50 per-flight confidence level. The overall envelope of the per-flight P95/50 levels led to Lewis' recommended EOS interface shock endurance specification. A similar methodology was used to develop Lewis' recommended EOS mission assurance levels. The available test data for the EOS mission are significantly larger than for a normal mission, thus increasing the confidence level in the calculated expected shock environment. Lewis significantly affected the EOS mission by properly employing statistical analysis to the data. This analysis prevented a costly requalification of the spacecraft's instruments, which otherwise would have been exposed to significantly higher test levels.

McNelis, Anne M.↗

Statistical correlation analysis for comparing vibration data from test and analysis

A theory was developed to compare vibration modes obtained by NASTRAN analysis with those obtained experimentally. Because many more analytical modes can be obtained than experimental modes, the analytical set was treated as expansion functions for putting both sources in comparative form. The dimensional symmetry was developed for three general cases: nonsymmetric whole model compared with a nonsymmetric whole structural test, symmetric analytical portion compared with a symmetric experimental portion, and analytical symmetric portion with a whole experimental test. The theory was coded and a statistical correlation program was installed as a utility. The theory is established with small classical structures.

Butler, T. G.↗

An assessment of total depletion uncertainties for a GBC-32 dry storage cask with PLUS7 fuels using Monte Carlo sampling and two-way ANOVA F-test

It is important to accurately evaluate depletion uncertainties that exist due to the limitations of a computer code on accuracy in a nuclear depletion calculation for criticality safety analysis. In this work, the bias and bias uncertainty in the effective neutron multiplication factor (k{sub eff}) for the generic 32 PWR-assembly burnup credit (GBC-32) cask system were assessed using the Monte Carlo uncertainty sampling method for three different burnups and the isotopic biases and uncertainties obtained with the calculated and measured isotopic concentrations. The PLUS7 used nuclear fuel assemblies discharged from the Hanbit Nuclear Power Plant Unit 3 were assumed to be loaded into the GBC-32 cask. In addition, the statistical F-test in the two-way analysis of variance (ANOVA) was suggested to efficiently estimate the statistically converged total depletion uncertainty in k{sub eff}, with a significant reduction of computing efforts in the Monte Carlo criticality calculations, and it was applied to the GBC-32 cask system after a sensitivity analysis was performed to select the important nuclides having significant contributions to the total depletion uncertainty. With the statistical F-tests in the two-way ANOVA, 100 criticality calculations were needed to get a statistically converged total depletion uncertainty for 10 and 30 GWD/MTU, while 120 criticality calculations were needed for 50 GWD/MTU. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Statistical Evaluation of Molecular Contamination During Spacecraft Thermal Vacuum Test

The purpose of this paper is to evaluate the statistical molecular contamination data with a goal to improve spacecraft contamination control. The statistical data was generated in typical thermal vacuum tests at the National Aeronautics and Space Administration, Goddard Space Flight Center (GSFC). The magnitude of material outgassing was measured using a Quartz Crystal Microbalance (QCM) device during the test. A solvent rinse sample was taken at the conclusion of the each test. Then detailed qualitative and quantitative measurements were obtained through chemical analyses. All data used in this study encompassed numerous spacecraft tests in recent years.

Chen, Philip↗

Statistical Evaluation of Molecular Contamination During Spacecraft Thermal Vacuum Test

The purpose of this paper is to evaluate the statistical molecular contamination data with a goal to improve spacecraft contamination control. The statistical data was generated in typical thermal vacuum tests at the National Aeronautics and Space Administration, Goddard Space Flight Center (GSFC). The magnitude of material outgassing was measured using a Quartz Crystal Microbalance (QCM) device during the test. A solvent rinse sample was taken at the conclusion of each test. Then detailed qualitative and quantitative measurements were obtained through chemical analyses. All data used in this study encompassed numerous spacecraft tests in recent years.

Chen, Philip↗

Statistical Evaluation of Molecular Contamination During Spacecraft Thermal Vacuum Test

The purpose of this paper is to evaluate the statistical molecular contamination data with a goal to improve spacecraft contamination control. The statistical data was generated in typical thermal vacuum tests at the National Aeronautics and Space Administration, Goddard Space Flight Center (GSFC). The magnitude of material outgassing was measured using a Quartz Crystal Microbalance (QCNO device during the test. A solvent rinse sample was taken at the conclusion of each test. Then detailed qualitative and quantitative measurements were obtained through chemical analyses. All data used in this study encompassed numerous spacecraft tests in recent years.

Chen, Philip↗

Develop and Manufacture an Ergonomically Sound Glovebox Glove Report

Ergonomic injury and radiation exposure are two safety concerns for the Plutonium Facility at Los Alamos National Laboratory (LANL). This facility employs the largest number of gloveboxes (GB) at LANL with approximately 6000 gloves installed. The current GB glove design dates back to the 1960’s and is not based on true hand anatomy, revealing several issues: short fingers, inappropriate length from the wrist to finger webbing, nonexistent joint angles and incorrect thumb placement. These design flaws are directly related to elbow (lateral epicondylitis) and thumb (DeQuervain’s tenosynovitis) injuries. The current design also contributes to increased wear on the glove, causing unplanned glove openings (failures) which places workers at risk of exposure. An improved glovebox glove design has three significant benefits: 1) it will reduce the risk of injury, 2) it will improve comfort and productivity, and 3) it will reduce the risk of a glovebox failures. The combination of these three benefits has estimated savings of several million dollars. The new glove design incorporated the varied physical attributes of workers ranging from the 5 th percentile female to the 95th percentile male. Anthropometric hand dimensions along with current GB worker dimensions were used to develop the most comprehensive design specifications for the new glove. Collaboration with orthopedic hand surgeons also provided major contributtions to the design. The new glovebox glove was developed and manufactured incorporating over forty dimensions producing the most comprehensive ergonomically sound design. The new design received a LANL patent (patent attorney docket No: LANS 36USD1 “Protective Glove”, one of 20 highest patents awarded by the Richard P. Feynman Center for Innovation. The glove dimensions were inputed into a solid works model which was used to produce molds. The molds were then shipped to a glove manufacturer for production of the new glovebox gloves. The new glovebox gloves were tested against the presently used glovebox gloves for design validity. The testing included a subjective survey and four dexterity tests. The prototype was statistically significant in 3 dexterity tests and favorable on 8 out of 10 survey questions. The more ergonomically sound glovebox glove will improve worker comfort, mitigate glovebox worker injuries, and reduce glove breaches.

42 ENGINEERING↗

Ventilation distribution and chest wall mechanics in microgravity

The effect of gravity on lung ventilation distribution and the mechanisms of the chest wall were investigated. The following tests were performed with the respiratory monitoring system of the Anthorack, flown onboard Spacelab D2 mission: single breath washout (SBW), multiple breath washout (MBW) and argon rebreathing (ARB). In order to study chest wall mechanisms in microgravity, a respiratory inductive plethysmograph was used. The SBW tests did not reach statistical significance, while the ARB tests showed that gravity independent inhomogeneity of specific ventilation is larger than gravity dependent inhomogeneity. In which concerns the chest wall mechanisms, the analysis on the four astronauts during the normal respirations of the relaxation maneuver showed a 40 percent increase on the abdominal contribution to respiration.

Paiva, M.↗

Reducing V&V Cost of Flight Critical Systems: Myth or Reality?

This paper presents an overview of NASA research program on the V&V of flight critical systems. Five years ago, NASA started an effort to reduce the cost and possibly increase the effectiveness of V&V for flight critical systems. It is the right time to take a look back and realize what progress has been made. This paper describes our overall approach and the tools introduced to address different phases of the software lifecycle. For example, we have improved testing by developing a statistical learning approach tor defining test cases. The tool automatically identifies possible unsafe conditions by analyzing outliers in output data; using an iterative learning process, it can then generate more test cases that represent potentially unsafe regions of operation. At the code level, we have developed and made available as open source a static analyzer for C and C++ programs called IKOS. We have shown that IKOS is very precise in the analysis of embedded C programs (very few false positives) and a bit less for regular C and C++ code. At the design level, in collaboration with our NRA partners, we have developed a suite of analysis tools for Simulink models. The analysis is done in a compositional framework for scalability.

Brat, Guillaume P.↗

A complete sample of double-lobed radio quasars for VLBI tests of source models - Definition and statistics

A complete, flux-density-limited sample of double-lobed radio quasars is defined, with nuclei bright enough to be mapped with the Mark III VLBI system. It is shown that the statistics of linear size, nuclear strength, and curvature are consistent with the assumption of random source orientations and simple relativistic beaming in the nuclei. However, these statistics are also consistent with the effects of interaction between the beams and the surrounding medium. The distribution of jet velocities in the nuclei, as measured with VLBI, will provide a powerful test of physical theories of extragalactic radio sources.

Hough, D. H.↗

Probing the role of solids loading and mix procedure on the properties of acoustically mixed materials for additive manufacturing

We report resonant acoustic mixing has been of particular interest for use in additive manufacturing since viscous, solids-loaded materials can be difficult to mix and inhomogeneity has adverse effects on print quality. In this study, we detail a method to iterate through different formulations and mix procedures and assess mixture quality. The approach utilizes a constant pressure-driven flow test to collect statistics on flow rate through a standard geometry. This test is first applied to well mixed formulations containing particulate solids and find that the results are sensitive to viscosity produced by solids content. We then consider the formulations at various stages of mixing and find that the spread in the volume measurements is indicative of the mixing quality; poorly mixed material yields measurements with wide distributions. We believe this testing approach can be useful when screening new formulations, developing mixing processes, or for quality control.

36 MATERIALS SCIENCE↗