Search NASA⌕ Search

SEARCH · Search NASA

Results for “test statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Ensuring statistical reproducibility of ocean model simulations in the age of hybrid computing

Novel high performance computing systems that feature hybrid architectures require large scale code refactoring to unravel underlying exploitable parallelism. Such redesign can often be accompanied with machine-precision changes as the order of computation cannot always be maintained. For chaotic systems like climate models, these round-off level differences can grow rapidly. Systematic errors may also manifest initially as machine-precision differences. Isolating genuine round off level differences from such errors remains a challenge. Here, we apply two-sample equality of distribution tests to evaluate statistical reproducibility of the ocean model component of US Department of Energy's Energy Exascale Earth System Model (E3SM). A 2-year control simulation ensemble is compared to a modified ensemble as a test case - after a known non-bit-for-bit change in a model component is introduced - to evaluate the null hypothesis that the two ensembles are statistically indistinguishable. To quantify the false negative rates of these tests, we conduct a formal power analysis using a targeted suite of short simulation ensembles. The ensemble suite contains several perturbed ensembles, each with a progressively different climate than the baseline ensemble - obtained by perturbing the magnitude of a single model tuning parameter, the Gent and McWilliams κ, in a controlled manner. The null hypothesis is evaluated for each of perturbed ensembles using these tests. The power analysis informs on the detection limits of the tests for given ensemble size allowing model developers to evaluate the impact of an introduced non-bit-for-bit change to the model.

Mahajan, Salil↗
NASA NTRSDate not supplied

Spatiotemporal Analysis of High-Resolution Pressure-Sensitive Paint Measurements on a Launch Vehicle Wind Tunnel Model

An accurate understanding of unsteady aerodynamic loads is critical for launch vehicle structural design and for development of the vibro-acoustic environment for payload components. Analysts commonly use point-wise surface pressure measurements from wind tunnel testing to build statistical models of the in-flight turbulent boundary layer flow structures, often extrapolating over large swaths of the surface due to measurement sparsity. We present novel results from a transonic wind tunnel test using fast-response pressure-sensitive paint (PSP) and show how it can be used to visualize and quantify localized turbulent boundary layer wall pressure statistics with unprecedented spatial resolution. The wind tunnel model is a scaled model of the Space Launch System (SLS) rocket Block 1B Crew configuration and analysis focused on the compression corner between the Service Module fairing and the Universal Stage Adapter.

Corcos Model↗
NASA NTRS2004

Novel Image Processing Interface to Relate DSB Spatial Distribution from Immunofluorescence Foci Experiments to the State-of-the-Art Models of DNA Breakage

A recently developed software (NASARadiationTrackImage) allows a quick and automatic segmentation of foci that indicate spatial localization of specific proteins that are visualized by immunofluorescence. Of interest are the spatial and temporal distribution of foci such as gammaH2AX, a signal of the phosphorylation of a variant of the histone H2A that has been shown to correspond to DSBs, or proteins involved in DSB processing, such as ATM, Rad51, and p53, following exposures of human cells to high charge and energy (HZE) ion irradiation. Experimental data are recorded as sets of two-dimensional images in color with cells and foci of gammaH2AX, ATM, Rad51 or others shown. Different cells, levels of radiation and timing after radiation were recorded. The software allows us to calculate the number of foci per cell, overall intensity of light in foci and their spatial organization. A simple statistical model allows for testing of foci overlap (eclipse). A more complex statistical model previously known as DNAbreak simulates track structure and random chromosome geometry. It has one adjustable parameter corresponding to an average intensity of DSB creation in cubic micrometers of DNA volume per particle track or unit dose. Its limitation is the low-resolution limit both in physical space and DSB's along DNA. It works adequately on the scale of a cell and provides further insights on how the geometry of tracks and DNA affects genomic damage of the cell and subsequent repair. Future developments of the model for the description of the time evolution of DNA damage response proteins, and more robust track structure models will be discussed.

Ponomarev, A. L.↗
NASA NTRS2010

Statistical Analysis of a Large Sample Size Pyroshock Test Data Set Including Post Flight Data Assessment

The Earth Observing System (EOS) Terra spacecraft was launched on an Atlas IIAS launch vehicle on its mission to observe planet Earth in late 1999. Prior to launch, the new design of the spacecraft's pyroshock separation system was characterized by a series of 13 separation ground tests. The analysis methods used to evaluate this unusually large amount of shock data will be discussed in this paper, with particular emphasis on population distributions and finding statistically significant families of data, leading to an overall shock separation interface level. The wealth of ground test data also allowed a derivation of a Mission Assurance level for the flight. All of the flight shock measurements were below the EOS Terra Mission Assurance level thus contributing to the overall success of the EOS Terra mission. The effectiveness of the statistical methodology for characterizing the shock interface level and for developing a flight Mission Assurance level from a large sample size of shock data is demonstrated in this paper.

Hughes, William O.↗
DOE OSTI2024

Improved Subseasonal Forecasting of Extreme Polar Vortices Using Machine Learning

Our research was focused on forecasting the position and shape of the winter stratospheric polar vortex at a subseasonal timescale of 15 days in advance. To achieve this, we employed both statistical and neural network machine learning techniques. The analysis was performed on 42 winter seasons of reanalysis data provided by NASA giving us a total of 6,342 days of data. The state of the polar vortex for determined by using geometric moments to calculate the centroid latitude and the aspect ratio of an ellipse fit onto the vortex. Timeseries for thirty additional precursors were calculated to help improve the predictive capabilities of the algorithm. Feature importance of these precursors was performed using random forest to measure the predictive importance and the ideal number of precursors. Then, using the precursors identified as important, various statistical methods were tested for predictive accuracy with random forest and nearest neighbor performing the best. An echo state network, a type of recurrent neural network that features sparsely connected hidden layer and a reduced number of trainable parameters that allows for rapid training and testing, was also implemented for the forecasting problem. Hyperparameter tuning was performed for each methods using a subset of the training data. The algorithms were trained and tuned on the first 41 years of data, then tested for accuracy on the final year. In general, the centroid latitude of the polar vortex proved easier to predict than the aspect ratio across all algorithms. Random forest outperformed other statistical forecasting algorithms overall but struggled to predict extreme values. Forecasting from echo state network suggested a strong predictive capability past 15 days, but further work is required to fully realize the potential of recurrent neural network approaches.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

High-Throughput Statistical Interrogation of Mechanical Properties with Build Plate Location and Powder Reuse in AlSi10Mg

Abstract Additive manufacturing (AM) allows agile, rapid manufacturing of geometrically complex components that would otherwise be impossible through traditional manufacturing methods. With this maturing manufacturing technology comes the need to adopt testing methods that are commensurate with the speed of additive manufacturing and take advantage of its geometric flexibility. High-throughput tensile testing (HTT) is a technique that allows a large number of tensile bars to be tested in a short amount of time. In the present study, HTT is used to evaluate AM AlSi10Mg produced using powder bed fusion with a Renishaw AM250 machine. Three parameters were varied in this study: (1) powder reuse history, (2) location on the build plate, and (3) size of the tensile specimen. For all parameter combinations, at least 22 specimens were tested; in several cases, over 40 were tested. This large dataset, consisting of over 500 tensile tests, permits Weibull statistical analysis and provides sufficient fidelity to isolate subtle trends that would have likely been missed in smaller, traditional datasets. The observed trends are rationalized in terms of the role of porosity and surface crust on mechanical response.

Carroll, Jay D. (ORCID:0000000258184709)↗
NASA NTRS2018

Structural Certification of Human-Rated Inflatable Space Structures

This paper details the results of an initial study to develop a certification plan for human-rated inflatable space structures, including guidelines for qualification testing. Habitable softgoods inflatables are multi-layered shell structures that use high-strength webbing, cordage and broadcloth fabric to carry the skin loads of a variety of volumetric shapes and structural architectures. The primary objectives of this study are to define the key parameters that affect these structures and propose a statistically robust approach to defining safety and knockdown factors based on test and analysis. Current NASA standards for habitable inflatable space structures use a factor of safety of 4, which was inherited from airship design criteria. An updated approach to defining a design factor, taking into account material strength variability, load variability in the article, number of test samples, and damage and degradation effects is specified. Accurate analytical modeling of these structures is hindered by the difficulty of obtaining accurate and consistent material data due to load-history- dependent, nonlinear load versus strain behavior. A building block approach to certification is detailed that uses stochastic modeling and statistical test design and analysis to address the unique challenges these high-strength softgoods structures present. Human-rated inflatable modules are a transformative capability for launching much larger habitable volumes into space than is possible with rigid shell structures. This research aims to provide the framework for certifying these structures for future human space exploration missions.

Jones, Thomas C.↗
NASA NTRS2006

An Analytical Thermal Model for Autonomous Soaring Research

A viewgraph presentation describing an analytical thermal model used to enable research on autonomous soaring for a small UAV aircraft is given. The topics include: 1) Purpose; 2) Approach; 3) SURFRAD Data; 4) Convective Layer Thickness; 5) Surface Heat Budget; 6) Surface Virtual Potential Temperature Flux; 7) Convective Scaling Velocity; 8) Other Calculations; 9) Yearly trends; 10) Scale Factors; 11) Scale Factor Test Matrix; 12) Statistical Model; 13) Updraft Strength Calculation; 14) Updraft Diameter; 15) Updraft Shape; 16) Smoothed Updraft Shape; 17) Updraft Spacing; 18) Environment Sink; 19) Updraft Lifespan; 20) Autonomous Soaring Research; 21) Planned Flight Test; and 22) Mixing Ratio.

Allen, Michael↗
NASA NTRS1989

Evaluation of cloud detection instruments and performance of laminar-flow leading-edge test articles during NASA Leading-Edge Flight-Test Program

Summary evaluations of the performance of laminar-flow control (LFC) leading edge test articles on a NASA JetStar aircraft are presented. Statistics, presented for the test articles' performance in haze and cloud situations, as well as in clear air, show a significant effect of cloud particle concentrations on the extent of laminar flow. The cloud particle environment was monitored by two instruments, a cloud particle spectrometer (Knollenberg probe) and a charging patch. Both instruments are evaluated as diagnostic aids for avoiding laminar-flow detrimental particle concentrations in future LFC aircraft operations. The data base covers 19 flights in the simulated airline service phase of the NASA Leading-Edge Flight-Test (LEFT) Program.

Davis, Richard E.↗
NASA NTRS2016

Characterization of Carbon Dioxide Washout Measurement Techniques in the Mark-III Space Suit

A space suit must provide adequate carbon dioxide (CO2) washout inside the helmet to prevent symptoms of hypercapnia. In the past, an oronasal mask has been used to measure the inspired air of suited subjects to determine a space suit's CO2 washout capability. While sufficient for super-ambient pressure testing of space suits, the oronasal mask fails to meet several human factors and operational criterion needed for future sub-ambient pressure testing (e.g. compatibility with a Valsalva device). This paper describes the evaluation of a nasal cannula as a device for measuring inspired air within a space suit. Eight test subjects were tasked with walking on a treadmill or operating an arm ergometer to achieve target metabolic rates of 1000, 2000, and 3000 British thermal units per hour (BTU/hr), at flow rates of 2, 4, and 6 actual cubic feet per minute (ACFM). Each test configuration was conducted twice, with subjects instructed to breathe either through their nose only, or however they felt comfortable. Test data shows that the nasal cannula provides more statistically consistent data across test subjects than the oronasal mask used in previous tests. The data also shows that inhaling/exhaling through only the nose provides a lower sample variance than a normal breathing style. Nose-only breathing reports better CO2 washout due to several possible reasons, including a decreased respiratory rate, an increased tidal volume, and because nose-only breathing directs all of the exhaled CO2 down and away from the oronasal region. The test subjects in this study provided feedback that the nasal cannula is comfortable and can be used with the Valsalva device.

Meginnis, Ian M.↗
NASA NTRS2026

Mechanical Properties of Carbon Fiber Reinforced Composites Exposed to Cryogenic Conditions and Space Radiation via Simulation and Testing

As NASA missions extend beyond low Earth orbit, increasing reliance is placed on carbon fiber reinforced polymer (CFRP) composites for spacecraft structures where mass efficiency, durability, and long-term reliability are critical. In service, these materials are subjected to a combination of ultraviolet radiation, vacuum, ionizing radiation, atomic oxygen, and extreme thermal excursions under sustained mechanical loading. Flight systems such as the Boeing Starliner and SpaceX Dragon employ external composite structures that will experience these environments for extended durations. Although prior spaceflight and ground studies have reported limited changes in bulk mechanical properties, the synergistic effects of these environments on composite microstructure, particularly at the fiber matrix interphase, remain insufficiently characterized and represent a potential qualification and reliability risk. This study investigates the effects of short-term cryogenic exposure on a radiation shielding carbon epoxy composite, SC2020, as a ground-based analog for space relevant thermal extremes. The SC2020 material system has previously flown on the International Space Station under the Materials International Space Station Experiment (MISSE) program. Composite specimens were exposed to liquid nitrogen for 6 and 24 hours and evaluated using a multiscale characterization framework that combined ASTM D3039 tensile testing, Atomic Force Microscopy (AFM) based interphase analysis, and helium gas permeability measurements. Tensile testing showed no statistically significant or permanent degradation in global strength or modulus following cryogenic exposure. In contrast, AFM measurements revealed reductions in interphase modulus, weakened adhesion, and increased nanoscale heterogeneity, indicating localized degradation mechanisms not captured by conventional bulk testing. Gas permeability measurements showed a progressive increase in helium diffusion with exposure duration, consistent with micro-void formation or partial interfacial debonding. The results indicate that cryogenic exposure initiates degradation at the fiber matrix interphase while leaving global mechanical properties largely unchanged over short durations. These findings underscore the importance of multiscale diagnostics for identifying early-stage damage mechanisms that may influence long term performance and qualification margins for spaceflight composite structures. The data presented establish a cryogenic baseline for comparison with forthcoming MISSE flight exposure results and support ongoing NASA Established Program to Stimulate Competitive Research (EPSCoR) efforts aimed at improving composite qualification methodologies, risk assessment, and reliability prediction for space environments.

composite reliability↗
NASA NTRS2001

Normal and abnormal tissue identification system and method for medical images such as digital mammograms

A system and method for analyzing a medical image to determine whether an abnormality is present, for example, in digital mammograms, includes the application of a wavelet expansion to a raw image to obtain subspace images of varying resolution. At least one subspace image is selected that has a resolution commensurate with a desired predetermined detection resolution range. A functional form of a probability distribution function is determined for each selected subspace image, and an optimal statistical normal image region test is determined for each selected subspace image. A threshold level for the probability distribution function is established from the optimal statistical normal image region test for each selected subspace image. A region size comprising at least one sector is defined, and an output image is created that includes a combination of all regions for each selected subspace image. Each region has a first value when the region intensity level is above the threshold and a second value when the region intensity level is below the threshold. This permits the localization of a potential abnormality within the image.

Heine, John J.↗
NASA NTRS2013

What Reliability Engineers Should Know about Space Radiation Effects

Space radiation in space systems present unique failure modes and considerations for reliability engineers. Radiation effects is not a one size fits all field. Threat conditions that must be addressed for a given mission depend on the mission orbital profile, the technologies of parts used in critical functions and on application considerations, such as supply voltages, temperature, duty cycle, and redundancy. In general, the threats that must be addressed are of two types-the cumulative degradation mechanisms of total ionizing dose (TID) and displacement damage (DD). and the prompt responses of components to ionizing particles (protons and heavy ions) falling under the heading of single-event effects. Generally degradation mechanisms behave like wear-out mechanisms on any active components in a system: Total Ionizing Dose (TID) and Displacement Damage: (1) TID affects all active devices over time. Devices can fail either because of parametric shifts that prevent the device from fulfilling its application or due to device failures where the device stops functioning altogether. Since this failure mode varies from part to part and lot to lot, lot qualification testing with sufficient statistics is vital. Displacement damage failures are caused by the displacement of semiconductor atoms from their lattice positions. As with TID, failures can be either parametric or catastrophic, although parametric degradation is more common for displacement damage. Lot testing is critical not just to assure proper device fi.mctionality throughout the mission. It can also suggest remediation strategies when a device fails. This paper will look at these effects on a variety of devices in a variety of applications. This paper will look at these effects on a variety of devices in a variety of applications. (2) On the NEAR mission a functional failure was traced to a PIN diode failure caused by TID induced high leakage currents. NEAR was able to recover from the failure by reversing the current of a nearby Thermal Electric Cooler (turning the TEC into a heater). The elevated temperature caused the PIN diode to anneal and the device to recover. It was by lot qualification testing that NEAR knew the diode would recover when annealed. This paper will look at these effects on a variety of devices in a variety of applications. Single Event Effects (SEE): (1) In contrast to TID and displacement damage, Single Event Effects (SEE) resemble random failures. SEE modes can range from changes in device logic (single-event upset, or SEU). temporary disturbances (single-event transient) to catastrophic effects such as the destructive SEE modes, single-event latchup (SEL). single-event gate rupture (SEGR) and single-event burnout (SEB) (2) The consequences of nondestructive SEE modes such as SEU and SET depend critically on their application--and may range from trivial nuisance errors to catastrophic loss of mission. It is critical not just to ensure that potentially susceptible devices are well characterized for their susceptibility, but also to work with design engineers to understand the implications of each error mode. -For destructive SEE, the predominant risk mitigation strategy is to avoid susceptible parts, or if that is not possible. to avoid conditions under which the part may be susceptible. Destructive SEE mechanisms are often not well understood, and testing is slow and expensive, making rate prediction very challenging. (3) Because the consequences of radiation failure and degradation modes depend so critically on the application as well as the component technology, it is essential that radiation, component. design and system engineers work togetherpreferably starting early in the program to ensure critical applications are addressed in time to optimize the probability of mission success.

DiBari, Rebecca↗
NASA NTRS2003

Automated Monitoring with a BCP Fault-Decision Test

The Bayesian conditional probability (BCP) technique is a statistical fault-decision technique that is suitable as the mathematical basis of the fault-manager module in the automated-monitoring system and method described in the immediately preceding article. Within the automated-monitoring system, the fault-manager module operates in conjunction with the fault-detector module, which can be based on any one of several fault-detection techniques; examples include a threshold-limit-comparison technique or the BSP or SPRT technique mentioned in the preceding article. The present BCP technique is used to evaluate a series of one or more fault-detection events for the purpose of filtering out occasional false alarms produced by many types of statistical fault-detection procedures. The BCP technique increases the probability that an automated monitoring system produces a correct decision regarding the presence or absence of a fault. Because occasional false alarms are an inevitable consequence of the SPRT, BSP, or any other statistically based fault-detection test, there is a need for a logical procedure to distinguish between true and false alarms. Heretofore, it has been common practice to make a fault decision on an ad hoc basis for example by following a multiple-observation voting strategy in which a signal is declared to be indicative of a fault if m of the last n observations produced a fault-detection alarm. The BCP technique was developed to obtain results more reliable than those afforded by a voting strategy. The BCP technique involves a test in which one applies Bayesian inference techniques to a series of one or more single-observation alarms produced by a fault-detection test. One considers the last n decisions generated by a fault-detection test in order to evaluate the conditional probability that a failure is indicated (see figure). Each new decision reached by a fault-detection test is treated as a new piece of evidence about the state of the monitored asset, and the conditional probability of failure for the system is updated on the basis of this new evidence. The conditional probability of failure is compared with a predefined limit. For a probability below the limit, the asset is declared to be healthy. For a probability above the limit, the asset is declared to be faulty.

Bickford, Randall L.↗
NASA NTRS2007

Offset Stream Technology Test-Summary of Results

Statistical jet noise prediction codes that accurately predict spectral directivity for both cold and hot jets are highly sought both in industry and academia. Their formulation, whether based upon manipulations of the Navier-Stokes equations or upon heuristic arguments, require substantial experimental observation of jet turbulence statistics. Unfortunately, the statistics of most interest involve the space-time correlation of flow quantities, especially velocity. Until the last 10 years, all turbulence statistics were made with single-point probes, such as hotwires or laser Doppler anemometry. Particle image velocimetry (PIV) brought many new insights with its ability to measure velocity fields over large regions of jets simultaneously; however, it could not measure velocity at rates higher than a few fields per second, making it unsuitable for obtaining temporal spectra and correlations. The development of time-resolved PIV, herein called TR-PIV, has removed this limitation, enabling measurement of velocity fields at high resolution in both space and time. In this paper, ground-breaking results from the application of TR-PIV to single-flow hot jets are used to explore the impact of heat on turbulent statistics of interest to jet noise models. First, a brief summary of validation studies is reported, undertaken to show that the new technique produces the same trusted results as hotwire at cold, low-speed jets. Second, velocity spectra from cold and hot jets are compared to see the effect of heat on the spectra. It is seen that heated jets possess 10 percent more turbulence intensity compared to the unheated jets with the same velocity. The spectral shapes, when normalized using Strouhal scaling, are insensitive to temperature if the stream-wise location is normalized relative to the potential core length. Similarly, second order velocity correlations, of interest in modeling of jet noise sources, are also insensitive to temperature as well.

Brown, Clifford A.↗
NASA NTRS2015

Leak Rate Quantification Method for Gas Pressure Seals with Controlled Pressure Differential

An enhancement to the pressure decay leak rate method with mass point analysis solved deficiencies in the standard method. By adding a control system, a constant gas pressure differential across the test article was maintained. As a result, the desired pressure condition was met at the onset of the test, and the mass leak rate and measurement uncertainty were computed in real-time. The data acquisition and control system were programmed to automatically stop when specified criteria were met. Typically, the test was stopped when a specified level of measurement uncertainty was attained. Using silicone O-ring test articles, the new method was compared with the standard method that permitted the downstream pressure to be non-constant atmospheric pressure. The two methods recorded comparable leak rates, but the new method recorded leak rates with significantly lower measurement uncertainty, statistical variance, and test duration. Utilizing this new method in leak rate quantification, projects will reduce cost and schedule, improve test results, and ease interpretation between data sets.

seal↗
DOE OSTI2024

Conceptual Design of Neutron Sensor Qualification Device

The Advanced Sensors and Instrumentation Program at Idaho National Laboratory has been formulating strategies to qualify sensors for use in nuclear environments, particularly in irradiation experiments and advanced reactors. When qualifying neutron sensors for use in high-temperature environments, the wide range of neutron flux levels and representative energy spectra presents significant challenges. This paper discusses the development of the Neutron Sensor Qualification Device (NQD), which is designed to test neutron sensors in high temperature controlled environments with known neutron spectra, addressing the spatial and spectral complexities of neutron fluxes in reactor cores. The proposed NQD will be situated in the exposure room at the Armed Forces Radiobiology Research Institute, thus affording a unique capability to expose sensors to high neutron and gamma fluxes. To achieve thermal control, the device will utilize a radiation-hardened tube furnace, accommodating multiple sensors and neutron activation dosimetry wires. Titanium, iron, and cobalt dosimeter wires are chosen from the American Society for Testing and Materials and International Reactor Dosimetry and Fusion File libraries as references for providing energy-dependent fluence measurements. The design ensures precise sensor positioning to minimize mutual shielding and flux perturbation, which are evaluated via Monte Carlo N particle Transport Code (MCNP) simulations. These simulations have informed the development of guidelines on sensor placement within the NQD. The NQD is essential to the qualification of neutron sensors for advanced reactor technologies. It enables controlled testing of a statistically significant number of sensors, thereby supporting assessments of sensor performance across various neutron flux levels and temperatures. This paper highlights the detailed planning for the NQD prototype, along with its inaugural irradiation (scheduled for fiscal year [FY] 2025). The results from this initial testing will be fundamental in evaluating the device’s performance and establishing measurement uncertainty for in-pile neutron sensor measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗