Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistically designed experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Evaluation of Correction Methods for NASA GeneLab Transcriptomic Datasets

Conducting space biology experiments aboard the International Space Station, particularly those utilizing complex model organisms like mice, is expensive and difficult due to limited crew availability, hardware, and space. As a result, sample numbers from these studies are low, reducing the statistical power of any one experiment. Aggregating spaceflight datasets serves as a method to increase sample numbers, allowing for novel insights through bioinformatic analysis of ‘omics data from merged datasets. However, aggregating datasets can introduce unwanted variation including 1) differences in sample handling, processing, and sequencing platforms between datasets (technical variation) as well as 2) differences in experimental design between datasets such as sex or age of the model organism used. In the present study, NASA GeneLab-hosted RNAseq datasets from rodent liver tissues were used to evaluate several statistical methods to correct for this unwanted variation through two approaches, reference-based and standard. The following correction algorithms were applied with (reference-based) and/or without (standard) considering Universal Mouse RNA Reference samples: ComBat and ComBat_seq from the SVA package, median polish, empirical Bayes, and ANOVA-based algorithms from the MBatch package, and negative binomial regression normalization in the DESeq2 package. For each approach, after the correction algorithm was applied, differential gene expression (DGE) analysis of flight and ground control samples was performed with the combined data. The robustness of each tool was evaluated using BatchQC, to determine statistical differences between datasets before and after correction, Principal Component Analysis, to evaluate global gene expression in samples before and after correction, and by comparing DGE analysis of individual datasets and combined datasets before and after correction. The results showed that the reference-based approach introduced several additional (and likely artificial) DEGs when compared with the standard approach. Thus, the most robust standard correction will be implemented in the GeneLab Visualization 2.0 platform when datasets are combined.

GeneLab, RNA-seq, Batch Correction↗

Validating an Air Traffic Management Concept of Operation Using Statistical Modeling

Validating a concept of operation for a complex, safety-critical system (like the National Airspace System) is challenging because of the high dimensionality of the controllable parameters and the infinite number of states of the system. In this paper, we use statistical modeling techniques to explore the behavior of a conflict detection and resolution algorithm designed for the terminal airspace. These techniques predict the robustness of the system simulation to both nominal and off-nominal behaviors within the overall airspace. They also can be used to evaluate the output of the simulation against recorded airspace data. Additionally, the techniques carry with them a mathematical value of the worth of each prediction-a statistical uncertainty for any robustness estimate. Uncertainty Quantification (UQ) is the process of quantitative characterization and ultimately a reduction of uncertainties in complex systems. UQ is important for understanding the influence of uncertainties on the behavior of a system and therefore is valuable for design, analysis, and verification and validation. In this paper, we apply advanced statistical modeling methodologies and techniques on an advanced air traffic management system, namely the Terminal Tactical Separation Assured Flight Environment (T-TSAFE). We show initial results for a parameter analysis and safety boundary (envelope) detection in the high-dimensional parameter space. For our boundary analysis, we developed a new sequential approach based upon the design of computer experiments, allowing us to incorporate knowledge from domain experts into our modeling and to determine the most likely boundary shapes and its parameters. We carried out the analysis on system parameters and describe an initial approach that will allow us to include time-series inputs, such as the radar track data, into the analysis

Statistical emulation↗

Macrovoid Defect Growth during Evaporative Casting of Polymeric Membranes

Macrovoid (MV) formation is a significant problem in evaporatively cast polymeric membranes. MVs are large, elongated or teardrop-shaped pores (~10-50 micron) that can impair membrane structural integrity. Although MVs have been extensively studied, there is no general agreement on the mechanisms governing MV growth. Recently, our research group has formulated the solutocapillary convection (SC) hypothesis, which contends that MV growth involves three principal forces: a Marangoni force generated by surface tension gradients within the MV interface, a viscous drag force, and a gravitationally induced body force. Two sets of complementary experiments were conducted to test the SC hypothesis. Ground-based videomicroscopy flow-visualization (VMFV) was utilized to measure the flow velocities at the MV-casting solution interface and deep within the casting solution. The measurements were performed with casting solutions containing 10 wt% cellulose acetate (CA), 30 wt% H2O, 60 wt% acetone, and 200- ppm TiO2 particles for flow visualization, and the surface tension was controlled by surfactant addition. Qualitatively, the experiments indicated that MV growth occurs in three distinct phases: (1) a very rapid initial growth period, (2) a much slower growth phase, and (3) absorption of selected MVs into the expanding demixed region. The presence of tracer particles inside the MVs suggests the presence of a convective flow, which transfers the particles from the bulk solution to the MV interior. Although the VMFV experiments did not establish any surfactant effect on the interfacial velocities, a statistically significant effect on the MV number density was observed. In the second set of experiments, membranes were cast aboard a KC-135 aircraft under 0-g and 2-g conditions. Despite careful attention to the design and fabrication of the membrane casting apparatus (MCA), several problems were encountered, the most significant of which was the contamination of the casting solution by the activated carbon particles used for solvent absorption.

Greenberg, A. R.↗

Advanced Vibration Analysis Tools and New Strategies for Robust Design of Turbine Engine Rotors

The adverse effects of small, random structural irregularities among the blades, called mistuning, can result in blade forced-response amplitudes and stresses that are much larger than those predicted for a perfectly tuned rotor. Manufacturing tolerances, deviations in material properties, or nonuniform operational wear causes mistuning; therefore, mistuning is unavoidable. Furthermore, even a small mistuning can have a dramatic effect on the vibratory behavior of a rotor because it can lead to spatial localization of the vibration energy (see the following photographs). As a result, certain blades may experience forced response amplitudes and stresses that are substantially larger than those predicted by an analysis of the nominal (tuned) design. Unfortunately, these random uncertainties in blade properties, and the immense computational effort involved in obtaining statistically reliable design data, combine to make this aspect of rotor design cumbersome.

Min, James B.↗

Advanced Vibration Analysis Tools and New Strategies for Robust Design of Turbine Engine Rotors

The adverse effects of small, random structural irregularities among the blades, called mistuning, can result in blade forced-response amplitudes and stresses that are much larger than those predicted for a perfectly tuned rotor. Manufacturing tolerances, deviations in material properties, or nonuniform operational wear causes mistuning; therefore, mistuning is unavoidable. Furthermore, even a small mistuning can have a dramatic effect on the vibratory behavior of a rotor because it can lead to spatial localization of the vibration energy (see the following photographs). As a result, certain blades may experience forced response amplitudes and stresses that are substantially larger than those predicted by an analysis of the nominal (tuned) design. Unfortunately, these random uncertainties in blade properties, and the immense computational effort involved in obtaining statistically reliable design data, combine to make this aspect of rotor design cumbersome.

Min, James B.↗

Improving Metallic Thermal Protection System Hypervelocity Impact Resistance Through Design of Experiments Approach

A design of experiments approach has been implemented using computational hypervelocity impact simulations to determine the most effective place to add mass to an existing metallic Thermal Protection System (TPS) to improve hypervelocity impact protection. Simulations were performed using axisymmetric models in CTH, a shock-physics code developed by Sandia National Laboratories, and validated by comparison with existing test data. The axisymmetric models were then used in a statistical sensitivity analysis to determine the influence of five design parameters on degree of hypervelocity particle dispersion. Several damage metrics were identified and evaluated. Damage metrics related to the extent of substructure damage were seen to produce misleading results, however damage metrics related to the degree of dispersion of the hypervelocity particle produced results that corresponded to physical intuition. Based on analysis of variance results it was concluded that the most effective way to increase hypervelocity impact resistance is to increase the thickness of the outer foil layer. Increasing the spacing between the outer surface and the substructure is also very effective at increasing dispersion.

Poteet, Carl C.↗

Preliminary Experiments for the Assessment of V/W-band Links for Space-Earth Communications

Since September 2012, NASA Glenn Research Center has deployed a microwave profiling radiometer at White Sands, NM, to estimate atmospheric propagation effects on communications links in the V and W bands (71-86GHz). Estimates of attenuation statistics in the millimeter wave due to gaseous and cloud components of the atmosphere show good agreement with current ITU-R models, but fail to predict link performance in the presence of moderate to heavy rain rates, due to the inherent limitations of passive radiometry. Herein, we discuss the preliminary results of these measurements and describe a design for a terrestrial link experiment to validate/refine existing rain attenuation models in the V/Wbands.

propagation↗

Fatigue failure of materials under narrow band random vibrations. I.

A novel approach for the study of fatigue failure of materials under the multifactor influence of narrow band random vibrations is developed. The approach involves the conduction of an experiment in conjunction with various statistical techniques. Three factors including two statistical properties of the excitation or response are considered and varied simultaneously. A minimum of 6 tests for 3 variables is possible for a fractional f actorial design. The four coefficients of the predicting equation can be independently estimated. A look at 3 predicting equations shows the predominant effect of the root mean square stress of the first order equation.

Huang, T. C.↗

Study of the effect of cloud inhomogeneity on the earth radiation budget experiment

The Earth Radiation Budget Experiment (ERBE) is the most recent and probably the most intensive mission designed to gather precise measurements of the Earth's radiation components. The data obtained from ERBE is of great importance for future climatological studies. A statistical study reveals that the ERBE scanner data are highly correlated and that instantaneous measurements corresponding to neighboring pixels contain almost the same information. Analyzing only a fraction of the data set when sampling is suggested and applications of this strategy are given in the calculation of the albedo of the Earth and of the cloud-forcing over ocean.

Smith, Phillip J.↗

Convective Systems Observed and Simulated During TRMM Field Campaigns

Recently completed TRMM field campaigns (TEFLUN1998, SCSMEX-1998, TRMM.LBA-1999, and KWAJEX 1999) have obtained direct measurements of microphysical data associated with convective systems from various geographical locations. These TRMM field experiments were designed to contribute to fundamental understanding of cloud dynamics and microphysics, as well as for validation,, testing assumptions and error estimates of cloud-resolving models, forward radiative transfer models, algorithms used to estimate rainfall statistics and vertical structure of precipitation and latent heating from both surface-based radar and satellites.

Tao, Wei-Kuo↗

Preliminary Experiments for the Assessment of VW-Band Links for Space-Earth Communications

Since September 2012, NASA Glenn Research Center has deployed a microwave profiling radiometer at White Sands, NM, to estimate atmospheric propagation effects on communications links in the V and W bands (71-86GHz). Estimates of attenuation statistics in the millimeter wave due to gaseous and cloud components of the atmosphere show good agreement with current ITU-R models, but fail to predict link performance in the presence of moderate to heavy rain rates, due to the inherent limitations of passive radiometry. Herein, we discuss the preliminary results of these measurements and describe a design for a terrestrial link experiment to validaterefine existing rain attenuation models in the VW-bands.

terrestrial milimeterwave experiments↗

Metrology Optical Power Budgeting in SIM Using Statistical Analysis Techniques

The Space Interferometry Mission (SIM) is a space-based stellar interferometry instrument, consisting of up to three interferometers, which will be capable of micro-arc second resolution. Alignment knowledge of the three interferometer baselines requires a three-dimensional, 14-leg truss with each leg being monitored by an external metrology gauge. In addition, each of the three interferometers requires an internal metrology gauge to monitor the optical path length differences between the two sides. Both external and internal metrology gauges are interferometry based, operating at a wavelength of 1319 nanometers. Each gauge has fiber inputs delivering measurement and local oscillator (LO) power, split into probe-LO and reference-LO beam pairs. These beams experience power loss due to a variety of mechanisms including, but not restricted to, design efficiency, material attenuation, element misalignment, diffraction, and coupling efficiency. Since the attenuation due to these sources may degrade over time, an accounting of the range of expected attenuation is needed so an optical power margin can be book kept. A method of statistical optical power analysis and budgeting, based on a technique developed for deep space RF telecommunications, is described in this paper and provides a numerical confidence level for having sufficient optical power relative to mission metrology performance requirements.

stellar interferometry↗

The X-43A Flight Research Program: Lessons Learned on the Road to Mach 10

During an aerospace engineer's undergraduate studies, he or she will attend classes in aerodynamics, thermodynamics, structures, stability and control, dynamics, design, propulsion, and computer science, along with the related courses in mathematics, physics, statistics, and chemistry required to understand the material. Upon graduation, the new engineer will have acquired a basic knowledge of how to build an aerospace vehicle. What only comes through experience, however, is the understanding of the inevitable imperfect process through which an aerospace vehicle is built. This is the adventure of turning a basic concept into functional hardware. Engineers working on a project must often deal with ambiguous situations. They are routinely asked by management to provide risk assessments of a project, yet even after careful analysis uncertainties remain. The project must be accomplished within finite limits of time and money. The question an engineer answers is whether the solution to potential problem is worth the cost and schedule delay, or if the solution might actually be worse than the problem it is meant to solve. Review protocols are established to ensure that an unknown has not been overlooked. But these cannot protect against an unknown unknown. Examples of these situations can be found in the history of the X-43A Hyper-X (Hypersonic Experiment) program. In this NASA project, a supersonic combustion ramjet (scramjet) engine was flight tested on a subscale vehicle. The X-43A Hyper-X Research Vehicle (HXRV) was launched from a B-52B mothership, then boosted to the test speed by a modified Pegasus rocket first stage, called the Hyper-X Launch Vehicle (HXLV). Once at the proper speed and altitude, the X-43A separated from the booster, stabilized itself, and then the engine test began. Although wind-tunnel scramjet engine tests had begun in the late 1950s, before the Hyper-X program there had never been an actual in-flight test of such an engine integrated with an appropriate airframe. Thus, while the scramjet had successfully operated in the artificial airflow of wind tunnels, the concept had yet to be proven in real air. These conditions meant changes in density and temperature, as well as changes in angle of attack and sideslip of a free-flying vehicle. A wind tunnel is limited in its ability to simulate these subtle factures, which have a major impact on almost any vehicle, but especially that of a scramjet's performance. The Hyper-X project was to provide a real-world benchmark of the ground test data. The full scale X-43A engine would be operated in the wind tunnel, and then flown, and the data from its operation would then be compared with projections. If these matched, the wind tunnel data would be considered a reliable design tool for future scramjet. If there were significant differences, the reasons for these would have to be identified. Until such information was available, scramjets would lack the technological maturity to be considered for future space launch or high-speed atmospheric flight vehicles.

Peebles, Curtis↗

Increases in Future AR Count and Size: Overview of 2 the ARTMIP Tier 2 CMIP5/6 Experiment

The Atmospheric River (AR) Tracking Method Intercomparison Project (ARTMIP) is a community effort to systematically assess how the uncertainties from AR detectors (ARDTs) impact our scientific understanding of ARs. This study describes the ARTMIP Tier 2 experimental design and initial results using the Coupled Model Intercomparison Project (CMIP) Phases 5 and 6 multi-model ensembles. We show that AR statistics from a given ARDT in CMIP5/6 historical simulations compare remarkably well with the MERRA-2 reanalysis. In CMIP5/6 future simulations, most ARDTs project a global increase in AR frequency, counts, and sizes, especially along the western coastlines of the Pacific and Atlantic oceans. We find that the choice of ARDT is the dominant contributor to the uncertainty in projected AR frequency when compared with model choice. These results imply that new projects investigating future changes in ARs should explicitly consider ARDT uncertainty as a core part of the experimental design. Plain Language Summary: Atmospheric rivers (ARs) are a type of weather pattern known to be important for moving water vapor from the warm, moist tropics to the cool, dry polar regions; when they reach midlatitudes in the winter time, they are commonly associated with heavy precipitation. Recent studies that assess the impacts of global climate change on ARs tend to agree that there will be more ARs in a warmer climate, and that ARs will tend to be more extreme. However, it has been increasingly recognized by the AR research community that these results may depend on the method used to identify ARs and the choice of climate model. This study reports results from a controlled experiment, involving an international research community, that aims to show how different AR identification methods and climate models might impact our scientific understanding of ARs in the future. This experiment shows that there will likely be more ARs in the future, and that ARs will generally have a larger spatial footprint. This experiment also shows that uncertainty in these results are large, with the uncertainty from AR identification methods outweighing that of climate models. Future efforts to better understand the physics of ARs may help us reduce this uncertainty.

T A OBrien↗

Development of NASA's Accident Precursor Analysis Process Through Application on the Space Shuttle Orbiter

Accident Precursor Analysis (APA) serves as the bridge between existing risk modeling activities, which are often based on historical or generic failure statistics, and system anomalies, which provide crucial information about the failure mechanisms that are actually operative in the system. APA docs more than simply track experience: it systematically evaluates experience, looking for under-appreciated risks that may warrant changes to design or operational practice. This paper presents the pilot application of the NASA APA process to Space Shuttle Orbiter systems. In this effort, the working sessions conducted at Johnson Space Center (JSC) piloted the APA process developed by Information Systems Laboratories (ISL) over the last two years under the auspices of NASA's Office of Safety & Mission Assurance, with the assistance of the Safety & Mission Assurance (S&MA) Shuttle & Exploration Analysis Branch. This process is built around facilitated working sessions involving diverse system experts. One important aspect of this particular APA process is its focus on understanding the physical mechanism responsible for an operational anomaly, followed by evaluation of the risk significance of the observed anomaly as well as consideration of generalizations of the underlying mechanism to other contexts. Model completeness will probably always be an issue, but this process tries to leverage operating experience to the extent possible in order to address completeness issues before a catastrophe occurs.

Maggio, Gaspare↗

Directed Design of Experiments (DOE) for Determining Probability of Detection (POD) Capability of NDE Systems (DOEPOD)

This viewgraph presentation reviews some of the problems that are encountered by designers of Non-Destructive Examination (NDE) have in determining the probability of detection. According to the author "[the] NDE community should not blindly accept statistical results due to lack of knowledge." This is an attempt to bridge the gap between people doing NDE, and statisticians.

Generazio, Edward R.↗

AAFE man-made noise experiment project. Volume 1: Introduction experiment definition and requirements

An experiment was conducted to measure and map the man-made radio frequency emanations which exist at earth orbital altitudes. The major objectives of the program are to develop a complete conceptual experiment and developmental hardware for the collection and processing of data required to produce meaningful statistics on man-made noise level variations as functions of time, frequency, and geographic location. A wide dispersion measurement receiver mounted in a spacecraft operating in a specialized orbit is used to obtain the data. A summary of the experiment designs goals and constraints is provided. The recommended orbit for the spacecraft is defined. The characteristics of the receiver and the antennas are analyzed.

Source record↗

Statistical learning framework for safety and failure analysis of a DNN-based autonomous aircraft system

Deep Neural Networks (DNNs) and Machine Learning technology is increasingly used for safety-critical applications in the Aerospace domain. To ensure safe operations, the DNN and the system must undergo rigorous verification and validation, including advanced statistical analyses. Performance and safety of the DNN and system behavior must not only be analyzed for the nominal case, but under numerous off-nominal and failure cases. In this paper we will describe how our statistical learning framework SYSAI can efficiently perform such analyses using the tool’s unique combination of advanced learning modeling and statistical analysis techniques. SYSAI can effectively explore the high-dimensional state and failure space of the system under test; geometrical shape detection of safety regions and boundaries support explainability of the results to the designer. In this paper, we report experiments and results obtained with a vision-based DNN control system (ACT) that is capable of autonomously steering an aircraft down a runway.

Yuning He↗