Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistically designed experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Prediction of spout diameter in gas-solid spouted beds using factorial design of experiments approach with the aid of advanced optical fibre probe

In this study, the effects of five operating and design variables (solid density, static bed height, particle diameter, superficial gas velocity, and inlet diameter) on the average spout diameter of a 0.152 m inside diameter gas-solid spouted bed have been assessed experimentally using advanced gas-solid optical fibre probe technique. Statistical analysis of the experimental data including the factorial design of the experiments using MINITAB17 statistical software has been performed to determine the extent of the effects of these variables on the spout diameter as a case study. It was found that all five operating and design variables, except the solid density together with the 2-ways interactions between particles size and inlet diameter, in addition to gas velocity and inlet diameter, have a significant effect on the average spout diameter. Regression analysis was performed to correlate these variables with the average spout diameter for the gas-solid spouted beds. The obtained preliminary regression correlation was able to closely predict the average spout diameter of this work with the mean relative deviation value of 0.7 %.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Use of Design of Experiments in Determining Neural Network Architectures for Loss of Control Detection

Abstract—We describe empirical methods for selecting a neural network architecture to implement belief state inference on generic commercial transport aircraft. We highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). Our main contribution is the application of a structured method that can be used for machine learning in many aerospace applications. This method optimizes the structure and training parameters of a neural network for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE analysis was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from the NASA T-2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications.

neural networks↗

Use of Design of Experiments in Determining Neural Network Architectures for Loss of Control Detection

We describe empirical methods for selecting a neural network architecture to implement belief state inference on generic commercial transport aircraft. We highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). Our main contribution is the application of a structured method that can be used for machine learning in many aerospace applications. This method optimizes the structure and training parameters of a neural network for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE analysis was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from the NASA T 2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications.

Loss of Control↗

Use of Design of Experiments in Determining Neural Network Architectures for Loss of Control Detection

We describe empirical methods for selecting a neural network architecture to implement belief state inference on generic commercial transport aircraft. We highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). Our main contribution is the application of a structured method that can be used for machine learning in many aerospace applications. This method optimizes the structure and training parameters of a neural network for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE analysis was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from the NASA T-2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications.

Loss of Control↗

Wind Tunnel Investigation of the Supersonic Stage Separation Aerodynamics of a Generic 0.0175-Scale Bimese Two-Stage-to-Orbit Reusable Launch Vehicle Configuration

A wind tunnel investigation was conducted of the supersonic stage separation aerodynamics of a generic two-stage-to-orbit bimese wingbody configuration in the NASA Langley Research Center Unitary Plan Wind Tunnel. Proximity and isolated model testing was conducted at Mach numbers of 2.3, 3.0, and 4.5 and a unit Reynolds number of 2.0 million per foot using 0.0175-scale models of the Langley Glide-Back Booster concept designated as the orbiter and booster in belly-to-belly and back-to-belly configurations. Longitudinal forces and moments were obtained on both models and surface static pressure measurements were obtained on the orbiter model at 328 relative proximity locations and at relative angles of attack of 0 degrees and 5 degrees. The test results supported a larger effort to develop and validate experimental and computational tools applicable to the design and simulation of stage separation and abort procedures for reusable launch vehicles composed of multiple bodies, including winged bodies. An initial proof-of-concept experiment featuring low-cost uninstrumented models was conducted to verify an emerging automated model control system and new support system hardware, and to identify potential model and support system blockage and unsteady aerodynamics/model dynamics prior to committing to higher-fidelity instrumented models. This investigation led to upgrades in the facility stage separation hardware, calibration and testing techniques and capabilities, and data analysis and documentation methodologies that have been extended to the more recent NASA Constellation and Space Launch System crew and cargo launch vehicle programs. A virtual diagnostics interface methodology was used to facilitate the design of the stage separation support hardware, to position the models in the test section, and to define the experimental test space. Advances in the facility automated model positioning system established a foundation for the development of a continuous-sweep data acquisition technique that is responsible for significant productivity improvements to the current NASA Space Launch System test program. The automated model positioning capability was leveraged to conduct a companion statistically-designed stage separation experiment requiring randomization of the relative proximity positions of the orbiter and booster models. The respective zones of influence and interference effects of the orbiter and booster were identified from three-dimensional scatter plots, contour and influence maps, and two-dimensional plotting methods. The highly-nonlinear, shock-dominated aerodynamic characteristics of the orbiter and booster in the Unitary Plan Wind Tunnel exhibited good agreement with independent test data obtained in a NASA Marshall Space Flight Center wind tunnel and with computational fluid dynamics predictions using a compressible, three-dimensional flow solver and an inviscid, unstructured Cartesian method.

Erickson, Gary E.↗

Use of Design of Experiments and Rule-Based Inference in Determining Neural Network Architectures for Loss of Control Detection

In this work, we describe methods for selecting the neural network architectures and input spaces to implement belief state inference on generic commercial transport aircraft. First, we highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). We present a structured method that can be used in a number of aerospace applications, to optimize the structure and training parameters of the CVAE for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from a NASA T-2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications. While theoretically, we could create a single CVAE with an input space the size of all measurable flight variables and environmental dynamics, it becomes intractable to use such a neural network in an in-situ intelligent multi-agent system. Using the recommendations from our case study, we introduce a technical approach for feasibly describing the belief space by (1) identifying significant statistical relationships among flight variables using rule induction, (2) using a set of rules that cover all features to define the input space of multiple CVAEs, and (3) forming a belief space based on the joint probability density of their collective latent spaces. This results in a series of relatively small matrix multiplications that can be performed in real time, as opposed to large matrix computations in a single CVAE. We demonstrate the application of this approach on the T-2 flight loss-of control experiments, using the architecture and hyperparameter recommendations from the case study. We compare the utilities of an individual CVAE trained on all flight variables and multiple CVAEs defined on subsets of flight variables for detecting qualitative changes in flight. We demonstrate that the use of multiple CVAEs with smaller input spaces permits the CVAE to capture more granular relationships in the latent space, permitting better state space characterization and loss-of-control detection.

Design of experiments↗

Effects of alloy composition on cyclic flame hot-corrosion attack of cast nickel-base superalloys at 900 deg C

The effects of Cr, Al, Ti, Mo, Ta, Nb, and W content on the hot corrosion of nickel base alloys were investigated. The alloys were tested in a Mach 0.3 flame with 0.5 ppmw sodium at a temperature of 900 C. One nondestructive and three destructive tests were conducted. The best corrosion resistance was achieved when the Cr content was 12 wt %. However, some lower-Cr-content alloys ( 10 wt%) exhibited reasonable resistance provided that the Al content alloys ( 10 wt %) exhibited reasonable resistance provided that the Al content was 2.5 wt % and the Ti content was Aa wt %. The effect of W, Ta, Mo, and Nb contents on the hot-corrosion resistance varied depending on the Al and Ti contents. Several commercial alloy compositions were also tested and the corrosion attack was measured. Predicted attack was calculated for these alloys from derived regression equations and was in reasonable agreement with that experimentally measured. The regression equations were derived from measurements made on alloys in a one-quarter replicate of a 2(7) statistical design alloy composition experiment. These regression equations represent a simple linear model and are only a very preliminary analysis of the data needed to provide insights into the experimental method.

Deadmore, D. L.↗

Vortex Generators in a Streamline-Traced, External-Compression Supersonic Inlet

Vortex generators within a streamline-traced, external-compression supersonic inlet for Mach 1.66 were investigated to determine their ability to increase total pressure recovery and reduce total pressure distortion. The vortex generators studied were rectangular vanes arranged in counter-rotating and co-rotating arrays. The vane geometric factors of interest included height, length, spacing, angle-of-incidence, and positions upstream and downstream of the inlet terminal shock. The flow through the inlet was simulated numerically through the solution of the steady-state, Reynolds-averaged Navier-Stokes equations on multi-block, structured grids using the Wind-US flow solver. The vanes were simulated using a vortex generator model. The inlet performance was characterized by the inlet total pressure recovery and the radial and circumferential total pressure distortion indices at the engine face. Design of experiments and statistical analysis methods were applied to quantify the effect of the geometric factors of the vanes and search for optimal vane arrays. Co-rotating vane arrays with negative angles-of-incidence positioned on the supersonic diffuser were effective in sweeping low-momentum flow from the top toward the sides of the subsonic diffuser. This distributed the low-momentum flow more evenly about the circumference of the subsonic diffuser and reduced distortion. Co-rotating vane arrays with negative angles-of-incidence or counter-rotating vane arrays positioned downstream of the terminal shock were effective in mixing higher-momentum flow with lower-momentum flow to increase recovery and decrease distortion. A strategy of combining a co-rotating vane array on the supersonic diffuser with a counter-rotating vane array on the subsonic diffuser was effective in increasing recovery and reducing distortion.

computational fluid dynamics↗

Experiments and other methods for developing expertise with design of experiments in a classroom setting

The only way to gain genuine expertise in Statistical Process Control (SPC) and the design of experiments (DOX) is with repeated practice, but not on canned problems with dead data sets. Rather, one must negotiate a wide variety of problems each with its own peculiarities and its own constantly changing data. The problems should not be of the type for which there is a single, well-defined answer that can be looked up in a fraternity file or in some text. The problems should match as closely as possible the open-ended types for which there is always an abundance of uncertainty. These are the only kinds that arise in real research, whether that be basic research in academe or engineering research in industry. To gain this kind of experience, either as a professional consultant or as an industrial employee, takes years. Vast amounts of money, not to mention careers, must be put at risk. The purpose here is to outline some realistic simulation-type lab exercises that are so simple and inexpensive to run that the students can repeat them as often as desired at virtually no cost. Simulations also allow the instructor to design problems whose outcomes are as noisy as desired but still predictable within limits. Also the instructor and the students can learn a great deal more from the postmortum conducted after the exercise is completed. One never knows for sure what the true data should have been when dealing only with real life experiments. To add a bit more realism to the exercises, it is sometimes desirable to make the students pay for each experimental result from a make-believe budget allocation for the problem.

Patterson, John W.↗

Design and analysis of confirmation experiments

The statistical literature and practitioners have long advocated the use of confirmation experiments as the final stage of a sequence of designed experiments to verify that the optimal operating conditions identified as part of a response surface methodology strategy are attainable and able to achieve the value of the response desired. Yet, until recently there has been a gap between this recommendation and details about how to perform an analysis to quantitatively assess whether the confirmation runs are adequate. Likewise, there has been little in the way of specific recommendations for the number and nature of the confirmation runs that should be performed. In this article, we propose analysis methods to assess agreement between the mean response from previous experiments and the confirmation experiment, and suggest a strategy for the design of confirmation experiments that more fully explores the region around the optimum.

97 MATHEMATICS AND COMPUTING↗

Single element injector cold flow testing for STME swirl coaxial injector element design

An oxidizer-swirled coaxial element injector is being investigated for application in the Space Transportation Main Engine (STME). Single element cold flow experiments were conducted to provide characterization of the STME injector element for future analysis, design, and optimization. All tests were conducted to quiescent, ambient backpressure conditions. Spray angle, circumferential spray uniformity, dropsize, and dropsize distribution were measured in water-only and water/nitrogen flows. Rupe mixing efficiency was measured using water/sucrose solution flows with a large grid patternator for simple comparative evaluation of mixing. Factorial designs of experiment were used for statistical evaluation of injector geometrical design features and propellant flow conditions on mixing and atomization. Increasing the free swirl angle of the liquid oxidizer had the greatest influence on increasing the mixing efficiency. The addition of gas assistance had the most significant effect on reducing oxidizer droplet size parameters and increasing droplet size distribution. Increasing the oxidizer injection velocity had the greatest influence for reducing oxidizer droplet size parameters and increasing size distribution for non-gas assisted flows. Single element and multi-element subscale hot fire testing are recommended to verify optimized designs before committing to the STME design.

Hulka, J.↗

Statistical results from the Virginia Tech propagation experiment using the Olympus 12, 20, and 30 GHz satellite beacons

Virginia Tech has performed a comprehensive propagation experiment using the Olympus satellite beacons at 12.5, 19.77, and 29.66 GHz (which we refer to as 12, 20, and 30 GHz). Four receive terminals were designed and constructed, one terminal at each frequency plus a portable one with 20 and 30 GHz receivers for microscale and scintillation studies. Total power radiometers were included in each terminal in order to set the clear air reference level for each beacon and also to predict path attenuation. More details on the equipment and the experiment design are found elsewhere. Statistical results for one year of data collection were analyzed. In addition, the following studies were performed: a microdiversity experiment in which two closely spaced 20 GHz receivers were used; a comparison of total power and Dicke switched radiometer measurements, frequency scaling of scintillations, and adaptive power control algorithm development. Statistical results are reported.

Stutzman, Warren L.↗

An experimental study of the temporal statistics of radio signals scattered by rain

A fixed-beam bistatic CW experiment designed to measure the temporal statistics of the volume reflectivity produced by hydrometeors at several selected altitudes, scattering angles, and at two frequencies (3.6 and 7.8 GHz) is described. Surface rain gauge data, local meteorological data, surveillance S-band radar, and great-circle path propagation measurements were also made to describe the general weather and propagation conditions and to distinguish precipitation scatter signals from those caused by ducting and other nonhydrometeor scatter mechanisms. The data analysis procedures were designed to provide an assessment of a one-year sample of data with a time resolution of one minute. The cumulative distributions of the bistatic signals for all of the rainy minutes during this period are presented for the several path geometries.

Hubbard, R. W.↗

Taguchi Approach to Design Optimization for Quality and Cost: An Overview

Calibrations to existing cost of doing business in space indicate that to establish human presence on the Moon and Mars with the Space Exploration Initiative (SEI) will require resources, felt by many, to be more than the national budget can afford. In order for SEI to succeed, we must actually design and build space systems at lower cost this time, even with tremendous increases in quality and performance requirements, such as extremely high reliability. This implies that both government and industry must change the way they do business. Therefore, new philosophy and technology must be employed to design and produce reliable, high quality space systems at low cost. In recognizing the need to reduce cost and improve quality and productivity, Department of Defense (DoD) and National Aeronautics and Space Administration (NASA) have initiated Total Quality Management (TQM). TQM is a revolutionary management strategy in quality assurance and cost reduction. TQM requires complete management commitment, employee involvement, and use of statistical tools. The quality engineering methods of Dr. Taguchi, employing design of experiments (DOE), is one of the most important statistical tools of TQM for designing high quality systems at reduced cost. Taguchi methods provide an efficient and systematic way to optimize designs for performance, quality, and cost. Taguchi methods have been used successfully in Japan and the United States in designing reliable, high quality products at low cost in such areas as automobiles and consumer electronics. However, these methods are just beginning to see application in the aerospace industry. The purpose of this paper is to present an overview of the Taguchi methods for improving quality and reducing cost, describe the current state of applications and its role in identifying cost sensitive design parameters.

Unal, Resit↗

A review of satellite lightning experiments

Over the past five years a series of satellite optical experiments were conducted to investigate terrestrial lightning. These experiments were designed to gather statistical information about the optical waveform of lightning, measure occurrence rates, demonstrate the feasibility of detecting lightning from space platforms, and study possible applications for satellite lightning sensors. These experiments are reviewed. Some of the results are presented, and some ideas for future satellite systems are discussed.

Turman, B. N.↗

The COMSAT 13 and 18 GHz Propagation Experiment

The ATS-6 COMSAT Propagation Experiment was designed to gather statistical data on attenuation caused by rain and snow at 13 and 18 GHz. These data will be used to determine system design parameters for future communications satellite systems operating at frequencies above 10 GHz. The experiment used 25, 18 GHz, and 15, 13 GHz unattended ground transmitters at 25 locations in the eastern U.S. to transmit to the ATS-6. The ATS-6 transponder converts these carriers to frequencies around 4150 MHz and transmits these signals to the COMSAT large horn antenna/data acquisition and receiving facility at Andover, Me. This facility calibrates and digitally records each carrier once per second. These data have been processed and analyzed for the period from July to Nov. 2, 1972. Plans are being made to conduct the experiment in Europe and India during the 35 deg E longitude site phase of ATS-6 operations.

King, J. L.↗

Verification of Space Station Secondary Power System Stability Using Design of Experiment

This paper describes analytical methods used in verification of large DC power systems with applications to the International Space Station (ISS). Large DC power systems contain many switching power converters with negative resistor characteristics. The ISS power system presents numerous challenges with respect to system stability such as complex sources and undefined loads. The Space Station program has developed impedance specifications for sources and loads. The overall approach to system stability consists of specific hardware requirements coupled with extensive system analysis and testing. Testing of large complex distributed power systems is not practical due to size and complexity of the system. Computer modeling has been extensively used to develop hardware specifications as well as to identify system configurations for lab testing. The statistical method of Design of Experiments (DoE) is used as an analysis tool for verification of these large systems. DOE reduces the number of computer runs which are necessary to analyze the performance of a complex power system consisting of hundreds of DC/DC converters. DoE also provides valuable information about the effect of changes in system parameters on the performance of the system. DoE provides information about various operating scenarios and identification of the ones with potential for instability. In this paper we will describe how we have used computer modeling to analyze a large DC power system. A brief description of DoE is given. Examples using applications of DoE to analysis and verification of the ISS power system are provided.

Karimi, Kamiar J.↗

The Implementation of Maximum Likelihood Estimation in Space Launch System Vehicle Design

The Space Launch System uses a Maximum Likelihood Estimation process in conjunction with Design of Experiments to develop statistically representative vehicles for the Block 1 configuration. These vehicles are then used to estimate maximum load conditions for simulating stressing cases in other simulations. This paper discusses the modeling process and how SLS captures manufacturing uncertainty in the launch vehicle design. It also provides an overview of the differences between Block 1 statistical representations. This paper also discusses proper grid choice as well as which uncertainties drive the vehicle design.

Stein, W. B.↗