Search NASA⌕ Search

SEARCH · Search NASA

Results for “Design of experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Application of Design of Experiments and Surrogate Modeling within the NASA Advanced Concepts Office, Earth-to-Orbit Design Process

Decisions made during early conceptual design have a large impact upon the expected life-cycle cost (LCC) of a new program. It is widely accepted that up to 80% of such cost is committed during these early design phases [1]. Therefore, to help minimize LCC, decisions made during conceptual design must be based upon as much information as possible. To aid in the decision making for new launch vehicle programs, the Advanced Concepts Office (ACO) at NASA Marshall Space Flight Center (MSFC) provides rapid turnaround pre-phase A and phase A concept definition studies. The ACO team utilizes a proven set of tools to provide customers with a full vehicle mass breakdown to tertiary subsystems, preliminary structural sizing based upon worst-case flight loads, and trajectory optimization to quantify integrated vehicle performance for a given mission [2]. Although the team provides rapid turnaround for single vehicle concepts, the scope of the trade space can be limited due to analyst availability and the manpower requirements for manual execution of the analysis tools. In order to enable exploration of a broader design space, the ACO team has implemented an advanced design methods (ADM) based approach. This approach applies the concepts of design of experiments (DOE) and surrogate modeling to more exhaustively explore the trade space and provide the customer with additional design information to inform decision making. This paper will first discuss the automation of the ACO tool set, which represents a majority of the development effort. In order to fit a surrogate model within tolerable error bounds a number of DOE cases are needed. This number will scale with the number of variable parameters desired and the complexity of the system's response to those variables. For all but the smallest design spaces, the number of cases required cannot be produced within an acceptable timeframe using a manual process. Therefore, automation of the tools was a key enabler for the successful application of an ADM approach to an ACO design study. Following the overview of the tool set automation, an example problem will be given to illustrate the implementation of the ADM approach. The example problem will first cover the inclusion of ground rules and assumptions (GR&A) for a study. The GR&A are very important to the study as they determine the constraints within which a trade study can be conducted. These trades must ultimately reconcile with the customer's desired output and any anticipated "what if" questions.

Zwack, Mathew R.↗

Application of Design of Experiments and Surrogate Modeling within the NASA Advanced Concepts Office, Earth-to-Orbit Design Process

Decisions made during early conceptual design have a large impact upon the expected life-cycle cost (LCC) of a new program. It is widely accepted that up to 80% of such cost is committed during these early design phases. Therefore, to help minimize LCC, decisions made during conceptual design must be based upon as much information as possible. To aid in the decision making for new launch vehicle programs, the Advanced Concepts Office (ACO) at NASA Marshall Space Flight Center (MSFC) provides rapid turnaround pre-phase A and phase A concept definition studies. The ACO team utilizes a proven set of tools to provide customers with a full vehicle mass breakdown to tertiary subsystems, preliminary structural sizing based upon worst-case flight loads, and trajectory optimization to quantify integrated vehicle performance for a given mission. Although the team provides rapid turnaround for single vehicle concepts, the scope of the trade space can be limited due to analyst availability and the manpower requirements for manual execution of the analysis tools. In order to enable exploration of a broader design space, the ACO team has implemented an advanced design methods (ADM) based approach. This approach applies the concepts of design of experiments (DOE) and surrogate modeling to more exhaustively explore the trade space and provide the customer with additional design information to inform decision making. This paper will first discuss the automation of the ACO tool set, which represents a majority of the development effort. In order to fit a surrogate model within tolerable error bounds a number of DOE cases are needed. This number will scale with the number of variable parameters desired and the complexity of the system's response to those variables. For all but the smallest design spaces, the number of cases required cannot be produced within an acceptable timeframe using a manual process. Therefore, automation of the tools was a key enabler for the successful application of an ADM approach to an ACO design study. Following the overview of the tool set automation, an example problem will be given to illustrate the implementation of the ADM approach. The example problem will first cover the inclusion of ground rules and assumptions (GR&A) for a study. The GR&A are very important to the study as they determine the constraints within which a trade study can be conducted. These trades must ultimately reconcile with the customer's desired output and any anticipated "what if" questions. The example problem will then illustrate the setup and execution of a DOE through the automated ACO tools. This process is accomplished more efficiently in this work by splitting the tools into two separate environments. The first environment encompasses the structural optimization and mass estimation tools, while the second is focused on trajectory optimization. Surrogate models are fit to the outputs of each environment and are "integrated" via connection of the surrogate equations. Throughout this process, checks are implemented to compare the output of the surrogates to the output of manually run cases to ensure that the error of the final surrogates is at an acceptable level. The conclusion of the example problem demonstrates the utility of the ADM based approach. Using surrogate models gives the ACO team the ability to visualize vehicle sensitivities to various design parameters and identify regions of interest within the design space. The ADM approach can thus be used to inform concept down selection and isolate promising vehicle configurations to be explored in more detail through the manual design process. In addition it provides the customer with an almost instantaneous turnaround on any ''what if" questions that may arise within the bounds of the surrogate model. This approach ultimately expands the ability of the ACO team to provide its customer with broad and rapid turnaround trade studies for launch vehicle conceptual design. The ability to identify a selection of designs which can meet the customer requirements will help ensure lower LCC of launch vehicle designs originating from ACO.

Zwack, Mathew R.↗

Advances in Aero-Propulsive Modeling for Fixed-Wing and eVTOL Aircraft Using Experimental Data

Small unmanned aircraft and electric vertical takeoff and landing (eVTOL) aircraft have recently emerged as vehicles able to perform new missions and stimulate future air transportation methods. This dissertation presents several system identification research advancements for these modern aircraft configurations enabling accurate mathematical model development for flight dynamics simulations based on wind-tunnel and flight-test data. The first part of the dissertation focuses on advances in flight-test system identification methods using small, fixed-wing, remotely-piloted, electric, propeller-driven aircraft. A generalized approach for flight dynamics model development for small fixed-wing aircraft from flight data is described and is followed by presentation of novel flight-test system identification applications, including: aero-propulsive model development for propeller aircraft and nonlinear dynamic model identification without mass properties. The second part of the dissertation builds on established fixed-wing and rotary-wing aircraft system identification methods to develop modeling strategies for transitioning, distributed propulsion, eVTOL aircraft. Novel wind-tunnel experiment designs and aero-propulsive modeling approaches are developed using a subscale, tandem tilt-wing, eVTOL aircraft, leveraging design of experiments and response surface methodology techniques. Additionally, a method applying orthogonal phase-optimized multisine input excitations to aircraft control effectors in wind-tunnel testing is developed to improve test efficiency and identified model utility. Finally, the culmination of this dissertation is synthesis of the techniques described throughout the document to form a flight-test system identification approach for eVTOL aircraft that is demonstrated using a high-fidelity flight dynamics simulation. The research findings highlighted throughout the dissertation constitute substantial progress in efficient empirical aircraft modeling strategies that are applicable to many current and future aeronautical vehicles enabling accurate flight simulation development, which can subsequently be used to foster advancement in many other pertinent technology areas.

system identification↗

Conceptual design of the modular detector and readout system for the CMB-S4 survey experiment

We present the conceptual design of the modular detector and readout system for the Cosmic Microwave Background – Stage four (CMB-S4) ground-based survey experiment. CMB-S4 will map the cosmic microwave background (CMB) and the millimeter-wave sky to unprecedented sensitivity, using 500,000 superconducting detectors observing from Chile and Antarctica to map over 60% of the sky. The fundamental building block of the detector and readout system is a detector module package operated at 100 mK, which is connected to a readout and amplification chain that carries signals out to room temperature. It uses arrays of feedhorn-coupled orthomode transducers (OMT) that collect optical power from the sky onto dc-voltage-biased transition-edge sensor (TES) bolometers. The resulting current signal in the TESs is then amplified by a two-stage cryogenic Superconducting Quantum Interference Device (SQUID) system with a time-division multiplexer to reduce wire count, and matching room-temperature electronics to condition and transmit signals to the data acquisition system. Sensitivity and systematics requirements are being developed for the detector and readout system over wide range of observing bands (20 to 300 GHz) and optical powers to accomplish CMB-S4’s science goals. While the design incorporates the successes of previous generations of CMB instruments, CMB-S4 requires an order of magnitude more detectors than any prior experiment. This requires fabrication of complex superconducting circuits on over 10 m2 of silicon, as well as significant amounts of precision wiring, assembly and cryogenic testing

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The design of the MEG II experiment

The MEG experiment, designed to search for the &#x03BC;<!-- μ --> + &#x2192;<!-- → --> e + &#x03B3;<!-- γ --> decay, completed data-taking in 2013 reaching a sensitivity level of 5.3 &#x00D7;<!-- × --> 10 &#x2212;<!-- - --> 13 for the branching ratio. In order to increase the sensitivity reach of the experiment by an order of magnitude to the level of 6 &#x00D7;<!-- × --> 10 &#x2212;<!-- - --> 14 , a total upgrade, involving substantial changes to the experiment, has been undertaken, known as MEG II. We present both the motivation for the upgrade and a detailed overview of the design of the experiment and of the expected detector performance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Directed Design of Experiments for Validating Probability of Detection Capability of NDE Systems (DOEPOD)

Directed Design of Experiments for Validating Probability of Detection Capability of NDE Systems (DOEPOD) Manual v.1.2 The capability of an inspection system is established by applications of various methodologies to determine the probability of detection (POD). One accepted metric of an adequate inspection system is that there is 95% confidence that the POD is greater than 90% (90/95 POD). Design of experiments for validating probability of detection capability of nondestructive evaluation (NDE) systems (DOEPOD) is a methodology that is implemented via software to serve as a diagnostic tool providing detailed analysis of POD test data, guidance on establishing data distribution requirements, and resolving test issues. DOEPOD demands utilization of observance of occurrences. The DOEPOD capability has been developed to provide an efficient and accurate methodology that yields observed POD and confidence bounds for both Hit-Miss or signal amplitude testing. DOEPOD does not assume prescribed POD logarithmic or similar functions with assumed adequacy over a wide range of flaw sizes and inspection system technologies, so that multi-parameter curve fitting or model optimization approaches to generate a POD curve are not required. DOEPOD applications for supporting inspector qualifications is included.

Generazio, Edward R.↗

Analysis of Wind Tunnel Polar Replicates Using the Modern Design of Experiments

The role of variance in a Modern Design of Experiments analysis of wind tunnel data is reviewed, with distinctions made between explained and unexplained variance. The partitioning of unexplained variance into systematic and random components is illustrated, with examples of the elusive systematic component provided for various types of real-world tests. The importance of detecting and defending against systematic unexplained variance in wind tunnel testing is discussed, and the random and systematic components of unexplained variance are examined for a representative wind tunnel data set acquired in a test in which a missile is used as a test article. The adverse impact of correlated (non-independent) experimental errors is described, and recommendations are offered for replication strategies that facilitate the quantification of random and systematic unexplained variance.

Deloach, Richard↗

Conceptual Design and Performance Considerations for Superconducting Magnets in the Material Plasma Exposure eXperiment

An important step toward the advent of nuclear fusion as a future power source is the development of plasmafacing materials that can function as designed for a long period of time. While ITER and other devices including Wendelstein 7-X and the Joint European Torus will provide insight into divertor and first wall performance, a dedicated device to advance the understanding of material performance in the representative plasma environments is needed. The Material Plasma Exposure eXperiment has been proposed as a linear plasma device to generate and to direct fusion reactor-like plasma energy and particle flux at the target materials with electron temperatures of 1-15 eV and electron densities of 10 20 -10 21 m -3 . Given that the requirements for radio frequency (RF) heating on-axis field are no greater than 2.5 T and the warm bore diameters must be between 60 cm and 1.5 m, the conceptual design was developed for the experiments on a set of superconducting magnets carried out using commercially available NbTi superconductors. This conceptual design evaluated the cryogenic heat loads, mechanical loads, and quench protection to ensure that the current design is compatible with current technologies. In addition, an alternative evaluation of this design relative to ReBCO high-temperature superconducting magnets determined the conditions under which these technologies could be advantageous.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Goal-oriented optimal design of experiments for large-scale Bayesian linear inverse problems

We develop a framework for goal-oriented optimal design of experiments (GOODE) for large-scale Bayesian linear inverse problems governed by PDEs. This framework differs from classical Bayesian optimal design of experiments (ODE) in the following sense: we seek experimental designs that minimize the posterior uncertainty in the experiment end-goal, e.g. a quantity of interest (QoI), rather than the estimated parameter itself. This is suitable for scenarios in which the solution of an inverse problem is an intermediate step and the estimated parameter is then used to compute a QoI. In such problems, a GOODE approach has two benefits: the designs can avoid wastage of experimental resources by a targeted collection of data, and the resulting design criteria are computationally easier to evaluate due to the often low-dimensionality of the QoIs. We present two modified design criteria, A-GOODE and D-GOODE, which are natural analogues of classical Bayesian A- and D-optimal criteria. We analyze the connections to other ODE criteria, and provide interpretations for the GOODE criteria by using tools from information theory. Then, we develop an efficient gradient-based optimization framework for solving the GOODE optimization problems. Additionally, we present comprehensive numerical experiments testing the various aspects of the presented approach. The driving application is the optimal placement of sensors to identify the source of contaminants in a diffusion and transport problem. As a result, we enforce sparsity of the sensor placements using an L1-norm penalty approach, and propose a practical strategy for specifying the associated penalty parameter.

97 MATHEMATICS AND COMPUTING↗

Flow Boiling and Condensation Experiment: Payload Design Overview

The Flow Boiling and Condensation Experiment (FBCE) is a flight experiment that is designed to operate in the Fluids Integrated Rack (FIR) on the International Space Station (ISS). The objective of the FBCE is to develop an integrated two-phase flow experiment that will serve as a primary platform for obtaining flow boiling and condensation heat transfer data in microgravity. This presentation discusses the overall design of the FBCE payload, as well as the status of the FBCE hardware as it continues through final verification testing.

Guzik, Monica C.↗

Best Bang for the Buck: Part 1 – The Size of Experiments Relative to Design Performance

There are many choices to make, when designing an experiment for a study, such as: what design factors to consider, which levels of the factors to use and which model to focus on. One aspect of design, however, is often left unquestioned: the size of the experiment. When learning about design of experiments, problems are often posed as "select a design for a particular objective with N runs." It’s tempting to consider the design size as a given constraint in the design-selection process. If you think of learning through designed experiments as a sequential process, however, strategically planning for the use of resources at different stages of data collection can be beneficial: Saving experimental runs for later is advantageous if you can efficiently learn with less in the early stages. Alternatively, if you’re too frugal in the early stages, you might not learn enough to proceed confidently with the next stages. Therefore, choosing the right-sized experiment is important—not too large or too small, but with a thoughtful balance to maximize the knowledge gained given the available resources. It can be a great advantage to think about the design size as flexible and include it as an aspect for comparisons. Sometimes you’re asked to provide a small design that is too ambitious for the goals of the study. Finally, if you can show quantitatively how the suggested design size might be inadequate or lead to problems during analysis—and also offer a formal comparison to some alternatives of different (likely larger) sizes—you may have a better chance to ask for additional resources to deliver statistically sound and satisfying results

97 MATHEMATICS AND COMPUTING↗

Stepwise Regression Analysis of MDOE Balance Calibration Data Acquired at DNW

This paper reports a comparison of two experiment design methods applied in the calibration of a strain-gage balance. One features a 734-point test matrix in which loads are varied systematically according to a method commonly applied in aerospace research and known in the literature of experiment design as One Factor At a Time (OFAT) testing. Two variations of an alternative experiment design were also executed on the same balance, each with different features of an MDOE experiment design. The Modern Design of Experiments (MDOE) is an integrated process of experiment design, execution, and analysis applied at NASA's Langley Research Center to achieve significant reductions in cycle time, direct operating cost, and experimental uncertainty in aerospace research generally and in balance calibration experiments specifically. Personnel in the Instrumentation and Controls Department of the German Dutch Wind Tunnels (DNW) have applied MDOE methods to evaluate them in the calibration of a balance using an automated calibration machine. The data have been sent to Langley Research Center for analysis and comparison. This paper reports key findings from this analysis. The chief result is that a 100-point calibration exploiting MDOE principles delivered quality comparable to a 700+ point OFAT calibration with significantly reduced cycle time and attendant savings in direct and indirect costs. While the DNW test matrices implemented key MDOE principles and produced excellent results, additional MDOE concepts implemented in balance calibrations at Langley Research Center are also identified and described.

DeLoach, RIchard↗

A Design of Experiments Investigation of Offset Streams for Supersonic Jet Noise Reduction

An experimental investigation into the noise characteristics of a dual-stream jet with four airfoils inserted in the fan nozzle was conducted. The intent of the airfoils was to deflect the fan stream relative to the core stream and, therefore, impact the development of the secondary potential core and noise radiated in the peak jet-noise direction. The experiments used a full-factorial Design of Experiments (DoE) approach to identify parameters and parameter interactions impacting noise radiation at two azimuthal microphone array locations, one of which represented a sideline viewing angle. The parameters studied included airfoil angle-of-attack, airfoil azimuthal location within the fan nozzle, and airfoil axial location relative to the fan-nozzle trailing edge. Jet conditions included subsonic and supersonic fan-stream Mach numbers. Heated jets conditions were simulated with a mixture of helium and air to replicate the exhaust velocity and density of the hot jets. The introduction of the airfoils was shown to impact noise radiated at polar angles in peak-jet noise direction and to have no impact on noise radiated at small and broadside polar angles and to have no impact on broadband-shock-associated noise. The DoE analysis showed the main effects impacting noise radiation at sideline-azimuthal-viewing angles included airfoil azimuthal angle for the airfoils on the lower side of the jet near the sideline array and airfoil trailing edge distance (with airfoils located at the nozzle trailing edge produced the lowest sound pressure levels). For an array located directly beneath the jet (and on the side of the jet from which the fan stream was deflected), the main effects impacting noise radiation included airfoil angle-of-attack and airfoil azimuthal angle for the airfoils located on the observation side of the jet as well and trailing edge distance. Interaction terms between multiple configuration parameters were shown to have significant impact on the radiated noise. The models were shown to adequately describe the sound-pressure levels obtained for a configuration in the center of the design space indicating the models can be used to navigate the design space.

Jet Noise↗

Characterization of Covetic Materials for Process Control. Final CRADA report

GDC Industries LLC has been performing process research on covetic materials since its formation in February 2015. With assistance from DOE and the Air Force via SBIR projects, GDC focused on the enhancement of aluminum alloys to covetics to replicate a previously reported electrical conductivity of about 67% IACS (International Annealed Copper Standard). GDC has established a joint development agreement with General Cable Corporation, wherein General Cable agreed to perform numerous extrusions of as cast covetics and subsequent tensile and electrical conductivity tests on the resultant wire. Covetics conversion was proven but the significant improvement is yet to be replicated. To control the experiments towards enhanced process control, a series of designed experiments was created by an expert in process control from the automotive industry. Six process variables were identified and a designed experiment matrix requiring 18 independent conversions was created at GDC. The result of those designed experiments has now allowed GDC to focus on two process variables, namely, residence time and DC current in the conversions with the other four variable held constant. While this work is useful in replicating the earlier enhancements, GDC feels it will not be sufficient for the necessary process knowhow for scale up required by industry as GDC still does not have a direct correlation of the process variables to the actual carbon in the finished covetics. Since 2015, GDC has been aware of the capabilities existing at Argonne National Laboratory for performing carbon analysis that exceeds the precision commonly available to Industry. GDC and ANL submitted a proposal in response to the DOE-EERE – Small Business Vouchers Pliot Program announcement and the proposal was selected for funding. GDC will melt-process covetic aluminum samples following their design of experiment criteria and have the as-casted samples extruded by their partner, General Cable. Argonne will measure the conductivity, analyze carbon content, perform X-ray diffraction, and examine the microstructural features of the samples. Careful process variable measurements will be recorded by each party such that correlations can be developed indicating process parameters that yield the best carbon concentration in covetics.

36 MATERIALS SCIENCE↗

Optimization of detection sensitivity for a Fiber Optic Intrusion Detection System (FOIDS) using design of experiments.

The Fiber Optic Intrusion Detection System (FOIDS)1 is a physical security sensor deployed on fence lines to detect climb or cut intrusions by adversaries. Calibration of detection sensitivity can be time consuming because, for example, the FiberSenSys FD-332 has 32 settings that can be adjusted independently to provide a balance between a high probability of detection and a low nuisance alarm rate. Therefore, an efficient method of calibrating the FOIDS in the field, other than by trial and error, was needed. This study was conducted to: x Identify the most significant settings for controlling detection x Develop a way of predicting detection sensitivity for given settings x Develop a set of optimal settings for validation The Design of Experiments (DoE) 2-4 methodology was used to generate small, planned test matrixes, which could be statistically analyzed to yield more information from the test data. Design of Experiments is a statistical methodology for quickly optimizing performance of systems with measurable input and output variables. DoE was used to design custom screening experiments based on 11 FOIDS settings believed to have the most affect on WKH types of fence perimeter intrusions were evaluated: simulated cut intrusions and actual climb intrusions. Two slightly different two-level randomized fractional factorial designed experiment matrixes consisting of 16 unique experiments were performed in the field for each type of intrusion. Three repetitions were conducted for every cut test; two repetitions were conducted for every climb test. Total number of cut tests analyzed was 51; the total number of climb tests was 38. This paper discusses the results and benefits of using Design of Experiments (DoE) to calibrate and optimize the settings for a FOIDS sensor

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Designers' models of the human-computer interface

Understanding design models of the human-computer interface (HCI) may produce two types of benefits. First, interface development often requires input from two different types of experts: human factors specialists and software developers. Given the differences in their backgrounds and roles, human factors specialists and software developers may have different cognitive models of the HCI. Yet, they have to communicate about the interface as part of the design process. If they have different models, their interactions are likely to involve a certain amount of miscommunication. Second, the design process in general is likely to be guided by designers' cognitive models of the HCI, as well as by their knowledge of the user, tasks, and system. Designers do not start with a blank slate; rather they begin with a general model of the object they are designing. The author's approach to a design model of the HCI was to have three groups make judgments of categorical similarity about the components of an interface: human factors specialists with HCI design experience, software developers with HCI design experience, and a baseline group of computer users with no experience in HCI design. The components of the user interface included both display components such as windows, text, and graphics, and user interaction concepts, such as command language, editing, and help. The judgments of the three groups were analyzed using hierarchical cluster analysis and Pathfinder. These methods indicated, respectively, how the groups categorized the concepts, and network representations of the concepts for each group. The Pathfinder analysis provides greater information about local, pairwise relations among concepts, whereas the cluster analysis shows global, categorical relations to a greater extent.

Gillan, Douglas J.↗

A scalable design of experiments framework for optimal sensor placement

Here, we present a scalable design of an experiments framework for sensor placement in systems described by partial differential equations (PDEs). In particular, we aim to compute optimal sensor locations by minimizing the uncertainty of parameters estimated from Bayesian inverse problems and where the system. The resulting problem is a computationally intractable mixed-integer nonlinear program constrained by PDEs. We approach this problem with two heuristics used in compressed sensing and optimal control literature: a sparsity-inducing approach and a sum-up rounding approach. We also investigate metrics to guide the design of experiments (the total flow variance and the A-optimal design criterion) and analyze the effect of different noise structures (white and colored). Using an application in natural gas pipelines, we conclude that the sum-up rounding approach approach gives the best results and produces shrinking gaps with increasing mesh resolution. We also observe that convergence for the white noise measurement error case is slower than for the colored noise case. For A-optimal design, the solution is close to a uniform distribution of sensors along the pipeline while for the flow variance design the distribution is unstructured.

42 ENGINEERING↗