Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sequential experiment design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Model-Based Sequential Design of Experiments for Pilot Testing of Novel Water-Lean CO2 Capture Solvent

Poster for the 2024 Fossil Energy and Carbon Management Meeting. It summarizes work done on process modeling and uncertainty quantification in preparation for the test campaign at the National Carbon Capture Center for a general audience. The poster includes sections detailing background on the EEMPA solvent, sequential design of experiments, process modeling (including results from the model), uncertainty quantification, and the goals of the test campaign.

Hedrick, Katherine↗
DOE OSTI2024

Sequential Design of Experiments for Pilot Testing of Novel Solvent System

The CCSI2 program is supporting a six-month test campaign at the National Carbon Capture Center (NCCC) for evaluation of a novel water-lean solvent. This presentation describes CCSI2’s efforts in process modeling of the solvent system for both coal and natural gas-based flue gas sources and initial uncertainty quantification (UQ) work to estimate parametric uncertainty in key sub-models of interest (e.g., thermodynamics, mass transfer, reaction kinetics). Moreover, perspective is provided on how UQ and sequential design of experiments (SDoE) tools are used to assess the impact of model uncertainty on projected process performance, use this information to optimize data collection during the campaign, and refine process models through data collection. This framework is expected to reduce the overall model uncertainty, and thus risk associated with scale-up as the process moves towards commercialization.

Morgan, Joshua↗
NASA NTRSDate not supplied

Evaluation of Response Surface Experiment Designs for Distributed Propulsion Aircraft Aero-Propulsive Modeling

Modern distributed hybrid and electric propulsion aircraft, including vertical, short, and conventional takeoff and landing configurations, exhibit significant aero-propulsive complexity and a large number of interacting test factors. This paper presents the development and evaluation of experiment designs for aero-propulsive characterization of distributed propulsion aircraft. Five different foundational response surface designs are evaluated to inform the development of two sequential design approaches tailored to complex aircraft aerodynamic characterization experiments. The first approach, which builds on sequential face-centered central composite designs, has been used previously to develop aero-propulsive models for complex aircraft using wind tunnel testing. The second approach is a new design strategy leveraging a regular I-optimal and nested I-optimal design that was developed for this study. The two sequential design strategies are compared for experiments with a large number of test factors using pre-experiment design evaluation metrics, as well as modeling results obtained from simulated wind tunnel data for the NASA LA-8 aircraft. The design evaluation metrics show that the sequential I-optimal base design has higher statistical power, lower correlation among candidate regressors, lower prediction variance, and more precise parameter estimates. The simulated wind tunnel experiments conducted using each design reveal that the sequential I-optimal base design has better predictive capability with fewer test points. The experiment design and evaluation procedures are described in detail to inform future aerodynamic characterization experiments for complex aircraft.

design of experiments↗
NASA NTRS2008

RFID in Space: Exploring the Feasibility and Performance of Gen 2 Tags as a Means of Tracking Equipment, Supplies, and Consumable Products in Cargo Transport Bags onboard a Space Vehicle or Habitat

Current inventory management techniques for consumables and supplies aboard space vehicles are burdensome and time consuming. Inventory of food, clothing, and supplies are taken periodically by manually scanning the barcodes on each item. The inaccuracy of reading barcodes and the excessive amount of time it takes for the astronauts to perform this function would be better spent doing scientific experiments. Therefore, there is a need for an alternative method of inventory control by NASA astronauts. Radio Frequency Identification (RFID) is an automatic data capture technology that has potential to create a more effective and user-friendly inventory management system (IMS). In this paper we introduce a Design for Six Sigma Research (DFSS-R) methodology that allows for reliability testing of RFID systems. The research methodology uses a modified sequential design of experiments process to test and evaluate the quality of commercially available RFID technology. The results from the experimentation are compared to the requirements provided by NASA to evaluate the feasibility of using passive Generation 2 RFID technology to improve inventory control aboard crew exploration vehicles.

Jones, Erick C.↗
DOE OSTI2023

CCSI Toolset 3.17 Release

CCSI Toolset 3.17 Release Highlights A workaround was developed to allow complex Aspen Custom Modeler (ACM) models to be used in FOQUS. This workaround uses Visual Basic for Applications to connect the ACM models to FOQUS. The ability for User plugins to be uploaded to FOQUS Cloud was added. The documentation was updated to include Optional Software Install and Tutorial Notes to clarify the usage of Turbine and SimSinter in installation instructions and adds a link to the relevant tutorial page. The Sequential Design of Experiments documentation was updated with current screenshots. The copyright was updated to include 2023.

AS↗
DOE OSTI2023

CCSI Toolset 3.19 Release

CCSI Toolset 3.19 Release Highlights A gradient generation tool was developed to support GENN models in FOQUS. Certain machine learning tools train gradient-enhanced neural network (GENN) models which can be more accurate for complex datasets given a priori knowledge of model derivatives. However, the derivatives must be known beforehand and are not often available for process data. This tool automatically predicts the gradients for a training dataset in a form usable by common GENN trainers, such as Surrogate Modeling Toolbox. Support was added for Surrogate Modeling Toolbox GENN models in FOQUS, including updates to the run methods, node properties, test framework, documentation and optional dependencies list. Users can train/save Surrogate Modeling Toolbox gradient-enhanced neural network (GENN) models with custom objects and produce .pkl files compatible with the Machine Learning/Artificial Intelligence Plugin in FOQUS. A simpler implementation of the ordering algorithm in the Sequential Design of Experiments (SDOE) module was included. The SDOE examples documentation was updated. The Optimality-Based Design of Experiments was updated to improve the error handling when the results are None.

AS↗
DOE OSTI2024

CCSI Toolset 3.20 Release

CCSI Toolset 3.20 Release Highlights Minimum Viable Product surrogate plugin was added for creating Machine Learning/Artificial Intelligence models. Corresponding documentation was added for the plugin. Sequential Design of Experiments plots were updated to eliminate an issue with the window stack ordering upon closure of the plots. Support for Python 3.7 was removed. Documentation was improved by adding new mandatory section to the ReadTheDocs configuration and adding installation instructions back for NLOpt. TurbineLite was updated to 3.0.0, which is compatible with SimSinter 3.0.0. The developer environment was updated and 32-bit support was removed. SimSinter was updated to 3.0.0. This version removed gPROMS support and included security updates.

AS↗
DOE OSTI2024

CCSI Toolset 3.21 Release

CCSI Toolset 3.21 Release Highlights Parallelization support was added for Sequential Design of Experiments (SDOE) computations using Dask (preliminary). Input type dependent ordering capability was added to the SDOE module. With this implementation the user can specify the level of difficulty to change an input (Easy or Hard) and FOQUS will generate the appropriate ordered design depending on the input difficulty combination. Python version support was extended. FOQUS is now compatible with Python 3.8 through 3.12. Platforms used for automated testing were expanded to include macOS ARM (Apple Silicon). Updates to the FOQUS documentation to include information on how to set paths for SimSinter and TurbineLite. Turbine configuration section was added to Debugging Documentation.

AS↗
DOE OSTI2024

CCSI Toolset 3.22 Release

CCSI Toolset 3.22 Release Highlights The Sequential Design of Experiments user interface was updated to resolve an issue where the results would fail to plot in some cases (e.g., Non-Uniform Space Filling designs). The Machine Learning/Artificial Intelligence module was updated to support Keras 3 and to reflect changes made to dependencies’ syntax. A check was added to ensure PSUADE is installed and available at FOQUS startup. If PSUADE is not installed, a link to the FOQUS documentation is displayed and FOQUS is closed. The copyright year was updated to include 2024 in places where it had not previously been updated. Typographical errors were corrected to improve clarity in variable names and documentation. The FOQUS documentation was updated to reflect the fact that ALAMO can have two executables and indicates the correct executable to add to the Settings path. SimSinter was updated to version 3.1.0. This version removed gPROMS support and included security updates.

AS↗
DOE OSTI2024

Validation Framework for Post-Combustion Carbon Capture CFD Simulations

First-principles based computational fluid dynamics (CFD) simulations are proposed as a fundamental tool for investigating solvent-based CO2 absorption in packed columns, due to the ability to accurately represent the underlying non-linear multiscale dynamics. In this work, we employ such models to investigate hydrodynamics of columns with structured by assessing the key hydrodynamic metrics, such as pressure drop and liquid holdup. Our models are validated with experimental data from a specifically designed column for this line of work. The test cases of gas and liquid flowrates and operating conditions were selected through a comprehensive sequential design of experiments approach offered by the CCSI2 toolset.

Panagakos, Grigorios↗
DOE OSTI2022

Framework for Optimization, Quantification of Uncertainty and Surrogates – Updated Capabilities

This poster presents updated capabilities within the FOQUS Toolset, covering core features as well as project-based applications. Specifically, the poster highlights advancements in FOQUS integration with cloud-based clients, plugin support for machine learning tools and external simulations, sequential design of experiments, and advanced support for dynamic process models. The applications demonstrate the breadth of FOQUS predictive capabilities for chemical, energy and economic system analysis.

Paul, Brandon↗
NASA NTRS1972

Kullback-Leibler information function and the sequential selection of experiments to discriminate among several linear models

A sequential adaptive experimental design procedure for a related problem is studied. It is assumed that a finite set of potential linear models relating certain controlled variables to an observed variable is postulated, and that exactly one of these models is correct. The problem is to sequentially design most informative experiments so that the correct model equation can be determined with as little experimentation as possible. Discussion includes: structure of the linear models; prerequisite distribution theory; entropy functions and the Kullback-Leibler information function; the sequential decision procedure; and computer simulation results. An example of application is given.

Sidik, S. M.↗
DOE OSTI2023

Bayesian sequential optimal experimental design for nonlinear models using policy gradient reinforcement learning

We present a mathematical framework and computational methods for optimally designing a finite sequence of experiments. This sequential optimal experimental design (sOED) problem is formulated as a finite-horizon partially observable Markov decision process (POMDP) under a Bayesian setting and with information-theoretic utilities. The formulation is general and may accommodate continuous random variables, non-Gaussian posteriors, and nonlinear forward models. The sOED design policy incorporates elements of feedback and lookahead simultaneously, and we show it to generalize the commonly-used batch and greedy design strategies. We solve for the sOED policy using the policy gradient (PG) method from reinforcement learning, and provide a derivation for the PG expression in the sOED context. Adopting an actor-critic approach, the policy and value functions are parameterized using deep neural networks and improved via PG estimates produced from simulated episodes of designs and observations. The new PG-sOED algorithm is first validated on a linear-Gaussian benchmark, and then compared against other design baselines on a sensor movement problem for contaminant source inversion in a convection-diffusion field. As a result, we provide explanation for the policy behaviors using knowledge of the underlying physical process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

CAMERA: A method for cost-aware, adaptive, multifidelity, efficient reliability analysis

Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distributions, and Monte Carlo sampling methods are intractable when expensive high-fidelity simulations have to be queried. Here, we propose a method to use models of multiple fidelities that trade accuracy for computational efficiency. Specifically, we propose the use of multifidelity Gaussian process models to efficiently fuse models at multiple fidelity, thereby offering a cheap surrogate model that emulates the original model at all fidelities. Furthermore, we propose a novel sequential acquisition function based experiment design framework that can automatically select samples from appropriate fidelity models to make predictions about quantities of interest at the highest fidelity. We use our proposed approach in an importance sampling setting and demonstrate our method on the failure level set and probability estimation on synthetic test functions and two real-world applications, namely, the reliability analysis of a gas turbine engine blade using a finite element method and a transonic aerodynamic wing test case using Reynolds-averaged Navier-Stokes equations. We show that our method predicts the failure boundary and probability more accurately and at a fraction of the computational cost compared with using just a single expensive high-fidelity model. Finally, we show that our sequential approach is guaranteed to asymptotically converge to the true failure boundary with high probability.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2017

Efficient Testing Combining Design of Experiment and Learn-to-Fly Strategies

Rapid modeling and efficient testing methods are important in a number of aerospace applications. In this study efficient testing strategies were evaluated in a wind tunnel test environment and combined to suggest a promising approach for both ground-based and flight-based experiments. Benefits of using Design of Experiment techniques, well established in scientific, military, and manufacturing applications are evaluated in combination with newly developing methods for global nonlinear modeling. The nonlinear modeling methods, referred to as Learn-to-Fly methods, utilize fuzzy logic and multivariate orthogonal function techniques that have been successfully demonstrated in flight test. The blended approach presented has a focus on experiment design and identifies a sequential testing process with clearly defined completion metrics that produce increased testing efficiency.

Murphy, Patrick C.↗