Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sequential experiment design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

RFID in Space: Exploring the Feasibility and Performance of Gen 2 Tags as a Means of Tracking Equipment, Supplies, and Consumable Products in Cargo Transport Bags onboard a Space Vehicle or Habitat

Current inventory management techniques for consumables and supplies aboard space vehicles are burdensome and time consuming. Inventory of food, clothing, and supplies are taken periodically by manually scanning the barcodes on each item. The inaccuracy of reading barcodes and the excessive amount of time it takes for the astronauts to perform this function would be better spent doing scientific experiments. Therefore, there is a need for an alternative method of inventory control by NASA astronauts. Radio Frequency Identification (RFID) is an automatic data capture technology that has potential to create a more effective and user-friendly inventory management system (IMS). In this paper we introduce a Design for Six Sigma Research (DFSS-R) methodology that allows for reliability testing of RFID systems. The research methodology uses a modified sequential design of experiments process to test and evaluate the quality of commercially available RFID technology. The results from the experimentation are compared to the requirements provided by NASA to evaluate the feasibility of using passive Generation 2 RFID technology to improve inventory control aboard crew exploration vehicles.

Jones, Erick C.↗

Using the Carbon Capture Simulation Initiative (CCSI) Tool to Design the Experiments in the Parametric Campaign of a Novel Compact Absorber for Carbon Capture

Gas absorption towers with structured packing and solvent have been used for Carbon Dioxide (CO 2 ) Capture for about many decades. To overcome process limitations and practical disadvantages for CO 2 capture from the stationary emitter (e.g. NG and coal power plant), many new designs have been proposed and explored at the various scales in the last decade with aim of either low energy penalty or low capital cost. To reduce the size of the absorption tower and hence the total cost of CO 2 capture, the University of Kentucky Center for Applied Energy Research Center (UK CAER) has designed and built a novel CO 2 capture absorption tower or Compact Absorber, integrated into an existing large-bench scale CO 2 capture unit. The Compact Absorber has three sections. The top of the column is a fogging section where the solvent is sprayed through a nozzle producing droplets flowing downward in a co-current fashion with the flue gas. The center of the column is a frothing section where the solvent and flue gas flow through regenerative frothing screens designed by Industrial Climate Solutions, Inc. The bottom of the column is a typical structured packing section were the flue gas and solvent flow in a counter-current fashion. The parametric campaign will be conducted in order to optimize the operating parameters for CO 2 capture including liquid/gas ratio, lean loading, and temperature, liquid residence time. A simulated flue gas with 14% CO 2 will be used along with a UK CAER developed proprietary solvent. The 100-hour parametric campaign is designed using a statistical approach of the Sequential Design of Experiments (sDOE). sDOE is one of the CCSI tools that provides an adaptive statistical approach for designing future experiments based on the results of previous experiments. Application of a typical DOE provides the user with the minimum number of experiments required to get the same data, but sDOE allows the user to make an informed choice of experiments based on the results of previous experiments. The complete absorption column has been constructed and has been partially commissioned. Initial data has been collected by operating using the fogging section and the frothing section. The fogging section produces solvent droplets of about 100 μm sauter mean diameter and as small as 25 μm using a hydraulic nozzle by BETE. The frothing section produces bubbles of about 5mm with high mixing of solvent promoting the higher mass transfer from gas to liquid. The absorber reaches the capture efficiency of about 50% with only two sections in operation. Based on the current results, it can be deduced that increasing the solvent feed temperature and including the packed section for absorption the capture efficiency will increase further. Initial data will be collected using all three sections of the absorber and will be used for sDOE. Non-Uniform Space Filling model of sDOE will be used to prioritize the input conditions resulting into maximum capture efficiency. sDOE is performed using the platform called Framework Optimization, Quantification of Uncertainty, and Surrogates (FOQUS). The method and results demonstrating the progress of the parametric campaign from the initial set of experiments to the final stage of obtaining optimized parameters using sDOE tool will be presented in detail.

20 FOSSIL-FUELED POWER PLANTS↗

CCSI Toolset 3.17 Release

CCSI Toolset 3.17 Release Highlights A workaround was developed to allow complex Aspen Custom Modeler (ACM) models to be used in FOQUS. This workaround uses Visual Basic for Applications to connect the ACM models to FOQUS. The ability for User plugins to be uploaded to FOQUS Cloud was added. The documentation was updated to include Optional Software Install and Tutorial Notes to clarify the usage of Turbine and SimSinter in installation instructions and adds a link to the relevant tutorial page. The Sequential Design of Experiments documentation was updated with current screenshots. The copyright was updated to include 2023.

AS↗

CCSI Toolset 3.19 Release

CCSI Toolset 3.19 Release Highlights A gradient generation tool was developed to support GENN models in FOQUS. Certain machine learning tools train gradient-enhanced neural network (GENN) models which can be more accurate for complex datasets given a priori knowledge of model derivatives. However, the derivatives must be known beforehand and are not often available for process data. This tool automatically predicts the gradients for a training dataset in a form usable by common GENN trainers, such as Surrogate Modeling Toolbox. Support was added for Surrogate Modeling Toolbox GENN models in FOQUS, including updates to the run methods, node properties, test framework, documentation and optional dependencies list. Users can train/save Surrogate Modeling Toolbox gradient-enhanced neural network (GENN) models with custom objects and produce .pkl files compatible with the Machine Learning/Artificial Intelligence Plugin in FOQUS. A simpler implementation of the ordering algorithm in the Sequential Design of Experiments (SDOE) module was included. The SDOE examples documentation was updated. The Optimality-Based Design of Experiments was updated to improve the error handling when the results are None.

AS↗

CCSI Toolset 3.20 Release

CCSI Toolset 3.20 Release Highlights Minimum Viable Product surrogate plugin was added for creating Machine Learning/Artificial Intelligence models. Corresponding documentation was added for the plugin. Sequential Design of Experiments plots were updated to eliminate an issue with the window stack ordering upon closure of the plots. Support for Python 3.7 was removed. Documentation was improved by adding new mandatory section to the ReadTheDocs configuration and adding installation instructions back for NLOpt. TurbineLite was updated to 3.0.0, which is compatible with SimSinter 3.0.0. The developer environment was updated and 32-bit support was removed. SimSinter was updated to 3.0.0. This version removed gPROMS support and included security updates.

AS↗

CCSI Toolset 3.21 Release

CCSI Toolset 3.21 Release Highlights Parallelization support was added for Sequential Design of Experiments (SDOE) computations using Dask (preliminary). Input type dependent ordering capability was added to the SDOE module. With this implementation the user can specify the level of difficulty to change an input (Easy or Hard) and FOQUS will generate the appropriate ordered design depending on the input difficulty combination. Python version support was extended. FOQUS is now compatible with Python 3.8 through 3.12. Platforms used for automated testing were expanded to include macOS ARM (Apple Silicon). Updates to the FOQUS documentation to include information on how to set paths for SimSinter and TurbineLite. Turbine configuration section was added to Debugging Documentation.

AS↗

CCSI Toolset 3.22 Release

CCSI Toolset 3.22 Release Highlights The Sequential Design of Experiments user interface was updated to resolve an issue where the results would fail to plot in some cases (e.g., Non-Uniform Space Filling designs). The Machine Learning/Artificial Intelligence module was updated to support Keras 3 and to reflect changes made to dependencies’ syntax. A check was added to ensure PSUADE is installed and available at FOQUS startup. If PSUADE is not installed, a link to the FOQUS documentation is displayed and FOQUS is closed. The copyright year was updated to include 2024 in places where it had not previously been updated. Typographical errors were corrected to improve clarity in variable names and documentation. The FOQUS documentation was updated to reflect the fact that ALAMO can have two executables and indicates the correct executable to add to the Settings path. SimSinter was updated to version 3.1.0. This version removed gPROMS support and included security updates.

AS↗

Validation Framework for Post-Combustion Carbon Capture CFD Simulations

First-principles based computational fluid dynamics (CFD) simulations are proposed as a fundamental tool for investigating solvent-based CO2 absorption in packed columns, due to the ability to accurately represent the underlying non-linear multiscale dynamics. In this work, we employ such models to investigate hydrodynamics of columns with structured by assessing the key hydrodynamic metrics, such as pressure drop and liquid holdup. Our models are validated with experimental data from a specifically designed column for this line of work. The test cases of gas and liquid flowrates and operating conditions were selected through a comprehensive sequential design of experiments approach offered by the CCSI2 toolset.

Panagakos, Grigorios↗

Framework for Optimization, Quantification of Uncertainty and Surrogates – Updated Capabilities

This poster presents updated capabilities within the FOQUS Toolset, covering core features as well as project-based applications. Specifically, the poster highlights advancements in FOQUS integration with cloud-based clients, plugin support for machine learning tools and external simulations, sequential design of experiments, and advanced support for dynamic process models. The applications demonstrate the breadth of FOQUS predictive capabilities for chemical, energy and economic system analysis.

Paul, Brandon↗

Kullback-Leibler information function and the sequential selection of experiments to discriminate among several linear models

A sequential adaptive experimental design procedure for a related problem is studied. It is assumed that a finite set of potential linear models relating certain controlled variables to an observed variable is postulated, and that exactly one of these models is correct. The problem is to sequentially design most informative experiments so that the correct model equation can be determined with as little experimentation as possible. Discussion includes: structure of the linear models; prerequisite distribution theory; entropy functions and the Kullback-Leibler information function; the sequential decision procedure; and computer simulation results. An example of application is given.

Sidik, S. M.↗

Bayesian sequential optimal experimental design for nonlinear models using policy gradient reinforcement learning

We present a mathematical framework and computational methods for optimally designing a finite sequence of experiments. This sequential optimal experimental design (sOED) problem is formulated as a finite-horizon partially observable Markov decision process (POMDP) under a Bayesian setting and with information-theoretic utilities. The formulation is general and may accommodate continuous random variables, non-Gaussian posteriors, and nonlinear forward models. The sOED design policy incorporates elements of feedback and lookahead simultaneously, and we show it to generalize the commonly-used batch and greedy design strategies. We solve for the sOED policy using the policy gradient (PG) method from reinforcement learning, and provide a derivation for the PG expression in the sOED context. Adopting an actor-critic approach, the policy and value functions are parameterized using deep neural networks and improved via PG estimates produced from simulated episodes of designs and observations. The new PG-sOED algorithm is first validated on a linear-Gaussian benchmark, and then compared against other design baselines on a sensor movement problem for contaminant source inversion in a convection-diffusion field. As a result, we provide explanation for the policy behaviors using knowledge of the underlying physical process.

97 MATHEMATICS AND COMPUTING↗

CAMERA: A method for cost-aware, adaptive, multifidelity, efficient reliability analysis

Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distributions, and Monte Carlo sampling methods are intractable when expensive high-fidelity simulations have to be queried. Here, we propose a method to use models of multiple fidelities that trade accuracy for computational efficiency. Specifically, we propose the use of multifidelity Gaussian process models to efficiently fuse models at multiple fidelity, thereby offering a cheap surrogate model that emulates the original model at all fidelities. Furthermore, we propose a novel sequential acquisition function based experiment design framework that can automatically select samples from appropriate fidelity models to make predictions about quantities of interest at the highest fidelity. We use our proposed approach in an importance sampling setting and demonstrate our method on the failure level set and probability estimation on synthetic test functions and two real-world applications, namely, the reliability analysis of a gas turbine engine blade using a finite element method and a transonic aerodynamic wing test case using Reynolds-averaged Navier-Stokes equations. We show that our method predicts the failure boundary and probability more accurately and at a fraction of the computational cost compared with using just a single expensive high-fidelity model. Finally, we show that our sequential approach is guaranteed to asymptotically converge to the true failure boundary with high probability.

97 MATHEMATICS AND COMPUTING↗

Best Bang for the Buck: Part 1 – The Size of Experiments Relative to Design Performance

There are many choices to make, when designing an experiment for a study, such as: what design factors to consider, which levels of the factors to use and which model to focus on. One aspect of design, however, is often left unquestioned: the size of the experiment. When learning about design of experiments, problems are often posed as "select a design for a particular objective with N runs." It’s tempting to consider the design size as a given constraint in the design-selection process. If you think of learning through designed experiments as a sequential process, however, strategically planning for the use of resources at different stages of data collection can be beneficial: Saving experimental runs for later is advantageous if you can efficiently learn with less in the early stages. Alternatively, if you’re too frugal in the early stages, you might not learn enough to proceed confidently with the next stages. Therefore, choosing the right-sized experiment is important—not too large or too small, but with a thoughtful balance to maximize the knowledge gained given the available resources. It can be a great advantage to think about the design size as flexible and include it as an aspect for comparisons. Sometimes you’re asked to provide a small design that is too ambitious for the goals of the study. Finally, if you can show quantitatively how the suggested design size might be inadequate or lead to problems during analysis—and also offer a formal comparison to some alternatives of different (likely larger) sizes—you may have a better chance to ask for additional resources to deliver statistically sound and satisfying results

97 MATHEMATICS AND COMPUTING↗

Introduction to Statistically Designed Experiments

Statistically designed experiments can save researchers time and money by reducing the number of necessary experimental trials, while resulting in more conclusive experimental results. Surprisingly, many researchers are still not aware of this efficient and effective experimental methodology. As reported in a 2013 article from Chemical & Engineering News, there has been a resurgence of this methodology in recent years (http://cen.acs.org/articles/91/i13/Design-Experiments-Makes-Comeback.html?h=2027056365). This presentation will provide a brief introduction to statistically designed experiments. The main advantages will be reviewed along with the some basic concepts such as factorial and fractional factorial designs. The recommended sequential approach to experiments will be introduced and finally a case study will be presented to demonstrate this methodology.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Efficient Testing Combining Design of Experiment and Learn-to-Fly Strategies

Rapid modeling and efficient testing methods are important in a number of aerospace applications. In this study efficient testing strategies were evaluated in a wind tunnel test environment and combined to suggest a promising approach for both ground-based and flight-based experiments. Benefits of using Design of Experiment techniques, well established in scientific, military, and manufacturing applications are evaluated in combination with newly developing methods for global nonlinear modeling. The nonlinear modeling methods, referred to as Learn-to-Fly methods, utilize fuzzy logic and multivariate orthogonal function techniques that have been successfully demonstrated in flight test. The blended approach presented has a focus on experiment design and identifies a sequential testing process with clearly defined completion metrics that produce increased testing efficiency.

Murphy, Patrick C.↗

Predictive Maturity of Multi-Scale Simulation Models for Fuel Performance

The project proposed to provide a Predictive Maturity Framework with its companion metrics that (1) introduce a formalized, quantitative means to communicate information between interested parties, (2) provide scientifically dependable means to claim completion of Validation and Uncertainty Quantification (VU) activities, and (3) guide the decision makers in the allocation of Nuclear Energy’s resources for code development and physical experiments. The project team proposed to develop this framework based on two complimentary criteria: (1) the extent of experimental evidence available for the calibration of simulation models and (2) the sophistication of the physics incorporated in simulation models. The proposed framework is capable of quantifying the interaction between the required number of physical experiments and degree of physics sophistication. The project team has developed this framework and implemented it with a multi-scale model for simulating creep of a core reactor cladding. The multi-scale model is composed of the viscoplastic self-consistent (VPSC) code at the meso-scale, which represents the visco-plastic behavior and changing properties of a highly anisotropic material and a Finite Element (FE) code at the macro-scale to represent the elastic behavior and apply the loading. The framework developed takes advantage of the transparency provided by partitioned analysis, where independent constituent codes are coupled in an iterative manner. This transparency allows model developers to better understand and remedy the source of biases and uncertainties, whether they stem from the constituents or the coupling interface by exploiting separate-effect experiments conducted within the constituent domain and integral-effect experiments conducted within the full-system domain. The project team has implemented this procedure with the multi- scale VPSC-FE model and demonstrated its ability to improve the predictive capability of the model. Within this framework, the project team has focused on optimizing resource allocation for improving numerical models through further code development and experimentation. Related to further code development, we have developed a code prioritization index (CPI) for coupled numerical models. CPI is implemented to effectively improve the predictive capability of the coupled model by increasing the sophistication of constituent codes. In relation to designing new experiments, we investigated the information gained by the addition of each new experiment used for calibration and bias correction of a simulation model. Additionally, the variability of ‘information gain’ through the design domain has been investigated in order to identify the experiment settings where maximum information gain occurs and thus guide the experimenters in the selection of the experiment settings. This idea was extended to evaluate the information gain from each experiment can be improved by intelligently selecting the experiments, leading to the development of the Batch Sequential Design (BSD) technique. Additionally, we evaluated the importance of sufficiently exploring the domain of applicability in experiment-based validation of high-consequence modeling and simulation by developing a new metric to quantify coverage. This metric has also been incorporated into the design of new experiments. Finally, we have proposed a data-aware calibration approach for the calibration of numerical models. This new method considers the complexity of a numerical model (the number of parameters to be calibrated, parameter uncertainty, and form of the model) and seeks to identify the number of experiments necessary to calibrate the model based on the level of sophistication of the physics. The final component in the project team’s work to improve model calibration and validation methods is the incorporation of robustness to non-probabilistic uncertainty in the input parameters. This is an improvement to model validation and uncertainty quantification stemming beyond the originally proposed scope of the project. We have introduced a new metric for incorporating the concept of robustness into experiment-based validation of numerical models. This project has accounted for the graduation of two Ph.D. students (Kendra Van Buren and Josh Hegenderfer) and two M.S. students (Matthew Egeberg and Parker Shields). One of the doctoral students is now working in the nuclear engineering field and the other one is a post-doctoral fellow at the Los Alamos National Laboratory. Additionally, two more Ph.D. students (Garrison Stevens and Tunc Kulaksiz) who are working towards graduation have been supported by this project.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Practical and Optimal Sequential Bayesian Experimental Design for Complex Systems Incorporating Human Experimenter Preferences (Final Scientific/Technical Report)

Experiments are indispensable for developing models of complex systems. Carefully designed experiments can provide substantial savings for these expensive data-acquisition opportunities. However, designs based on heuristics are often suboptimal for systems with multiphysics, nonlinear dynamics, and uncertain and noisy environments. Optimal experimental design, while leveraging predictive models, seeks to systematically quantify and maximize the value of experiments. In this project, we focused on the design of multiple experiments, where current approaches are largely suboptimal: batch-design does not adapt to new data acquired during the experiment campaign (no feedback), and greedy/myopic design ignores future dynamics and consequences (no lookahead). We developed the mathematical framework and computational methods for sequential optimal experimental design (sOED) for complex systems. We enabled tractable model-based sOED in a rigorous manner through novel algorithms based on reinforcement learning, and investigated the effects of human experimenters on the design process. Our methods are fully Bayesian, able to quantify and update uncertainty in a principled manner. The traits aimed by our approach—mathematical rigor and optimality, human effects and uncertainty quantification, computational practicality—are crucial for elevating the standards of artificial intelligence (AI) to support decision-making in scientific domains, and contribute toward trust and realistic adoption of AI in experimental design practice.

97 MATHEMATICS AND COMPUTING↗