Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sequential design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

An Approach to Bayesian Optimization for Design Feasibility Check on Discontinuous Black-Box Functions

The paper presents a novel approach to applying Bayesian Optimization (BO) in predicting an unknown constraint boundary, also representing the discontinuity of an unknown function, for a feasibility check on the design space, thereby representing a classification tool to discern between a feasible and infeasible region. Bayesian optimization is a low-cost black-box global optimization tool in the Sequential Design Methods where one learns and updates knowledge from prior evaluated designs, and proceeds to the selection of new designs for future evaluation. However, BO is best suited to problems with the assumption of a continuous objective function and does not guarantee true convergence when having a discontinuous design space. This is because of the insufficient knowledge of the BO about the nature of the discontinuity of the unknown true function. In this paper, we have proposed to predict the location of the discontinuity using a BO algorithm on an artificially projected continuous design space from the original discontinuous design space. The proposed approach has been implemented in a thin tube design with the risk of creep-fatigue failure under constant loading of temperature and pressure. The stated risk depends on the location of the designs in terms of safe and unsafe regions, where the discontinuities lie at the transition between those regions; therefore, the discontinuity has also been treated as an unknown creep-fatigue failure constraint. The proposed BO algorithm has been trained to maximize sampling toward the unknown transition region, to act as a high accuracy classifier between safe and unsafe designs with minimal training cost. The converged solution has been validated for different design parameters with classification error rate and function evaluations at an average of <1% and ~150, respectively. Finally, the performance of our proposed approach in terms of training cost and classification accuracy of thin tube design is shown to be better than the existing machine learning (ML) algorithms such as Support Vector Machine (SVM), Random Forest (RF), and Boosting.

Engineering↗

An optimal momentum management controller for the Space Station

This paper presents a new sequential design procedure for determining an optimal CMG (control moment gyro) momentum management and attitude control system for the Space Station Freedom. First, the Space Station equations of motion are linearized and uncoupled, and the associated state space equations are defined. Next, a new sequential procedure is used for the development of a continuous quadratic regulator with eigenvalue placement in a specified region of the complex plane. The regional pole assignment method is utilized since it is best suited for tradeoffs between eigenvalue locations and robustness with respect to parameter variations, sensor failures, implementation accuracies and gain reductions. The matrix sign function is used for solving the Riccati equations which appear in the design procedure. Simulation results are given which show that the resultant design provides desired system performance.

Sunkel, J. W.↗

Predictive Maturity of Multi-Scale Simulation Models for Fuel Performance

The project proposed to provide a Predictive Maturity Framework with its companion metrics that (1) introduce a formalized, quantitative means to communicate information between interested parties, (2) provide scientifically dependable means to claim completion of Validation and Uncertainty Quantification (VU) activities, and (3) guide the decision makers in the allocation of Nuclear Energy’s resources for code development and physical experiments. The project team proposed to develop this framework based on two complimentary criteria: (1) the extent of experimental evidence available for the calibration of simulation models and (2) the sophistication of the physics incorporated in simulation models. The proposed framework is capable of quantifying the interaction between the required number of physical experiments and degree of physics sophistication. The project team has developed this framework and implemented it with a multi-scale model for simulating creep of a core reactor cladding. The multi-scale model is composed of the viscoplastic self-consistent (VPSC) code at the meso-scale, which represents the visco-plastic behavior and changing properties of a highly anisotropic material and a Finite Element (FE) code at the macro-scale to represent the elastic behavior and apply the loading. The framework developed takes advantage of the transparency provided by partitioned analysis, where independent constituent codes are coupled in an iterative manner. This transparency allows model developers to better understand and remedy the source of biases and uncertainties, whether they stem from the constituents or the coupling interface by exploiting separate-effect experiments conducted within the constituent domain and integral-effect experiments conducted within the full-system domain. The project team has implemented this procedure with the multi- scale VPSC-FE model and demonstrated its ability to improve the predictive capability of the model. Within this framework, the project team has focused on optimizing resource allocation for improving numerical models through further code development and experimentation. Related to further code development, we have developed a code prioritization index (CPI) for coupled numerical models. CPI is implemented to effectively improve the predictive capability of the coupled model by increasing the sophistication of constituent codes. In relation to designing new experiments, we investigated the information gained by the addition of each new experiment used for calibration and bias correction of a simulation model. Additionally, the variability of ‘information gain’ through the design domain has been investigated in order to identify the experiment settings where maximum information gain occurs and thus guide the experimenters in the selection of the experiment settings. This idea was extended to evaluate the information gain from each experiment can be improved by intelligently selecting the experiments, leading to the development of the Batch Sequential Design (BSD) technique. Additionally, we evaluated the importance of sufficiently exploring the domain of applicability in experiment-based validation of high-consequence modeling and simulation by developing a new metric to quantify coverage. This metric has also been incorporated into the design of new experiments. Finally, we have proposed a data-aware calibration approach for the calibration of numerical models. This new method considers the complexity of a numerical model (the number of parameters to be calibrated, parameter uncertainty, and form of the model) and seeks to identify the number of experiments necessary to calibrate the model based on the level of sophistication of the physics. The final component in the project team’s work to improve model calibration and validation methods is the incorporation of robustness to non-probabilistic uncertainty in the input parameters. This is an improvement to model validation and uncertainty quantification stemming beyond the originally proposed scope of the project. We have introduced a new metric for incorporating the concept of robustness into experiment-based validation of numerical models. This project has accounted for the graduation of two Ph.D. students (Kendra Van Buren and Josh Hegenderfer) and two M.S. students (Matthew Egeberg and Parker Shields). One of the doctoral students is now working in the nuclear engineering field and the other one is a post-doctoral fellow at the Los Alamos National Laboratory. Additionally, two more Ph.D. students (Garrison Stevens and Tunc Kulaksiz) who are working towards graduation have been supported by this project.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Effect of thermal conditioning on the initiation threshold of secondary high‐explosives

While most performance metrics of high–explosive (HE) based devices like detonation velocity, detonation pressure, and energy output are expected to degrade over time, the evolution of initiation threshold appears less clear, with claims of both increasing and decreasing trends in threshold having been made in the literature. This work analyzes D–optimally designed sequential binary test data for a few thermally conditioned porous–powder and polymer–bonded HE initiator systems using a Bayesian likelihood method employing the probit regression model. Here we find that in most cases the initiation threshold decreases (i.e., sensitivity increases) upon accelerated thermal conditioning. However, such results are nuanced and influenced by factors like the contact area of initiating stimulus, HE characteristics like density and specific surface area, as well as possible thermally induced changes to other materials and interfaces involved.

36 MATERIALS SCIENCE↗

Creep anisotropy modeling and uncertainty quantification of an additively manufactured Ni-based superalloy

The advantages offered by additive manufacturing over traditional processes has driven a great deal of industrial and academic interest in recent years. However, the process is relatively new and requires additional investigation to become sufficiently mature for wide scale industrial adoption. Electron beam melting powder bed fusion is one technology that has shown promise for fabricating high temperature resistant materials such as nickel based superalloys. The resulting microstructures typically exhibit a strong fiber texture in the build direction giving rise to anisotropic time-dependent deformation behavior. In order to accelerate the qualification of these materials for industrial adoption accurate numerical models are needed for simulating their behavior. In this work a crystal plasticity model including non-Schmid effects is presented for capturing creep anisotropy observed in additively manufactured IN738LC. The model is calibrated via a probabilistic framework where model parameters are treated as random variables. An iterative sequential design strategy is utilized to efficiently identify the probability density of the unknown model parameters. As a case study the model is utilized to investigate the behavior of randomly oriented equiaxed grain clusters sometimes observed embedded in the additively manufactured columnar structure. A synthetic realization is simulated and uncertainty is propagated through to the full-field response. Results indicate that these features are the source of significant creep relaxation and strain accumulation which partially explains observed grain boundary decohesion at these locations.

36 MATERIALS SCIENCE↗

CCSI Toolset 3.17 Release

CCSI Toolset 3.17 Release Highlights A workaround was developed to allow complex Aspen Custom Modeler (ACM) models to be used in FOQUS. This workaround uses Visual Basic for Applications to connect the ACM models to FOQUS. The ability for User plugins to be uploaded to FOQUS Cloud was added. The documentation was updated to include Optional Software Install and Tutorial Notes to clarify the usage of Turbine and SimSinter in installation instructions and adds a link to the relevant tutorial page. The Sequential Design of Experiments documentation was updated with current screenshots. The copyright was updated to include 2023.

AS↗

CCSI Toolset 3.19 Release

CCSI Toolset 3.19 Release Highlights A gradient generation tool was developed to support GENN models in FOQUS. Certain machine learning tools train gradient-enhanced neural network (GENN) models which can be more accurate for complex datasets given a priori knowledge of model derivatives. However, the derivatives must be known beforehand and are not often available for process data. This tool automatically predicts the gradients for a training dataset in a form usable by common GENN trainers, such as Surrogate Modeling Toolbox. Support was added for Surrogate Modeling Toolbox GENN models in FOQUS, including updates to the run methods, node properties, test framework, documentation and optional dependencies list. Users can train/save Surrogate Modeling Toolbox gradient-enhanced neural network (GENN) models with custom objects and produce .pkl files compatible with the Machine Learning/Artificial Intelligence Plugin in FOQUS. A simpler implementation of the ordering algorithm in the Sequential Design of Experiments (SDOE) module was included. The SDOE examples documentation was updated. The Optimality-Based Design of Experiments was updated to improve the error handling when the results are None.

AS↗

CCSI Toolset 3.20 Release

CCSI Toolset 3.20 Release Highlights Minimum Viable Product surrogate plugin was added for creating Machine Learning/Artificial Intelligence models. Corresponding documentation was added for the plugin. Sequential Design of Experiments plots were updated to eliminate an issue with the window stack ordering upon closure of the plots. Support for Python 3.7 was removed. Documentation was improved by adding new mandatory section to the ReadTheDocs configuration and adding installation instructions back for NLOpt. TurbineLite was updated to 3.0.0, which is compatible with SimSinter 3.0.0. The developer environment was updated and 32-bit support was removed. SimSinter was updated to 3.0.0. This version removed gPROMS support and included security updates.

AS↗

CCSI Toolset 3.21 Release

CCSI Toolset 3.21 Release Highlights Parallelization support was added for Sequential Design of Experiments (SDOE) computations using Dask (preliminary). Input type dependent ordering capability was added to the SDOE module. With this implementation the user can specify the level of difficulty to change an input (Easy or Hard) and FOQUS will generate the appropriate ordered design depending on the input difficulty combination. Python version support was extended. FOQUS is now compatible with Python 3.8 through 3.12. Platforms used for automated testing were expanded to include macOS ARM (Apple Silicon). Updates to the FOQUS documentation to include information on how to set paths for SimSinter and TurbineLite. Turbine configuration section was added to Debugging Documentation.

AS↗

CCSI Toolset 3.22 Release

CCSI Toolset 3.22 Release Highlights The Sequential Design of Experiments user interface was updated to resolve an issue where the results would fail to plot in some cases (e.g., Non-Uniform Space Filling designs). The Machine Learning/Artificial Intelligence module was updated to support Keras 3 and to reflect changes made to dependencies’ syntax. A check was added to ensure PSUADE is installed and available at FOQUS startup. If PSUADE is not installed, a link to the FOQUS documentation is displayed and FOQUS is closed. The copyright year was updated to include 2024 in places where it had not previously been updated. Typographical errors were corrected to improve clarity in variable names and documentation. The FOQUS documentation was updated to reflect the fact that ALAMO can have two executables and indicates the correct executable to add to the Settings path. SimSinter was updated to version 3.1.0. This version removed gPROMS support and included security updates.

AS↗

Sequential Bayesian Methods for Analyzing Computer Models

Efficient analysis of computer models is essential for the validation and uncertainty quantification of those models. Surrogate models, and Gaussian processes in particular, are a common and powerful approach to analyzing computer models that treat computer models as a black-box function. Gaussian processes form a Bayesian model over a space of functions that gives a measure of uncertainty about the computer model output at unobserved locations and a framework for sequential sampling. This tutorial will show how to fit Gaussian processes on a series of test functions and apply sequential design techniques to estimate extrema, level sets, and reliabilities of those test functions.

97 MATHEMATICS AND COMPUTING↗

A Simulator for Neyer Tests of Explosives

Explosives and explosive devices such as detonators are typically tested by applying a range of stimuli such as voltage or mechanical shock, and recording binary “detonated/did not detonate” responses. These are analyzed using maximum likelihood or generalized linear models to provide estimates of quantities such as the all-fire and no-fire points. Given that the true threshold for detonation is unknown a priori , sequential design methods are typically used to optimize the set of test points. One popular method, implemented in commercial software, is Neyer’s algorithm. To support simulation and experimental design, we have developed code in the R programming language to duplicate the functions of the Neyer software. We provide code for the simulator along with a description and examples of usage.

42 ENGINEERING↗

Numbers of center points appropriate to blocked response surface experiments

Tables are given for the numbers of center points to be used with blocked sequential designs of composite response surface experiments as used in empirical optimum seeking. The star point radii for exact orthogonal blocking is presented. The center point options varied from a lower limit of one to an upper limit equal to the numbers proposed by Box and Hunter for approximate rotatability and uniform variance, and exact orthogonal blocking. Some operating characteristics of the proposed options are described.

Holms, A. G.↗

Numbers of center points appropriate to blocked response surface experiments

Tables are given for the numbers of center points to be used with blocked sequential designs of composite response surface experiments as used in empirical optimum seeking. The tables also give the star point radii for exact orthogonal blocking. The center point options vary from a lower limit of one to an upper limit equal to the numbers proposed by Box and Hunter for approximate rotatability and uniform variance, and exact orthogonal blocking. Some operating characteristics of the proposed options are described.

Holms, A. G.↗

Multidisciplinary optimization for engineering systems: Achievements and potential

The currently common sequential design process for engineering systems is likely to lead to suboptimal designs. Recently developed decomposition methods offer an alternative for coming closer to optimum by breaking the large task of system optimization into smaller, concurrently executed and, yet, coupled tasks, identified with engineering disciplines or subsystems. The hierarchic and non-hierarchic decompositions are discussed and illustrated by examples. An organization of a design process centered on the non-hierarchic decomposition is proposed.

Sobieszczanski-Sobieski, Jaroslaw↗

Multidisciplinary optimization for engineering systems - Achievements and potential

The currently common sequential design process for engineering systems is likely to lead to suboptimal designs. Recently developed decomposition methods offer an alternative for coming closer to optimum by breaking the large task of system optimization into smaller, concurrently executed and, yet, coupled tasks, identified with engineering disciplines or subsystems. The hierarchic and non-hierarchic decompositions are discussed and illustrated by examples. An organization of a design process centered on the non-hierarchic decomposition is proposed.

Sobieszczanski-Sobieski, Jaroslaw↗

Sequential Importance Sampling for Rare Event Estimation with Computer Experiments

Importance sampling often drastically improves the variance of percentile and quantile estimators of rare events. We propose a sequential strategy for iterative refinement of importance distributions for sampling uncertain inputs to a computer model to estimate quantiles of model output or the probability that the model output exceeds a fixed or random threshold. A framework is introduced for updating a model surrogate to maximize its predictive capability for rare event estimation with sequential importance sampling. Examples of the proposed methodology involving materials strength and nuclear reactor applications will be presented. The conclusions are: (1) Importance sampling improves UQ of percentile and quantile estimates relative to brute force approach; (2) Benefits of importance sampling increase as percentiles become more extreme; (3) Iterative refinement improves importance distributions in relatively few iterations; (4) Surrogates are necessary for slow running codes; (5) Sequential design improves surrogate quality in region of parameter space indicated by importance distributions; and (6) Importance distributions and VRFs stabilize quickly, while quantile estimates may converge slowly.

97 MATHEMATICS AND COMPUTING↗