Search NASA⌕ Search

SEARCH · Search NASA

Results for “surrogate model development”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Probing Sensitivity of Discharge Characteristics to Model Selection using Uncertainty Quantification in an aprotic Li-Oxygen Battery

Currently, there are several models in the literature, such as kinetic models, microstructural models, and mass transport models that describe a Li-air battery's discharge behavior. Many of these models are calibrated and tested at low current densities and cannot be easily transferred to high current densities. Even at low current densities, there is no quantitative method for a researcher to choose a reaction kinetic model such as classical Butler-Volmer and its derivatives, and modified Marcus-Hush-Chidsey, a resistance model for lithium peroxide such as electron transport via tunneling or linear resistivity, a surface coverage model (lithium peroxide growth) such as partial coverage or full coverage, and mass transport model (discussed in Ref. [1]). Also, it is time-consuming to test different models at high current density (1C) due to a lack of well-tested models and well-calibrated model parameters. For this presentation, we will develop an analytical model, which acts as a surrogate model for a sophisticated finite element model to predict discharge time and discharge voltage. Next, we use an uncertainty quantifying technique called reduced-order stochastic optimization [2, 3] to determine the uncertainty in model parameters for rate kinetics, lithium peroxide resistivity, and parasitic resistance. Finally, a finite element simulation is performed to determine the error introduced by the surrogate model and its influence on the uncertainty in the model parameters.

M Mehta↗

Program to Optimize Simulated Trajectories II (POST2) Surrogate Models for Mars Ascent Vehicle (MAV) Performance Assessment

The primary purpose of the multiPOST tool is to enable the execution of much larger sets of vehicle cases to allow for broader trade space exploration. However, this exploration is not achieved solely with the increased case throughput. The multiPOST tool is applied to carry out a Design of Experiments (DOE), which is a set of cases that have been structured to capture a maximum amount of information about the design space with minimal computational effort. The results of the DOE are then used to fit a surrogate model, ultimately enabling parametric design space exploration. The approach used for the MAV study includes both DOE and surrogate modeling. First, the primary design considerations for the vehicle were used to develop the variables and ranges for the multiPOST DOE. The final set of DOE variables were carefully selected in order to capture the desired vehicle trades and take into account any special considerations for surrogate modeling. Next, the DOE sets were executed through multiPOST. Following successful completion of the DOE cases, a manual verification trial was performed. The trial involved randomly selecting cases from the DOE set and running them by hand. The results from the human analyst's run and multiPOST were then compared to ensure that the automated runs were being executed properly. Completion of the verification trials was then followed by surrogate model fitting. After fits to the multiPOST data were successfully created, the surrogate models were used as a stand-in for POST2 to carry out the desired MAV trades. Using the surrogate models in lieu of POST2 allowed for visualization of vehicle sensitivities to the input variables as well as rapid evaluation of vehicle performance. Although the models introduce some error into the output of the trade study, they were very effective at identifying areas of interest within the trade space for further refinement by human analysts. The next section will cover all of the ground rules and assumptions associated with DOE setup and multiPOST execution. Section 3.1 gives the final DOE variables and ranges, while section 3.2 addresses the POST2 specific assumptions. The results of the verification trials are given in section 4. Section 5 gives the surrogate model fitting results, including the goodness-of-fit metrics for each fit. Finally, the MAV specific results are discussed in section 6.

Zwack, M. R.↗

Optimal Reference Strain Structure for Studying Dynamic Responses of Flexible Rockets

In the proposed paper, the optimal design of reference strain structures (RSS) will be performed targeting for the accurate observation of the dynamic bending and torsion deformation of a flexible rocket. It will provide the detailed description of the finite-element (FE) model of a notional flexible rocket created in MSC.Patran. The RSS will be attached longitudinally along the side of the rocket and to track the deformation of the thin-walled structure under external loads. An integrated surrogate-based multi-objective optimization approach will be developed to find the optimal design of the RSS using the FE model. The Kriging method will be used to construct the surrogate model. For the data sampling and the performance evaluation, static/transient analyses will be performed with MSC.Natran/Patran. The multi-objective optimization will be solved with NSGA-II to minimize the difference between the strains of the launch vehicle and RSS. Finally, the performance of the optimal RSS will be evaluated by checking its strain-tracking capability in different numerical simulations of the flexible rocket.

finite-element (FE)↗

Shape Optimization by Bayesian-Validated Computer-Simulation Surrogates

A nonparametric-validated, surrogate approach to optimization has been applied to the computational optimization of eddy-promoter heat exchangers and to the experimental optimization of a multielement airfoil. In addition to the baseline surrogate framework, a surrogate-Pareto framework has been applied to the two-criteria, eddy-promoter design problem. The Pareto analysis improves the predictability of the surrogate results, preserves generality, and provides a means to rapidly determine design trade-offs. Significant contributions have been made in the geometric description used for the eddy-promoter inclusions as well as to the surrogate framework itself. A level-set based, geometric description has been developed to define the shape of the eddy-promoter inclusions. The level-set technique allows for topology changes (from single-body,eddy-promoter configurations to two-body configurations) without requiring any additional logic. The continuity of the output responses for input variations that cross the boundary between topologies has been demonstrated. Input-output continuity is required for the straightforward application of surrogate techniques in which simplified, interpolative models are fitted through a construction set of data. The surrogate framework developed previously has been extended in a number of ways. First, the formulation for a general, two-output, two-performance metric problem is presented. Surrogates are constructed and validated for the outputs. The performance metrics can be functions of both outputs, as well as explicitly of the inputs, and serve to characterize the design preferences. By segregating the outputs and the performance metrics, an additional level of flexibility is provided to the designer. The validated outputs can be used in future design studies and the error estimates provided by the output validation step still apply, and require no additional appeals to the expensive analysis. Second, a candidate-based a posteriori error analysis capability has been developed which provides probabilistic error estimates on the true performance for a design randomly selected near the surrogate-predicted optimal design.

Patera, Anthony T.↗

PALMO: An OVERFLOW Machine Learning Airfoil Performance Database

The OVERFLOW Machine Learning Airfoil Performance (PALMO) database has been created to enable robust modeling of airfoil performance in a variety of applications. The database uses OVERFLOW simulation data second-order accurate in time and fourth-order accurate in space with Spalart-Allmaras turbulence closure. The foundation of the in-development PALMO database is the airfoil base cube. Each base cube includes simulation data parametrized over a range of Mach numbers, Reynolds numbers, and angles-of-attack. This first release of the database includes the NACA 4-series airfoils, with parametrization in airfoil thickness and camber from an NACA 0006 to an NACA 4424. In total, 52,480 NACA 4-series calculations were run on the NASA High-End Compute Capability (HECC) supercomputer and the corresponding airfoil performance coefficients are embedded in the Appendix of this document for public distribution. This provides high-order-accurate simulation data covering a wide range of aerospace design applications, which enables users to develop OVERFLOW-quality airfoil performance look-up tables without additional high-performance computing. In addition to engineering design and analysis of aerospace vehicles, PALMO is well suited to be a benchmark dataset for the development and testing of machine learning methods in aerospace engineering. Downstream surrogate models enable OVERFLOW- quality airfoil performance predictions for any arbitrary combination of camber, thickness, Mach number, Reynolds number, and angle-of-attack within the bounds of the database.

Database↗

Tuning Neural Network Models for Improved Prediction of Boundary Layer Transition

Boundary layer transition can strongly impact flight vehicle performance as it influences surface skin friction and aerodynamic heating, making accurate transition prediction a key to designing next generation aircraft. Artificial neural networks (ANNs) have shown promise toward predicting laminar-turbulent transition based on linear stability correlations. The computational efficiency of ANNs and the substantially reduced user involvement in relation to direct computations based on the linear stability theory (LST) makes them an attractive methodology for integrating the LST based correlations in computational fluid dynamics codes. Tollmien-Schlichting (TS) waves correspond to the dominant transition mechanism in 2D or weakly 3D subsonic boundary layers, such as those encountered in general aviation applications. Improvements to neural network model accuracy in predicting the amplification rates of TS instability waves have been investigated by leveraging recent machine learning developments in conjunction with surrogate optimization techniques and via suitable augmentation of the data used to train the networks. The optimized models trained on the modified dataset reduced the average transition location errors on different airfoils at several flow conditions by 51% of the original manually-tuned network’s errors on the same flow cases. The actual transition locations were derived from the Langley Stability and Transition Analysis Code (LASTRAC).

Machine Learning↗

Probabilistic Prognosis of Non-Planar Fatigue Crack Growth

Quantifying the uncertainty in model parameters for the purpose of damage prognosis can be accomplished utilizing Bayesian inference and damage diagnosis data from sources such as non-destructive evaluation or structural health monitoring. The number of samples required to solve the Bayesian inverse problem through common sampling techniques (e.g., Markov chain Monte Carlo) renders high-fidelity finite element-based damage growth models unusable due to prohibitive computation times. However, these types of models are often the only option when attempting to model complex damage growth in real-world structures. Here, a recently developed high-fidelity crack growth model is used which, when compared to finite element-based modeling, has demonstrated reductions in computation times of three orders of magnitude through the use of surrogate models and machine learning. The model is flexible in that only the expensive computation of the crack driving forces is replaced by the surrogate models, leaving the remaining parameters accessible for uncertainty quantification. A probabilistic prognosis framework incorporating this model is developed and demonstrated for non-planar crack growth in a modified, edge-notched, aluminum tensile specimen. Predictions of remaining useful life are made over time for five updates of the damage diagnosis data, and prognostic metrics are utilized to evaluate the performance of the prognostic framework. Challenges specific to the probabilistic prognosis of non-planar fatigue crack growth are highlighted and discussed in the context of the experimental results.

Leser, Patrick E.↗

L'Ralph's Advanced Thermal Model Correlation Using Veritrek

Thermal model correlation uses data from thermal balance tests to better estimate uncertain input parameter values. During the correlation process, input parameters are modified in an iterative manner which can become computationally expensive since this requires that the high-fidelity thermal model be run for each iteration. Depending on the number of thermal balance test points there can be many sets of correlation parameters that satisfy correlation criteria; and having enough data to ascertain the best set of correlation parameters to use, further increases the computational expense. Reduced-order models (ROMs) provide computationally efficient surrogates of high-fidelity models and are often built to reduce development cycle times and cost. By leveraging the speed of reduced-order models and the Correlation Analysis feature in the Veritrek software, the typical computational expense of a traditional thermal model correlation process can be significantly reduced and having access to hundreds of thousands of iteration results provides an advanced means of intelligently determining the best set of correlation parameters to use. The L’Ralph thermal team at NASA Goddard Space Flight Center explored the use of the Veritrek software for their thermal model correlation efforts. The ROM that was created allowed for the variation of 15 input parameters to match 70 temperature sensor readouts from 3 thermal balance plateus and required 125 runs of the high-fidelity Thermal Desktop® model to generate a ROM that could predict the detailed model’s results to within 0.2 K (RMS). The ROM was then used to find dozens of plausible correlation parameter values based on L’Ralph instrument test data within a few seconds. By providing several plausible correlation parameter combinations, Veritrek allowed the thermal team to explore different uncertain parameter value combinations and provided insight into how deterministic each input parameter was. This allowed for a more confident decision on the best set of correlation parameters to use, compared to traditional model correlation techniques. In this presentation, the L’Ralph thermal team will be presenting their experience with the Veritrek software and how the software was utilized to provide additional insights during the correlation process.

Daniel Bae↗

L'Ralph's Advanced Thermal Model Correlation Using Veritrek

Thermal model correlation uses data from thermal balance tests to better estimate uncertain input parameter values. During the correlation process, input parameters are modified in an iterative manner which can become computationally expensive since this requires that the high-fidelity thermal model be run for each iteration. Depending on the number of thermal balance test points there can be many sets of correlation parameters that satisfy correlation criteria; and having enough data to ascertain the best set of correlation parameters to use, further increases the computational expense. Reduced-order models (ROMs) provide computationally efficient surrogates of high-fidelity models and are often built to reduce development cycle times and cost. By leveraging the speed of reduced-order models and the Correlation Analysis feature in the Veritrek software, the typical computational expense of a traditional thermal model correlation process can be significantly reduced and having access to hundreds of thousands of iteration results provides an advanced means of intelligently determining the best set of correlation parameters to use. The L’Ralph thermal team at NASA Goddard Space Flight Center explored the use of the Veritrek software for their thermal model correlation efforts. The ROM that was created allowed for the variation of 15 input parameters to match 70 temperature sensor readouts from 3 thermal balance plateus and required 125 runs of the high-fidelity Thermal Desktop® model to generate a ROM that could predict the detailed model’s results to within 0.2 K (RMS). The ROM was then used to find dozens of plausible correlation parameter values based on L’Ralph instrument test data within a few seconds. By providing several plausible correlation parameter combinations, Veritrek allowed the thermal team to explore different uncertain parameter value combinations and provided insight into how deterministic each input parameter was. This allowed for a more confident decision on the best set of correlation parameters to use, compared to traditional model correlation techniques. In this presentation, the L’Ralph thermal team will be presenting their experience with the Veritrek software and how the software was utilized to provide additional insights during the correlation process. "

Daniel Bae↗

Use of Preliminary PRA to Inform Decisions During Initial NASA Gateway Development

How do you use Probabilistic Risk Assessment (PRA) to support a program in development before designs are even known? Traditional PRAs require detailed design information and early in a program life cycle such information is not available. National Aeronautics and Space Administration (NASA) Safety and Mission Assurance (SMA) developed a preliminary PRA for the Gateway Program based upon NASA reference designs utilizing data and models from pervious PRA studies as surrogates for the Gateway systems. Gateway will be a lunar outpost that supports missions to the moon and includes several elements/modules developed by NASA and International Partners. NASA SMA began supporting Gateway in fall 2017 during initial formulation and continues to support the Gateway Program today. This paper will explore how the NASA SMA developed preliminary PRA was used to inform Gateway Program decisions with specific examples provided.

PRA↗

Use of Preliminary PRA to Inform Decisions During Initial NASA Gateway Development

How do you use Probabilistic Risk Assessment (PRA) to support a program in development before designs are even known? Traditional PRAs require detailed design information and early in a program life cycle such information is not available. National Aeronautics and Space Administration (NASA) Safety and Mission Assurance (SMA) developed a preliminary PRA for the Gateway Program based upon NASA reference designs utilizing data and models from previous PRA studies as surrogates for the Gateway systems. Gateway will be a lunar outpost that supports missions to the moon and includes several elements/modules developed by NASA and International Partners. NASA SMA began supporting Gateway in fall 2017 during initial formulation and continues to support the Gateway Program today. This paper will explore how the NASA SMA developed preliminary PRA was used to inform Gateway Program decisions with specific examples provided.

PRA↗

Creation of an Upper Stage Trajectory Capability Boundary to Enable Booster System Trade Space Exploration

The problem of trajectory optimization is important in all space missions. The solution of this problem enables one to specify the optimum thrust steering program which should be followed to achieve a specified mission objective, simultaneously satisfying the constraints.1 It is well known that whether or not the ascent trajectory is optimal can have a significant impact on propellant usage for a given payload, or on payload weight for the same gross vehicle weight.2 Consequently, ascent guidance commands are usually optimized in some fashion. Multi-stage vehicles add complexity to this analysis process as changes in vehicle properties in one stage propagate to the other stages through gear ratios and changes in the optimal trajectory. These effects can cause an increase in analysis time as more variables are added and convergence of the optimizer to system closure requires more analysis iterations. In this paper, an approach to simplifying this multi-stage problem through the creation of an upper stage capability boundary is presented. This work was completed as part of a larger study focused on trade space exploration for the advanced booster system that will eventually form a part of NASA s new Space Launch System.3 The approach developed leverages Design of Experiments and Surrogate Modeling4 techniques to create a predictive model of the SLS upper stage performance. The design of the SLS core stages is considered fixed for the purposes of this study, which results in trajectory parameters such as staging conditions being the only variables relevant to the upper stage. Through the creation of a surrogate model, which takes staging conditions as inputs and predicts the payload mass delivered by the SLS upper stage to a reference orbit as the response, it is possible to identify a "surface" of staging conditions which all satisfy the SLS requirement of placing 130 metric tons into low-Earth orbit (LEO).3 This identified surface represents the 130 metric ton capability boundary for the upper stage, such that if the combined first stage and boosters can achieve any one staging point on that surface, then the design is identified as feasible. With the surrogate model created, design and analysis of advanced booster concepts is streamlined, as optimization of the upper stage trajectory is no longer required in every design loop.

Walsh, Ptrick↗

Multifidelity, Multidisciplinary Design Under Uncertainty with Non-Intrusive Polynomial Chaos

The primary objective of this work is to develop an approach for multifidelity uncertainty quantification and to lay the framework for future design under uncertainty efforts. In this study, multifidelity is used to describe both the fidelity of the modeling of the physical systems, as well as the difference in the uncertainty in each of the models. For computational efficiency, a multifidelity surrogate modeling approach based on non-intrusive polynomial chaos using the point-collocation technique is developed for the treatment of both multifidelity modeling and multifidelity uncertainty modeling. Two stochastic model problems are used to demonstrate the developed methodologies: a transonic airfoil model and multidisciplinary aircraft analysis model. The results of both showed the multifidelity modeling approach was able to predict the output uncertainty predicted by the high-fidelity model as a significant reduction in computational cost.

West, Thomas K., IV↗

Soyuz Landing Reconstructions

Introduction: Recent data show a landing-attributed injury rate among Soyuz crew members to be higher than predicted in original certification analysis. New vehicles being developed for NASA are being certified using analytical tools to quantify injury risk. This assessment will provide data to allow the Agency to evaluate whether these tools are able to capture true injury risk and allow a comparison between Soyuz landings and upcoming vehicles. Methods: A finite element model (FEM) of the Soyuz descent module (DM) and its landing environment were developed to recreate Soyuz landing conditions. Occupant breakout models composed of the Soyuz seat and Sokol helmet were then developed to evaluate occupant response. These models included both anthropomorphic test device (ATD) and human body model (HBM) surrogates in three anthropometric sizes. A generalized distribution analysis of the Soyuz landing environment was performed using landing variable distributions from available literature. Results were used to identify trends in vehicle landing acceleration with landing conditions and to compare landing model injury risk predictions with those estimated in vehicle certification analysis. Next, historic Soyuz landings identified as inducing occupant injury during were reconstructed using the developed landing model and estimated landing conditions. Results and Discussion: This assessment demonstrated the capability of certification metrics, which include a combination of vehicle- and occupant-level injury risk analysis, to identify elevated injury risk landing conditions. However, the developed landing load predictions were limited by available vehicle and landing condition data. Additional data, particularly landing acceleration data specific to historic Soyuz landing conditions, would greatly enhance this assessment’s findings.

Preston Greenhalgh↗

Probabilistic Calibration of Expensive Models using Efficiently Trained Surrogates

Calibration of computational models in the presence of uncertainty is often cast as a Bayesian inference problem and solved via sampling methods, e.g., Markov chain Monte Carlo. When the computational model is expensive, this task becomes intractable due to the large number of samples required to accurately estimate the posterior distribution of the calibration parameters. A popular solution to this problem is to use machine learning to develop a faster-to-evaluate, lower-fidelity substitute for the original model to serve as a surrogate while solving the inference problem. Although considered an offline cost, generating training data to construct this surrogate model can still be an expensive task in practice. An active learning algorithm is presented that focuses training on improving surrogate accuracy specifically in and around the bulk of the posterior distribution, as this is where the model is exercised during calibration. Candidate samples are drawn from families of distributions related to an approximation of the posterior. The sample maximizing predictive variance is then selected for evaluation by the original computational model, yielding a label for the training point. Iterating this approach increases efficiency relative to space filling designs (e.g., Latin hypercube sampling) by avoiding low probability points. Practical considerations are discussed, including the benefits of using a sequential Monte Carlo sampling approach, convergence heuristics, and the importance of both exploration and exploitation given that the true posterior is unknown a priori.

uncertainty quantification↗

Calibration of a Structural Finite Element Model for a Representative Inflatable Space Structure Utilizing Probabilistic Methods and Surrogate Models

A structural finite element model representing a novel inflatable airlock concept has been calibrated using full‐scale test data. The concept, denoted as the Non‐Axisymmetric Inflatable Pressure Structure (NAIPS), was developed under NASA’s Minimalistic Advanced Softgoods Hatch (MASH) Program. The current studies extended previous numerical efforts by incorporating the midbody section of the NAIPS to the dome section and calibrating the model with test data using a process that included surrogate models. Brief overviews of the finite element model and calibration process are provided. The completion of the calibration process provided a model that adequately replicated the test data. The successful demonstration of calibration of a finite element model representing an inflatable habitat provides confidence in the ability to use numerical simulations and associated surrogate models to support design and certification of inflatable space habitats.

Lyle, Karen H.↗

Numerical Investigation and Optimization of a Flushwall Injector for Scramjet Applications at Hypervelocity Flow Conditions

An investigation utilizing Reynolds-averaged simulations (RAS) was performed in order to demonstrate the use of design and analysis of computer experiments (DACE) methods in Sandia’s DAKOTA software package for surrogate modeling and optimization. These methods were applied to a flow- path fueled with an interdigitated flushwall injector suitable for scramjet applications at hyper- velocity conditions and ascending along a constant dynamic pressure flight trajectory. The flight Mach number, duct height, spanwise width, and injection angle were the design variables selected to maximize two objective functions: the thrust potential and combustion efficiency. Because the RAS of this case are computationally expensive, surrogate models are used for optimization. To build a surrogate model a RAS database is created. The sequence of the design variables comprising the database were generated using a Latin hypercube sampling (LHS) method. A methodology was also developed to automatically build geometries and generate structured grids for each design point. The ensuing RAS analysis generated the simulation database from which the two objective functions were computed using a one-dimensionalization (1D) of the three-dimensional simulation data. The data were fitted using four surrogate models: an artificial neural network (ANN), a cubic polynomial, a quadratic polynomial, and a Kriging model. Variance-based decomposition showed that both objective functions were primarily driven by changes in the duct height. Multiobjective design optimization was performed for all four surrogate models via a genetic algorithm method. Optimal solutions were obtained at the upper and lower bounds of the flight Mach number range. The Kriging model predicted an optimal solution set that exhibited high values for both objective functions. Additionally, three challenge points were selected to assess the designs on the Pareto fronts. Further sampling among the designs of the Pareto fronts may be required to lower the surrogate model errors and perform more accurate surrogate-model-based optimization.

Shenoy, Rajiv R.↗

PALMO: An OVERFLOW Machine Learning Airfoil Performance Database

The OVERFLOW Machine Learning Airfoil Performance (PALMO) database has been created to enable robust modeling of airfoil performance in a variety of applications. The PALMO database uses OVERFLOW simulation data second-order accurate in time and fourth-order accurate in space with Spalart-Allmaras turbulence closure. The foundation of the in-development PALMO database is the airfoil base cube. Each base cube includes simulation data parametrized over a range of Mach numbers, Reynolds numbers, and angles-of-attack. This database includes the NACA 4-series airfoils, with parametrization in airfoil thickness and camber from an NACA 0006 to an NACA 4424. In total, 52,480 NACA 4-series OVERFLOW calculations were run on the NASA High-End Compute Capability (HECC) supercomputer. This provides high-order-accurate simulation data covering a wide range of aerospace design applications, which enables users to develop accurate airfoil performance look-up tables without additional high-performance computing. In addition to engineering design and analysis of aerospace vehicles, PALMO is well suited to be a benchmark dataset for the development and testing of machine learning methods in aerospace engineering. This work presents an example PALMO surrogate model that enables accurate airfoil performance predictions for any arbitrary combination of camber, thickness, Mach number, Reynolds number, and angle of attack within the bounds of the database. Airfoil performance tables predicted for an airfoil not used in training the model are used in three-dimensional OVERFLOW simulations to quantify the downstream accuracy on aggregate rotor performance metrics. For the NACA 3415 airfoil, which had no common thickness or camber with the training data, the surrogate predicted and CFD generated tables were within 2.1% of each other in the forward flight lift to drag metric. This suggests that performance tables generated for airfoils within the bounds of the PALMO database will yield aggregate rotor performance predictions on par with tables generated from directly running OVERFLOW airfoil calculations. The PALMO airfoil performance coefficients are available publicly.

Database↗