Search NASA⌕ Search

SEARCH · Search NASA

Results for “Simulation Credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Application of probability method to demonstrate unsafe configuration of dropped cans is not credible - 14268

An unanalyzed condition was identified for a transport cart that could result in multiple cans falling onto the ground. Calculations showed there were arrangements of four cans or five cans that could exceed the allowable k{sub eff} limit for a single upset. This was reported to the US Nuclear Regulatory Commission as an unanalyzed condition. The cans would have to fall with very little spacing between them. The likelihood of this arrangement needed to be assessed. The probability of the unacceptable configuration was calculated based on a variation of Buffon's Clean Tile Problem. A series of conservative approximations were used including assuming that the rectangular cans are inscribed cylinders and the cylinders land on the base and do not tip over. Even with the conservative assumptions used, the calculated likelihood was less than 1 in 1,000,000 years. The notification was withdrawn based on this work since the event could be categorized as not credible. Additionally work was performed to account for the actual shape of the cans and rotation of the cans. The analysis was performed using a Monte Carlo simulation. The average center-to-center spacing was used to establish a correlation with the system reactivity. The average center-to-center spacing also correlates with the probability of the configuration. With this the probability of having an unacceptable k{sub eff} was established. (authors)

42 ENGINEERING↗

Advanced Simulation and Computing: ASC FY24 Implementation Plan

The DOE National Nuclear Security Administration (NNSA) Stockpile Stewardship Program (SSP) is an integrated technical program for maintaining the safety, security, and reliability of the U.S. nuclear stockpile. The SSP incorporates nuclear test data, computational modeling and simulation, and experimental facilities to advance understanding of nuclear weapons. The suite of data analyzed comes from activities including previous nuclear tests, stockpile surveillance, experimental research, and development and engineering programs. This integrated national program requires the continued use of experimental facilities and the computational capabilities to support the SSP missions. These component parts, in addition to an appropriately scaled production capability, enable NNSA to support stockpile requirements. The ultimate goal of the SSP, and thus of the Advanced Simulation and Computing (ASC) program, is to ensure that the U.S. maintains a safe, secure, and effective strategic deterrent. The ASC program is a cornerstone of the SSP, providing simulation capabilities and computational resources to support the annual stockpile assessment and certification process, study advanced nuclear weapons design and manufacturing processes, analyze accident scenarios and weapons aging, and provide the tools to enable stockpile Life Extension Programs (LEPs) and the resolution of Significant Finding Investigations (SFIs). This work requires a balance of resources, including technical staff, hardware, simulation software, and computer science solutions. The ASC program focuses on increasing the predictive capabilities in a three-dimensional (3D) simulation environment while maintaining support to the SSP. The Program continues to improve its unique tools for understanding and solving progressively more difficult stockpile problems (sufficient resolution, dimensionality, and scientific details), and quantifying critical margins and uncertainties. Resolving each issue requires increasingly difficult analyses because the aging process has progressively moved the stockpile further from the original test base. While the focus remains on the U.S. nuclear weapons program, where possible, the Program also enables the use of high-performance computing (HPC) and simulation tools to address broader national security needs, such as foreign nuclear weapon assessments and nuclear counterterrorism. The 2022 Nuclear Posture Review (NPR) calls for NNSA to “deliver a modern, adaptive nuclear security enterprise based on an integrated strategy for risk management, production-based resilience, science and technology innovation, and workforce initiatives.” Furthermore, “NNSA will establish a Science and Technology Innovation Initiative to accelerate the integration of science and technology (S&T) throughout its activities.” Executing this strategy necessitates the continued emphasis on developing and sustaining high-quality scientific and engineering staff, as well as supporting computational and experimental capabilities. These components constitute the foundation of the nuclear weapons program. The continued success of the SSP and LEPs is predicated upon the ability to credibly certify the stockpile, without a return to underground nuclear tests (UGTs). Shortly after the nuclear test moratorium entered into force in 1992, the Accelerated Strategic Computing Initiative (ASCI) was established to provide an extensive simulation capability to underpin stockpile certification. While computing and simulation have always been essential to the success of the nuclear weapons program, the program goal of ASCI was to execute NNSA’s vision of using these tools in support of the stockpile stewardship mission. The ASCI program was essential to the successful demonstration of the SSP, providing critical nuclear weapons simulation and modeling capabilities. ASCI officially evolved into the ASC program in fiscal year (FY) 2005, but the mission remains essentially the same: provide the simulation and computational capabilities that underpin the ability to maintain a safe, secure, effective nuclear weapon stockpile, without returning to underground nuclear testing. The capabilities that the ASC program provides at the national laboratories play a vital role in the nuclear security enterprise and are necessary for fulfilling the stockpile stewardship and life extension requirements outlined for NNSA. The Program develops modern simulation tools that provide insights into stockpile aging issues, provide the computational and simulation tools that enable designers and analysts to certify the current stockpile and life-extended nuclear weapons, and inform the decision-making process when any modifications in nuclear warheads or the associated manufacturing processes are deemed necessary. Furthermore, ASC is enhancing the predictive simulation capabilities that are essential to evaluate weapons effects, design experiments, and ensure test readiness. The ASC program continues to improve its unique tools to solve stockpile problems— with a focus on sufficient resolution, dimensionality, and scientific detail—to enable Quantification of Margins and Uncertainties (QMU) and to resolve the increasingly difficult analyses needed for stockpile stewardship. The needs of the Stockpile Management and Production Modernization programs (formerly Directed Stockpile Work) also drive the requirements for simulation and computational resources. These requirements include planned LEPs, stockpile support activities, and mitigation efforts against the potential for technical surprise. All of the weapons within the current stockpile are in some stage of the life extension process. The simulation and computational capabilities are crucial for successful execution of these life extensions and for ensuring NNSA can certify these life-extended weapons without conducting a UGT.

97 MATHEMATICS AND COMPUTING↗

Simulator evaluation of displays for a revised takeoff performance monitoring system

Cockpit displays for a Takeoff Performance Monitoring System (TOPMS) to provide pilots with graphic and alphanumeric information pertinent to their decision to continue or abort a takeoff are evaluated. Revised head-down and newly developed head-up displays were implemented on electronic screens in the real-time Transport Systems Research Vehicle (TSRV) Simulator for the Boeing 737 airplane at the Langley Research Center and evaluated by 17 NASA, U.S. Air Force, airline, and industry pilots. Both types of displays were in color, but they were not dependent upon it. The TOPMS head-down display is composed of a runway graphic overlaid with symbolic status and advisory information related to both the expected takeoff point and the predicted stop point (in the event an abort becomes necessary). In addition, an overall Situation Advisory Flag indicates a preferred course of action based on analysis of the various elements of airplane performance and system status. A simpler head-up display conveys most of this same information and relates it to the visual scene. The evaluation pilots found the displays to be credible, easy to monitor, and appropriate for the task. In particular, the pilots said the head-up display was monitored with very little effort and did not obstruct or distract them from monitoring the simulated out-the-window runway scene. This report augments NASA TP-2908, 1989.

Middleton, David B.↗

Mission Scenario Development Workbench

The Mission Scenario Development Workbench (MSDW) is a multidisciplinary performance analysis software tool for planning and optimizing space missions. It provides a number of new capabilities that are particularly useful for planning the surface activities on other planets. MSDW enables rapid planning of a space mission and supports flight system and scientific-instrumentation trades. It also provides an estimate of the ability of flight, ground, and science systems to meet high-level mission goals and provides means of evaluating expected mission performance at an early stage of planning in the project life cycle. In MSDW, activity plans and equipment-list spreadsheets are integrated with validated parameterized simulation models of spacecraft systems. In contrast to traditional approaches involving worst-case estimates with large margins, the approach embodied in MSDW affords more flexibility and more credible results early in the lifecycle through the use of validated, variable- fidelity models of spacecraft systems. MSDW is expected to help maximize the scientific return on investment for space missions by understanding early the performance required to have a successful mission while reducing the risk of costly design changes made at late stages in the project life cycle.

Kordon, Mark↗

Resolving Low Cloud Feedbacks Globally With E3SM High‐Res MMF: Agreement With LES but Stronger Shortwave Effects

This study investigates low cloud feedback in a warmer climate using global simulations from the High-Resolution Multi-scale Modeling Framework (HR-MMF), which explicitly simulates small-scale eddies globally. Two 5-year simulations—one with present-day sea surface temperatures (SSTs) and a second with SSTs warmed uniformly by 4 K—reveal a positive global shortwave cloud radiative effect (SWCRE = 0.3 W/m 2 /K), comparable to estimates from CMIP models. As the climate warms, significant reductions in low cloud cover occur over stratocumulus regions. This study is the first attempt to compare HR-MMF results with predictions from idealized large-eddy simulations from the CGILS intercomparison. Despite different underlying assumptions, we find qualitative agreement in SWCRE and inversion height changes between HR-MMF and CGILS predictions. This suggests reasonable credibility for the CGILS framework in predicting cloud responses under the out-of-sample conditions found in HR-MMF. However, the HR-MMF exhibits stronger SWCRE changes than predicted by CGILS. We explore potential causes for this discrepancy, examining variations in cloud-controlling factors (CCFs) and cloud conditions. Our results show a fairly homogeneous SWCRE response, with little systematic variation tied to the variations in CCFs. This reveals a dominant role for SST forcing in modulating SWCRE.

boundary-layer clouds↗

Flight test of a synthetic aperture radar antenna using STEP

To establish confidence in its overall performance, credible information on the synthetic aperture radar antenna's mechanical properties in orbit must be obtained. However, the antenna's size, design, and operating environment make it difficult to simulate operating conditions under 1-g Earth conditions. The Space Technology Experiments Platform (STEP) offers a timely opportunity to mechanically qualify and characterize the antenna design in a representative environment. The proposed experimental configuration would employ a half-system of the full-scale RADARSAT antenna which would be mounted on the STEP platform in the orbiter cargo bay such that it could be deployed and retracted in orbit (as shown in this figure). The antenna would be subjected to typical environmental exposures while an array of targets and sensors on the antenna support structure and reflecting surface are observed and monitored. In particular, the typical environments would include deployment and retraction, dynamic response to vehicle thruster or base exciter inputs, and thermal soak and transient effects upon entering or exiting Earth eclipse. The proposed experiment would also provide generic information on the properties of large space structures in space and on techniques to obtain the desired information.

Zimcik, D. G.↗

Gateway Modeling and Simulation Plan

This plan institutes direction across the Gateway Program and the Element Projects to ensure that Cross Program M&S are produced in a manner that (1) generate the artifacts required for NASA-STD-7009 compliance, (2) ensures interoperability of M&S exchanged and integrated across the program and, (3) drives integrated development efforts to provide cross-domain integrated simulation of the Gateway elements, space environment, and operational scenarios. This direction is flowed down via contractual enforcement to prime contractors and includes both the GMS requirements specified in this plan and the NASASTD- 7009 derived requirements necessary for compliance. Grounding principles for management of Gateway Models and Simulations (M&S) are derived from the Columbia Accident Investigation Board (CAIB) report and the Diaz team report, “A Renewed Commitment to Excellence.” As an outcome of these reports, and in response to Action 4 of the Diaz team report, the NASA Standard for Models and Simulations, NASA-STD-7009 was developed. The standard establishes M&S requirements for development and use activities to ensure proper capture and communication of M&S pedigree and credibility information to Gateway program decision makers. Through the course of the Gateway program life cycle M&S will be heavily relied upon to conduct analysis, test products, support operations activities, enable informed decision making and ultimately to certify the Gateway with an acceptable level of risk to crew and mission. To reduce risk associated with M&S influenced decisions, this plan applies the NASA-STD-7009 requirements to produce the artifacts that support credibility assessments and ensure the information is communicated to program management.

NASA-STD-7009↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗

Construction of accuracy-preserving surrogate for the eigenvalue radiation diffusion and/or transport problem

The construction of surrogate models for high fidelity models is now considered an important objective in support of all engineering activities which require repeated execution of the simulation, such as verification studies, validation exercises, and uncertainty quantification. The surrogate must be computationally inexpensive to allow its repeated execution, and must be computationally accurate in order for its predictions to be credible. This manuscript introduces a new surrogate construction approach that reduces the dimensionality of the state solution via a range-finding algorithm from linear algebra. It then employs a proper orthogonal decomposition-like approach to solve for the reduced state. The algorithm provides an upper bound on the error resulting from the reduction. Different from the state-of-the-art, the new approach allows the user to define the desired accuracy a priori which controls the maximum allowable reduction. We demonstrate the utility of this approach using an eigenvalue radiation diffusion model, where the accuracy is selected to match machine precision. Results indicate that significant reduction is possible for typical reactor assembly models, which are currently considered expensive given the need to employ very fine mesh many group calculations to ensure the highest possible fidelity for the downstream core calculations. Given the potential for significant reduction in the computational cost, we believe it is possible to rethink the manner in which homogenization theory is currently employed in reactor design calculations. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Mix simulations of experiments on the National Ignition Facility

The value of α b , the Rayleigh-Taylor growth rate, is important in correctly calculating the material mixing of capsule implosions. Using self-similarity arguments for the implementation of the KL mix model in the ARES code, a sweep of settings for α b between 0.015 to 0.061 and initial mixing width (L 0 ) are made for 3 similar Two-Shock capsule implosions. The simulation results are matched to the experimental results, which show that the setting of α b has a much larger impact than L 0 , and that the data is more credibly matched at higher values of α b and lower values of L 0 . Even though the three experiments are extremely similar, there is no one set of variables that match the experimental results for all three data sets.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DeepDiagnostics: A Software Package for Streamlined Posterior Evaluation

Automated prediction techniques like simulation-based inference (SBI) are important tasks for science experiments that produce large amounts of complex, raw data. However, their development remains in its early stages because the uncertainties of these techniques lack sufficient trustworthiness and interpretability. Packages for SBI provide a growing set of diagnostics; however, the software requirements are substantial, as they are tied to the inference technology itself, and the APIs lack adaptability. We introduce the DeepDiagnostics package for diagnosing posteriors from analytic likelihood-based methods and SBI methods, such as neural posterior estimation. DeepDiagnostics produces a comprehensive set of high-quality visualizations and metrics in a highly accessible, easy-to-use, and flexible package. We address all of these goals by providing a command-line inference tool and a Python API that is controlled through a configuration file. The package includes common diagnostics, such as parity plots, corner (covariance) plots, simulation-based calibration (SBC) diagnostics (including posterior coverage and rank histograms), Lemos et al. s PQMass and TARP, Masserano et al. s WALDO, Linhart et al. s LC2ST, as well as credible region diagnostics developed by our group.

Voetberg, Maggie [Fermilab]↗

An Overview of Recent Developments in Computational Aeroelasticity

The motivation for Computational Aeroelasticity (CA) and the elements of one type of the analysis or simulation process are briefly reviewed. The need for streamlining and improving the overall process to reduce elapsed time and improve overall accuracy is discussed. Further effort is needed to establish the credibility of the methodology, obtain experience, and to incorporate the experience base to simplify the method for future use. Experience with the application of a variety of Computational Aeroelasticity programs is summarized for the transonic flutter of two wings, the AGARD 445.6 wing and a typical business jet wing. There is a compelling need for a broad range of additional flutter test cases for further comparisons. Some existing data sets that may offer CA challenges are presented.

Bennett, Robert M.↗

FACETS Dynamical Downscaling Simulations over North America by the CAM-MPAS Variable-Resolution Model

Comprehensive assessment of climate datasets created by statistical or dynamical models is important for effectively communicating model projection and associated uncertainty to stakeholders and decision-makers. The Department of Energy FACETS project aims to foster such communication through development of metrics and their demonstration on a hierarchy of downscaled climate datasets to quantify aspects of climate change projections that are credible, particularly for supporting decisions related to the energy-water-land nexus. As a part of this effort, we have produced a regional climate dataset using the Model for Prediction Across Scales coupled to the Community Atmosphere Model (CAM-MPAS). This global modeling framework is configured with variable-resolution meshes featuring higher resolutions over North America, as well as quasi-uniform resolution meshes across the globe. The variable-resolution configurations allow fine-scale features to be better resolved inside the refinement and interact with global-scale circulations. The dataset includes multiple uniform- (240km and 120km) and variable-resolution (200-50km, 100-25km, and 46-12km) simulations that are designed to be compatible with other regional climate simulations that contribute to the hierarchy of downscaled climate datasets of the project. Furthermore, the dataset consists of simulations for both the present-day (1989-2010) and future (2079-2100) climate and post-processing of the model output has been coordinated across the project for consistency to facilitate common analysis across the hierarchy of datasets. Altogether, this CAM-MPAS model dataset provides a unique opportunity to assess the influence of resolutions and modeling framework on model credibility and climate change projection.

Sakaguchi, Koichi↗

Strong Bayesian evidence for the normal neutrino hierarchy

The configuration of the three neutrino masses can take two forms, known as the normal and inverted hierarchies. We compute the Bayesian evidence associated with these two hierarchies. Previous studies found a mild preference for the normal hierarchy, and this was driven by the asymmetric manner in which cosmological data has confined the available parameter space. Here we identify the presence of a second asymmetry, which is imposed by data from neutrino oscillations. By combining constraints on the squared-mass splittings [1] with the limit on the sum of neutrino masses of Σ m {sub ν} < 0.13 eV [2], and using a minimally informative prior on the masses, we infer odds of 42:1 in favour of the normal hierarchy, which is classified as 'strong' in the Jeffreys' scale. We explore how these odds may evolve in light of higher precision cosmological data, and discuss the implications of this finding with regards to the nature of neutrinos. Finally the individual masses are inferred to be m {sub 1}=3.80{sup +26.2}{sub -3.73}meV; m {sub 2}=8.8{sup +18}{sub -1.2}meV; m {sub 3}=50.4{sup +5.8}{sub -1.2}meV (95% credible intervals).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Predicting Ice Sheet and Climate Evolution on Extreme Scales (PISCEES) Final Report

Predicting Ice Sheet and Climate Evolution at Extreme Scales (PISCEES) PISCEES is a SciDAC Earth System Modeling project with the following goals: To develop and apply robust, accurate, and scalable dynamical cores for ice sheet modeling on structured and unstructured meshes with adaptive refinements To evaluate ice sheet models using new tools and data sets for verification and validation (V&V) and uncertainty quantification (UQ) To integrate these models and tools into DOE's Accelerated Climate Model for Energy (ACME) using improved estimates of ice sheet initial conditions, we will simulate decade-to-century-scale evolution of the Greenland and Antarctic ice sheets, running PISCEES ice sheet models both in standalone mode and coupled to ACME. We aim to provide useful, credible predictions, including uncertainty ranges, of future ice-sheet mass loss and resulting changes in climate and sea level. PISCEES is jointly funded by the Office of Biological and Environmental Research (BER) and the Office of Advanced Scientific Computing Research (ASCR) of the DOE Office of Science. Participating institutions: Los Alamos National Laboratory (LANL) Lawrence Berkeley National Laboratory (LBNL) Oak Ridge National Laboratory (ORNL) Sandia National Laboratories (SNL) Florida State University (FSU) Massachusetts Institute of Technology (MIT) University of South Carolina (USC) University of Texas at Austin (UT) National Center for Atmospheric Research (NCAR) (https://www.scidac.gov/PISCEES/).

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Large-Scale and Regional Climatic Response Across North Africa to Natural Variability in Oceanic Modes and Terrestrial Vegetation Among the CMIP5 Models

Hydrologic variability is a serious threat to the poverty-stricken regions of North Africa. Meanwhile, the scientific community struggles to attribute these extreme climatic episodes to specific oceanic and land drivers. Prior modeling studies have not assessed simulated feedbacks over North Africa against an established observational benchmark, so their results are considered as untested, model-specific findings. The Coupled Model Intercomparison Project Phase Five (CMIP5) archive represents the state-of-the-art in climate projections, with most CMIP5 models now containing interactive vegetation phenology; however, there have been no studies to date of their simulated vegetation feedbacks. The capability of CMIP5 models at accurately simulating the forcing of both sea-surface temperature (SST) and regional leaf area index (LAI) anomalies on North African climate needs to be a key consideration in assessing the models’ overall credibility and determining appropriate model weighting for developing climate projections. The Generalized Equilibrium Feedback Assessment (GEFA) is a promising statistical method, which can be applied to either model output or observations, for isolating the local and remote impacts of individual oceanic or terrestrial forcings on regional climate. We performed a combined observational and modeling assessment of land-ocean-atmosphere interactions across the distinct ecological and moisture gradients of North Africa. We evaluated and demonstrated the reliability of the GEFA statistical method over North Africa using the Community Earth System Model (CESM), applied GEFA to observational data to quantify the observed forcing of ocean basin SST anomalies and regional LAI anomalies on North African climate, evaluated the CMIP5 models’ performance in terms of representing these key observed feedbacks, and formulated CMIP5 feedback performance metrics for weighting North African climate projections. Our study represented the first attempt to separate the observed roles of oceanic and vegetation feedbacks across North Africa, the first systematic assessment and intercomparison of land-ocean-atmosphere feedbacks in CMIP5, and the first exploration of vegetation feedbacks among CMIP5 models. The following work was accomplished. (1) The team generated 14 scientific publications and 30 presentations based on the DOE-funded research. (2) A stepwise version of the GEFA statistical method was developed in which unimportant forcings were dropped to increase the reliability of the results. (3) SGEFA was successfully validated through experiments with CESM in terms of its ability to isolate the atmospheric responses to individual oceanic or land forcings. (4) Observational evidence was revealed for the Sahel’s positive vegetation-rainfall feedback on the seasonal to interannual time scale, and it was attributed to a moisture recycling mechanism rather than an albedo mechanism. (5) An approach with SGEFA was developed in which the individual contributions of soil moisture versus vegetation forcings could be separated, revealing that the former forcing outweighed the latter for sub-Saharan Africa. (6) Tropical ocean temperatures were found to be key regulators of pan-tropical vegetation variability, especially for arid and semi-arid regions, including sub-Saharan Africa. (7) The CMIP5 models largely underestimated the importance of land feedbacks across the Sahel. (8) The general consensus among CMIP5 models indicates, for the late 21st century, a diminished seasonal predictability of sub-Saharan African regional climate and an elevated role of the land surface compared to oceanic drivers in regulating regional climate variability. (9) Land-ocean-atmosphere interactions were demonstrated to be key contributors to the seasonal predictability of African wildfire activity. (10) The El Djouf was determined to be of greater importance than the Bodélé depression in terms of providing trans-Atlantic dust transport to the Americas.

54 ENVIRONMENTAL SCIENCES↗

Interdisciplinary technology

The 'computational test-cell' will enable the incorporation of new methodologies, such as concurrent engineering and probabilistic methods, into the propulsion design process. This will provide the capability to conduct credible, interdisciplinary analyses of new propulsion concepts and designs. Probabilistic methods can be used as the basis for reliability-based design. Recently methods have been devised that provide the capability of simulating the performance of propulsion systems at several levels of resolution. These methods make it possible to quantify uncertainty and to establish confidence bounds for the calculated values. The introduction of reliability-based design methodology along with probabilistic analyses will provide a tool to reduce the design space for new systems and to reduce our dependence on hardware testing for proof-of-concept and system integration demonstrations. The resulting simulations will reduce the need for testing and identify potential operational problems early in the design process. This capability will make it possible to compute the expected performance, stability, reliability, and life of propulsion components, subsystems, and systems at design and off-design conditions, to bring life cycle cost trade-offs early into the design process and to determine optimum designs to satisfy specified mission requirements.

Nichols, Lester D.↗

ASME V\&V challenge problem: Surrogate-based V&V

The process of verification and validation can be resource intensive. From the computational model perspective, the resource demand typically arises from long simulation run times on multiple cores coupled with the need to characterize and propagate uncertainties. In addition, predictive computations performed for safety and reliability analyses have similar resource requirements. For this reason, there is a tradeoff between the time required to complete the requisite studies and the fidelity or accuracy of the results that can be obtained. At a high level, our approach is cast within a validation hierarchy that provides a framework in which we perform sensitivity analysis, model calibration, model validation, and prediction. The evidence gathered as part of these activities is mapped into the Predictive Capability Maturity Model to assess credibility of the model used for the reliability predictions. With regard to specific technical aspects of our analysis, we employ surrogate-based methods, primarily based on polynomial chaos expansions and Gaussian processes, for model calibration, sensitivity analysis, and uncertainty quantification in order to reduce the number of simulations that must be done. The goal is to tip the tradeoff balance to improving accuracy without increasing the computational demands.

42 ENGINEERING↗