Search NASA⌕ Search

SEARCH · Search NASA

Results for “Simulation Credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Comprehensive Material Characterization and Simultaneous Model Calibration for Improved Computational Simulation Credibility

Computational simulation is increasingly relied upon for high-consequence engineering decisions, and a foundational element to solid mechanics simulations is a credible material model. Our ultimate vision is to interlace material characterization and model calibration in a real-time feedback loop, where the current model calibration results will drive the experiment to load regimes that add the most useful information to reduce parameter uncertainty. The current work investigated one key step to this Interlaced Characterization and Calibration (ICC) paradigm, using a finite load-path tree to incorporate history/path dependency of nonlinear material models into a network of surrogate models that replace computationally-expensive finite-element analyses. Our reference simulation was an elastoplastic material point subject to biaxial deformation with a Hill anisotropic yield criterion. Training data was generated using either a space-filling or adaptive sampling method, and surrogates were built using either Gaussian process or polynomial chaos expansion methods. Surrogate error was evaluated to be on the order of 10 ⁻5 and 10 ⁻3 percent for the space-filling and adaptive sampling training data, respectively. Direct Bayesian inference was performed with the surrogate network and with the reference material point simulator, and results agreed to within 3 significant figures for the mean parameter values, with a reduction in computational cost over 5 orders of magnitude. These results bought down risk regarding the surrogate network and facilitated a successful FY22-24 full LDRD proposal to research and develop the complete ICC paradigm.

36 MATERIALS SCIENCE↗

Interlaced Characterization and Calibration (ICC) for Improved Computational Simulation Credibility

Accurate material characterization and model calibration are pivotal for simulations used for high-consequence engineering decisions. Current characterization and calibration methods (1) use simplified test specimen geometries and global data, (2) cannot guarantee that sufficient characterization data is collected for a specific model of interest, (3) provide only mean parameter values with no uncertainty quantification, and (4) are sequential, inflexible, and time-consuming. This work developed a new paradigm—coined Interlaced Characterization and Calibration (ICC)—which drives forward the state-of-the-art in model calibration by bringing together recent advancements into one improved workflow. The ICC paradigm (1) employs tools to efficiently use full-field data to calibrate high-fidelity material models, (2) aligns the data needed with the data collected by adopting an optimal experimental design protocol, (3) provides uncertainty metrics on the calibrated model parameters, and (4) incorporates these advances into a quasi real-time feedback loop. The ICC framework was validated synthetically with both low-fidelity and high-fidelity simulations paired with several different elastoplastic material models, and was also demonstrated experimentally with an aluminum 6061 cruciform exemplar specimen. Results showed that the ICC framework—in which Bayesian optimal experimental design actively guided the experiment— resulted in calibrations with similar or better accuracy than predetermined experiments based on subject matter expertise. Moreover, the ICC framework produced a complete model calibration— with quantified uncertainties on model parameters—in 1 week, a 5 - 10× increase in efficiency over traditional approaches. Thus, the ICC paradigm improves both the calibration process and quality, by (1) improving efficiency, which increases agility of solid mechanics modeling and enables utilization of computational simulation (CompSim) at earlier stages of the design cycle and (2) providing quantified, and in some cases reduced, parameter uncertainties, which increases confidence in model predictions and supports credible decision making.

97 MATHEMATICS AND COMPUTING↗

Uncertainty quantification's role in modeling and simulation planning, and credibility assessment through the predictive capability maturity model

The importance of credible, trustworthy numerical simulations is obvious especially when using the results for making high-consequence decisions. Determining the credibility of such numerical predictions is much more difficult and requires a systematic approach to assessing predictive capability, associated uncertainties and overall confidence in the computational simulation process for the intended use of the model. This process begins with an evaluation of the computational modeling of the identified, important physics of the simulation for its intended use. This is commonly done through a Phenomena Identification Ranking Table (PIRT). Then an assessment of the evidence basis supporting the ability to computationally simulate these physics can be performed using various frameworks such as the Predictive Capability Maturity Model (PCMM). There were several critical activities that follow in the areas of code and solution verification, validation and uncertainty quantification, which will be described in detail in the following sections. Here, we introduce the subject matter for general applications but specifics are given for the failure prediction project. In addition, the first task that must be completed in the verification & validation procedure is to perform a credibility assessment to fully understand the requirements and limitations of the current computational simulation capability for the specific application intended use. The PIRT and PCMM are tools used at Sandia National Laboratories (SNL) to provide a consistent manner to perform such an assessment. Ideally, all stakeholders should be represented and contribute to perform an accurate credibility assessment. PIRTs and PCMMs are both described in brief detail below and the resulting assessments for an example project are given.

97 MATHEMATICS AND COMPUTING↗

The de-correlation of westerly winds and westerly-wind stress over the Southern Ocean during the Last Glacial Maximum

This paper investigates the changes of the Southern Westerly Winds (SWW) and Southern Ocean (SO) upwelling between the Last Glacial Maximum (LGM) and preindustrial (PI) in the PMIP3/CMIP5 simulations, highlighting the role of the Antarctic sea ice in modulating the wind stress effect on the ocean. Particularly, a discrepancy may occur between the changes in SWW and westerly wind stress, caused primarily by an equatorward expansion of winter Antarctic sea ice that undermines the wind stress in driving the liquid ocean. Such discrepancy may reflect the LGM condition in reality, in view of that the model simulates this condition has most credible simulation of modern SWW and Antarctic sea ice. The effect of wind stress on the SO upwelling is further explored via the wind-induced Ekman pumping, which is reduced under the LGM condition in all models, in part by the sea-ice “capping” effect present in the models.

Antarctic sea ice↗

The path to CAM6: coupled simulations with CAM5.4 and CAM5.5

This paper documents coupled simulations of two developmental versions of the Community Atmosphere Model (CAM) towards CAM6. The configuration called CAM5.4 introduces new microphysics, aerosol, and ice nucleation changes, among others to CAM. The CAM5.5 configuration represents a more radical departure, as it uses an assumed probability density function (PDF)-based unified cloud parameterization to replace the turbulence, shallow convection, and warm cloud macrophysics in CAM. This assumed PDF method has been widely used in the last decade in atmosphere-only climate simulations but has never been documented in coupled mode. Here, we compare the simulated coupled climates of CAM5.4 and CAM5.5 and compare them to the control coupled simulation produced by CAM5.3. We find that CAM5.5 has lower cloud forcing biases when compared to the control simulations. Improvements are also seen in the simulated amplitude of the Niño-3.4 index, an improved representation of the diurnal cycle of precipitation, subtropical surface wind stresses, and double Intertropical Convergence Zone biases. Degradations are seen in Amazon precipitation as well as slightly colder sea surface temperatures and thinner Arctic sea ice. Simulation of the 20th century results in a credible simulation that ends slightly colder than the control coupled simulation. The authors find this is due to aerosol indirect effects that are slightly stronger in the new version of the model and propose a solution to ameliorate this. Altogether, in these early coupled simulations, CAM5.5 produces a credible climate that is appropriate for science applications and is ready for integration into the National Center for Atmospheric Research's (NCAR's) next-generation climate model.

54 ENVIRONMENTAL SCIENCES↗

Method for Real-Time Salt Aerosol Concentration and Size Measurements for Molten Salt Reactor Safety Assessments

Licensing a new nuclear reactor involves evaluating credible accident scenarios by developing models that simulate accident progression to predict possible outcomes and their impact on safety. The formation of radionuclide-bearing aerosols in the respirable size range can significantly affect dose consequence and threaten human health and is therefore a focus of nuclear reactor safety assessments. Recent reviews of the literature identified a lack of existing experimental data describing the mechanisms of formation and properties (size, concentration, and composition) of radionuclide-bearing aerosols that may be produced from molten salt reactor (MSR) facilities during postulated accident scenarios. Experiments on aerosol formation from molten salt systems are a high priority need that will support MSR licensing by indicating the radiological consequences of aerosol formation and providing the data required for model development and validation. The evolving conditions that occur during a MSR accident, such as a spill of molten fuel salt, may affect aerosol formation mechanisms and aerosol properties over time. There is a need to conduct experiments that simulate credible MSR accidents in a laboratory to generate aerosols with realistic characteristics and behaviors and a need to measure these aerosols in real time under accident-relevant conditions. This report describes the development of a method that can be used to quantify the size and concentration of salt aerosol particles that form from molten salt systems in real time. This method will be employed in future integral effects tests that are conducted at an engineering scale to simulate realistic MSR accidents and in future separate effects tests that will provide mechanistic insight into aerosol formation and properties to support process model development.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

User guidelines and best practices for CASL VUQ analysis using Dakota.

Sandia's Dakota software (available at http://dakota.sandia.gov) supports science and engineering transformation through advanced exploration of simulations. Specifically it manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to enhance understanding of risk, improve products, and assess simulation credibility. This manual offers Consortium for Advanced Simulation of Light Water Reactors (LWRs) (CASL) partners a guide to conducting Dakota-based VUQ studies for CASL problems. It motivates various classes of Dakota methods and includes examples of their use on representative application problems. On reading, a CASL analyst should understand why and how to apply Dakota to a simulation problem. This SAND report constitutes the product of CASL milestone L3:VUQ.V&V.P8.01 and is also being released as a CASL unlimited release report with number CASL-U-2014-0038-000.

97 MATHEMATICS AND COMPUTING↗

User Guidelines and Best Practices for CASL VUQ Analysis Using Dakota.

Sandia's Dakota software (available at http://dakota.sandia.gov) supports science and engineering transformation through advanced exploration of simulations. Specifically, it manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to enhance understanding of risk, improve products, and assess simulation credibility. This manual offers Consortium for Advanced Simulation of Light Water Reactors (LWRs) (CASL) partners a guide to conducting Dakota-based VUQ studies for CASL problems. It motivates various classes of Dakota methods and includes examples of their use on representative application problems. On reading, a CASL analyst should understand why and how to apply Dakota to a simulation problem.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗