Search NASA⌕ Search

SEARCH · Search NASA

Results for “Simulation Credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Quantifying the unknown impact of segmentation uncertainty on image-based simulations

Abstract Image-based simulation, the use of 3D images to calculate physical quantities, relies on image segmentation for geometry creation. However, this process introduces image segmentation uncertainty because different segmentation tools (both manual and machine-learning-based) will each produce a unique and valid segmentation. First, we demonstrate that these variations propagate into the physics simulations, compromising the resulting physics quantities. Second, we propose a general framework for rapidly quantifying segmentation uncertainty. Through the creation and sampling of segmentation uncertainty probability maps, we systematically and objectively create uncertainty distributions of the physics quantities. We show that physics quantity uncertainty distributions can follow a Normal distribution, but, in more complicated physics simulations, the resulting uncertainty distribution can be surprisingly nontrivial. We establish that bounding segmentation uncertainty can fail in these nontrivial situations. While our work does not eliminate segmentation uncertainty, it improves simulation credibility by making visible the previously unrecognized segmentation uncertainty plaguing image-based simulation.

42 ENGINEERING↗

Investigating Power System Primary and Secondary Reserve Interaction under High Wind Power Penetration

Power system frequency needs to be maintained close to its nominal value at all times to successfully balance load and generation and maintain system reliability. Adequate primary frequency response and secondary frequency response are the primary forces to correct an energy imbalance at the second-to-minute level. As wind energy becomes a larger portion of the world's energy portfolio, there is an increased need for wind to provide frequency response. This paper addresses one of the major concerns about using wind for frequency regulation: the unknown factor of the interaction between primary and secondary reserves. The lack of a commercially available tool to model this has limited the energy industry's understanding of when the depletion of primary reserves will impact the performance of secondary response or vice versa. This paper investigates the issue by developing a multi-area frequency response integration tool with combined primary and secondary capabilities. The simulation is conducted in close coordination with economical energy scheduling scenarios to ensure credible simulation results.

17 WIND ENERGY↗

PTRANSP Tests Of TGLF And Predictions For ITER

One of the physics goals for ITER is to achieve high fusion power PDT at a high gain QDT. This goal is important for studying the physics of reactor-relevant burning plasmas. Simulations of plasma performance in ITER can help achieve this goal by aiding in the design of systems such as diagnostics and in planning ITER plasma regimes. Simulations can indicate areas where further research in theory and experiments is needed. To have credible simulations integrated modeling is necessary since plasma profiles and applied heating, torque, and current drive are strongly coupled.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Computational fluid dynamics simulations of a binary particle bed in a riser-based carbon stripper for chemical looping combustion

Chemical-looping combustion (CLC) is a next generation combustion technology that shows great promise as a solution for the need of high-efficiency low-cost carbon capture from fossil fueled power plants. In this paper, numerical simulations are conducted of a binary particle bed associated with a coal-direct CLC system consisting of coal (represented by plastic beads) and oxygen carrier particles and validated against an experimental riser-based carbon stripper. The detailed particle dynamics and solid-gas and solid-solid interactions are investigated using the Lagrangian particle-tracking approach known as the discrete element method coupled with the computational fluid dynamics solution for the flow field. The simulation results of the fluidization behavior and the separation ratio of the particles are in excellent agreement with the experiment. In conclusion, a credible simulation of a binary particle bed is of particular importance for understanding the details of the fluidization behavior; the baseline simulation established in this work can be used as a tool for designing and optimizing the performance of such systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Separability of Mesh Bias and Parametric Uncertainty for a Full System Thermal Analysis

When making computational simulation predictions of multi-physics engineering systems, sources of uncertainty in the prediction need to be acknowledged and included in the analysis within the current paradigm of striving for simulation credibility. A thermal analysis of an aerospace geometry was performed at Sandia National Laboratories. For this analysis a verification, validation and uncertainty quantification workflow provided structure for the analysis, resulting in the quantification of significant uncertainty sources including spatial numerical error and material property parametric uncertainty. It was hypothesized that the parametric uncertainty and numerical errors were independent and separable for this application. This hypothesis was supported by performing uncertainty quantification simulations at multiple mesh resolutions, while being limited by resources to minimize the number of medium and high resolution simulations. Based on this supported hypothesis, a prediction including parametric uncertainty and a systematic mesh bias are used to make a margin assessment that avoids unnecessary uncertainty obscuring the results and optimizes computing resources.

42 ENGINEERING↗

Separability of Mesh Bias and Parametric Uncertainty for a Full System Thermal Analysis

When making computational simulation predictions of multiphysics engineering systems, sources of uncertainty in the prediction need to be acknowledged and included in the analysis within the current paradigm of striving for simulation credibility. A thermal analysis of an aerospace geometry was performed at Sandia National Laboratories. Here, for this analysis, a verification, validation, and uncertainty quantification (VVUQ) workflow provided structure for the analysis, resulting in the quantification of significant uncertainty sources including spatial numerical error and material property parametric uncertainty. It was hypothesized that the parametric uncertainty and numerical errors were independent and separable for this application. This hypothesis was supported by performing uncertainty quantification (UQ) simulations at multiple mesh resolutions, while being limited by resources to minimize the number of medium and high resolution simulations. In conclusion, based on this supported hypothesis, a prediction including parametric uncertainty and a systematic mesh bias is used to make a margin assessment that avoids unnecessary uncertainty obscuring the results and optimizes use of computing resources.

42 ENGINEERING↗

User Guidelines and Best Practices for CASL VUQ Analysis Using Dakota

Sandia’s Dakota software (available at http://dakota.sandia.gov) supports science and engineering transformation through advanced exploration of simulations. Specifically it manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to enhance understanding of risk, improve products, and assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a physics-based computational model. This can lend efficiency and rigor to manual parameter perturbation studies already being conducted by analysts. However, Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. Dakota algorithms enrich complex science and engineering models, enabling an analyst to answer crucial questions of - Sensitivity: Which are the most important input factors or parameters entering the simulation, and how do they influence key outputs?; Uncertainty: What is the uncertainty or variability in simulation output, given uncertainties in input parameters? How safe, reliable, robust, or variable is my system? (Quantification of margins and uncertainty, QMU); Optimization: What parameter values yield the best performing design or operating condition, given constraints? Calibration: What models and/or parameters best match experimental data? In general, Dakota is the Consortium for Advanced Simulation of Light Water Reactors (CASL) delivery vehicle for verification, validation, and uncertainty quantification (VUQ) algorithms. It permits ready application of the VUQ methods described above to simulation codes by CASL researchers, code developers, and application engineers.

97 MATHEMATICS AND COMPUTING↗

Novel Method to Characterize and Model the Multiaxial Constitutive and Damage Response of Energetic Materials.

Simulant polymer bonded explosives are widely used to simulate the mechanical response of real energetic materials. In this paper, the fracture resistance of a simulant polymer bo nded explosive (PBX) is experimentally investigated. The simulant is composed of 80 wt.% soda lime glass beads (SLGB) and 20 wt.% high impact Polystyrene 825 (HIPS). Brazilian disk tests are performed to characterize the tensile and compressive properties. Fracture toughness and energy tests are performed in the semi - circular bending (SCB) configuration on 80, 81, 82, and 83 wt % SLGB compositions. Digital image correlation is performed to record the surface displacements and calculate surface strains during testing. The m icromechanical behavior of ductile and brittle fracture are evaluated using digital microscopy and scanning electron microscopy of the fracture surface. It is determined that (i) the manufacturing process produces a credible simulant of PBX properties, and (ii) the SCB test measures fracture resistance with a reasonable coefficient of variation.

36 MATERIALS SCIENCE↗

Characteristics of Future Warmer Base States in CESM2

Abstract Simulations of 21st century climate with Community Earth System Model version 2 (CESM2) using the standard atmosphere (CAM6), denoted CESM2(CAM6), and the latest generation of the Whole Atmosphere Community Climate Model (WACCM6), denoted CESM2(WACCM6), are presented, and a survey of general results is described. The equilibrium climate sensitivity (ECS) of CESM2(CAM6) is 5.3°C, and CESM2(WACCM6) is 4.8°C, while the transient climate response (TCR) is 2.1°C in CESM2(CAM6) and 2.0°C in CESM2(WACCM6). Thus, these two CESM2 model versions have higher values of ECS than the previous generation of model, the CESM (CAM5) (hereafter CESM1), that had an ECS of 4.1°C, though the CESM2 versions have lower values of TCR compared to the CESM1 with a somewhat higher value of 2.3°C. All model versions produce credible simulations of the time evolution of historical global surface temperature. The higher ECS values for the CESM2 versions are reflected in higher values of global surface temperature increase by 2,100 in CESM2(CAM6) and CESM2(WACCM6) compared to CESM1 between comparable emission scenarios for the high forcing scenario. Future warming among CESM2 model versions and scenarios diverges around 2050. The larger values of TCR and ECS in CESM2(CAM6) compared to CESM1 are manifested by greater warming in the tropics. Associated with a higher climate sensitivity, for CESM2(CAM6) the first instance of an ice‐free Arctic in September occurs for all scenarios and ensemble members in the 2030–2050 time frame, but about a decade later in CESM2(WACCM6), occurring around 2040–2060.

54 ENVIRONMENTAL SCIENCES↗

Positive tropical marine low-cloud cover feedback inferred from cloud-controlling factors

Differences in simulations of tropical marine low-cloud cover (LCC) feedback are sources of significant spread in temperature responses of climate models to anthropogenic forcing. Here we show that in models the feedback is mainly driven by three large-scale changes—a strengthening tropical inversion, increasing surface latent heat flux, and an increasing vertical moisture gradient. Variations in the LCC response to these changes alone account for most of the spread in model-projected 21st century LCC changes. A methodology is devised to constrain the LCC response observationally using sea surface temperature (SST) as a surrogate for the latent heat flux and moisture gradient. In models where the current climate's LCC sensitivities to inversion strength and SST variations are consistent with observed, LCC decreases systematically, which would increase absorption of solar radiation. These results support a positive LCC feedback. Finally, correcting biases in the sensitivities will be an important step toward more credible simulation of cloud feedbacks.

58 GEOSCIENCES↗

Evaluation of E3SM land model snow simulations over the western United States

Abstract. Seasonal snow has crucial impacts on climate, ecosystems, and humans, but it is vulnerable to global warming. The land component (ELM) of the Energy Exascale Earth System Model (E3SM) mechanistically simulates snow processes from accumulation, canopy interception, compaction, and snow aging to melt. Although high-quality field measurements, remote sensing snow products, and data assimilation products with high spatio-temporal resolution are available, there has been no systematic evaluation of the snow properties and phenology in ELM. This study comprehensively evaluates ELM snow simulations over the western United States at 0.125∘ resolution during 2001–2019 using the Snow Telemetry (SNOTEL) in situ networks, MODIS remote sensing products (i.e., MCD43 surface albedo product), the spatially and temporally complete (STC) snow-covered area and grain size (MODSCAG) and MODIS dust and radiative forcing in snow (MODDRFS) products (STC-MODSCAG/STC-MODDRFS), and the snow property inversion from remote sensing (SPIReS) product and two data assimilation products of snow water equivalent and snow depth – i.e., University of Arizona (UA) and SNOw Data Assimilation System (SNODAS). Overall the ELM simulations are consistent with the benchmarking datasets and reproduce the spatio-temporal patterns, interannual variability, and elevation gradients for different snow properties including snow cover fraction (fsno), surface albedo (αsur) over snow cover regions, snow water equivalent (SWE), and snow depth (Dsno). However, there are large biases of fsno with dense forest cover and αsur in the Rocky Mountains and Sierra Nevada in winter, compared to the MODIS products. There are large discrepancies of snow albedo, snow grain size, and light-absorbing particle-induced snow albedo reduction between ELM and the MODIS products, attributed to uncertainties in the aerosol forcing data, snow aging processes in ELM, and remote sensing retrievals. Against UA and SNODAS, ELM has a mean bias of −20.7 mm (−35.9 %) and −20.4 mm (−35.5 %), respectively, for spring, and −13.8 mm (−27.8 %) and −10.2 mm (−22.2 %), respectively, for winter. ELM shows a relatively high correlation with SNOTEL SWE, with mean correlation coefficients of 0.69 but negative mean biases of −122.7 mm. Compared to the snow phenology of STC-MODSCAG and SPIReS, ELM shows delayed snow accumulation onset dates by 17.3 and 12.4 d, earlier snow end dates by 35.5 and 26.8 d, and shorter snow durations by 52.9 and 39.5 d, respectively. This study underscores the need for diagnosing model biases and improving ELM representations of snow properties and snow phenology in mountainous areas for more credible simulation and future projection of mountain snowpack.

54 ENVIRONMENTAL SCIENCES↗

Advanced multiphysics coupling for LWR fuel performance analysis

Even the most basic nuclear fuel analysis is a multiphysics undertaking, as a credible simulation must consider at a minimum coupled heat conduction and mechanical deformation. The need for more realistic fuel modeling under a variety of conditions invariably leads to a desire to include coupling between a more complete set of the physical phenomena influencing fuel behavior, including neutronics, thermal hydraulics, and mechanisms occurring at lower length scales. This paper covers current efforts toward coupled multiphysics LWR fuel modeling in three main areas. The first area covered in this paper concerns thermomechanical coupling. The interaction of these two physics, particularly related to the feedback effect associated with heat transfer and mechanical contact at the fuel/clad gap, provides numerous computational challenges. An outline is provided of an effective approach used to manage the nonlinearities associated with an evolving gap in BISON, a nuclear fuel performance application. A second type of multiphysics coupling described here is that of coupling neutronics with thermomechanical LWR fuel performance. DeCART, a high-fidelity core analysis program based on the method of characteristics, has been coupled to BISON. DeCART provides sub-pin level resolution of the multigroup neutron flux, with resonance treatment, during a depletion or a fast transient simulation. Two-way coupling between these codes was achieved by mapping fission rate density and fast neutron flux fields from DeCART to BISON and the temperature field from BISON to DeCART while employing a Picard iterative algorithm. Finally, the need for multiscale coupling is considered. Fission gas production and evolution significantly impact fuel performance by causing swelling, a reduction in the thermal conductivity, and fission gas release. The mechanisms involved occur at the atomistic and grain scale and are therefore not the domain of a fuel performance code. However, it is possible to use lower length scale models such as those used in the mesoscale MARMOT code to compute average properties, e.g. swelling or thermal conductivity. These may then be used by an engineering-scale model. Examples of this type of multiscale, multiphysics modeling are shown.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Connecting Large‐Scale Meteorological Patterns to Extratropical Cyclones in CMIP6 Climate Models Using Self‐Organizing Maps

Abstract Extratropical cyclones (ETCs) are responsible for the majority of cool‐season extreme events in the northeastern United States (NEUS), often leading to high‐impact weather conditions that can have wide‐ranging socioeconomic impacts. Evaluating the ability of climate models to adequately simulate ETC dynamics is essential for improving model performance and increasing confidence in future projections used by stakeholders and policymakers. ETCs are traditionally studied using techniques such as case studies and synoptic typing, however, these approaches can be time‐consuming, require subjective analysis, and do not necessarily identify the coincident large‐scale meteorological patterns (LSMPs). Here, we apply self‐organizing maps (SOMs) as an automated machine‐learning approach to characterize the LSMPs and associated frequency and intensity of discrete ETC events over NEUS. The dominant patterns of geopotential height variability are identified through SOM analysis of five reanalysis products during the last four decades. ETC events are tracked using TempestExtremes and are integrated with SOMs to classify the accumulated cyclone activity (ACA) associated with each pattern. We then evaluate the skill of CMIP6 historical experiments in simulating the LSMPs and ETC events identified in the SOM. Our results identify a robust bias toward more zonal patterns, with models struggling to reproduce the more amplified patterns typically associated with the highest cyclone activity. While model resolution has some impact on simulation credibility, model configuration appears to be more important in LSMP representation. The vast majority of CMIP6 models produce too few ETCs, although model errors are distributed around historical reanalyses when ACA is normalized by storm frequency.

54 ENVIRONMENTAL SCIENCES↗

Design Analysis Kit for Optimization and Terascale Applications 6.0

Sandia's Dakota software (available at http://dakota.sandia.gov) supports science and engineering transformation through advanced exploration of simulations. Specifically it manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to: (1) enhance understanding of risk, (2) improve products, and (3) assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a computational model. However, Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. The algorithms implemented in Dakota aim to address challenges in performing these analyses with complex science and engineering models from desktop to high performance computers.

Source record↗

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.14

Sandia's Dakota software supports science and engineering transformation through advanced exploration of simulations. Specifically, Dakota manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to: (1) enhance understanding of risk, (2) improve products, and (3) assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a computational model. Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. The algorithms implemented in Dakota aim to address challenges in performing these analyses with complex science and engineering models from desktop to high performance computers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-10468 O

Adams, BrianM.↗

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.16

Sandia's Dakota software supports science and engineering transformation through advanced exploration of simulations. Specifically, Dakota manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to: (1) enhance understanding of risk, (2) improve products, and (3) assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a computational model. Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. The algorithms implemented in Dakota aim to address challenges in performing these analyses with complex science and engineering models from desktop to high performance computers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-10468 O

Adams, BrianM.↗

User Guidelines and Best Practices for CASL VUQ Analysis Using Dakota.

Sandia's Dakota software (available at http://dakota.sandia.gov) supports science and engineering transformation through advanced exploration of simulations. Specifically it manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to enhance understanding of risk, improve products, and assess simulation credibility.

97 MATHEMATICS AND COMPUTING↗

Dispersion Validation for Flow Involving a Large Structure Revisited: 45 Degree Rotation

The atmospheric dispersion of contaminants in the wake of a large urban structure is a challenging fluid mechanics problem of interest to the scientific and engineering communities. Magnetic Resonance Velocimetry (MRV) and Magnetic Resonance Concentration (MRC) are relatively new techniques that leverage diagnostic equipment used primarily by the medical field to make 3D engineering measurements of flow and contaminant dispersal. SIERRA/Fuego, a computational fluid dynamics (CFD) code at Sandia National Labs is employed to make detailed comparisons to the dataset to evaluate the quantitative and qualitative accuracy of the model. This work is the second in a series of scenarios. In the prior work, a single large building in an array of similar buildings was considered with the wind perpendicular to a building face. In this work, the geometry is rotated by 45 degrees and improved studies are performed for simulation credibility. The comparison exercise shows conditionally good comparisons between the model and experiment. Model uncertainties are assessed through parametric variations. Various methods of quantifying the accuracy between experiments and data are examined Three-dimensional analysis of accuracy is performed. The effort helped identify deficiencies in the techniques used to make these comparisons, and further methods development therefore becomes one of the main recommendations for follow-on work.

42 ENGINEERING↗