Search NASA⌕ Search

SEARCH · Search NASA

Results for “Simulation Credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Technical Note: Response measurement for select radiation detectors in magnetic fields

Purpose: Dose response to applied magnetic fields for ion chambers and solid state detectors has been investigated previously for the anticipated use in linear accelerator–magnetic resonance devices. In this investigation, the authors present the measured response of selected radiation detectors when the magnetic field is applied in the same direction as the radiation beam, i.e., a longitudinal magnetic field, to verify previous simulation only data. Methods: The dose response of a PR06C ion chamber, PTW60003 diamond detector, and IBA PFD diode detector is measured in a longitudinal magnetic field. The detectors are irradiated with buildup caps and their long axes either parallel or perpendicular to the incident photon beam. In each case, the magnetic field dose response is reported as the ratio of detector signals with to that without an applied longitudinal magnetic field. The magnetic field dose response for each unique orientation as a function of magnetic field strength was then compared to the previous simulation only studies. Results: The measured dose response of each detector in longitudinal magnetic fields shows no discernable response up to near 0.21 T. This result was expected and matches the previously published simulation only results, showing no appreciable dose response with magnetic field. Conclusions: Low field longitudinal magnetic fields have been shown to have little or no effect on the dose response of the detectors investigated and further lend credibility to previous simulation only studies.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Data Driven Smart Proxy for CFD: Application of Big Data Analytics & Machine Learning in Computational Fluid Dynamics (Part 1)

Simulation technologies can reduce the time and cost of the development and deployment of advanced technologies and allow rapid scale-up of these technologies for fossil fuel based energy systems. However, to ensure their usefulness in practice, the credibility of the simulations needs to be established with Uncertainty Quantification (UQ) methods. National Energy Technology Laboratory (NETL) has been applying non-intrusive UQ methodologies to categorize and quantify uncertainties in CFD simulations of gas-solid multiphase flows. To reduce the computational cost associated with gas-solid flow simulations required for UQ analysis, techniques commonly used in the area of Artificial Intelligence (AI) and Data Mining (DM) are used to construct smart proxy models, which can reduce the computational cost of conducting large number of multiphase CFD simulations.

97 MATHEMATICS AND COMPUTING↗

The Resolution Sensitivity of Northern Hemisphere Blocking in Four 25-km Atmospheric Global Circulation Models

The aim of this study is to investigate if the representation of Northern Hemisphere blocking is sensitive to resolution in current-generation atmospheric global circulation models (AGCMs). An evaluation is thus conducted of how well atmospheric blocking is represented in four AGCMs whose horizontal resolution is increased from a grid spacing of more than 100 km to about 25 km. It is shown that Euro-Atlantic blocking is simulated overall more credibly at higher resolution (i.e., in better agreement with a 50-yr reference blocking climatology created from the reanalyses ERA-40 and ERA-Interim). The improvement seen with resolution depends on the season and to some extent on the model considered. Euro-Atlantic blocking is simulated more realistically at higher resolution in winter, spring, and autumn, and robustly so across the model ensemble. The improvement in spring is larger than that in winter and autumn. Summer blocking is found to be better simulated at higher resolution by one model only, with little change seen in the other three models. The representation of Pacific blocking is not found to systematically depend on resolution. Despite the improvements seen with resolution, the 25-km models still exhibit large biases in Euro-Atlantic blocking. For example, three of the four 25-km models underestimate winter northern European blocking frequency by about one-third. The resolution sensitivity and biases in the simulated blocking are shown to be in part associated with the mean-state biases in the models' midlatitude circulation.

54 ENVIRONMENTAL SCIENCES↗

The Cloud Feedback Model Intercomparison Project (CFMIP) contribution to CMIP6

Our primary objective of CFMIP is to inform future assessments of cloud feedbacks through improved understanding of cloud–climate feedback mechanisms and better evaluation of cloud processes and cloud feedbacks in climate models. But, the CFMIP approach is also increasingly being used to understand other aspects of climate change, and so a second objective has now been introduced, to improve understanding of circulation, regional-scale precipitation, and non-linear changes. CFMIP is supporting ongoing model inter-comparison activities by coordinating a hierarchy of targeted experiments for CMIP6, along with a set of cloud-related output diagnostics. CFMIP contributes primarily to addressing the CMIP6 questions How does the Earth system respond to forcing? and What are the origins and consequences of systematic model biases? and supports the activities of the WCRP Grand Challenge on Clouds, Circulation and Climate Sensitivity. A compact set of Tier 1 experiments is proposed for CMIP6 to address this question: (1) what are the physical mechanisms underlying the range of cloud feedbacks and cloud adjustments predicted by climate models, and which models have the most credible cloud feedbacks? Additional Tier 2 experiments are proposed to address the following questions. (2) Are cloud feedbacks consistent for climate cooling and warming, and if not, why? (3) How do cloud-radiative effects impact the structure, the strength and the variability of the general atmospheric circulation in present and future climates? (4) How do responses in the climate system due to changes in solar forcing differ from changes due to CO 2 , and is the response sensitive to the sign of the forcing? (5) To what extent is regional climate change per CO 2 doubling state-dependent (non-linear), and why? (6) Are climate feedbacks during the 20th century different to those acting on long-term climate change and climate sensitivity? (7) How do regional climate responses (e.g. in precipitation) and their uncertainties in coupled models arise from the combination of different aspects of CO 2 forcing and sea surface warming? CFMIP also proposes a number of additional model outputs in the CMIP DECK, CMIP6 Historical and CMIP6 CFMIP experiments, including COSP simulator outputs and process diagnostics to address the following questions. How well do clouds and other relevant variables simulated by models agree with observations? What physical processes and mechanisms are important for a credible simulation of clouds, cloud feedbacks and cloud adjustments in climate models? Which models have the most credible representations of processes relevant to the simulation of clouds? How do clouds and their changes interact with other elements of the climate system?

54 ENVIRONMENTAL SCIENCES↗

Carbon contamination, its consequences and its mitigation in ion-simulation of neutron-induced swelling of structural metals

Neutron-induced swelling in austenitic and ferritic steels is sensitive to the carbon level in the steel, as well as its distribution in matrix or precipitates. It has recently become known that ion-irradiation to high dpa levels leads to a progressive ion-beam-induced increase in carbon concentration and precipitation within the ion range, with concurrent reductions in void swelling. This neutron-atypical phenomenon imperils the credibility of ion simulation for light water reactor applications. A series of experiments involving pure iron and a structural alloy HT9, was conducted to identify the source and distribution of injected carbon. It was found that negatively-charged carbon atoms are entrained in the self-ion beam by a Coulomb drag effect, and thereby delivered at low drift energy to the irradiated surface, followed by ion-beam-mixing and diffusion. A technique for filtering out contaminants, especially carbon, oxygen and nitrogen, was developed and resulted in higher, more neutron-relevant swelling levels than achieved without filtering.

Shao, Lin↗

Spreader-Bar Radiation Detection System Enhancements: A Modeling and Simulation Study

An investigation of radiation detectors on crane-mounted platforms was performed to understand the limitations and optimal capability of these types of systems. Crane-mounted systems are primarily focused on crane-mounted radiation detector systems, where the detectors are mounted on a spreader-bar platform. Spreader bars are attached with cables to a crane at seaports to load and unload containers from cargo ships. The bars can spread from 20 feet to 53 feet using hydraulics, allowing a single bar to move a variety of container lengths. Spreader-bars are also used on straddle carriers, which move containers around the laydown yard in the port. Spreader bar radiation detection (SBRD) systems are commercially available from at least two companies. These systems employ a set of spectroscopic sensors placed on the underside of a gantry crane and held near the top of a cargo container for detection. These systems have been previously tested and some issues and limitations observed. Radiation detectors mounted on spreader-bars are single sided systems (observing cargo only from the top) and it is therefore challenging to obtain the same sensitivity as double-sided systems (for example, portal monitors) especially when considering the possible amounts of intervening cargo that could be present. The approximately exponential attenuation of gamma rays in intervening dense cargo presents an inherent limitation to detection. However, SBRD systems hold detectors closer to the container, have a longer dwell time, and may have lower background (over the ship); all of these aspects help mitigate the single-sided issue. In addition, there are operational considerations that make spreader-bar radiation systems attractive. These include scanning for radiation during other operations (loading, unloading or container movement) which minimizes additional time for scanning, incorporating the radiation detection into existing equipment to minimize initial cost, and in the case of ship unloading, scanning the containers before reaching the laydown yard. This study is focused on researching optimized configurations of SBRD systems, including number of detectors, locations, and best use of detector data, to determine a reasonable limit on the capability of these types of systems. The results will help support decisions on where and how these systems might be effectively deployed, and could be used for future specification development for SBRD acquisition. The next phase of this research and investigation into SBRD systems and quantification of the possible improved capability with an enhanced SBRD is the focus of this report. Supporting this investigation, detailed models of an enhanced SBRD system were created using a 3D radiation transport code, and models were run to simulate the data from sources and background for a realistic cargo-loading port environment. The enhanced SBRD had increased detector material (numbers of detectors) compared to the commercial systems, with a distribution providing more uniform coverage. Measurements using small industrial sources were made with an enhanced SBRD system developed by Sandia National Laboratory to support model validation to establish credibility for the simulations of these threat and background scenarios. A significant simulation effort was undertaken to simulate sources of interest within a 40-foot cargo container. In order to estimate the performance of a generalized SBRD system in scenarios including background and cargo, a highly enriched uranium (HEU) test source (with 3x10 -8 232 U by weight) within a wood cargo model was simulated for a 40-foot cargo container. This source was placed at a variety of locations, and the flux from the source was multiplied as necessary to create estimated minimal detectable quantities (MDQ) figures for various quantities of HEU. Simulated data sets were produced corresponding to a complete container offloading scenario for a large number of statistical realizations. Significant work was performed on both the algorithm development and the container cargo distributions entering the US, and the result of this modeling, validation, and simulation effort was a set of estimates of the performance of a variety of radiation detection algorithms in this cargo-screening environment. In the case of algorithms, a variety of contemporary radiation detection and identification approaches were employed, and the optimal approaches to selecting time and location subsets of detector data were explored. In all cases, algorithm performance was compared, and the best approaches were suggested along with the best expected performance from the enhanced SBRD. In general, template-matching schemes employing a limited set of regression parameters tend to provide best results. The improvements of an enhanced SBRD with increased detector material and improved algorithms result in an effective MDQ of 10 kg of HEU in ~50 percent of the imported cargo in 40-foot containers, assuming a random source location. This is approximately two times the capability of the estimated performance of the commercial systems. For an MDQ of the 10 kg HEU source located in the worst location (bottom of the 40-foot container), the volume of cargo scanned drops to 10% for the enhanced SBRD, again a factor of two or more larger than the commercial systems. Enhancing the SBRD systems by adding more detectors, providing a more uniform coverage, and incorporating more advanced algorithms will result in a significant increase in capability. Although this investigation provided some indication of the performance capabilities of an enhanced SBRD system, additional work is needed to estimate the capability for other container configurations, such as the 20 and 45 foot containers. Since the 20-foot container weight limit is similar to the 40-foot, more dense cargo is typically shipped in 20-foot containers. This will result in a smaller percentage of cargo scanned for the 20-foot containers (for a particular source quantity) compared to the 40-foot containers. In addition to other configuration, other source material needs to be investigated to understand the capabilities for the entire threat space, where only HEU is considered in this work.

crane-mounted↗

The Cloud Feedback Model Intercomparison Project (CFMIP) contribution to CMIP6.

The primary objective of CFMIP is to inform future assessments of cloud feedbacks through improved understanding of cloud-climate feedback mechanisms and better evaluation of cloud processes and cloud feedbacks in climate models. However, the CFMIP approach is also increasingly being used to understand other aspects of climate change, and so a second objective has now been introduced, to improve understanding of circulation, regional-scale precipitation, and non-linear changes. CFMIP is supporting ongoing model inter-comparison activities by coordinating a hierarchy of targeted experiments for CMIP6, along with a set of cloud-related output diagnostics. CFMIP contributes primarily to addressing the CMIP6 questions 'How does the Earth system respond to forcing?' and 'What are the origins and consequences of systematic model biases?' and supports the activities of the WCRP Grand Challenge on Clouds, Circulation and Climate Sensitivity. A compact set of Tier 1 experiments is proposed for CMIP6 to address this question: (1) what are the physical mechanisms underlying the range of cloud feedbacks and cloud adjustments predicted by climate models, and which models have the most credible cloud feedbacks? Additional Tier 2 experiments are proposed to address the following questions. (2) Are cloud feedbacks consistent for climate cooling and warming, and if not, why? (3) How do cloud-radiative effects impact the structure, the strength and the variability of the general atmospheric circulation in present and future climates? (4) How do responses in the climate system due to changes in solar forcing differ from changes due to CO2, and is the response sensitive to the sign of the forcing? (5) To what extent is regional climate change per CO2 doubling state-dependent (non-linear), and why? (6) Are climate feedbacks during the 20th century different to those acting on long-term climate change and climate sensitivity? (7) How do regional climate responses (e.g. in precipitation) and their uncertainties in coupled models arise from the combination of different aspects of CO2 forcing and sea surface warming? CFMIP also proposes a number of additional model outputs in the CMIP DECK, CMIP6 Historical and CMIP6 CFMIP experiments, including COSP simulator outputs and process diagnostics to address the following questions. 1. How well do clouds and other relevant variables simulated by models agree with observations? 2. What physical processes and mechanisms are important for a credible simulation of clouds, cloud feedbacks and cloud adjustments in climate models? 3. Which models have the most credible representations of processes relevant to the simulation of clouds? 4. How do clouds and their changes interact with other elements of the climate system?

carbon dioxide↗

Simulating the Dynamics of the CX-100 Wind Turbine Blade: Model Selection Using a Robustness Criterion

Several plausible modeling strategies are available to develop finite element (FE) models of ever-increasingly complex phenomena. Expert judgment is typically used to choose which strategy to employ, while the “best” modeling approach remains unknown. This paper proposes a decision analysis framework that offers a systematic and rigorous methodology for comparing plausible modeling strategies. The proposed framework departs from the conventional approach that considers only test-analysis correlation to select the model that provides the highest degree of fidelity-to-data. The novelty of the framework lies in an exploration of the trade-offs between robustness to uncertainty and fidelity-to-data. Exploring robustness to model imprecision and inexactness, in addition to fidelity-to-data, lends credibility to the simulation by guaranteeing that its predictions can be trusted even if some of the modeling assumptions and input parameters are incorrect. To demonstrate this approach, an experimental configuration is analyzed in which large masses are used to load the CX-100 wind turbine blade in bending during vibration testing. Two plausible simulations are developed with differing strategies to implement these large masses using (i) a combination of point-mass and spring elements or (ii) solid elements. In this paper, the authors study the ability of the two FE models to predict the experimentally obtained natural frequencies, and the robustness of these competing models to uncertainties in the input parameters. Considering robustness for model selection provides the extent to which prediction accuracy deteriorates as the lack-of-knowledge increases. Therefore, the preferable modeling strategy is the one that offers the best compromise between fidelity-to-data and robustness to uncertainty. To predict the bending vibration of the CX-100 wind turbine blade, it is observed that the modeling strategy with solid elements is far superior to the other one in its ability to provide a compromise between fidelity-to-data and robustness to the modeling assumptions. (Approved for unlimited, public release on October xx, 2012, LA-UR-12-xxxx, Unclassified.)

17 WIND ENERGY↗

A Framework for Deep Learning Emulation of Numerical Models With a Case Study in Satellite Remote Sensing

Numerical models based on physics represent the state of the art in Earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning (DL), across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in Earth systems. A difficult test for DL-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A DL emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here, we examine, with a case study in satellite-based remote sensing, the hypothesis that DL approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the DL emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of DL and the growing desire for higher resolution simulations in the Earth sciences.

Bayesian Deep Learning↗

Neutronics Code Benchmark for Fluoride-Salt-Cooled Reactors

The fluoride-salt-cooled high-temperature reactor (FHR) is an advanced reactor design that aims to improve on the efficiency, cost, safety and non-proliferation security of nuclear energy, while exploiting existing technologies to minimize the design and licensing burden. FHRs share many design features with the high-temperature gas-cooled reactor (HTGR), namely using the same fuel form: a bed of graphite spheres, each with thousands of small coated fuel particles (TRISO) dispersed throughout it. However, rather than using a gas as a coolant, the FHR uses a molten salt which changes the behavior of the system; in particular, from a neutronics perspective, the coolant is no longer effectively transparent to neutrons, but rather contributes both to neutron moderation and absorption. It is difficult to perform exploratory reactor physics experiments for new reactor concepts, as the regulation and cost surrounding a fuel experiment is often highly restrictive and prohibitive. As such, researchers and design engineers must rely heavily on simulation capability to develop a working knowledge for how the reactor physics of a pre-prototypical reactor might behave. It is then essential to have confidence that simulation codes provide credible results. As there are no instances of FHRs deployed to date, nor are there any experimental data available on neutron behavior of pebble fuel immersed in salt, the first step is to perform a code-to-code verification of idealized scenarios that capture the physics involved with an FHR system. This summary describes the development of a code-to-code benchmark for FHR with the purpose of code verification and presents preliminary results. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Optimal experimental design for prediction based on push-forward probability measures

Incorporating experimental data is essential for increasing the credibility of simulation-aided decision making and design. This paper presents a method which uses a computational model to guide the optimal acquisition of experimental data to produce data-informed predictions of quantities of interest (QoI). Many strategies for optimal experimental design (OED) select data that maximize some utility that measures the reduction in uncertainty of uncertain model parameters, for example the expected information gain between prior and posterior distributions of these parameters. In this paper, we seek to maximize the expected information gained from the pushforward of an initial (prior) density to the push-forward of the updated (posterior) density through the parameter-to-prediction map. The formulation presented is based upon the solution of a specific class of stochastic inverse problems which seeks a probability density that is consistent with the model and the data in the sense that the push-forward of this density through the parameter-to-observable map matches a target density on the observable data. While this stochastic inverse problem forms the mathematical basis for our approach, we develop a one-step algorithm, focused on push-forward probability measures, that leverages inference-for-prediction to bypass constructing the solution to the stochastic inverse problem. A number of numerical results are presented to demonstrate the utility of this optimal experimental design for prediction and facilitate comparison of our approach with traditional OED.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Code-verification techniques for the method-of-moments implementation of the combined-field integral equation

Code verification plays an important role in establishing the credibility of computational simulations by assessing the correctness of the implementation of the underlying numerical methods. In computational electromagnetics, the numerical solution to integral equations incurs multiple interacting sources of numerical error, as well as other challenges, which render traditional code-verification approaches ineffective. In this paper, we provide approaches to separately measure the numerical errors arising from these different error sources for the method-of-moments implementation of the combined-field integral equation. Here, we demonstrate the effectiveness of these approaches for cases with and without coding errors.

97 MATHEMATICS AND COMPUTING↗

A quantitative method to determine the region not influenced by injected interstitial and surface effects during void swelling in ion-irradiated metals

We propose and demonstrate a microstructurally-based experimental method to quantitively determine the depth regions in self-ion-irradiated metals that are affected by the injected interstitial effect and various surface effects, focusing on the choice of safe analysis zones to minimize the impact of these phenomena. The goal is to define the depth ranges where extracted data can be confidently applied to ion-neutron correlations for reactor application. Since ion energies in the range of 1–5 MeV are most frequently employed by the radiation effects community, irradiations were conducted at four energies in this range, all proceeding at 475 °C. The experiment was conducted on relatively pure single crystal iron to focus only on physical phenomena, avoiding the influence of possibly confounding chemical or segregation processes. Care was also taken to minimize the influence of other physical factors such as crystalline orientation. It was shown that, at 475 °C, ion energies of ≤1 MeV were too shallow in penetration and did not yield a safe depth range, but irradiations at 2.5 MeV and above yielded useful safe zones with predicted swelling behavior becoming independent of ion energy. The surface-affected zone width was found to be roughly twice that of the void-denuded zone width and to be independent of accumulated displacement dose. The largest injected-interstitial effect arises from the injected interstitial depression of void nucleation and growth. The interstitial-affected region starts at about one half of the projected range and does not show any “spreading” of its influence in depth as the peak damage level increases from 50 to 100 dpa. This study provides some confidence that enhances the credibility of ion simulation when applied to prediction of void swelling in neutron environments.

36 MATERIALS SCIENCE↗

Propagating synthetic populations with dynamic Bayesian networks: a framework for long-horizon demographic forecasting

This study presents a dynamic demographic microsimulator using dynamic Bayesian networks to forecast long–term changes in household and individual life events. Leveraging longitudinal Panel Study of Income Dynamics (PSID) data, two networks for individuals and households were modeled to simulate transitions in employment, income, education, marriage, childbirth, leaving the parental home, home ownership, mortality, and household formation or dissolution. Across 1,000 simulation runs spanning 24 years, household–level outcomes remain highly accurate and individual–level predictions reasonable. Although accuracy naturally declines with projection horizon, performance remains promising at both levels. This study addresses a key limitation of existing population synthesis models, which typically generate only a single static snapshot of the population. In conclusion, by introducing a framework that propagates cross-sectional outputs into the future, the microsimulator enables the tracking of demographic evolution over time, enhances realism in population-based simulations, and supplies credible inputs to agent-based travel demand models.

Demographic modeling↗

Prebiotic Evolution of Nitrogen Compounds

Support from this four year grant has funded our research on two general problems. One involves attempts to model the abiotic formation of simple source compounds for functional biomolecules, their concentration from dilute state in the hydrosphere and, in several cases, surface induced reactions to form precursor monomers for bioactive end products (refs. 1-5). Because of the pervasiveness and antiquity of phosphate based biochemistry and the catalytic activity of RNA we have exploring the hypothesis of an RNA World as an early stage in the emergence of life. This concept is now rather generally considered, but has been questioned due to the earlier lack of an experimentally demonstrated successful scheme for the spontaneous formation of ribose phosphate, the key backbone molecule in RNA. That impediment has now been removed. This has been achieved by demonstrating probable sources of activated (condensed) highly soluble and strongly sorbed phosphates in nature (Refs. 1,2) and effective condensation of aldehyde phosphates to form ribose phosphate in high yield (ref.6), thereby placing the RNA World concept on a somewhat safer experimental footing. Like all work in this field these experiments are oversimplifications that largely ignore competing side reactions with other compounds expected to be present. None the less our choice of experimental conditions aim at selective processes that eliminate interfering reactions. We have also sought to narrow the credibility gap by simulating geophysically and geochemically plausible conditions surrounding the putative prebiotic reactions.

Arrhenius, G.↗

Effect of Under-Resolved Grids on High Order Methods

There has been much discussion on verification and validation processes for establishing the credibility of CFD simulations. Since the early 1990s, many of the aeronautical and mechanical engineering related reference journals mandated that any accepted articles in numerical simulations (without known solutions to compared with) need to perform a minimum of one level of grid refinement and time step reduction. Due to the difficulty in analysis, the effect of under-resolved grids and the nonlinear behavior of available spatial discretizations, are scarcely discussed in the literature. Here, an under-resolved numerical simulation is one where the grid spacing being used is too coarse to resolve the smallest physically relevant scales of the chosen continuum governing equations that are of interest to the numerical modeler. With the advent of new developments in fourth-order or higher spatial schemes, it has become common to regard high order schemes as more accurate, reliable and require less grid points. The danger comes when one tries to perform computations with the coarsest grid possible while still hoping to maintain numerical results sufficiently accurate for complex flows, and especially, data-limited problems. On one hand, high order methods when applies to highly coupled multidimensional complex nonlinear problems might have different stability, convergence and reliability behavior than their well studied low order counterparts, especially for nonlinear schemes such as TVD, MUSCL with limiters, ENO, WENO and discrete Galerkin. On the other hand, high order methods involve more operation counts and systematic grid convergence study can be time consuming and prohibitively expansive. At the same time it is difficult to fully understand or categorize the different nonlinear behavior of finite discretizations, especially at the limits of under-resolution when different types of bifurcation phenomena might occur, depending on the combination of grid spacings, time steps, initial conditions and numerical treatments of boundary conditions.

Yee, H. C.↗

JPL Thermal Design Modeling Philosophy and NASA-STD-7009 Standard for Models and Simulations - A Case Study

The Standard JPL thermal engineering practice prescribes worst-case methodologies for design. In this process, environmental and key uncertain thermal parameters (e.g., thermal blanket performance, interface conductance, optical properties) are stacked in a worst case fashion to yield the most hot- or cold-biased temperature. Thus, these simulations would represent the upper and lower bounds. This, effectively, represents JPL thermal design margin philosophy. Uncertainty in the margins and the absolute temperatures is usually estimated by sensitivity analyses and/or by comparing the worst-case results with "expected" results. Applicability of the analytical model for specific design purposes along with any temperature requirement violations are documented in peer and project design review material. In 2008, NASA released NASA-STD-7009, Standard for Models and Simulations. The scope of this standard covers the development and maintenance of models, the operation of simulations, the analysis of the results, training, recommended practices, the assessment of the Modeling and Simulation (M&S) credibility, and the reporting of the M&S results. The Mars Exploration Rover (MER) project thermal control system M&S activity was chosen as a case study determining whether JPL practice is in line with the standard and to identify areas of non-compliance. This paper summarizes the results and makes recommendations regarding the application of this standard to JPL thermal M&S practices.

thermal blanket performance↗

Numerical Uncertainty Estimation for Stochastic Particle-in-Cell Simulations Applied to Verification and Validation.

Systematic veri cation and validation (V&V) is necessary to establish the credibility for high consequence simulations. In this paper, we focus on a radiation-induced plasma experimental validation exercise for simulations which uses both numerical error estimation and input parameter uncertainty quanti cation to provide a direct comparison between Particle-In-Cell (PIC) plasma simulations and experiments. This approach demonstrates how careful validation can uncover missing physics in the simulation. Three di erent validation examples are shown; a vacuum space charge limited cavity, a gas lled space charge limited cavity, and a vacuum non space charge limited cavity. Two of the example are picked to show the importance of error estimation in uncovering inaccuracy/incomplete simulation models. We also report on a newly-developed numerical error estimation approach, StREEQ, which is a notable improvement to past approaches. In the StREEQ approach, a multi- tting scheme based on L 1 , L 2 , and L$\infty$ error norms and alternate weightings is used to propagate uncertainties in the relative importance of outliers and coarse/re ned discretization levels. Bootstrap sampling is used to represent the stochasticity in the response data. The resulting method appears to robustly and conservatively predict the fully-converged response within estimated numerical error bounds for stochastic simulations. The StREEQ approach is demonstrated on two related prototype electron diode problems, and preliminary results are reported for a radiation-induced plasma simulation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗