Search NASA⌕ Search

SEARCH · Search NASA

Results for “quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Overview of the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design

A NATO symposium held in 2008 identified many promising sensitivity analysis and un-certainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not known. The STO Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic problems of interest to NATO. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper presents an overview of the AVT-191 program content.

Benek, John A.↗
NASA NTRS2019

Uncertainty Quantification for JPL Retrievals

We define the notions of verification, validation, and uncertainty quantification (VVUQ), and place them in the context of retrievals of Earth science data. Uncertainty quantification (UQ) is the process of characterizing the uncertainty of a measurement system relative to the true, physical quantity it measures. UQ is needed when measurements are used for scientific inference, assimilated into models with other data, and used for decision-making and risk analysis. Many measurements come with measures of standard error and bias, but these uncertainty measures are often inaccurate, due to the operational need to assume crisp values for parameters which are in fact uncertain, as well as the failure of technical assumptions needed by operational error-estimation approaches. UQ provides a way to study which assumptions fail to hold, and a tool to improve the measurement. We describe a particular, broadly-applicable UQ setup that has been successful for JPL retrievals including OCO-2, and provide recommendations for furthering the UQ state of the practice at JPL.

Turmon, Michael↗
NASA NTRS2018

Multifidelity Uncertainty Quantification of a Commercial Supersonic Transport

The objective of this work was to develop a multifidelity uncertainty quantification approach for efficient analysis of a commercial supersonic transport concept. An approach based on point-collocation, non-intrusive polynomial chaos was formulated in which a low-fidelity model could be corrected using multiple higher-fidelity models. The formulation and methodology also allows for the addition of uncertainty sources not present in the lower fidelity models. To demonstrate the applicability and potential computational savings of the multifidelity polynomial chaos approach, two model problems were explored. The first was a supersonic airfoil with three levels of modeling fidelity, each capturing a gradual increase in modeling of the underlying flow physics. As much as 50% computational cost reduction was observed using the mutlifidelity approach, while predicting nearly the same amount of uncertainty in drag. The second problem was a commercial supersonic transport. This model had three levels of fidelity that included two different modeling approaches and the addition of physics between the fidelity levels. Results of this analysis yielded nearly a 70% computational savings to predict a comparable amount of uncertainty in ground noise. Both problems illustrate the applicability and significant computational savings of the multifidelity method for efficient and accurate uncertainty quantification.

Thomas K. West IV↗
NASA NTRS2021

Post-Landing Major Element Quantification Using SuperCam Laser Induced Breakdown Spectroscopy

The SuperCam instrument on the PerseveranceMars 2020 rover uses a pulsed 1064 nm laser to ablate targets at a distance and conduct laser induced breakdown spectroscopy (LIBS) by analyzing the light from the resulting plasma. SuperCam LIBS spectra are preprocessed to remove ambient light, noise, and the continuum signal present in LIBS observations. Prior to quantification, spectra are masked to remove noisier spectrometer regions andspectra are normalized to minimize signal fluctuations and effectsof target distance.In some cases, the spectra are also standardized or binned prior to quantification. To determine quantitative elemental compositionsof diverse geologic materials at Jezero crater, Mars, we use a suite of 1198 laboratory spectra of 334 well-characterized reference samples. The samples were selected to span a wide range of compositions and include typical silicate rocks, pure minerals (e.g.,silicates, sulfates, carbonates, oxides),more unusual compositions (e.g.,Mn oreand sodalite), andreplicates of the sintered SuperCam calibration targets (SCCTs) onboardthe rover. For each major element (SiO2, TiO2, Al2O3, FeOT, MgO, CaO, Na2O, K2O), the database was subdivided into five“folds” with similar distributions of the element of interest. One fold was held out as an independent test set, and the remaining fourfolds were used to optimize multivariate regression models relating the spectrum to the composition. We considered a variety of models, and selected several for further investigation for each element, based primarily on the root mean squared error of prediction (RMSEP) on the test set, when analyzed at 3m. In cases with several models of comparable performance at 3 m, we incorporated the SCCT performance at different distances to choose the preferred model. Shortly after landing on Mars and collecting initial spectra of geologic targets, we selected one model per element. Subsequently, with additional data from geologic targets, some models were revised to ensure results that are more consistent with geochemical constraints. The calibration discussed here is a snapshot of an ongoing effort to deliver the most accurate chemical compositions with SuperCam LIBS.

Mars 2020↗
NASA NTRS2022

Event Report for The Ethical Artificial Intelligence Quantification Workshop

Artificial Intelligence (AI) is a powerful emerging technology area which requires special attention to using it ethically. AI ethics is still an emerging field, and the partners for this workshop and report seek to move AI ethics discussion ahead by experimenting with ways to measure AI ethics criteria. The following document describes the outcomes and learnings from The Ethical Artificial Intelligence Quantification Workshop held at the National Institute for Aerospace (NIA), Hampton, Virginia on May 12th, 2022. The purpose of the workshop was for participants to evaluate and experiment-with the methodology and process presented by AIEthics.World in cooperation with Intel Corporation. The meeting participants learned about the Ethical AI Certification and Maturity Model™ and applied the methodology to selected notional AI systems. The workshop facilitated the evaluation of the maturity of the AI system according to ethical considerations relevant to NASA, NIA and other participants. The workshop consisted of three main phases. The first phase focused on understanding and summarizing NASA’s ethical approaches, mission and values based on published documentation, discussions and individual insights & opinions of participants. This information was prioritized, weighted, ordered, and quantified in phase two, to formulate an alignment between human values (ethics) and their applicability to AI systems during all lifecycle phases. The first two phases were summarized as a form of ethical genealogy for artificial intelligence, specific to NASA’s ethical approaches. In the third and last phase of the workshop the participants evaluated notional examples of artificial intelligence to qualify and quantify its ability to adhere to the organizational ethics approaches, using the Ethical AI Certification and Maturity Model™. The workshop uses the concept of genealogy, in the traditional sense: the study and traceability of lines of ancestors in the process of evolutionary development from earlier forms. However, as it is applied to an Ethical AI definition, it is providing the insights to the necessary and mandatory traceability of content, data, metrics, telemetry, elements, and structures which are used in the AI’s lifecycle to foster and measure AI ethics in all steps of its lifecycle. The Ethical Artificial Intelligence Quantification Workshop provided NASA with the opportunity to apply the Ethical AI Certification and Maturity Model™, in combination with existing and well-known decision-making and quality control methods to identify the metrics and measurements for an Ethical AI and assess its ethical condition and quality aligned with NASA ethics approaches. The result of the workshop is the capacity for NASA to apply the maturity model assessment to its AI Systems as desired and if necessary, publish the ability of these AI Systems to adhere to the organizational ethical goals. AI ethics frameworks need to be customized for each application domain, for example, individual NASA Mission Directorates. General principles that work in one area such as AI/Machine Learning-based text analysis (the ethics of information-extraction) may need to be adapted for another such as sense-and-avoid decision-making in a flight environment. The workshop was conducted among approximately twenty NASA subject matter experts, so the elements noted above should be considered examples, not definitive NASA ethical AI principles, genealogy, etc. Generating a definitive AI ethics framework for an organization as diverse as NASA would require far more discussion, debate, review, etc. However, the workshop provided valuable insight into mechanisms and processes for quantifying AI ethical qualities.

Artificial Intelligence↗
NASA NTRS2022

Evaluation of IMERG Satellite Precipitation Over the Land-Coast-Ocean Continuum – Part Ii: Quantification

To understand and manage water systems under a changing climate and meet an increasing demand for water, a quantitative understanding of precipitation is most important in coastal regions. The capabilities of the Integrated Multi-satellitE Retrievals for Global Precipitation Measurement (IMERG) V06B product for precipitation quantification are examined over three coastal regions of the United States: the West Coast, the Gulf of Mexico, and the East Coast, all of which are characterized by different topographies and precipitation climatologies. A novel uncertainty analysis of IMERG is proposed that considers environmental and physical parameters such as elevation and distance to the coastline. The IMERG performance is traced back to its components, i.e., passive microwave (PMW), infrared (IR), and morphing-based estimates. The analysis is performed using high-resolution, high-quality Ground Validation Multi-Radar/Multi-Sensor (GV-MRMS) rainfall estimates as ground reference at the native resolution of IMERG of 30 min and 0.1°. IMERG Final (IM-F) quantification performance heavily depends on the respective contribution of PMW, IR, and morph components. IM-F and its components overestimate the contribution of light rainfall (<1 mm h−1) and underestimate the contribution of high rainfall rates (>10 mm h−1) to the total rainfall volume. Strong regional dependencies are highlighted, especially over the West Coast, where the proximity of complex terrain to the coastline challenges precipitation estimates. Other major drivers are the distance from the coastline, elevation, and precipitation types, especially over the land and coast surface types, that highlight the impact of precipitation regimes.

Atmosphere↗
NASA NTRSDate not supplied

Data Fusion With Uncertainty Quantification for Sub-City-Scale Air Quality Assessment and Forecasting

Many information sources can support air quality assessment and forecasting, including atmospheric chemistry model outputs, satellite retrievals of column chemical and aerosol constituents, and surface-based air quality monitoring data from both regulatory and low-cost instruments. Systematic integration of these data sources provides a major opportunity to improve understanding and management of air quality, but also presents technical barriers, especially in resource- and data-constrained settings in the Global South. This presentation describes a data fusion system, currently under development using the Google Earth Engine platform, which aims to integrate the information sources listed above to support comprehensive sub-city-scale assessment and management of air quality. Furthermore, the data fusion framework includes provisions for the quantification of uncertainties in the resulting fused estimates based on the variability of and among the input data sources. These capabilities will allow air quality managers to better understand their local air quality situation, including relative confidence in the fused estimates for different constituents, locations, and times, leading to better informed air quality management decisions. This presentation covers the underlying methodology of the data fusion and uncertainty quantification approaches, provides an update on the status of its implementation, and presents early qualitative and quantitative results.

Carl Malings↗
NASA NTRS2024

Demonstration of Portable X-ray Fluorescence Spectroscopy for High-Throughput In-Situ Quantification of Surface Lunar Dust for Testing and Future Surface Missions

In this paper, we present a new method of quantification for surface concentrations of lunar dust and lunar simulant for use and deployment for development testing and potential eventual use for verification and development testing and lunar surface missions. This technique demonstrates the use of portable X-ray fluorescence spectroscopy (pXRF) to quantify lunar dust loading on surfaces using an adaption of existing pXRF techniques. This paper shows the background in current methodologies for quantification of lunar dust in tests as well as current and potential future techniques for lunar surface missions, as well as current applications of commercial off-the-shelf (COTS) pXRF technology. The methodology for adapting current pXRF techniques is presented, followed by a demonstration of this new method on a variety of materials related to spaceflight or lunar surface missions. This technique shows high fidelity for immediate utilization as well as a demonstration of high potential for future surface missions.

Spectroscopy↗
DOE OSTI2020

Sensitivity and Uncertainty Quantification of Transition Scenario Simulations

This report documents the first collective attempt at developing and applying capabilities to quantify uncertainties, assess parametric sensitivities, and optimize multiple parameters and metrics in fuel cycle simulations generated by the SA&I Campaign. To do this, external codes that were designed to perform sensitivity analysis and uncertainty quantification (SA&UQ) needed to be coupled to the SA&I Campaign’s nuclear fuel cycle simulators (NFCS). In FY20, two approaches were pursued: 1) coupling Cyclus to an ORNL-internal code called MOT (Metaheuristic Optimization Tool) and 2) coupling DYMOND to the opensource SA&UQ tool kit Dakota. The primary objective of having these NFCS/SA&UQ coupled capabilities is to better inform DOE-NE and other stakeholders on the results generated from the NFCS. For a given set of fuel cycle strategies, policies, and technology assumptions that make up a fuel cycle scenario, these NFCS have traditionally been used by the SA&I Campaign to provide quantitative answers in terms of year-by-year mass flows, infrastructure requirements, costs, etc. With these newly developed coupled capabilities, the SA&I Campaign can now efficiently simulate hundreds or thousands of these scenarios, sample large ranges of parameters and assumptions, and use the unique features of the SA&UQ tools to process the data. This enables providing answers with known and propagated uncertainties, determining the sensitivity of important metrics to different parameters and assumptions, quantifying how much fuel cycle and technology parameters impact each other, and producing optimized fuel cycle strategies for single and multiple variables. To demonstrate these new capabilities, the Cyclus/MOT was used to model several scenarios ranging from simple fleet retirements to transitions to advanced reactors. Specifically, for a transition scenario from LWRs to SFRs and advanced LWRs, uncertainty quantification, sensitivity analysis, and optimization studies were applied to cases involving single and multiple parameter (input) and single and multiple metric (output) variations. In addition, a similar transition scenario was modeled to demonstrate how to optimize the reprocessing capacity parameter to minimize two performance metrics while taking into account uncertainties from two other parameters. Lastly, a depletion module based on SCALE/ORIGEN was added in Cyclus to simulate the third scenario that was designed to quantify the impact of the modeling assumption that all LWR used nuclear fuel have the same burnup. The newly developed DYMOND/Dakota capability was also applied to a transition scenario from the existing fleet to small modular reactors and fast reactors. This particular scenario involves not only explicit isotopic depletion via ORIGEN-2, but also includes multirecycling and utilizing the criticality search feature to determine the fresh fuel composition of recycled fuel, a feature unique to the DYMOND NFCS. A large database of simulations were run with 4 main parameters that were sampled: start date of reprocessing, reprocessing capacity, energy demand growth rate, and advanced reactor share of the fleet. The 4 main metrics were uranium consumption, enrichment requirements, waste generation, and levelized cost of electricity using data from the Cost Basis Report. The demonstrated SA&UQ results include those that inform on how to choose parameters to avoid “failed” scenarios, Sobol’ indices that inform on the importance of various parameters individually and synergistically, and Analysis of Variance (ANOVA) studies that decompose parameter ranges into groups and informs on whether variations are statistically significant.

Feng, B.↗
DOE OSTI2021

Hydrogen Component Leak Rate Quantification for System Risk and Reliability Assessment through QRA and PHM Frameworks: Preprint

The National Renewable Energy Laboratory's (NREL) Hydrogen Safety Research and Development (HSR&D) program in collaboration with the University of Maryland's Systems Risk and Reliability Analysis Laboratory (SyRRA) are working to improve reliability and reduce risk in hydrogen systems. This approach strives to use quantitative data on component leaks and failures, together with Prognosis and Health Management (PHM), and Quantitative Risk Assessment (QRA) to identify at-risk components, reduce component failures and downtime, and predict when components require maintenance. Hydrogen component failures increase facility maintenance cost, facility downtime, and reduce public acceptance of hydrogen technologies, ultimately increasing facility size and cost because of potentially overly conservative requirements. Leaks are a predominant failure mode for hydrogen components. However, uncertainties in the amount of hydrogen emitted from leaking components and the frequency of those failure events limit the understanding of the risks that they present under real-world operational conditions. NREL has deployed a test fixture, the Leak Rate Quantification Apparatus (LRQA), to quantify the mass flow rate of leaking gases from medium and high-pressure components that have failed while in service. Quantitative hydrogen leak rate data from this system could ultimately be used to better inform risk assessment and Regulation Codes and Standards (RCS). Parallel activity explores the use of PHM and QRA techniques to assess and reduce risk, thereby improving safety and reliability of hydrogen systems. The results of QRAs could further provide a systematic and science-based foundation for the design and implementation of RCS, as in the latest versions of the NFPA 2 code for gaseous hydrogen stations. Alternatively, data-driven techniques of PHM could provide new damage diagnosis and health-state prognosis tools. This research will help end users, station owners and operators, and regulatory bodies move towards risk-informed preventative maintenance versus emergency corrective maintenance, reducing cost and improving reliability. Predictive modelling of failures could improve safety and affect RCS requirements such as setback distances at liquid refuelling sites. The combination of leak rate quantification research, PHM, and QRA can lead to better informed models enabling data-based decision to be made for hydrogen system safety improvements.

codes and standards↗
DOE OSTI2022

Uncertainty Quantification of Calculated Temperatures for the AGR 5/6/7 Experiment

This report documents the quantification of uncertainty of the calculated temperature data for the Advanced Gas Reactor (AGR) 5/6/7 fuel irradiation experiment conducted in the Advanced Test Reactor at Idaho National Laboratory in support of the Advanced Reactor Technologies? research and development program. Recognizing uncertainties inherent in physics and thermal simulations of the AGR 5/6/7 capsules, the results of the numerical simulations are used in combination with statistical analysis methods to improve qualification of measured data. The calculated fuel temperatures for AGR tests are also used for validation of the fission product transport and fuel performance simulation models. These crucial roles of the calculated fuel temperatures in ensuring achievement of the AGR experimental program objectives require accurate determination of the model temperature uncertainties. This report covers temperature uncertainty results for each of the five AGR 5/6/7 capsules. To quantify the uncertainty of calculated temperatures determined using the ABAQUS finite element heat transfer code, this study identifies and analyzes model parameters of potential importance to the calculated temperatures of fuel compacts and thermocouples. The selection of input parameters for uncertainty quantification is based on the ranking of their influences upon temperature predictions. Thus, selected input parameters include those with high sensitivity and those with the largest uncertainty. Propagation of model parameter uncertainty and sensitivity is then used to quantify the overall uncertainty of calculated temperatures. Measurement uncertainty, analysis of modeling assumptions, and expert judgment are used as the basis to quantify the uncertainty range for selected input parameters. The input uncertainties are dynamic, accounting for the effect of unplanned events and changes in thermal properties of capsule components over extended exposure to high temperatures and fast neutron irradiation. The sensitivity analysis performed in this work went beyond the traditional local sensitivity. Using experimental design, analysis of pairwise interactions of model parameters was performed to establish sufficiency of the time dependent first order (linear) expansion terms in constructing the temperature response surface. To achieve completeness, uncertainty propagation made use of pairwise noise correlations of model parameters. Furthermore, using an interpolation scheme over the input parameter domain, the analysis obtains time dependent sensitivity over the test campaign duration. This allows computation of uncertainty for the calculated fuel temperatures and the calculated graphite temperatures at thermocouple locations during the entire irradiation period.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Process for ultra-sensitive quantification of target analytes in complex biological systems

Antibody-free processes are disclosed that provide accurate quantification of a wide variety of low-abundance target analytes in complex samples. The processes can employ high-pressure, high-resolution chromatographic separations for analyte enrichment. Intelligent selection of target fractions may be performed via on-line Selected Reaction Monitoring (SRM) or off-line rapid screening of internal standards. Quantification may be performed on individual or multiplexed fractions. Applications include analyses of, e.g., very low abundance proteins or candidate biomarkers in plasma, cell, or tissue samples without the need for affinity-specific reagents.

Shi, Tujin↗
DOE OSTI2022

Quantification of the importance of the modeling fidelity in the Best Estimate Plus Uncertainty analysis

In this work, the multi-physics coupling of CTF-PARCS for both steady-state and transient simulations is evaluated focusing on the quantification of the importance of the modeling fidelity when applied to the Best Estimate Plus Uncertainty safety analysis. For the steady-state, a Picard iteration approach is adopted in the coupled code while for the transient an explicit approach has been developed as a first step. The CTF-PARCS coupling is applied to the REA at HFP BOC scenario proposed in the exercise I-2c of LWR-UAM benchmark Phase III. Two different modeling choices are investigated for the nominal calculations. The first consists of including the 3D burnup information in CTF, and the second of modeling the spacers grids in both PARCS and CTF. It is observed that due to the degradation of the fuel thermal conductivity, the 3D burnup inclusion in CTF leads to significant higher centerline temperatures than the base case, with a difference up to 300 K. The spacer grids modeling shows the expected power and temperature decrease in the axial positions of the spacer grids. For the uncertainty quantification study, the multi-physics modeling including the burnup information in CTF is used. The results show that the inserted reactivity has a relative standard deviation of 13.6% mainly attributed to the nuclear data. The maximum linear power has a relative standard deviation of 16.2% due to the nuclear data as well, while the maximum centerline temperature has a relative standard deviation of 3.5% primarily caused by the fuel thermal conductivity. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Model Gap Quantification and Evaluation

In the real world, model gaps always exist because models cannot perfectly match the objective physical plants. Model gaps reflect the integrity of models, which is vital for model validation and calibration. This letter proposes a novel approach for model gap quantification and evaluation. First, a comprehensive metric is developed to quantify dynamic model gaps. Next, the model gaps are evaluated from a panoramic view of the probability distribution of the comprehensive metric for multiple scenarios. Finally, we demonstrate the proposed quantification and evaluation approach through synchronous machine models.

Wang, Shaobu↗
DOE OSTI2026

MULTI-FIDELITY MODELING AND UNCERTAINTY QUANTIFICATION OF INVERTER BASED RESOURCES IN INTEGRATED T&D SYSTEMS

Uncertainty quantification plays a pivotal role in improving the accuracy and reliability of inverter operation within modern power systems that are increasingly dominated by inverter-based resources (IBRs). IBRs, especially those operating under grid forming (GFM) control, rely heavily on a complex set of control parameters and system measurements to maintain voltage, frequency, and power balance. Traditional deterministic modeling approaches often fail to capture these parameter deviations, potentially resulting in suboptimal control actions, reduced system stability, or even instability under high penetration of IBRs. In this paper, we demonstrate the application of model calibration and uncertainty quantification (UQ) principles to an integrated transmission and distribution (T&D) model involving a GFM converter and provide a framework for prioritizing control improvements, guiding robust design, and informing adaptive strategies that can accommodate real-time variability in system conditions. The proposed approach could be valuable in enhancing the robustness of current and future power systems under increased IBR penetrations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Code for multi-shape Gaussian process (GP) fitting with uncertainty quantification (UQ)

This is code associated with the publication “Nonparametric Multi-shape Modeling with Uncertainty Quantification,” authored by Hengrui Luo (Lawrence Berkeley National Laboratory) and Justin Strait (Los Alamos National Laboratory). The code is used to fit multiple-output Gaussian process (GP) models of planar closed curves to collections of ordered point sets, allowing for flexible nonlinear prediction of the underlying curve under dense or sparse point set samplings and with or without noise, as well as tractable uncertainty quantification. To do this, we employ use of a periodic kernel to account for the nonlinear input space of closed curves, and combine with coregionalization models to account for dependence both (i) between curve coordinates, and (ii) between pairs of curves. Functions in the code are capable of fitting these models, as well as performing additional tasks with the fitted curves such as (a) shape registration and alignment, (b) shape averaging, and (c) fitting for curve sub-populations / clusters.

Strait, Justin↗
DOE OSTI2024

Accelerating uncertainty quantification in incremental dynamic analysis using dimension reduction-based surrogate modeling

We propose a surrogate modeling framework based on dimension reduction to facilitate the quantification of seismic risk of structural systems in performance-based earthquake engineering. The framework adopts incremental dynamic analysis (IDA) for addressing hazard variability, and promotes significant computational efficiency improvement for propagating epistemic uncertainties associated with the structural models. It utilizes both linear and nonlinear dimension reduction approaches, equipped with inverse mappings, to learn a functional between the input parameter space (e.g., the epistemic uncertainties of the structure) to the high-dimensional output space created through the IDA implementation across different ground motions and seismic intensity levels. Polynomial chaos expansion is adopted as the surrogate model to learn this functional in the reduced space. A nine-story steel moment-resisting frame with uncertain structural properties is used as a testbed. Furthermore, we select the seismic fragility curves as a measure of the structure’s seismic performance, since it provides an estimate of the probability of entering specified damage states for given levels of ground shaking.

42 ENGINEERING↗
DOE OSTI2023

Multifidelity Monte Carlo estimation for efficient uncertainty quantification in climate-related modeling

Abstract. Uncertainties in an output of interest that depends on the solution of a complex system (e.g., of partial differential equations with random inputs) are often, if not nearly ubiquitously, determined in practice using Monte Carlo (MC) estimation. While simple to implement, MC estimation fails to provide reliable information about statistical quantities (such as the expected value of the output of interest) in application settings such as climate modeling, for which obtaining a single realization of the output of interest is a costly endeavor. Specifically, the dilemma encountered is that many samples of the output of interest have to be collected in order to obtain an MC estimator that has sufficient accuracy – so many, in fact, that the available computational budget is not large enough to effect the number of samples needed. To circumvent this dilemma, we consider using multifidelity Monte Carlo (MFMC) estimation which leverages the use of less costly and less accurate surrogate models (such as coarser grids, reduced-order models, simplified physics, and/or interpolants) to achieve, for the same computational budget, higher accuracy compared to that obtained by an MC estimator – or, looking at it another way, an MFMC estimator obtains the same accuracy as the MC estimator at lower computational cost. The key to the efficacy of MFMC estimation is the fact that most of the required computational budget is loaded onto the less costly surrogate models so that very few samples are taken of the more expensive model of interest. We first provide a more detailed discussion about the need to consider an alternative to MC estimation for uncertainty quantification. Subsequently, we present a review, in an abstract setting, of the MFMC approach along with its application to three climate-related benchmark problems as a proof-of-concept exercise.

54 ENVIRONMENTAL SCIENCES↗