Search NASA⌕ Search

SEARCH · Search NASA

Results for “input uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Ares I-X Best Estimated Trajectory and Comparison with Pre-Flight Predictions

The Ares I-X trajectory reconstruction produced best estimated trajectories of the flight test vehicle ascent through stage separation, and of the first and upper stage entries after separation. The trajectory reconstruction process combines on-board, ground-based, and atmospheric measurements to produce the trajectory estimates. The Ares I-X vehicle had a number of on-board and ground based sensors that were available, including inertial measurement units, radar, air- data, and weather balloons. However, due to problems with calibrations and/or data, not all of the sensor data were used. The trajectory estimate was generated using an Iterative Extended Kalman Filter algorithm, which is an industry standard processing algorithm for filtering and estimation applications. This paper describes the methodology and results of the trajectory reconstruction process, including flight data preprocessing and input uncertainties, trajectory estimation algorithms, output transformations, and comparisons with preflight predictions.

Karlgaard, Christopher D.↗
NASA NTRS2013

Center-TRACON Automation System (CTAS) En Route Trajectory Predictor Requirements and Capabilities

This requirements framework document is designed to support the capture of requirements and capabilities for state-of-the-art trajectory predictors (TPs). This framework has been developed to assist TP experts in capturing a clear, consistent, and cross-comparable set of requirements and capabilities. The goal is to capture capabilities (types of trajectories that can be built), functional requirements (including inputs and outputs), non-functional requirements (including prediction accuracy and computational performance), approaches for constraint relaxation, and input uncertainties. The sections of this framework are based on the Common Trajectory Predictor structure developed by the FAA/Eurocontrol Cooperative R&D Action Plan 16 Committee on Common Trajectory Prediction. It is assumed that the reader is familiar with the Common TP Structure.1 This initial draft is intended as a first cut capture of the En Route TS Capabilities and Requirements. As such, it contains many annotations indicating possible logic errors in the CTAS code or in the description provided. It is intended to work out the details of the annotations with NASA and to update this document at a later time.

framework↗
NASA NTRS2019

Continuously Improving Parametric Modeling with Historical Data on the ICESat-2 Mission

This paper delves into the details of the Joint Confidence Level (JCL) process performed for the Ice, Cloud, and Land Elevation Satellite (ICESat)-2 mission and how past performance was incorporated into subsequent JCL models to enable the project to continuously analyze potential slips to their launch readiness date (LRD). One year prior to the mission Preliminary Review (mPDR), the JCL model development process began. The first model was well received at the mPDR, held on October 10, 2012, and the input received by the Standing Review Board was incorporated into the model for the official data drop for key decision point (KDP)-C. The 70% JCL results of the October 2012 mPDR model forecast an LRD of February 2017 and associated cost of $830M. This result in 2012 immediately highlighted potential challenges with the project-planned LRD of July 2016. The year following the mPDR, the project had sustained a oneyear slip in the LRD due to problematic systems engineering requirement issues which impacted all project subsystems. This slip moved the project planned LRD from July 2016 to July 2017, an additional 5 months beyond the 2012 model’s 70% JCL result for the LRD of February 2017. As the project was quickly approaching the mission Critical Design Review (mCDR), the need for reliable JCL results increased significantly. The project held discussions on the JCL modeling process and focused on the input uncertainty distributions. Specifically, to identify the uncertainty distributions that the 2012 mPDR model would have needed to produce a 70% LRD result of July 2017. This led the project to compare multiple uncertainty distributions, and ultimately spurred the project to utilize uncertainty distributions that incorporated project past performance and historical data to forecast potential LRD slips. The revised results, created in 2014 and utilizing the new uncertainty distributions, showed that with 70% confidence, the ICESat-2 mission would launch in August 2018 with a cost of $1,044M. Today, ICESat-2 is scheduled to launch on September 15, 2018 with a project management (PM) agreement value of $1,056M. This illustrates how a JCL model can be continuously improved to produce valuable results for a project, even in cases of LRD delays. The primary reason for the ICESat-2 LRD delay is due to a laser failure on the primary instrument. Laser failure was one of the highest risk and uncertainty drivers within the JCL model. The project placed the most risk in this area of the model, and the model further identified the laser as the top risk driver and contributor to the LRD result. This further illustrates how a JCL can be used to predict and quantify possible issues on new technology missions.

Krygiel, Joseph↗
NASA NTRS2021

Technical Note: AQMEII4 Activity 1: Evaluation of Wet and Dry Deposition Schemes as an Integral Part of Regional-scale Air Quality Models

We present in this technical note the research protocol for phase 4 of the Air Quality Model Evaluation International Initiative (AQMEII4). This research initiative is divided into two activities, collectively having three goals: (i) to define the current state of the science with respect to representations of wet and especially dry deposition in regional models, (ii) to quantify the extent to which different dry deposition parameterizations influence retrospective air pollutant concentration and flux predictions, and (iii) to identify, through the use of a common set of detailed diagnostics, sensitivity simulations, model evaluation, and reduction of input uncertainty, the specific causes for the current range of these predictions. Activity 1 is dedicated to the diagnostic evaluation of wet and dry deposition processes in regional air quality models (described in this paper), and Activity 2 to the evaluation of dry deposition point models against ozone flux measurements at multiple towers with multiyear observations (to be described in future submissions as part of the special issue on AQMEII4). The scope of this paper is to present the scientific protocols for Activity 1, as well as to summarize the technical information associated with the different dry deposition approaches used by the participating research groups of AQMEII4. In addition to describing all common aspects and data used for this multi-model evaluation activity, most importantly, we present the strategy devised to allow a common process-level comparison of dry deposition obtained from models using sometimes very different dry deposition schemes. The strategy is based on adding detailed diagnostics to the algorithms used in the dry deposition modules of existing regional air quality models, in particular archiving diagnostics specific to land use–land cover (LULC) and creating standardized LULC categories to facilitate cross-comparison of LULC-specific dry deposition parameters and processes, as well as archiving effective conductance and effective flux as means for comparing the relative influence of different pathways towards the net or total dry deposition. This new approach, along with an analysis of precipitation and wet deposition fields, will provide an unprecedented process-oriented comparison of deposition in regional air quality models. Examples of how specific dry deposition schemes used in participating models have been reduced to the common set of comparable diagnostics defined for AQMEII4 are also presented.

Air Quality Model Evaluation International Initiat↗
NASA NTRS2023

Evaluation of EPIC Oxygen Bands Stability With Radiative Transfer Simulations Over the South Pole

The Earth Polychromatic Imaging Camera (EPIC) onboard the Deep Space Climate Observatory (DSCOVR) satellite orbiting the Sun at the Lagrange-1 point was launched without onboard calibration systems. Vicarious calibration is conducted for 8 of the 10 UV/VIS/NIR channels using other low earth orbiting satellite instruments, while its two O 2 bands (688 nm and 764nm) rely on indirect moon-view calibrations because the same narrow-band O 2 bands are not readily available from other in-flight instruments. This study compares EPIC measurements from the four O 2 bands aiming at examining sensor stability over a uniquely suited location, i.e., the permanently snow-covered South Pole. The study utilizes radiative transfer model simulations with in-situ atmospheric soundings taken at South Pole during months of December and January from 2015 to 2022. The absolute discrepancy between the model simulations and observations is less than 1.0% for the two reference bands, but 5.75% and 15.63% for the 688nm, and 764 nm absorption bands, respectively. The simulated A-band and B-band ratios are 16.09% and 4.74% higher than that from the observations. Various sensitivities are conducted to estimate possible contributions to the discrepancies from input atmospheric profiles, spectral surface albedos and surface BRDF. While none of the input uncertainties is likely to account for the large discrepancies in the oxygen absorption bands, a small shift in the instrument response function could be the main reason for these biases. On the other hand, the model simulations are able to capture systematic variations with observed angular measurements and explain the multi-year trends found in observed O 2 band ratios due to satellite orbit shifting. When model simulated contributions from the angle variations are deducted from the observed O 2 band ratios, the residual O 2 band ratios are found to be stable since 2015.

EPIC↗
NASA NTRSDate not supplied

Sensitivity Analysis of the Human Research Program’s Impact 1.0 Model

Sensitivity analysis estimates the relative contribution of the uncertainty in input values to the uncertainty of model outputs. Partial Rank Correlation Coefficient (PRCC) and Leave One Out (LOO) are methods of conducting sensitivity analysis on non-linear simulation models like the IMPACT Model. The PRCC method estimates the sensitivity using partial correlation of the ranks of the generated input values to each generated output value. The “partial” part is due to the adjustments made for the linear effects of all the other input values in the calculation of correlation between a particular input and each output. LOO removes a medical condition from test suite and calculates the change in the outcome. This is used to identify the influence of the condition input in the model The inputs to the sensitivity procedures include the number of occurrences of each of the one hundred plus IMPACT medical conditions generated over the simulations, and the IMPACT outputs from the MEDPRAT mathematical model. The outputs total task time lost (TTL), number of return to definitive care (RTDC), and number of loss of crew lives (LOCL). The IMPACT team will report the results of using PRCC and LOO on IMPACT 1.0. Tornado plots will assist in the visualization of the condition-related input sensitivities to each of the main outcomes. The outcomes of this sensitivity analysis will drive review focus by identifying conditions where changes in uncertainty, and input values could drive changes in overall model output uncertainty. These efforts are an integral part of the overall verification, validation, and credibility review of IMPACT 1.0.

Sensitivity Anaylsis↗
DOE OSTI2024

Bayes_Opt-SWMM: A Gaussian process-based Bayesian optimization tool for real-time flood modeling with SWMM

Real-time flood model plays a pivotal role in averting urban flood damage, particularly when there is minimal lead time for preparatory measures. However, urban flood modeling in real-time often contends with inherent uncertainties arising from input data uncertainty and parameter ambiguities. Here this study introduces a real-time calibration (RTC) tool called Bayes_Opt-SWMM, specifically tailored for real-time urban flood modeling and uncertainty optimization. This tool leverages the Gaussian process-based Bayesian optimization algorithm and interfaces seamlessly with the Stormwater Management Model (SWMM). It integrates real-time model forcing data and flood monitoring collected through sensors and gauges which are strategically placed within critical locations of urban drainage systems. Our approach hinges on the Surrogate Model based Uncertainty Optimization (SMUO) concept, providing an avenue for enhancing real-time flood modeling. Bayes_Opt-SWMM runs the optimization process using a surrogate model called Gaussian Process emulator with two inference methods: (1) the Gaussian Process (GP) model and (2) Markov Chain Monte Carlo (MCMC) algorithm in GP model (GP_MCMC). Furthermore, three acquisition functions, namely Expected Improvement (EI), Maximum Probability of Improvement (MPI), and Lower Confidence Bound (LCB), facilitate optimal parameter fitting within the surrogate models. The efficiency of GP-based surrogate models in learning SWMM model parameters, leads to an improved uncertainty quantification and accelerated real-time flood modeling in urban areas. Overall, Bayes_Opt-SWMM emerges as a cost-effective and valuable tool for real-time flood modeling and monitoring, with significant potential for managing intelligent storm water systems in urban environments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Updating PV and Battery Bill Savings Calculations for Net Billing: New Best Practices for Input Data and Uncertainty

Jurisdictions are increasingly adopting compensation structures for distributed PV and PV-battery systems that price exported energy lower than energy consumed onsite (net billing rates). Standard methods for calculating the bill savings from PV and PV-battery systems were developed for net metering structures, and applying these same methods to net billing structures (such as using Typical Meteorological Year weather with actual year load) introduces bias errors that underestimate PV-battery system bill savings by between 1.5\% and 9\%, depending on the utility rate. We assess the magnitude of these errors and compare them to other sources of uncertainty when estimating the bill savings from PV and PV-battery systems under more complex utility rates.

14 SOLAR ENERGY↗
NASA NTRS1998

A Monte Carlo Uncertainty Analysis of Ozone Trend Predictions in a Two Dimensional Model

We use Monte Carlo analysis to estimate the uncertainty in predictions of total O3 trends between 1979 and 1995 made by the Goddard Space Flight Center (GSFC) two-dimensional (2D) model of stratospheric photochemistry and dynamics. The uncertainty is caused by gas-phase chemical reaction rates, photolysis coefficients, and heterogeneous reaction parameters which are model inputs. The uncertainty represents a lower bound to the total model uncertainty assuming the input parameter uncertainties are characterized correctly. Each of the Monte Carlo runs was initialized in 1970 and integrated for 26 model years through the end of 1995. This was repeated 419 times using input parameter sets generated by Latin Hypercube Sampling. The standard deviation (a) of the Monte Carlo ensemble of total 03 trend predictions is used to quantify the model uncertainty. The 34% difference between the model trend in globally and annually averaged total O3 using nominal inputs and atmospheric trends calculated from Nimbus 7 and Meteor 3 total ozone mapping spectrometer (TOMS) version 7 data is less than the 46% calculated 1 (sigma), model uncertainty, so there is no significant difference between the modeled and observed trends. In the northern hemisphere midlatitude spring the modeled and observed total 03 trends differ by more than 1(sigma) but less than 2(sigma), which we refer to as marginal significance. We perform a multiple linear regression analysis of the runs which suggests that only a few of the model reactions contribute significantly to the variance in the model predictions. The lack of significance in these comparisons suggests that they are of questionable use as guides for continuing model development. Large model/measurement differences which are many multiples of the input parameter uncertainty are seen in the meridional gradients of the trend and the peak-to-peak variations in the trends over an annual cycle. These discrepancies unambiguously indicate model formulation problems and provide a measure of model performance which can be used in attempts to improve such models.

Considine, D. B.↗
DOE OSTI2023

Driving mode analysis—How uncertain functional inputs propagate to an output

Abstract Driving mode analysis elucidates how correlated features of uncertain functional inputs jointly propagate to produce uncertainty in the output of a computation. Uncertain input functions are decomposed into three terms: the mean functions, a zero‐mean driving mode, and zero‐mean residual. The random driving mode varies along a single direction, having fixed functional shape and random scale. It is uncorrelated with the residual, and under linear error propagation, it produces an output variance equal to that of the full input uncertainty. Finally, the driving mode best represents how input uncertainties propagate to the output because it minimizes expected squared Mahalanobis distance amongst competitors. These characteristics recommend interpretation of the driving mode as the single‐degree‐of‐freedom component of input uncertainty that drives output uncertainty. We derive the functional driving mode, show its superiority to other seemingly sensible definitions, and demonstrate the utility of driving mode analysis in an application. The application is the simulation of neutron transport in criticality experiments. The uncertain input functions are nuclear data that describe how Pu reacts to bombardment by neutrons. Visualization of the driving mode helps scientists understand what aspects of correlated functional uncertainty have effects that either reinforce or cancel one another in propagating to the output of the simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

DeepUQ: Assessing the Aleatoric Uncertainties from two Deep Learning Methods

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret exactly. We systematically compare aleatoric uncertainty measured by two UQ techniques, Deep Ensembles (DE) and Deep Evidential Regression (DER). Our method focuses on both zero-dimensional (0D) and two-dimensional (2D) data, to explore how the UQ methods function for different data dimensionalities. We investigate uncertainty injected on the input and output variables and include a method to propagate uncertainty in the case of input uncertainty so that we can compare the predicted aleatoric uncertainty to the known values. We experiment with three levels of noise. The aleatoric uncertainty predicted across all models and experiments scales with the injected noise level. However, the predicted uncertainty is miscalibrated to $\rm{std}(\sigma_{\rm al})$ with the true uncertainty for half of the DE experiments and almost all of the DER experiments. The predicted uncertainty is the least accurate for both UQ methods for the 2D input uncertainty experiment and the high-noise level. While these results do not apply to more complex data, they highlight that further research on post-facto calibration for these methods would be beneficial, particularly for high-noise and high-dimensional settings.

Nevin, Rebecca↗
NASA NTRS2005

Probabilistic Parameter Uncertainty Analysis of Single Input Single Output Control Systems

The current standards for handling uncertainty in control systems use interval bounds for definition of the uncertain parameters. This approach gives no information about the likelihood of system performance, but simply gives the response bounds. When used in design, current methods of m-analysis and can lead to overly conservative controller design. With these methods, worst case conditions are weighted equally with the most likely conditions. This research explores a unique approach for probabilistic analysis of control systems. Current reliability methods are examined showing the strong areas of each in handling probability. A hybrid method is developed using these reliability tools for efficiently propagating probabilistic uncertainty through classical control analysis problems. The method developed is applied to classical response analysis as well as analysis methods that explore the effects of the uncertain parameters on stability and performance metrics. The benefits of using this hybrid approach for calculating the mean and variance of responses cumulative distribution functions are shown. Results of the probabilistic analysis of a missile pitch control system, and a non-collocated mass spring system, show the added information provided by this hybrid analysis.

Smith, Brett A.↗
NASA NTRS2016

Sensitivity Analysis of the Integrated Medical Model for ISS Programs

Sensitivity analysis estimates the relative contribution of the uncertainty in input values to the uncertainty of model outputs. Partial Rank Correlation Coefficient (PRCC) and Standardized Rank Regression Coefficient (SRRC) are methods of conducting sensitivity analysis on nonlinear simulation models like the Integrated Medical Model (IMM). The PRCC method estimates the sensitivity using partial correlation of the ranks of the generated input values to each generated output value. The partial part is so named because adjustments are made for the linear effects of all the other input values in the calculation of correlation between a particular input and each output. In SRRC, standardized regression-based coefficients measure the sensitivity of each input, adjusted for all the other inputs, on each output. Because the relative ranking of each of the inputs and outputs is used, as opposed to the values themselves, both methods accommodate the nonlinear relationship of the underlying model. As part of the IMM v4.0 validation study, simulations are available that predict 33 person-missions on ISS and 111 person-missions on STS. These simulated data predictions feed the sensitivity analysis procedures. The inputs to the sensitivity procedures include the number occurrences of each of the one hundred IMM medical conditions generated over the simulations and the associated IMM outputs: total quality time lost (QTL), number of evacuations (EVAC), and number of loss of crew lives (LOCL). The IMM team will report the results of using PRCC and SRRC on IMM v4.0 predictions of the ISS and STS missions created as part of the external validation study. Tornado plots will assist in the visualization of the condition-related input sensitivities to each of the main outcomes. The outcomes of this sensitivity analysis will drive review focus by identifying conditions where changes in uncertainty could drive changes in overall model output uncertainty. These efforts are an integral part of the overall verification, validation, and credibility review of IMM v4.0.

medical equipment↗
DOE OSTI2022

Computer Model Calibration with Time Series Data Using Deep Learning and Quantile Regression

Computer models play a key role in many scientific and engineering problems. One major source of uncertainty in computer model experiments is input parameter uncertainty. Computer model calibration is a formal statistical procedure to infer input parameters by combining information from model runs and observational data. The existing standard calibration framework suffers from inferential issues when the model output and observational data are high-dimensional dependent data, such as large time series, due to the difficulty in building an emulator and the nonidentifiability between effects from input parameters and data-model discrepancy. To overcome these challenges, we, in this work, propose a new calibration framework based on a deep neural network (DNN) with long short-term memory layers that directly emulates the inverse relationship between the model output and input parameters. Adopting the “learning with noise” idea, we train our DNN model to filter out the effects from data-model discrepancy on input parameter inference. We also formulate a new way to construct interval predictions for DNN using quantile regression to quantify the uncertainty in input parameter estimates. Through a simulation study and real data application with the Weather Research and Forecasting Model Hydrological modeling system (WRF-Hydro), we show our approach can yield accurate point estimates and well-calibrated interval estimates for input parameters.

97 MATHEMATICS AND COMPUTING↗