Search NASA⌕ Search

SEARCH · Search NASA

Results for “robust estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

A new concept of stability in orbit propagation, useful for quantifying numerical errors

We present the concept of topological stability in the numerical propagation of orbits, and show how it results in a useful new method for measuring the global numerical error of an orbit propagation. The concept applies to any problem in orbital dynamics. Moreover, it can be extended to any three-dimensional system of di erential equations of second order. In order to assess the topological stability of a given integration a special metric is introduced, which can be used to estimate the numerical errors robustly. The method is particularly well suited for dealing with strongly perturbed and chaotic systems. The construction is based on the constraint imposed by the Hopf map that supports the Kustaanheimo-Stiefel transformation. Generic concepts of stability are translated to KS space.

Pelaez, Jesus↗

A Scalable Gradient Free Method for Bayesian Experimental Design with Implicit Models

Bayesian experimental design (BED) is to answer the question that how to choose designs that maximize the information gathering. For implicit models, where the likelihood is intractable but sampling is possible, conventional BED methods have difficulties in efficiently estimating the posterior distribution and maximizing the mutual information (MI) between data and parameters. Recent work proposed the use of gradient ascent to maximize a lower bound on MI to deal with these issues. However, the approach requires a sampling path to compute the pathwise gradient of the MI lower bound with respect to the design variables, and such a pathwise gradient is usually inaccessible for implicit models. In this paper, we propose a novel approach that leverages recent advances in stochastic approximate gradient ascent incorporated with a smoothed variational MI estimator for efficient and robust BED. Without the necessity of pathwise gradients, our approach allows the design process to be achieved through a unified procedure with an approximate gradient for implicit models. Several experiments show that our approach outperforms baseline methods, and significantly improves the scalability of BED in high-dimensional problems.

Zhang, Jiaxin↗

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗

Optimal 1D Ly α forest power spectrum estimation – I. DESI-lite spectra

ABSTRACT The 1D Ly α forest flux power spectrum P1D is sensitive to scales smaller than a typical galaxy survey, and hence ties to the intergalactic medium’s thermal state, suppression from neutrino masses, and new dark matter models. It has emerged as a competitive framework to study new physics, but also has come with various challenges and systematic errors in analysis. In this work, we revisit the optimal quadratic estimator for P1D, which is robust against the relevant problems such as pixel masking, time evolution within spectrum, and quasar continuum errors. We further improve the estimator by introducing a fiducial power spectrum, which enables us to extract more information by alleviating the discreteness of band powers. We meticulously apply our method to synthetic Dark Energy Spectroscopic Instrument (DESI) spectra and demonstrate how the estimator overcomes each challenge. We further apply an optimization scheme that approximates the Fisher matrix to three elements per row and reduces computation time by 60 per cent. We show that we can achieve per cent precision in P1D with 5-yr DESI data in the absence of systematics and provide forecasts for different spectral qualities.

79 ASTRONOMY AND ASTROPHYSICS↗

Simulations and cosmological inference: A statistical model for power spectra means and covariances

We describe an approximate statistical model for the sample variance distribution of the nonlinear matter power spectrum that can be calibrated from limited numbers of simulations. Our model retains the common assumption of a multivariate normal distribution for the power spectrum band powers but takes full account of the (parameter-dependent) power spectrum covariance. The model is calibrated using an extension of the framework in Habib et al. (2007) to train Gaussian processes for the power spectrum mean and covariance given a set of simulation runs over a hypercube in parameter space. We demonstrate the performance of this machinery by estimating the parameters of a power-law model for the power spectrum. Within this framework, our calibrated sample variance distribution is robust to errors in the estimated covariance and shows rapid convergence of the posterior parameter constraints with the number of training simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

Abstract Robust quantification of predictive uncertainty is a critical addition needed for machine learning applied to weather and climate problems to improve the understanding of what is driving prediction sensitivity. Ensembles of machine learning models provide predictive uncertainty estimates in a conceptually simple way but require multiple models for training and prediction, increasing computational cost and latency. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but does not account for epistemic uncertainty. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainties with one model. This study compares the uncertainty derived from evidential neural networks to that obtained from ensembles. Through applications of the classification of winter precipitation type and regression of surface-layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. To encourage broader adoption of evidential deep learning, we have developed a new Python package, Machine Integration and Learning for Earth Systems (MILES) group Generalized Uncertainty for Earth System Science (GUESS) (MILES-GUESS) ( https://github.com/ai2es/miles-guess ), that enables users to train and evaluate both evidential and ensemble deep learning. Significance Statement This study demonstrates a new technique, evidential deep learning, for robust and computationally efficient uncertainty quantification in modeling the Earth system. The method integrates probabilistic principles into deep neural networks, enabling the estimation of both aleatoric uncertainty from noisy data and epistemic uncertainty from model limitations using a single model. Our analyses reveal how decomposing these uncertainties provides valuable insights into reliability, accuracy, and model shortcomings. We show that the approach can rival standard methods in classification and regression tasks within atmospheric science while offering practical advantages such as computational efficiency. With further advances, evidential networks have the potential to enhance risk assessment and decision-making across meteorology by improving uncertainty quantification, a longstanding challenge. This work establishes a strong foundation and motivation for the broader adoption of evidential learning, where properly quantifying uncertainties is critical yet lacking.

Schreck, John S.↗

Novel 2D velocity estimation method for large transient events in plasmas

Dynamics of fast transient events are challenging to be analyzed with high time resolution. Such events can occur in fusion plasmas such as the filaments during edge-localized modes (ELMs). Here, we present a robust method—the spatial displacement estimation—for estimating the displacements of structures with fast dynamics from high spatial and time resolution imaging diagnostics [e.g., gas-puff imaging (GPI)] with sampling time temporal resolution. First, a background suppression method is shown, which suppresses the slowly time-evolving and spatially non-uniform background in the signal. In the second step, a two-dimensional polynomial trend subtraction method is presented to tackle the remaining polynomial order trend in the signal. After performing these pre-processing steps, the spatial displacement of the propagating structure is estimated from the two-dimensional spatial cross-correlation coefficient function calculated between consecutive frames. The method is tested for its robustness and accuracy by simulated Gaussian events and spatially displaced random noise. An example application of the method is presented on propagating ELM filaments measured by the GPI system on the National Spherical Torus Experiment spherical tokamak.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fossil resource and energy security dynamics in conventional and carbon-constrained worlds

Fossil resource endowments and the future development of fossil fuel prices are important factors that will critically influence the nature and direction of the global energy system. In this paper we analyze a multi-model ensemble of long-term energy and emissions scenarios that were developed within the framework of the EMF27 integrated assessment model inter-comparison exercise. The diverse nature of these models highlights large uncertainties in the likely development of fossil resource (coal, oil, and natural gas) consumption, trade, and prices over the course of the twenty-first century and under different climate policy frameworks. We explore and explain some of the differences across scenarios and models and compare the scenario results with fossil resource estimates from the literature. A robust finding across the suite of IAMs is that the cumulative fossil fuel consumption foreseen by the models is well within the bounds of estimated recoverable reserves and resources. Hence, fossil resource constraints are, in and of themselves, unlikely to limit future GHG emissions. Our analysis also shows that climate mitigation policies could lead to a major reallocation of financial flows between regions, in terms of expenditures on fossil fuels and carbon, and can help to alleviate near-term energy security concerns via the reductions in oil imports and increases in energy system diversity they will help to motivate.

McCollum, David↗

Stochastic robustness synthesis for a benchmark problem

Stochastic robustness analysis guides the synthesis of robust linear quadratic Gaussian (LQG) regulators for a benchmark control problem. Probabilities of exceeding allowable design limits, including stability, setting time, and control usage, are estimated by Monte Carlo evaluation. Robust, low-gain compensators that fulfill objectives are designed by numerically minimizing quadratic functions of these probabilities. The method is straightforward and makes use of uncomplicated design principles.

Stengel, Robert F.↗

Assessing variability of wind speed: comparison and validation of 27 methodologies

Because wind resources vary from year to year, the intermonthly and interannual variability (IAV) of wind speed is a key component of the overall uncertainty in the wind resource assessment process, thereby creating challenges for wind farm operators and owners. We present a critical assessment of several common approaches for calculating variability by applying each of the methods to the same 37-year monthly wind-speed and energy-production time series to highlight the differences between these methods. We then assess the accuracy of the variability calculations by correlating the wind-speed variability estimates to the variabilities of actual wind farm energy production. We recommend the robust coefficient of variation (RCoV) for systematically estimating variability, and we underscore its advantages as well as the importance of using a statistically robust and resistant method. Using normalized spread metrics, including RCoV, high variability of monthly mean wind speeds at a location effectively denotes strong fluctuations of monthly total energy generation, and vice versa. Meanwhile, the wind-speed IAVs computed with annual-mean data fail to adequately represent energy-production IAVs of wind farms. Finally, we find that estimates of energy-generation variability require 10±3 years of monthly mean wind-speed records to achieve a 90 % statistical confidence. This paper also provides guidance on the spatial distribution of wind-speed RCoV.

17 WIND ENERGY↗

Advanced Energy Storage Life and Health Prognostics (INL) (FY 2012 Annual Progress Report)

The objective of this work is to develop methodologies that will accurately estimate state-of-health (SOH) and remaining useful life (RUL) of electrochemical energy storage devices using both offline and online (i.e., in-situ) techniques through: • A statistically robust offline battery calendar life estimator tool based on both testing and simulation, and • Novel onboard sensor technology for improved online battery diagnostics and prognostics.

25 ENERGY STORAGE↗

MER-DIMES : a planetary landing application of computer vision

During the Mars Exploration Rovers (MER) landings, the Descent Image Motion Estimation System (DIMES) was used for horizontal velocity estimation. The DIMES algorithm combines measurements from a descent camera, a radar altimeter and an inertial measurement unit. To deal with large changes in scale and orientation between descent images, the algorithm uses altitude and attitude measurements to rectify image data to level ground plane. Feature selection and tracking is employed in the rectified data to compute the horizontal motion between images. Differences of motion estimates are then compared to inertial measurements to verify correct feature tracking. DIMES combines sensor data from multiple sources in a novel way to create a low-cost, robust and computationally efficient velocity estimation solution, and DIMES is the first use of computer vision to control a spacecraft during planetary landing. In this paper, the detailed implementation of the DIMES algorithm and the results from the two landings on Mars are presented.

landing systems↗

SU-F-BRF-02: Automated Lung Segmentation Method Using Atlas-Based Sparse Shape Composition with a Shape Constrained Deformable Model

Purpose: To develop an automated lung segmentation method, which combines the atlas-based sparse shape composition with a shape constrained deformable model in thoracic CT for patients with compromised lung volumes. Methods: Ten thoracic computed tomography scans for patients with large lung tumors were collected and reference lung ROIs in each scan was manually segmented to assess the performance of the method. We propose an automated and robust framework for lung tissue segmentation by using single statistical atlas registration to initialize a robust deformable model in order to perform fine segmentation that includes compromised lung tissue. First, a statistical image atlas with sparse shape composition is constructed and employed to obtain an approximate estimation of lung volume. Next, a robust deformable model with shape prior is initialized from this estimation. Energy terms from ROI edge potential and interior ROI region based potential as well as the initial ROI are combined in this model for accurate and robust segmentation. Results: The proposed segmentation method is applied to segment right lung on three CT scans. The quantitative results of our segmentation method achieved mean dice score of (0.92–0.95), mean accuracy of (0.97,0.98), and mean relative error of (0.10,0.16) with 95% CI. The quantitative results of previously published RASM segmentation method achieved mean dice score of (0.74,0.96), mean accuracy of (0.66,0.98), and mean relative error of (0.04, 0.38) with 95% CI. The qualitative and quantitative comparisons show that our proposed method can achieve better segmentation accuracy with less variance compared with a robust active shape model method. Conclusion: The atlas-based segmentation approach achieved relatively high accuracy with less variance compared to RASM in the sample dataset and the proposed method will be useful in image analysis applications for lung nodule or lung cancer diagnosis and radiotherapy assessment in thoracic computed tomography.

60 APPLIED LIFE SCIENCES↗

Robust detection, isolation and accommodation for sensor failures

The objective is to extend the recent advances in robust control system design of multivariable systems to sensor failure detection, isolation, and accommodation (DIA), and estimator design. This effort provides analysis tools to quantify the trade-off between performance robustness and DIA sensitivity, which are to be used to achieve higher levels of performance robustness for given levels of DIA sensitivity. An innovations-based DIA scheme is used. Estimators, which depend upon a model of the process and process inputs and outputs, are used to generate these innovations. Thresholds used to determine failure detection are computed based on bounds on modeling errors, noise properties, and the class of failures. The applicability of the newly developed tools are demonstrated on a multivariable aircraft turbojet engine example. A new concept call the threshold selector was developed. It represents a significant and innovative tool for the analysis and synthesis of DiA algorithms. The estimators were made robust by introduction of an internal model and by frequency shaping. The internal mode provides asymptotically unbiased filter estimates.The incorporation of frequency shaping of the Linear Quadratic Gaussian cost functional modifies the estimator design to make it suitable for sensor failure DIA. The results are compared with previous studies which used thresholds that were selcted empirically. Comparison of these two techniques on a nonlinear dynamic engine simulation shows improved performance of the new method compared to previous techniques

Emami-Naeini, A.↗

Wavelet Filtering to Reduce Conservatism in Aeroservoelastic Robust Stability Margins

Wavelet analysis for filtering and system identification was used to improve the estimation of aeroservoelastic stability margins. The conservatism of the robust stability margins was reduced with parametric and nonparametric time-frequency analysis of flight data in the model validation process. Nonparametric wavelet processing of data was used to reduce the effects of external desirableness and unmodeled dynamics. Parametric estimates of modal stability were also extracted using the wavelet transform. Computation of robust stability margins for stability boundary prediction depends on uncertainty descriptions derived from the data for model validation. F-18 high Alpha Research Vehicle aeroservoelastic flight test data demonstrated improved robust stability prediction by extension of the stability boundary beyond the flight regime.

Brenner, Marty↗

Deep nonparametric estimation of intrinsic data structures by chart autoencoders: Generalization error and robustness

Autoencoders have demonstrated remarkable success in learning low-dimensional latent features of high-dimensional data across various applications. Assuming that data are sampled near a low-dimensional manifold, we employ chart autoencoders, which encode data into low-dimensional latent features on a collection of charts, preserving the topology and geometry of the data manifold. Our paper establishes statistical guarantees on the generalization error of chart autoencoders, and we demonstrate their denoising capabilities by considering n noisy training samples, along with their noise-free counterparts, on a d-dimensional manifold. By training autoencoders, we show that chart autoencoders can effectively denoise the input data with normal noise. We prove that, under proper network architectures, chart autoencoders achieve a squared generalization error in the order of n–$\frac{2}{d+2}$log 4 n, which depends on the intrinsic dimension of the manifold and only weakly depends on the ambient dimension and noise level. We further extend our theory on data with noise containing both normal and tangential components, where chart autoencoders still exhibit a denoising effect for the normal component. As a special case, our theory also applies to classical autoencoders, as long as the data manifold has a global parametrization. Furthermore, our results provide a solid theoretical foundation for the effectiveness of autoencoders, which is further validated through several numerical experiments.

97 MATHEMATICS AND COMPUTING↗