Search NASA⌕ Search

SEARCH · Search NASA

Results for “prediction error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Augmenting a Simulation Campaign for Hybrid Computer Model and Field Data Experiments

The Kennedy and O’Hagan (KOH) calibration framework uses coupled Gaussian processes (GPs) to meta-model an expensive simulator (first GP), tune its “knobs” (calibration inputs) to best match observations from a real physical/field experiment and correct for any modeling bias (second GP) when predicting under new field conditions (design inputs). There are well-established methods for placement of design inputs for data-efficient planning of a simulation campaign in isolation, that is, without field data: space-filling, or via criterion like minimum integrated mean-squared prediction error (IMSPE). Analogues within the coupled GP KOH framework are mostly absent from the literature. Here, in this study, we derive a closed form IMSPE criterion for sequentially acquiring new simulator data for KOH. We illustrate how acquisitions space-fill in design space, but concentrate in calibration space. Closed form IMSPE precipitates a closed-form gradient for efficient numerical optimization. We demonstrate that our KOH-IMSPE strategy leads to a more efficient simulation campaign on benchmark problems, and conclude with a showcase on an application to equilibrium concentrations of rare earth elements for a liquid–liquid extraction reaction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Marginal unbiased score expansion and application to CMB lensing

Here, we present the marginal unbiased score expansion (MUSE) method, an algorithm for generic high-dimensional hierarchical Bayesian inference. MUSE performs approximate marginalization over arbitrary non-Gaussian latent parameter spaces, yielding Gaussianized asymptotically unbiased and near-optimal constraints on global parameters of interest. It is computationally much cheaper than exact alternatives like Hamiltonian Monte Carlo (HMC), excelling on funnel problems which challenge HMC, and does not require any problem-specific user supervision like other approximate methods such as variational inference or many simulation-based inference methods. MUSE makes possible the first joint Bayesian estimation of the delensed Cosmic Microwave Background (CMB) power spectrum and gravitational lensing potential power spectrum, demonstrated here on a simulated data set as large as the upcoming South Pole Telescope 3G 1500 deg 2 survey, corresponding to a latent dimensionality of ~6 million and of order 100 global bandpower parameters. On a subset of the problem where an exact but more expensive HMC solution is feasible, we verify that MUSE yields nearly optimal results. We also demonstrate that existing spectrum-based forecasting tools which ignore pixel-masking underestimate predicted error bars by only ~10%. This method is a promising path forward for fast lensing and delensing analyses which will be necessary for future CMB experiments such as SPT-3G, Simons Observatory, or CMB-S4, and can complement or supersede existing HMC approaches. The success of MUSE on this challenging problem strengthens its case as a generic procedure for a broad class of high-dimensional inference problems.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Symbolic pregression: Discovering physical laws from distorted video

In this work, we present a method for unsupervised learning of equations of motion for objects in raw and optionally distorted unlabeled synthetic video (or, more generally, for discovering and modeling predictable features in time-series data). We first train an autoencoder that maps each video frame into a low-dimensional latent space where the laws of motion are as simple as possible, by minimizing a combination of nonlinearity, acceleration, and prediction error. Differential equations describing the motion are then discovered using Pareto-optimal symbolic regression. We find that our pre-regression (“pregression”) step is able to rediscover Cartesian coordinates of unlabeled moving objects even when the video is distorted by a generalized lens. Using intuition from multidimensional knot theory, we find that the pregression step is facilitated by first adding extra latent space dimensions to avoid topological problems during training and then removing these extra dimensions via principal component analysis. An inertial frame is autodiscovered by minimizing the combined equation complexity for multiple experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

WinnowML: Stable feature selection for maximizing prediction accuracy of time-based system modeling

Online deep learning (ODL) has become an important methodology for modeling time-based performance of computer systems. An open problem is the intelligent selection of features from raw workload traces of computer systems. The best methods are overly sensitive to noisy data, causing frequent feature changes and re-training. Using all available features inflates training time and introduces model artifacts if some features should have been dropped. We present WinnowML, a method for automatically determining the most relevant feature subset for a predictive time-series model. WinnowML combines existing feature ranking algorithms and a history of each feature's ranking to iteratively rank a feature set to lower prediction error and maximize long term relevance. From this ranked feature set, the most relevant and stable subset is selected to train a model. Experimentally, we show how WinnowML can lower a model's mean absolute relative error up to 42% on average compared to the closest performing approach. Additionally, we lower the fluctuation in feature ranking and selection up to 65%. We also demonstrate how to combine WinnowML and a model search tool to provide improvements in performance of up to 14.5% when compared to using all the feature available.

Bel, Oceane MS↗
DOE OSTI2022

Neural Architecture and Feature Search for Predicting the Ridership of Public Transportation Routes

Accurately predicting the ridership of public-transit routes provides substantial benefits to both transit agencies, who can dispatch additional vehicles proactively before the vehicles that serve a route become crowded, and to passengers, who can avoid crowded vehicles based on publicly available predictions. The spread of the coronavirus disease has further elevated the importance of ridership prediction as crowded vehicles now present not only an inconvenience but also a public-health risk. At the same time, accurately predicting ridership has become more challenging due to evolving ridership patterns, which may make all data except for the most recent records stale. One promising approach for improving prediction accuracy is to fine-tune the hyper-parameters of machine-learning models for each transit route based on the characteristics of the particular route, such as the number of records. However, manually designing a machine-learning model for each route is a labor-intensive process, which may require experts to spend a significant amount of their valuable time. To help experts with designing machine-learning models, we propose a neural-architecture and feature search approach, which optimizes the architecture and features of a deep neural network for predicting the ridership of a public-transit route. Our approach is based on a randomized local hyper-parameter search, which minimizes both prediction error as well as the complexity of the model. We evaluate our approach on real-world ridership data provided by the public transit agency of Chattanooga, TN, and we demonstrate that training neural networks whose architectures and features are optimized for each route provides significantly better performance than training neural networks whose architectures and features are generic.

Ayman, Afiya↗
DOE OSTI2021

An Automatic Processing Framework for In Situ Determination of Ecohydrological Root Water Content by Ground-Penetrating Radar

This report concerns Root water content (RWC) as a vital component in water flux in soil-plant-atmosphere continuum. Knowledge of RWC helps to better understand the root function and the soil-root interaction and improves water cycle modeling. However, due to the lack of appropriate methods, field monitoring of RWC is seriously constrained. In this study, we used ground-penetrating radar (GPR), a common geophysical technique, to characterize RWC of coarse roots noninvasively. An automatic GPR data processing framework was proposed to (1) identify hyperbolic root reflections and locate roots in GPR images and (2) extract waveform parameters from the reflected wave of identified roots. These waveform parameters were then used to establish an empirical model and a semiempirical model to determine RWC. We validated the developed models using GPR root data at three antenna center frequencies (500 MHz, 900 MHz, and 2 GHz) that were produced from simulation experiments (with RWC ranging from 70% to 150%) and field experiments in sandy soils (with RWC ranging from 66% to 144%). Our results show that both the empirical and the semiempirical models achieved a good performance in estimating RWC with similar accuracy, i.e., the prediction error [root-mean-square error (RMSE)] was less than 8% for the simulation data and 12% for the field data. For both models, the accuracy of RWC estimation was the highest when applied to 2-GHz data. This study renders a new opportunity to determine RWC under field conditions that enhances the application of GPR for root study and the understanding and modeling of ecohydrology in the rhizosphere.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Traffic Prediction for Merging Coordination Control in Mixed Traffic Scenarios

Connected and autonomous vehicles (CAVs) have the potential to bring in safety, mobility, and energy benefits to transportation. The control decisions of CAVs are usually determined for a look-ahead horizon based on previewed traffic information. This requires an effective prediction of future traffic conditions and its integration with the CAV control framework. However, the short-term traffic prediction using information from connectivity is a challenging research topic, especially for mixed traffic scenarios. This work focuses on the development of a traffic prediction framework for a merging coordination controller. The previously developed merging controller coordinates the merging sequence and travel speed of CAVs to maximize the energy efficiency and overall mobility. In mixed traffic scenarios, the controller receives information regarding the position of all the vehicles traveling inside a control zone and controls the desired speed of all CAVs. The controller has no control on the human-driven vehicles. The merging controller does not have direct information or an explicit prediction on the behaviors of human-driven vehicles. Aiming to improve the performance of the merging controller in various mixed traffic conditions, a traffic prediction algorithm is developed and evaluated in this work. The performance of this traffic prediction algorithm is investigated for various penetration rates of connectivity for a single-lane secondary road merging to a single-lane primary road. The results show that compared to a constant speed assumption of human-driven vehicles, the proposed traffic prediction algorithm is able to reduce the prediction error of the arrival time of human-driven vehicles at the merging zone by more than 50%.

Shao, Yunli↗
DOE OSTI2022

Predicting the Cetane Number, Sooting Tendency, and Energy Density of Terpene Fuel Additives

Abstract Discovering renewable fuels and fuel additives is paramount in reducing carbon emissions from internal combustion engines. Terpenes, a group of compounds that can be synthesized from plant matter and microorganisms, have gained significant interest in recent years as promising candidates for fuels/additives. Terpenes are a diverse class of compounds that contain rings and methyl branches, resulting in high energy densities and optimal cold weather behavior. Their variation in bond order, carbon chains, and functional groups lead to varying degrees of soot formation and performance in existing engines. The present work leverages predictive models, namely artificial neural networks, to predict the cetane number (CN), sooting tendency (quantified with yield sooting index, YSI), and energy density (quantified with lower heating value, LHV) of terpenes and hydrogenated terpenes whose sooting propensities were previously determined through experimental means. Predicted sooting propensities of these terpenes are compared with experimental values, and predicted cetane numbers and energy densities are used to comment on the compounds’ ability to act as fuels/additives. Expected prediction errors for CN, YSI, and LHV, defined by blind test set median absolute error, are within 5.56 cetane units, 3.63 yield sooting index units, and 0.77 MJ/kg respectively. Additionally, the present work investigates a variety of correlation/dependence metrics for property-property relationships, furthering our understanding of how combustion-relevant properties are related.

09 BIOMASS FUELS↗
DOE OSTI2023

Dynamic Bayesian Networks for Fault Prognosis

A dynamic Bayesian Network (DBN)-based fault prognosis framework is proposed in this study to predict the future fault probabilities of gradual faults. The proposed framework utilizes the trend in prediction error generated from data driven forecasting models to estimate the future fault beliefs. The accuracy and scalability of the proposed method is evaluated using the data from a Modelica-based virtual testbed. Overall, the developed framework demonstrates good potential in estimating future fault probabilities of gradual faults.

Pradhan, Ojas↗
DOE OSTI2025

Divertor Plasma Detachment Control Neural Network

DivControlNN is a state-of-the-art software tool that leverages advanced machine learning techniques to predict and control divertor plasma behavior in fusion reactors. Plasma, a highly energetic and electrically charged gas, requires meticulous management to protect reactor components and maintain optimal energy production. Conventional simulation methods, although extremely detailed, typically demand extensive computational time-making them unsuitable for real-time control scenarios. DivControlNN addresses this challenge by learning from tens of thousands of high-fidelity simulations, thereby creating a rapid surrogate model that can deliver near-instantaneous predictions. At the core of its functionality is a sophisticated technique known as latent space mapping, which condenses complex, high-dimensional plasma data into a compact, lower-dimensional representation. This streamlined representation enables the system to quickly forecast essential plasma properties and determine the precise conditions required for effective detachment. Detachment is a crucial process in which the plasma is cooled before reaching the divertor plates, thereby reducing heat loads and mitigating material erosion. In recent experiments conducted on the KSTAR tokamak in South Korea, DivControlNN successfully guided the detachment process without any fine-tuning-even when applied to a new tungsten divertor configuration. By achieving a computational speed-up of over one hundred million times compared to traditional simulation methods while maintaining low prediction errors, DivControlNN stands to significantly enhance real-time control and diagnostic capabilities in future fusion reactors. This breakthrough paves the way for safer, more reliable reactor operation and represents a major advancement toward realizing fusion energy as a practical, sustainable, and clean power source.

Xu, Xueqiao [Lawrence Livermore National Laborator↗
DOE OSTI2024

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

Abstract Robust quantification of predictive uncertainty is a critical addition needed for machine learning applied to weather and climate problems to improve the understanding of what is driving prediction sensitivity. Ensembles of machine learning models provide predictive uncertainty estimates in a conceptually simple way but require multiple models for training and prediction, increasing computational cost and latency. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but does not account for epistemic uncertainty. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainties with one model. This study compares the uncertainty derived from evidential neural networks to that obtained from ensembles. Through applications of the classification of winter precipitation type and regression of surface-layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. To encourage broader adoption of evidential deep learning, we have developed a new Python package, Machine Integration and Learning for Earth Systems (MILES) group Generalized Uncertainty for Earth System Science (GUESS) (MILES-GUESS) ( https://github.com/ai2es/miles-guess ), that enables users to train and evaluate both evidential and ensemble deep learning. Significance Statement This study demonstrates a new technique, evidential deep learning, for robust and computationally efficient uncertainty quantification in modeling the Earth system. The method integrates probabilistic principles into deep neural networks, enabling the estimation of both aleatoric uncertainty from noisy data and epistemic uncertainty from model limitations using a single model. Our analyses reveal how decomposing these uncertainties provides valuable insights into reliability, accuracy, and model shortcomings. We show that the approach can rival standard methods in classification and regression tasks within atmospheric science while offering practical advantages such as computational efficiency. With further advances, evidential networks have the potential to enhance risk assessment and decision-making across meteorology by improving uncertainty quantification, a longstanding challenge. This work establishes a strong foundation and motivation for the broader adoption of evidential learning, where properly quantifying uncertainties is critical yet lacking.

Schreck, John S.↗
DOE OSTI2020

A control-oriented combustion model framework for compression ignition engines operating on low-reactivity fuel

This work focuses on zero-dimensional modeling of the heat release rate in a compression ignition engine operating on gasoline-like fuels. Due to the properties of gasoline, such as high volatility and longer ignition delay than diesel, the injection strategies can vary significantly from the operation with conventional diesel fuel. Different injection strategies are commonly used to achieve varying degrees of in-cylinder stratification in order to shape the combustion event and maximize efficiency. The proposed zero-dimensional combustion model was developed to account for the different stages in combustion caused by the fuel stratification. As the ignition delay model is an integral part of the entire combustion process and significantly affects the prediction accuracy, special attention has been paid to local phenomena influencing ignition delay. A one-dimensional spray model by Musculus and Kattke was employed in conjunction with a Lagrangian tracking approach in order to estimate the local air–fuel ratio within the spray tip, as a proxy for reactivity. The local air–fuel ratio, in-cylinder temperature and pressure were used in an integral fashion to estimate the ignition delay. Heat release rates were modeled using first-order non-linear differential equations. The proposed combustion model was validated against experimental data of a heavy-duty compression ignition engine with up to three injection events at mostly 1038 r/min and 14 bar brake mean effective pressure. Further validation of the model was carried out at other engine loads and speeds. Model prediction errors in CA50 of less than 1 °CA across all conditions were found. Modeling results of other combustion metrics such as combustion duration and indicated mean effective pressure are also highly satisfactory. In addition, the model has been shown to be capable of estimating the ringing intensity for most conditions.

Pamminger, Michael↗
DOE OSTI2025

Rapid monitoring of fermentations: a feasibility study on biological 2,3-butanediol production

2,3-butanediol (2,3-BDO) is an economically important platform chemical that can be produced by the fermentation of sugars using an engineered strain of Zymomonas mobilis . These fermentations require continuous monitoring and modification of fermentation conditions to maximize 2,3-BDO yields and minimize the production of the undesired coproducts glycerol and acetoin. Because of the time required for sampling and off-line chromatographic measurement of fermentation samples, the ability of fermentation scientists to modify fermentation conditions in a timely manner is limited. The goal of this study was to test if near-infrared spectroscopy (NIRS) along with multivariate statistics could reduce the time needed for this analysis and enable real-time monitoring and control of the fermentation. In this work we developed partial least squares (PLS) calibration models to predict the concentrations of glucose, xylose, 2,3-BDO, acetoin, and glycerol in fermentations via NIRS using two different spectrometers and two different spectroscopy modalities. We first evaluated the feasibility of rapid NIRS monitoring through experiments where we measured the signals from each analyte of interest and built NIRS-based PLS models using spectra from synthetic samples containing uncorrelated concentrations of these analytes. All analytes showed unique spectral signatures, and this initial modeling showed that all analytes could be detected simultaneously. We then began work with samples from laboratory fermentation experiments and tested the feasibility of regression model development across two spectral collection modalities (at-line and on-line) and two instruments: a laboratory-grade instrument and a low-cost instrument with a more limited spectral range. All modalities showed promise in the ability to monitor Z. mobilis fermentations of glucose and xylose to 2,3-BDO. The low-cost instrument displayed a lower signal-to-noise ratio than the laboratory-grade instrument, which led to comparatively lower performance overall, but still provided sufficient accuracy to monitor fermentation trends. While the ease of use of on-line monitoring systems was favored as compared to at-line systems due to the lack of sampling required and potential for automated process control, we observed some decrease in performance due to the additional complexity of the sample matrix. We have demonstrated that NIRS combined with multivariate analysis can be used for at-line and on-line monitoring of the concentrations of glucose, xylose, 2,3-BDO, acetoin, and glycerol during Z. mobilis fermentations. The decrease in signal-to-noise ratio when using a low-cost spectrometer led to greater prediction error than the laboratory-grade spectrometer for at-line monitoring. The on-line monitoring modality showed great promise for real time process control via NIRS.

09 BIOMASS FUELS↗
DOE OSTI2026

Towards robust laser beam propagation in atmospheric turbulence

High-fidelity optical propagation through the atmosphere is essential for free-space optical technologies, including laser-based remote sensing and optical communication. However, atmospheric turbulence severely distorts beams and compromises system performance. In this work, we employ hypergeometric-Gaussian (HyGG) vortex beams as probes to characterize and mitigate atmospheric turbulence. Using over 250,000 experimental and simulated frames, we show that refining the power spectrum density (PSD) can reduce numerical prediction errors by up to 79.8%. Concurrently, experimental observations supported by numerical simulations demonstrate that HyGG beams exhibit superior turbulence resilience across multiple metrics compared to conventional Gaussian beams, particularly in their ability to withstand over 5 times stronger turbulence while maintaining similar intensity fluctuations. These dual investigations, on both turbulence mitigation and robust beam solutions, converge to form a unified strategy for enhancing free-space optical system performance. Collectively, our findings provide new insights into light–turbulence interactions and highlight the practical utility of vortex beams under atmospheric conditions.

Zhang, Boyu↗
DOE OSTI2020

Improved Parametric Models for Explosion Pressure Signals Derived From Large Datasets

Accurate recording and characterization of explosion-induced pressure signals are key components of the forensic analysis of explosion events in the atmosphere. Parametric overpressure models based on several key waveform features (peak overpressure, positive pulse duration, and impulse) are widely used to estimate explosion energy in terms of trinitrotoluene equivalent yield. However, those models are often developed by a limited dataset, including only a few events or recordings at relatively short propagation distances. Here, we develop empirical waveform-parameter models based on a regression analysis of a large set of data curated from four chemical explosion experiments including 16 detonations. We measured peak overpressure and impulse for positive and negative phases from 1000 pressure signals recorded at local ranges (<20 km) with scaled distance up to 8000 m/kg 1/3 . Additionally, the measured waveform parameters showed large variation with respect to observing distances indicating the effects of atmospheric propagation. In this study, a second-order polynomial model was used in a least-squares regression to account for those propagation effects and to improve data fitting. In addition to model parameters for waveform features, we also determined range-dependent model uncertainties based on data variance. The model uncertainty represents the prediction error of our models and can be critical to evaluating the uncertainty of yield estimate.

58 GEOSCIENCES↗
DOE OSTI2021

Quantitative Non-Destructive Evaluation of Fatigue Damage Based on Multi-Sensor Fusion

Based on sensor fusion and machine learning, this project developed a novel non-destructive evaluation (NDE) methodology, which consists of a remaining useful life (RUL) prediction framework and regression models for predicting residual stress and full width at half maximum (FWHM). A series of fatigue testing experiments were conducted using 5052-H32 aluminum alloy specimens. All specimens were measured using linear ultrasonic (LU) and nonlinear ultrasonic (NLU) testing methods non-destructively. Machine learning models were developed to use LU and NLU measurements to predict loading condition, fatigue level, residual stress, and FWHM. It was demonstrated that the developed methodology could distinguish new and fatigue specimens with an accuracy of 97.53%. Also, the prediction errors for residual stress and FWHM were as low as 4.73% and 1.62%, respectively. An interactive database was created to publicly share the data generated from the project. It is envisioned that the developed NDE technology will equip manufacturers with a responsive screening system for incoming used metallic components, and potentially lead to a significant increase in using used metallic components for remanufacturing.

42 ENGINEERING↗
DOE OSTI2022

Verification and Validation Activities for the Multi-Fidelity Toolkit

The Multi-Fidelity Toolkit (MFTK) is a simulation tool being developed at Sandia National Laboratories for aerodynamic predictions of compressible flows over a range of physics fidelities and computational speeds. These models include the Reynolds-Averaged-Navier-Stokes (RANS) equations, the Euler equations, and modified Newtonian aerodynamics (MNA) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities as well as model validation with uncertainty considerations. Code verification is performed on the MNA model by comparing with an analytical solution for flat-plate and inclined-plate geometries. Solution-verification activities include grid-refinement studies of HIFiRE-1 wind tunnel measurements, which are used for validation, for all model fidelities. A thorough treatment of the validation comparison with prediction error and validation uncertainty is also presented.

42 ENGINEERING↗
DOE OSTI2022

Resilience Enhancements through Deep Learning Yields

This report documents the Resilience Enhancements through Deep Learning Yields (REDLY) project, a three-year effort to improve electrical grid resilience by developing scalable methods for system operators to protect the grid against threats leading to interrupted service or physical damage. The computational complexity and uncertain nature of current real-world contingency analysis presents significant barriers to automated, real-time monitoring. While there has been a significant push to explore the use of accurate, high-performance machine learning (ML) model surrogates to address this gap, their reliability is unclear when deployed in high-consequence applications such as power grid systems. Contemporary optimization techniques used to validate surrogate performance can exploit ML model prediction errors, which necessitates the verification of worst-case performance for the models.

24 POWER TRANSMISSION AND DISTRIBUTION↗