Search NASA⌕ Search

SEARCH · Search NASA

Results for “prediction error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

An Evaluation of Recent Gravity Models wrt. Altimeter Satellite Missions

With the launch of CHAMP and GRACE, we have entered a new phase in the history of satellite geodesy. For the first time, geopotential models are now available based almost exclusively on satellite-satellite tracking either with GPS in the case of the CHAMP-based geopotential models, or co-orbital intersatellite ultra-precise ranging in the case of GRACE. Different groups have analyzed these data, and produced a series of geopotential models (e.g., EIGENlS, EIGEN2, GGM0lS, GGMOlC) that incorporate the new data. We will compare the performance of these "newer" geopotential models with the standard models now used for computations, (e.g., JGM-3, BGM-96, PGS7727, and GRIMS-C1) for TOPEX, JASON, Geosat-Follow-On (GFO), and Envisat using standard metrics such as SLR RMS of fit, altimeter crossovers, and orbit overlaps. Where covariances are available we can evaluate the predicted geographically correlated orbit error. These predicted results can be compared with the Earth-fixed differences between dynamic and reduced-dynamic orbits to test the predictive accuracy of the covariances, as well as to calibrate the error of the solutions.

Lemoine, Frank G.↗

Comparing Designed Training Sets to Optimize Multivariate Regression Models for Pr, Nd, and Nitric Acid Using Spectrophotometry

Chemometric regression models were developed for the quantification of praseodymium (Pr, 0–1000 µg/mL), neodymium (Nd, 0–1000 µg/mL), and nitric acid (HNO 3 , 0.1–5 M) using spectrophotometry. Designed calibration sets were composed of 20 samples each: 10 model points and 10 lack-of-fit (LOF) points. The D-optimal designs effectively minimized the number of samples required to build models, and each design resulted in similar prediction performance, suggesting that statistical design of experiments can provide a reliable framework for selecting training set samples in three-variable systems. Partial least squares regression (PLSR) models were validated against a one-factor-at-a-time validation set composed of 125 samples (three variables, five levels). The top PLS-1 models resulted in average percent root mean square error of prediction error values of 3.5%, 1.7%, and 1.2% for Pr(III), Nd(III), and HNO 3 , respectively. Power set augmentations of the model and LOF samples were investigated to optimize the number of training set samples. PLSR models built using just required model points (10) had similar predictive capabilities as models including the LOF points (20) but with fewer samples. The number of validation samples was also varied systematically to learn how many samples are needed to validate regression models. This work addresses long-standing questions in the field of chemometrics to help make this approach amenable to the near-real-time quantification of hazardous species in remote settings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Prediction of laser beam spatial profiles in a high-energy laser facility by use of deep learning

We adapt the significant advances achieved recently in the field of generative artificial intelligence/machine-learning to laser performance modeling in multipass, high-energy laser systems with application to high-shot-rate facilities relevant to inertial fusion energy. Advantages of neural-network architectures include rapid prediction capability, data-driven processing, and the possibility to implement such architectures within future low-latency, low-power consumption photonic networks. Four models were investigated that differed in their generator loss functions and utilized the U-Net encoder/decoder architecture with either a reconstruction loss alone or combined with an adversarial network loss. We achieved inference times of 1.3 ms for a 256 × 256 pixel near-field beam with errors in predicted energy of the order of 1% over most of the energy range. It is shown that prediction errors are significantly reduced by ensemble averaging the models with different weight initializations. These results suggest that including the temporal dimension in such models may provide accurate, real-time spatiotemporal predictions of laser performance in high-shot-rate laser systems.

47 OTHER INSTRUMENTATION↗

Machine-learning prediction for quasiparton distribution function matrix elements

There have been rapid developments in the direct calculation in lattice QCD (LQCD) of the Bjorken-x dependence of hadron structure through large-momentum effective theory (LaMET). LaMET overcomes the previous limitation of LQCD to moments (that is, integrals over Bjorken x) of hadron structure, allowing LQCD to directly provide the kinematic regions where the experimental values are least known. LaMET requires large-momentum hadron states to minimize its systematics and allow us to reach small- x reliably. This means that very fine lattice spacing to minimize lattice artifacts at order $(P_za)^n$ will become crucial for next-generation LaMET-like structure calculations. Furthermore, such calculations require operators with long Wilson-link displacements, especially in finer lattice units, increasing the communication costs relative to that of the propagator inversion. In this work, we explore whether machine-learning algorithms can make predictions of correlators to reduce the computational cost of these LQCD calculations. We consider two algorithms, gradient-boosting decision tree and linear models, applied to LaMET data, the matrix elements needed to determine the kaon and $η_s$ unpolarized parton distribution functions (PDFs), meson distribution amplitude (DA), and the nucleon gluon PDF. We find that both algorithms can reliably predict the target observables with different prediction accuracy and systematic errors. The predictions from smaller displacement z to larger ones work better than those for momentum p due to the higher correlation among the data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Machine Learning Approach to Predict Aircraft Landing Times using Mediated Predictions from Existing Systems

We developed a novel approach for predicting the landing time of airborne flights in real-time operations. The first step predicts a landing time by using mediation rules to select from among physics-based predictions (relying on the expected flight trajectory) already available in real time in the Federal Aviation Administration System Wide Information Management system data feeds. The second step uses a machine learning model built upon the mediated predictions. The model is trained to predict the error in the mediated prediction, using features describing the current state of an airborne flight. These features are calculated in real time from a relatively small number of data elements that are readily available for airborne flights. Initial results based on five months of data at six large airports demonstrate that incorporating a machine learning model on top of the mediated physics-based prediction can lead to substantial additional improvements in prediction quality.

Machine learning↗

A Machine Learning Approach to Predict Aircraft Landing Times using Mediated Predictions from Existing Systems

We developed a novel approach for predicting the landing time of airborne flights in real-time operations. The first step predicts a landing time by using mediation rules to select from among physics-based predictions (relying on the expected flight trajectory) already available in real time in the Federal Aviation Administration System Wide Information Management system data feeds. The second step uses a machine learning model built upon the mediated predictions. The model is trained to predict the error in the mediated prediction, using features describing the current state of an airborne flight. These features are calculated in real time from a relatively small number of data elements that are readily available for airborne flights. Initial results based on five months of data at six large airports demonstrate that incorporating a machine learning model on top of the mediated physics-based prediction can lead to substantial additional improvements in prediction quality.

Machine learning↗

Putting error bars on density functional theory dataset

This dataset contains submission files and raw output files from high-throughput DFT simulations to analyze the systemic errors in lattice constant, bulk moduli and formation energy predictions for a range of binary and ternary oxides using four exchange correlation functionals (LDA, PBE, PBEsol and vdW-DF-C09). This data was then used as the basis for employing materials informatics methods to predict the expected errors in the lattice constants of the studied compounds. Predicted errors were also used to better the DFT-predicted lattice parameters. Our results emphasize the link between the computed errors and the electron density and hybridization errors of a functional. In essence, these results provide “error bars” for choosing a functional for the creation of high-accuracy, high-throughput datasets as well as avenues for the development of XC functionals with enhanced performance, thereby enabling the accelerated discovery and design of new materials.

36 MATERIALS SCIENCE↗

Adaptive Trajectory Prediction Algorithm for Climbing Flights

Aircraft climb trajectories are difficult to predict, and large errors in these predictions reduce the potential operational benefits of some advanced features for NextGen. The algorithm described in this paper improves climb trajectory prediction accuracy by adjusting trajectory predictions based on observed track data. It utilizes rate-of-climb and airspeed measurements derived from position data to dynamically adjust the aircraft weight modeled for trajectory predictions. In simulations with weight uncertainty, the algorithm is able to adapt to within 3 percent of the actual gross weight within two minutes of the initial adaptation. The root-mean-square of altitude errors for five-minute predictions was reduced by 73 percent. Conflict detection performance also improved, with a 15 percent reduction in missed alerts and a 10 percent reduction in false alerts. In a simulation with climb speed capture intent and weight uncertainty, the algorithm improved climb trajectory prediction accuracy by up to 30 percent and conflict detection performance, reducing missed and false alerts by up to 10 percent.

Seperation Assurance↗

File Usage Analysis and Resource Usage Prediction: a Measurement-Based Study

A probabilistic scheme was developed to predict process resource usage in UNIX. Given the identity of the program being run, the scheme predicts CPU time, file I/O, and memory requirements of a process at the beginning of its life. The scheme uses a state-transition model of the program's resource usage in its past executions for prediction. The states of the model are the resource regions obtained from an off-line cluster analysis of processes run on the system. The proposed method is shown to work on data collected from a VAX 11/780 running 4.3 BSD UNIX. The results show that the predicted values correlate well with the actual. The coefficient of correlation between the predicted and actual values of CPU time is 0.84. Errors in prediction are mostly small. Some 82% of errors in CPU time prediction are less than 0.5 standard deviations of process CPU time.

Devarakonda, Murthy V.-S.↗

Predictability of process resource usage: A measurement-based study of UNIX

A probabilistic scheme is developed to predict process resource usage in UNIX. Given the identity of the program being run, the scheme predicts CPU time, file I/O, and memory requirements of a process at the beginning of its life. The scheme uses a state-transition model of the program's resource usage in its past executions for prediction. The states of the model are the resource regions obtained from an off-line cluster analysis of processes run on the system. The proposed method is shown to work on data collected from a VAX 11/780 running 4.3 BSD UNIX. The results show that the predicted values correlate well with the actual. The correlation coefficient between the predicted and actual values of CPU time is 0.84. Errors in prediction are mostly small. Some 82% of errors in CPU time prediction are less than 0.5 standard deviations of process CPU time.

Devarakonda, Murthy V.↗

Study of self-interaction errors in density functional predictions of dipole polarizabilities and ionization energies of water clusters using Perdew-Zunger and locally scaled self-interaction corrected methods

Here, we studied the effects of self-interaction error (SIE) on the static dipole polarizabilities of water clusters modelled with three increasingly sophisticated, non-empirical density functional approximations (DFAs), viz. the local spin density approximation (LDA), the Perdew-Burke-Ernzherof (PBE) generalized-gradient approximation (GGA), and the strongly constrained and appropriately normed (SCAN) meta-GGA, using the Perdew-Zunger self-interaction-correction (PZ-SIC) energy functional in the Fermi-Lowdin orbital SIC (FLO-SIC) framework. Our results show that while all three DFAs overestimate the cluster polarizabilities, the description systematically improves from LDA to PBE to SCAN. The self-correlation free SCAN predicts polarizabilities quite accurately with a mean absolute error (MAE) of 0.58 Bohr 3 with respect to coupled cluster singles and doubles (CCSD) values. Removing SIE using PZ-SIC correctly reduces the DFA polarizabilities, but over-corrects, resulting in underestimated polarizabilities in SIC-LDA, -PBE, and -SCAN. Finally, we applied a recently proposed local-scaling SIC (LSIC) method using a quasi self-consistent scheme and using the kinetic energy density ratio as an iso-orbital indicator. The results show that the LSIC polarizabilities are in excellent agreement with mean absolute error of 0.08 Bohr 3 for LSIC-LDA and 0.06 Bohr 3 for LSIC-PBE with most recent CCSD polarizabilities. Likewise, the ionization energy estimates as an absolute of highest occupied energy eigenvalue predicted by LSIC are also in excellent agreement with CCSD(T) ionization energies with MAE of 0.4 eV for LSIC-LDA and 0.04 eV for LSIC-PBE. The LSIC-LDA predictions of ionization energies are comparable to the reported GW ionization energies while the LSIC-PBE ionization energies are more accurate than reported GW results.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Fast Correction of Errors in the DFT‐Calculated Energies of Gaseous Nitrogen‐Containing Species

Abstract Modeling adsorption phenomena on surfaces by DFT calculations often involves substantial errors, resulting in inaccurate predictions of catalytic activities. Such errors partly stem from the inaccurate description of the energetics of free molecules. Herein, we use a semiempirical group‐additivity method to correct the DFT‐calculated heats of formation of 106 carbon‐ and nitrogen‐containing gaseous compounds belonging to 15 different chemical families. PBE, PW91, RPBE and BEEF‐vdW initially yield mean absolute errors (MAEs) with respect to experiments in the range of 0.32–0.75 eV. After correcting the systematic errors, the overall MAEs decrease to ∼0.05 eV. Additionally, upon applying the corrections to three types of reaction enthalpies, the resulting MAEs are below 0.10 eV. These functional‐group corrections can be used in (electro)catalysis to correct the gas‐phase references necessary to evaluate equilibrium potentials and adsorption energies, predict error cancellation, and assess conflicting experimental data.

Urrego‐Ortiz, Ricardo↗

Predictability of process resource usage - A measurement-based study on UNIX

A probabilistic scheme is developed to predict process resource usage in UNIX. Given the identity of the program being run, the scheme predicts CPU time, file I/O, and memory requirements of a process at the beginning of its life. The scheme uses a state-transition model of the program's resource usage in its past executions for prediction. The states of the model are the resource regions obtained from an off-line cluster analysis of processes run on the system. The proposed method is shown to work on data collected from a VAX 11/780 running 4.3 BSD UNIX. The results show that the predicted values correlate well with the actual. The correlation coefficient betweeen the predicted and actual values of CPU time is 0.84. Errors in prediction are mostly small. Some 82 percent of errors in CPU time prediction are less than 0.5 standard deviations of process CPU time.

Devarakonda, Murthy V.↗

Evaluating simplifications of subsurface process representations for field-scale permafrost hydrology models

Abstract. Permafrost degradation within a warming climate poses a significant environmental threat through both the permafrost carbon feedback and damage to human communities and infrastructure. Understanding this threat relies on better understanding and numerical representation of thermo-hydrological permafrost processes and the subsequent accurate prediction of permafrost dynamics. All models include simplified assumptions, implying a tradeoff between model complexity and prediction accuracy. The main purpose of this work is to investigate this tradeoff when applying the following commonly made assumptions: (1) assuming equal density of ice and liquid water in frozen soil, (2) neglecting the effect of cryosuction in unsaturated freezing soil, and (3) neglecting advective heat transport during soil freezing and thaw. This study designed a set of 62 numerical experiments using the Advanced Terrestrial Simulator (ATS v1.2) to evaluate the effects of these choices on permafrost hydrological outputs, including both integrated and pointwise quantities. Simulations were conducted under different climate conditions and soil properties from three different sites in both column- and hillslope-scale configurations. Results showed that amongst the three physical assumptions, soil cryosuction is the most crucial yet commonly ignored process. Neglecting cryosuction, on average, can cause 10 %–20 % error in predicting evaporation, 50 %–60 % error in discharge, 10 %–30 % error in thaw depth, and 10 %–30 % error in soil temperature at 1 m beneath the surface. The prediction error for subsurface temperature and water saturation is more obvious at hillslope scales due to the presence of lateral flux. By comparison, using equal ice–liquid density has a minor impact on most hydrological metrics of interest but significantly affects soil water saturation with an averaged 5 %–15 % error. Neglecting advective heat transport presents the least error, 5 % or even much lower, in most metrics of interest for a large-scale Arctic tundra system without apparent influence caused by localized groundwater flow, and it can decrease the simulation time at hillslope scales by 40 %–80 %. By challenging these commonly made assumptions, this work provides permafrost hydrology scientists an important context for understanding the underlying physical processes, including allowing modelers to better choose the appropriate process representation for a given modeling experiment.

54 ENVIRONMENTAL SCIENCES↗

Reanalysis of the top-quark pair hadroproduction and a precise determination of the top-quark pole mass at the LHC *

In this study, we calculate the $t\bar{t}$ pQCD production cross-section at the NNLO and determine the top-quark pole mass from recent measurements at the LHC at the center-of-mass energy $\sqrt{S}=13$ TeV to a high precision by applying the principle of maximum conformality (PMC). The PMC provides a systematic method that rigorously eliminates QCD renormalization scale ambiguities by summing the nonconformal $\beta$ contributions into the QCD coupling constant. The PMC predictions satisfy the requirements of renormalization group invariance, including renormalization scheme independence, and the PMC scales accurately reflect the virtuality of the underlying production subprocesses. By using the PMC, an improved prediction for the $t\bar{t}$ production cross-section is obtained without scale ambiguities, which in turn provides a precise value for the top-quark pole mass. Moreover, the prediction of PMC calculations that the magnitudes of higher-order PMC predictions are well within the error bars predicted from the known lower-order has been demonstrated for the top-quark pair production. The resulting determination of the top-quark pole mass, $m_t^{\rm{pole}}=172.5\pm1.4$ GeV, from the LHC measurement at $\sqrt{S}=13$ TeV agrees with the current world average cited by the Particle Data Group (PDG). The PMC prediction provides an important high-precision test of the consistency of pQCD and the SM at $\sqrt{S}=13$ TeV with previous LHC measurements at lower CM energies.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Resource Selection Using Execution and Queue Wait Time Predictions

Computational grids provide users with many possible places to execute their applications. We wish to help users select where to run their applications by providing predictions of the execution times of applications on space shared parallel computers and predictions of when scheduling systems for such parallel computers will start applications. Our predictions are based on instance based learning techniques and simulations of scheduling algorithms. We find that our execution time prediction techniques have an average error of 37 percent of the execution times for trace data recorded from SGI Origins at NASA Ames Research Center and that this error is 67 percent lower than the error of user estimates. We also find that the error when predicting how long applications will wait in scheduling queues is 95 percent of mean queue wait times when using our execution time predictions and this is 57 percent lower than if we use user execution time estimates.

Warren, Smith↗

Resource Selection Using Execution and Queue Wait Time Predictions

Computational grids provide users with many possible places to execute their applications. We wish to help users select where to run their applications by providing predictions of the execution times of applications on space shared parallel computers and predictions of when scheduling systems for such parallel computers will start applications. Our predictions are based on instance based learning techniques and simulations of scheduling algorithms. We find that our execution time prediction techniques have an average error of 37 percent of the execution times for trace data recorded from SGI Origins at NASA Ames Research Center and that this error is 67 percent lower than the error of user estimates. We also find that the error when predicting how long applications will wait in scheduling queues is 95 percent of mean queue wait times when using our execution time predictions and this is 57 percent lower than if we use user execution time estimates.

Smith, Warren↗

Navigation Prediction Performance During OSIRIS-REx Proximity Operations at (101955) Bennu

The OSIRIS-REx (Origins, Spectral Interpretation, Resource Identification and Security–Regolith Explorer) Orbit Determination team performed covariance analyses prior to the commencement of proximity operations (ProxOps) at (101955) Bennu to determine the expected predicted trajectory performance in order to meet trajectory knowledge requirements throughout each phase of the mission. One of the primary requirements placed on the predicted trajectory performance was based on the performance during orbital phases leading up to the maneuver to initiate the Touch-and-Go (TAG) trajectory descent. Throughout ProxOps the nominal force models being used to predict the spacecraft trajectory were updated in an effort to improve the prediction performance. The most significant models that contributed to prediction performance were of solar radiation pressure, thermal reradiation of the spacecraft, predicted attitude errors, and desaturation maneuvers. Efforts were made throughout all of ProxOps to monitor, trend, predict, and update spacecraft modeling to improve the prediction performance. These efforts were vital to reduce the spacecraft knowledge errors necessary to achieve a TAG target smaller than pre-launch analysis allowed due to the rough terrain of Bennu. Increased precision in predicted trajectory errors allowed for refined uncertainties to be used for future phase planning throughout the mission. The navigation team successfully predicted the spacecraft trajectory throughout all of ProxOps achieving predicted trajectories errors less than originally analyzed.

Jason M. Leonard↗