Search NASA⌕ Search

SEARCH · Search NASA

Results for “prediction error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Evaluation of GlassNet for physics-informed machine learning of glass stability and glass-forming ability

Glassy materials form the basis of many modern applications, including nuclear waste immobilization, touch-screen displays, and optical fibers, and also hold great potential for future medical and environmental applications. However, their structural complexity and large composition space make design and optimization challenging for certain applications. Of particular importance for glass processing and design is an estimate of a given composition's glass-forming ability (GFA). However, there remain many open questions regarding the underlying physical mechanisms of glass formation, especially in oxide glasses. It is apparent that a proxy for GFA would be highly useful in glass processing and design, but identifying such a surrogate property has proven itself to be difficult. While glass stability (GS) parameters have historically been used as a GFA surrogate, recent research has demonstrated that most of these parameters are not accurate predictors of the GFA of oxide glasses. Here, in this work, we explore the application of an open-source pre-trained neural network model, GlassNet, that can predict the characteristic temperatures necessary to compute GS with reasonable performance and assess the feasibility of using these physics-informed machine learning (PIML)-predicted GS parameters to estimate GFA. In doing so, we track the uncertainties at each step of the computation—from the original ML prediction errors to the compounding of errors during GS estimation, and finally to the final estimation of GFA. While GlassNet exhibits reasonable accuracy on all individual properties, we observe a large compounding of error in the combination of these individual predictions for the PIML prediction of GS, finding that random forest models offer similar accuracy to GlassNet. We also break down the performance of GlassNet on different glass families and find that the error in GS prediction is correlated with the error in crystallization peak temperature prediction. Lastly, we utilize this finding to assess the relationship between top-performing GS parameters and GFA for two ternary glass systems: sodium borosilicate and sodium iron phosphate glasses. We conclude that to obtain true ML predictive capability of GFA, significantly more data needs to be collected.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Bosonic field digitization for quantum computers

Quantum simulation of quantum field theory is a flagship application of quantum computers that promises to deliver capabilities beyond classical computing. The realization of quantum advantage will require methods that can accurately predict error scaling as a function of the resolution and parameters of the model and that can be implemented efficiently on quantum hardware. In this paper, we address the representation of lattice bosonic fields in a discretized field amplitude basis, develop methods to predict error scaling, and present efficient qubit implementation strategies. A low-energy subspace of the bosonic Hilbert space, defined by a boson occupation number cutoff, can be represented with exponentially good accuracy by a low-energy subspace of a finite-size Hilbert space. The finite representation construction and the associated errors are directly related to the accuracy of the Nyquist-Shannon sampling and the finite Fourier transforms of the boson number states in the field and the conjugate-field bases. We analyze the relation between the boson mass, the discretization parameters used for wave function sampling, and the finite representation size. Numerical simulations of small size Φ 4 problems demonstrate that the boson mass optimizing the sampling of the ground state wave function is a good approximation to the optimal boson mass yielding the minimum low-energy subspace size. However, we find that accurate sampling of general wave functions does not necessarily result in accurate representation. Finally, we develop methods for validating and adjusting the discretization parameters to achieve more accurate simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1980

Composite model of a 3-D image

This paper presents a composite model of a moving (3-D) image especially useful for the sequential image processing and encoding. A non-linear predictor based on the composite model is described. The performance of this predictor is used as a measure of the validity of the model for a real image source. The minimization of a total mean square prediction error provides an inequality which determines a condition for the profitable use of the composite model and can serve as a decision device for the selection of the number of subsources within the model. The paper also describes statistical properties of the prediction error and contains results of computer simulation of two non-linear predictors in the case of perfect classification between subsources.

Dukhovich, I. J.↗
NASA NTRS2005

The Mars Exploration Rover (MER) Transverse Impulse Rocket System (TIRS)

In a very short period of time the MER project successfully developed and tested a system, TIRS/DIMES, to improve the probability of success in the presence of large Martian winds. The successful development of TIRS/DIMES played a big role in the landing site selection process by enabling the landing of Spirit on Gusev crater, a site of very high scientific interest but with known high wind conditions. The performance of TIRS by Spirit at Gusev Crater was excellent. The velocity prediction error was small and Big TIRS was fired reducing the impact horizontal velocity from approximately 23 meters per second to approximately 11 meters per second, well within the airbag capabilities. The performance of TIRS by Opportunity at Meridiani was good. The velocity prediction error was rather large (approximately 6 meters per second, a less than 2 sigma value, but TIRS did not fire which was the correct action.

Transverse Impulse Rocket System (TIRS)↗
NASA NTRS1995

Descent advisor preliminary field test

A field test of the Descent Advisor (DA) automation tool was conducted at the Denver Air Route Traffic Control Center in September 1994. DA is being developed to assist Center controllers in the efficient management and control of arrival traffic. DA generates advisories, based on trajectory predictions, to achieve accurate meter-fix arrival times in a fuel efficient manner while assisting the controller with the prediction and resolution of potential conflicts. The test objectives were to evaluate the accuracy of DA trajectory predictions for conventional- and flight-management-system-equipped jet transports, to identify significant sources of trajectory prediction error, and to investigate procedural and training issues (both air and ground) associated with DA operations. Various commercial aircraft (97 flights total) and a Boeing 737-100 research aircraft participated in the test. Preliminary results from the primary test set of 24 commercial flights indicate a mean DA arrival time prediction error of 2.4 sec late with a standard deviation of 13.1 sec. This paper describes the field test and presents preliminary results for the commercial flights.

Green, Steven M.↗
NASA NTRS1995

Descent Advisor Preliminary Field Test

A field test of the Descent Advisor (DA) automation tool was conducted at the Denver Air Route Traffic Control Center in September 1994. DA is being developed to assist Center controllers in the efficient management and control of arrival traffic. DA generates advisories, based on trajectory predictions, to achieve accurate meter-fix arrival times in a fuel efficient manner while assisting the controller with the prediction and resolution of potential conflicts. The test objectives were: (1) to evaluate the accuracy of DA trajectory predictions for conventional and flight-management system equipped jet transports, (2) to identify significant sources of trajectory prediction error, and (3) to investigate procedural and training issues (both air and ground) associated with DA operations. Various commercial aircraft (97 flights total) and a Boeing 737-100 research aircraft participated in the test. Preliminary results from the primary test set of 24 commercial flights indicate a mean DA arrival time prediction error of 2.4 seconds late with a standard deviation of 13.1 seconds. This paper describes the field test and presents preliminary results for the commercial flights.

Green, Steven M.↗
DOE OSTI2024

A Simplified Method for Predicting Shaker Voltage in IMMATs

Impedance Matched Multi-Axis Tests (IMMATs) can replicate in-service vibration induced stress more accurately than single axis shaker table tests as they can better match a part’s operational boundary conditions and excite it in multiple degrees of freedom simultaneously. Here, the shakers used in IMMATs are less powerful than shaker tables, so shaker force limits can be exceeded during tests if they are not placed adequately for the desired environment. The ability to predict shaker voltage and force before performing a test is, therefore, helpful in selecting shaker locations so that their limits are not exceeded. In this study, electrodynamic shakers were modeled as discrete electromechanical systems, and the shaker parameters were chosen to match experimentally obtained acceleration/voltage frequency response functions (FRFs). These models were coupled to a finite element model of the device under test (DUT) via dynamic substructuring, and the substructured model was demonstrated to accurately predict shaker voltage as well as the error in reproducing the environment at multiple accelerometer locations. A simple method called the FRF Multiplication method, in which the FRF of the substructured system is approximated as the product of two separate FRFs of the shaker and DUT respectively, was proposed and applied to the same system, yielding similar voltage and error predictions to those obtained using substructuring. Simple case studies were presented to explore the applicability of the proposed method, and it was demonstrated to have similar accuracy to the substructuring method in a range of cases. Additionally, we showed that while it was not possible to derive a unique model of the shakers from acceleration/voltage FRFs alone, the models that could be obtained were sufficient to predict test error almost perfectly and shaker voltage with less than 40 percent error.

42 ENGINEERING↗
NASA NTRS1981

Alterations of the climate of a primitive equation model produced by filtering approximations and subsequent tuning and stochastic forcing

A comparison is made of the simulated climates of nonlinear models based on the primitive equations (PE), balance equations (BE), and quasi-geostrophic (QG) equations. The models and numerical procedures are identical in all possible respects. The models are highly truncated spectral forms of Lorenz's (1960) energy preserving two-layer model. Two means of making use of the information contained in the (presumed known) short-term prediction error statistics are investigated. An unrealistically high level of thermal forcing is used so that the model climates are sufficiently different to allow any improvements due to the empirical methods to be observed. The general tuning problem is outlined and the QG model is tuned, using data obtained from a PE model run, to minimize the mean squared short term prediction error.

Hoffman, R. N.↗
DOE OSTI2023

Long–short-term memory encoder–decoder with regularized hidden dynamics for fault detection in industrial processes

The ability of recurrent neural networks (RNN) to model nonlinear dynamics of high dimensional process data has enabled data-driven RNN-based fault detection algorithms. Previous studies have focused on detecting faults by identifying the discrepancies in data distribution between the faulty and normal data, as reflected in prediction errors generated by RNN models. However, in industrial processes, variations in data distribution can also result from changes in normal control setpoints and compensatory control adjustments in response to disturbances, making it hard to differentiate between normal and faulty conditions. This paper proposes a fault detection method utilizing a long short-term memory (LSTM) encoder–decoder structure with regularized hidden dynamics and reversible instance normalization (RevIN) to compactly represent high-dimensional measurements for effective monitoring. During training, the hidden states of the model are regularized to form a low-dimensional latent space representation of the original multivariate time series data. As a result, the prediction errors of the latent states can be used to monitor the abnormal dynamic variations, while the reconstruction errors of the measured variables are used to monitor the abnormal static variations. Furthermore, the proposed indices can reflect operating conditions, even when the distribution of test data changes, which helps distinguish faults from normal adjustments and disturbances that controllers can settle. Here, data from numerical simulation and the Tennessee Eastman process are used to illustrate the effectiveness of the proposed fault detection method.

42 ENGINEERING↗
NASA NTRS2008

Impact of Pilot Delay and Non-Responsiveness on the Safety Performance of Airborne Separation

Assessing the safety effects of prediction errors and uncertainty on automationsupported functions in the Next Generation Air Transportation System concept of operations is of foremost importance, particularly safety critical functions such as separation that involve human decision-making. Both ground-based and airborne, the automation of separation functions must be designed to account for, and mitigate the impact of, information uncertainty and varying human response. This paper describes an experiment that addresses the potential impact of operator delay when interacting with separation support systems. In this study, we evaluated an airborne separation capability operated by a simulated pilot. The experimental runs are part of the Safety Performance of Airborne Separation (SPAS) experiment suite that examines the safety implications of prediction errors and system uncertainties on airborne separation assistance systems. Pilot actions required by the airborne separation automation to resolve traffic conflicts were delayed within a wide range, varying from five to 240 seconds while a percentage of randomly selected pilots were programmed to completely miss the conflict alerts and therefore take no action. Results indicate that the strategicAirborne Separation Assistance System (ASAS) functions exercised in the experiment can sustain pilot response delays of up to 90 seconds and more, depending on the traffic density. However, when pilots or operators fail to respond to conflict alerts the safety effects are substantial, particularly at higher traffic densities.

Consiglio, Maria↗
DOE OSTI2022

Imperfect slope measurements drive overestimation in a geometric cone model of lake and reservoir depth

Lake and reservoir (waterbody) depth is a critical characteristic that influences many important ecological processes. Unfortunately, depth measurements are labor-intensive to gather and are only available for a small fraction of waterbodies globally. Therefore, scientists have tried to predict depth from characteristics easily obtained for all waterbodies, such as surface area or the slope of the surrounding land. One approach for predicting waterbody depth simulates basins using a geometric cone model where the nearshore land slope and distance to the center of the waterbody are assumed to be representative proxies for in-lake slope and distance to the deepest point respectively. We tested these assumptions using bathymetry data from ~5000 lakes and reservoirs to examine whether differences in waterbody type or shape influenced depth prediction error. Here, we found that nearshore land slope was not representative of in-lake slope, and using it for prediction increases error substantially relative to models using true in-lake slope for all waterbody types and shapes. Predictions were biased toward overprediction in concave waterbodies (i.e., bowl-shaped; up to 18% of the study population) and reservoir waterbodies (up to 30% of the study population). Despite this systematic overprediction, model errors were fewer (in absolute and relative terms, irrespective of any specific slope covariate) for concave than convex waterbodies, suggesting the geometric cone model is an adequate representation of depth for these waterbodies. But because convex waterbodies are far more common (>72% of our study population), minimizing overall depth prediction error remains a challenge.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

EPIsembleVis: A geo-visual analysis and comparison of the prediction ensembles of multiple COVID-19 models

In this work, we present EPIsembleVis, a web-based comparative visual analysis tool for evaluating the consistency of multiple COVID-19 prediction models. Our approach analyzes a collection of COVID-19 predictions from different epidemiological models as an ensemble and utilizes two metrics to quantify model performance. These metrics include (a) prediction uncertainty (represented as the dispersion of predictions in each ensemble) and (b) prediction error (calculated by comparing individual model predictions with the recorded data). Through an interactive visual interface, our approach provides a data-driven workflow for (a) selecting and constructing the COVID-19 model prediction ensemble based on the spatiotemporal overlap of available predictions of multiple epidemiological models, (b) quantifying the model performance using both the uncertainty of each model prediction ensemble, and the error of each ensemble member that represents individual model predictions, and (c) visualizing the spatiotemporal variability in the projection performance of individual models using a suite of novel ensemble visualization techniques, such as the data availability map, a spatiotemporal textured-tile calendar, multivariate rose chart, and time-series leaflet glyph. We demonstrate the capability of our ensemble visual interface through a case study that investigates the performance of weekly COVID-19 predictions, which are provided through the COVID-19 Forecast Hub UMass-Amherst Influenza Forecasting Center of Excellence [47] for the United States and United States Territories. The EPIsembleVis tool is implemented using open-source web technologies and adaptive system design, rendering it interoperable with Elasticsearch and Kibana for automatically ingesting COVID-19 predictions from online repositories, and it is generalizable for analyzing worldwide projections from more epidemiological models.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Calibration of reactive burn and Jones-Wilkins-Lee parameters for simulations of a detonation-driven flow experiment with uncertainty quantification

Here, uncertainties in the explosive-specific parameters of the Jones-Wilkins-Lee (JWL) equation of state (EOS) are carefully considered in hydrodynamic simulations of an explosive experiment to minimize the error in the flow prediction. Experimental data of the leading shock position in the transverse direction over time serves as the prediction metric for quantifying simulation prediction error. The uncertainty quantification technique, global sensitivity analysis, is utilized to determine the JWL parameters to which the transverse shock propagation is most sensitive. A polynomial response surface (PRS) is constructed in the space of the most influential JWL parameters, and the point of minimum error between the experimental data and the PRS yields calibrated JWL parameters for the experimental flow. The simulation results following the parameter calibration show good agreement with the experimental data. It was found that two significant parameters, the heat release per unit mass of reactant Q and JWL model exponent R 1 are strongly related, which makes it difficult to identify accurate values.

36 MATERIALS SCIENCE↗
NASA NTRS1984

Space Shuttle flight test results of the Cosmic Ray Upset Experiment

CRUX is the first engineering flight experiment designed to test for the incidence of upsets in microcircuits by energetic particles. Harris HM 6504 4K x 1 static CMOS RAM's were used as the test device types in a 1.3 megabit memory which flew on two Shuttle flights. Ground (cyclotron) test information led to a prediction of about one error every 1000 days. No errors were experienced in 10 days of flight. While data were not in conflict with the error prediction and do support it, quantitative validation of the modeling for upsets is not statistically possible. Follow-on hardware (CRUX III) incorporates five different state-of-the-art microcircuits, and is scheduled for flight in October 1984.

Adolphsen, J. W.↗
NASA NTRS2018

Realistic Covariance Generation for the GPM Spacecraft

A covariance realism process for NASA's Global Precipitation Measurement (GPM) spacecraft is detailed. The GPM spacecraft is in a low earth orbit, and performs collision avoidance maneuvers few times a year. Currently GPM is below the International Space Station (ISS). So, in addition to cataloged debris objects, GPM must contend with smallsat/cubesat objects that are deployed from the ISS. Both operational scenarios require complete knowledge of the expected GPM prediction errors as a function of time. In this study, we present a method for generating realistic predicted covariance that uses linear propagation of the covariance with the addition of process noise. Further analyses are presented for the process noise ''tuning'' that generates an inflation factor based on the observed error statistics of the predictive satellite trajectories when compared to the definitive ones. Different tuning strategies are considered and compared via a Goodness-of-Fit testing for the Gaussian properties of the scaled covariance. SpaceNav's realistic covariance generation approach takes into account the contribution of predicted maneuver errors in the increased propagation uncertainty. Corresponding maneuver uncertainty is injected into the state uncertainty, and is used within the collision avoidance process to determine the collision risk for close approach events that follow a maneuver. This is a critical step in the maneuver planning process that provides the satellite operator with an accurate quantification of the collision probability for planned maneuvers. Using this information, an informed decision can be made to proceed with a maneuver if the collision risk is acceptable. This approach is validated by Monte-Carlo simulations and results are presented.

spacecraft uncertainty propagation↗
NASA NTRS1990

The effect of horizontal resolution on systematic errors of the GLA forecast model

Systematic prediction errors of the Goddard Laboratory for Atmospheres (GLA) forecast system are reduced when the higher-resolution (2 x 2.5 deg) model version is used. Based on a budget analysis of the 200-mb eddy streamfunction, the improvement of stationary eddy forecasting is seen to be caused by the following mechanism: by increasing the horizontal spatial resolution of the forecast model, atmospheric diabatic heating over the three tropical continents is changed in a way that intensifies the planetary-scale divergent circulations associated with the three pairs of divergent-convergent centers over these continents. The intensified divergent circulation results in an enhancement of vorticity sources in the Northern Hemisphere. The additional vorticity is advected eastward by a stationary wave train along 30 deg N, thereby reducing systematic errors in the lower-resolution (4 x 5 deg) GLA model.

Chen, Tsing-Chang↗