Search NASA⌕ Search

SEARCH · Search NASA

Results for “prediction error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Quantitative Non-Destructive Evaluation of Fatigue Damage Based on Multi-Sensor Fusion

Based on sensor fusion and machine learning, this project developed a novel non-destructive evaluation (NDE) methodology, which consists of a remaining useful life (RUL) prediction framework and regression models for predicting residual stress and full width at half maximum (FWHM). A series of fatigue testing experiments were conducted using 5052-H32 aluminum alloy specimens. All specimens were measured using linear ultrasonic (LU) and nonlinear ultrasonic (NLU) testing methods non-destructively. Machine learning models were developed to use LU and NLU measurements to predict loading condition, fatigue level, residual stress, and FWHM. It was demonstrated that the developed methodology could distinguish new and fatigue specimens with an accuracy of 97.53%. Also, the prediction errors for residual stress and FWHM were as low as 4.73% and 1.62%, respectively. An interactive database was created to publicly share the data generated from the project. It is envisioned that the developed NDE technology will equip manufacturers with a responsive screening system for incoming used metallic components, and potentially lead to a significant increase in using used metallic components for remanufacturing.

42 ENGINEERING↗
DOE OSTI2022

Verification and Validation Activities for the Multi-Fidelity Toolkit

The Multi-Fidelity Toolkit (MFTK) is a simulation tool being developed at Sandia National Laboratories for aerodynamic predictions of compressible flows over a range of physics fidelities and computational speeds. These models include the Reynolds-Averaged-Navier-Stokes (RANS) equations, the Euler equations, and modified Newtonian aerodynamics (MNA) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities as well as model validation with uncertainty considerations. Code verification is performed on the MNA model by comparing with an analytical solution for flat-plate and inclined-plate geometries. Solution-verification activities include grid-refinement studies of HIFiRE-1 wind tunnel measurements, which are used for validation, for all model fidelities. A thorough treatment of the validation comparison with prediction error and validation uncertainty is also presented.

42 ENGINEERING↗
DOE OSTI2022

Resilience Enhancements through Deep Learning Yields

This report documents the Resilience Enhancements through Deep Learning Yields (REDLY) project, a three-year effort to improve electrical grid resilience by developing scalable methods for system operators to protect the grid against threats leading to interrupted service or physical damage. The computational complexity and uncertain nature of current real-world contingency analysis presents significant barriers to automated, real-time monitoring. While there has been a significant push to explore the use of accurate, high-performance machine learning (ML) model surrogates to address this gap, their reliability is unclear when deployed in high-consequence applications such as power grid systems. Contemporary optimization techniques used to validate surrogate performance can exploit ML model prediction errors, which necessitates the verification of worst-case performance for the models.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Expanded verification and validation studies of hypersonic aerodynamics with multiple physics-fidelity models

Hypersonic aerothermodynamics is an important domain of modern multiphysics simulation. The Multi-Fidelity Toolkit is a simulation tool being developed at Sandia National Laboratories to predict aerodynamic properties for compressible flows from a range of physics fidelities and computational speeds. These models include the Reynolds-averaged Navier–Stokes (RANS) equations, the Euler equations with momentum-energy integral technique (MEIT), and modified Newtonian aerodynamics with flat-plate boundary layer (MNA+FPBL) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities, as well as model validation with uncertainty considerations. Code verification activities on the MNA+FPBL model build on previous work by focusing on the viscous portion of the model. Viscous quantities of interest are compared against those from an analytical solution for flat-plate, inclined-plate, and cone geometries. The code verification methodology for the MEIT model is also presented. Test setup and results of code verification tests on the laminar and turbulent models within MEIT are shown. Solution-verification activities include grid-refinement studies on simulations that model the HIFiRE-1 wind tunnel experiments. These experiments are used for validation of all model fidelities. A thorough validation comparison with prediction error and uncertainty is also presented. Three additional HIFiRE-1 experimental runs are simulated in this study, and the solution verification and validation work examines the effects of the associated parameter changes on model performance. Finally, a study is presented that compares the computational costs and fidelities from each of the different models.

42 ENGINEERING↗
DOE OSTI2025

CRCNS US-France Research Proposal: Collaborative Research: Encoding reward expectation in Drosophilia

The fruit fly Drosophila melanogaster has been a valuable model for investigating the genetic and neural bases that underlie learning and memory. Early and most current studies use basic behavior conditioning protocols to study learning in controlled laboratory settings. More recently, the ability to transgenically manipulate many of the brain neurons in the fruit fly with exquisite specificity, and the recent knowledge of the synaptic ‘connectome’ of the fruit fly brain, makes these animals almost unique as a comprehensive model for studies of learning, memory and motivated behavior. In fact, the connectome has revealed many types of new connections that had until now been overlooked. Within this context, the thesis of this proposal is that studies of learning and memory will be greatly enhanced by using more sophisticated means for evaluating memory representations, such as have been developed in vertebrates, and combining those studies with information from the connectome guided by computational modelling. We propose to push beyond the boundaries of existing conditioning protocols for fruit flies to investigate more complex memory representations. In particular, we will investigate the function of reinforcement pathways in relation to the absence of expected reinforcement. More specifically, we propose a series of experiments designed to investigate the memory representations in fruit flies when an expected consequence of a Conditioned Stimulus (CS) fails to occur. Although studies have evaluated how this failure can establish extinction memory for the CS, our studies will go beyond studying extinction. Specifically, we predict that in Drosophila when a CS is associated with a failed expectation of an appetitive food reinforcement it will acquire aversive value, and vice versa for a failed expectation of an aversive reinforcer. We combine these studies with manipulations of reinforcement pathways in the CNS inspired from the connectome, iteratively knitted in with established computational models. Intellectual Merit: The concept of reinforcement expectation and incentive contrast have been influential in the development of studies of associative learning in mammals. These questions are particularly challenging to answer in vertebrates because they require exquisite cellular, temporal, and genetic specificity of experimental manipulations. The recent development of work with identified neurons and their connectomes makes the larval and adult fly brains ripe as models for pushing our understanding of neural bases for these higher- order conditioning phenomena. Broader Impacts: Public health: These analyses and the conceptual framework of prediction error processing underlying them have a profound impact on our understanding of reinforcement-related behavior in humans, including monetary rewards and the mnemonic consequences of traumatic experiences, and for pathologies of the dopamine reinforcement system. Educational: This project will provide interdisciplinary training for postdoctoral researchers, Ph.D. and undergraduate students. The PIs will act as co-supervisors or mentors of students working in the different labs via face-to-face and internet-based technologies. We will also work with ASU’s award-winning Ask- A-Biologist program. This is an online science program designed to enrich the learning experiences of students of all ages and to provide classroom material for use by K-12 teachers. We will develop an extension of a game developed under a prior NSF award, and the new game will include modules to teach K-12 students about how insects learn. We will also integrate into the AAB site a program developed by a collaborator (B Gerber) at the Leibniz Institut für Neurobiologie, Magdeburg, and now in use in schools in Germany, to teach K-12 students how to train animals using the fruit fly larval learning paradigm. Underrepresented groups: All PIs will work with their university offices of Academic Diversity and Equal Opportunity for reaching underrepresented students.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

A Scientist-in-the-Loop Data Analytics Framework for Intelligent Simulation Model Tuning and Validation

This project developed a scientist-in-the-loop data analytics framework for intelligent simulation model tuning and validation, targeting the Weather Research and Forecasting (WRF) model and its solar energy variant, WRF-Solar-BNL. Domain experts, such as climate scientists, depend on large-scale numerical simulations for knowledge discovery and decision-making, yet the complexity of parameter tuning and the disconnect between automated optimization and domain expertise pose significant challenges. We extended an interactive visual analytics framework that enables domain experts to observe and intervene in the computational steering process by identifying disagreements between the simulation model, surrogate model, and the expert’s domain knowledge. Using Bayesian Optimization with Gaussian Process Regression as the surrogate model, our system allows users to probe parameter relationships, analyze correlation patterns, and adjust tuning parameters in real time. We developed use cases for solar irradiance forecasting through sustained collaboration with Brookhaven National Laboratory, resolving critical model configuration challenges and achieving meaningful reductions in prediction error. The project supported one PhD student, one MS student, and eight undergraduate students across three Data Science Capstone projects, resulting in one master’s thesis.

Dasgupta, Aritra [New Jersey Institute of Technolo↗
DOE OSTI2025

Transformers and Long Short-Term Memory Transfer Learning for GenIV Reactor Temperature Time Series Forecasting

Automated monitoring of the coolant temperature can enable autonomous operation of generation IV reactors (GenIV), thus reducing their operating and maintenance costs. Automation can be accomplished with machine learning (ML) models trained on historical sensor data. However, the performance of ML usually depends on the availability of large amount of training data, which is difficult to obtain for GenIV, as this technology is still under development. We propose the use of transfer learning (TL), which involves utilizing knowledge across different domains, to compensate for this lack of training data. TL can be used to create pre-trained ML models with data from small-scale research facilities, which can then be fine-tuned to monitor GenIV reactors. In this work, we develop pre-trained Transformer and long short-term memory (LSTM) networks by training them on temperature measurements from thermal hydraulic flow loops operating with water and Galinstan fluids at room temperature at Argonne National Laboratory. The pre-trained models are then fine-tuned and re-trained with minimal additional data to perform predictions of the time series of high temperature measurements obtained from the Engineering Test Unit (ETU) at Kairos Power. The performance of the LSTM and Transformer networks is investigated by varying the size of the lookback window and forecast horizon. The results of this study show that LSTM networks have lower prediction errors than Transformers, but LSTM errors increase more rapidly with increasing lookback window size and forecast horizon compared to the Transformer errors.

LSTM↗
DOE OSTI2022

Random Forest Regressor-Based Approach for Detecting Fault Location and Duration in Power Systems

Power system failures or outages due to short-circuits or “faults” can result in long service interruptions leading to significant socio-economic consequences. It is critical for electrical utilities to quickly ascertain fault characteristics, including location, type, and duration, to reduce the service time of an outage. Existing fault detection mechanisms (relays and digital fault recorders) are slow to communicate the fault characteristics upstream to the substations and control centers for action to be taken quickly. Fortunately, due to availability of high-resolution phasor measurement units (PMUs), more event-driven solutions can be captured in real time. In this paper, we propose a data-driven approach for determining fault characteristics using samples of fault trajectories. A random forest regressor (RFR)-based model is used to detect real-time fault location and its duration simultaneously. This model is based on combining multiple uncorrelated trees with state-of-the-art boosting and aggregating techniques in order to obtain robust generalizations and greater accuracy without overfitting or underfitting. Four cases were studied to evaluate the performance of RFR: 1. Detecting fault location (case 1), 2. Predicting fault duration (case 2), 3. Handling missing data (case 3), and 4. Identifying fault location and length in a real-time streaming environment (case 4). A comparative analysis was conducted between the RFR algorithm and state-of-the-art models, including deep neural network, Hoeffding tree, neural network, support vector machine, decision tree, naive Bayesian, and K-nearest neighborhood. Experiments revealed that RFR consistently outperformed the other models in detection accuracy, prediction error, and processing time.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Cosmic Inference: Constraining Parameters with Observations and a Highly Limited Number of Simulations

We look at cosmological probes that pose an inverse problem where the measurement result is obtained through observations, and the objective is to infer values of model parameters that characterize the underlying physical system-our universe, from these observations and theoretical forward-modeling. The only way to accurately forward-model physical behavior on small scales is via expensive numerical simulations, which are further “emulated” due to their high cost. Emulators are commonly built with a set of simulations covering the parameter space with Latin hypercube sampling and an interpolation procedure; the aim is to establish an approximately constant prediction error across the hypercube. In this paper, we provide a description of a novel statistical framework for obtaining accurate parameter constraints. The proposed framework uses multi-output Gaussian process emulators that are adaptively constructed using Bayesian optimization methods with the goal of maintaining a low emulation error in the region of the hypercube preferred by the observational data. In this paper, we compare several approaches for constructing multi-output emulators that enable us to take possible inter-output correlations into account while maintaining the efficiency needed for inference. Using a Lyα forest flux power spectrum, we demonstrate that our adaptive approach requires considerably fewer-by a factor of a few in the Lyα P(k) case considered here-simulations compared to the emulation based on Latin hypercube sampling, and that the method is more robust in reconstructing parameters and their Bayesian credible intervals.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Long-term variability in immersion-mode marine ice-nucleating particles from climate model simulations and observations

Abstract. Ice-nucleating particles (INPs) in the Southern Ocean (SO) atmosphere have significant impacts on cloud radiative and microphysical properties. Yet, INP prediction skill in climate models remains poorly understood, in part because of the lack of long-term measurements. Here we show, for the first time, how model-simulated INP concentrations compare with year-round INP measurements during the Macquarie Island Cloud Radiation Experiment (MICRE) campaign from 2017–2018. We simulate immersion-mode INP concentrations using the Energy Exascale Earth System Model version 1 (E3SMv1) by combining simulated aerosols with recently developed deterministic INP parameterizations and the native classical nucleation theory (CNT) for mineral dust in E3SMv1. Because MICRE did not collect aerosol measurements of super-micron particles, which are more effective ice nucleators, we evaluate the model's aerosol fields at other high-latitude sites using long-term in situ observations of dust and sea spray aerosol. We find that the model underestimates dust and overestimates sea spray aerosol concentrations by 1 to 2 orders of magnitude for most of the high-latitude sites in the Southern Hemisphere. We next compare predicted INP concentrations with concentrations of INPs collected on filter samples (typically for 2 or 3 d) and processed offline using the Colorado State University ice spectrometer (IS) in immersion freezing mode. We find that when deterministic parameterizations for both dust and sea spray INPs are used, simulated INPs are within a factor of 10 of observed INPs more than 60 % of the time during summer. Our results also indicate that the E3SM's current treatment of mineral dust immersion freezing in the SO is impacted by compensating biases – an underprediction of dust amount was compensated by an overprediction of its effectiveness as INPs. We also perform idealized droplet freezing experiments to quantify the implications of the time-dependent behavior assumed by the E3SM's CNT-parameterization and compare with the ice spectrometer observations. We find that the E3SM CNT 10 s diagnostic used in this study is a reasonable approximation of the exact formulation of CNT, when applied to ice spectrometer measurements in low-INP conditions similar to Macquarie Island. However, the linearized 10 s diagnostic underestimates the exact formula by an order of magnitude or more in places with high-INP conditions like the Sahara. Overall, our findings suggest that it is important to correct the biases in E3SM's simulated dust life cycle and update E3SM's INP parameterizations. INP prediction errors of 2 to 3 orders of magnitude can have considerable impacts on the simulated cloud and radiative properties in global climate models. On comparing INP concentrations during MICRE against ship-based campaigns, Measurements of Aerosols, Radiation, and Clouds over the Southern Ocean (MARCUS) and Antarctic Circumnavigation Expedition (ACE), we find that INPs from the latter are significantly higher only in regions closer to Macquarie Island. This alludes to the fact that physical, chemical and biological processes affecting INP concentrations as stimulated by the island could be partly responsible for the high INP concentrations observed at Macquarie Island during the MICRE campaign. Therefore, improvements to both aerosol simulation and INP parameterizations are required to adequately simulate INPs and their cloud impacts in E3SM. It will be helpful to include a parallel measurement of the size-resolved aerosol composition and explore opportunities for long-term measurement platforms in future field campaigns studying INP sources in remote marine regions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Biases in preconstruction estimates of wind plant annual energy production

Estimating the energy yield of a wind plant during the preconstruction phase is a historically difficult task, even with industry improvements in these estimations. We build on prior research comparing the realized energy production of wind plants and their estimated annual energy production P50 values (median energy production), using owner-provided energy production and losses. We produced similar results to prior studies but with a slightly increasing bias of overestimating median energy production (a bias between realized and estimated energy production of −7.4 % to −6.6 %, depending on the scenario, as opposed to −6.7 % to −5.5 % from earlier studies). In addition to assessing annual energy production P50 bias, we compared both the 1-year and the long-term annual energy production P90 and uncertainty energy yield assessment estimates to the observed long-term-corrected energy production. We found that neither the energy yield assessment uncertainty nor the P90 is conservative enough compared to the observed distribution of prediction errors, suggesting significant room for improvement in the energy yield assessment process.

17 WIND ENERGY↗
NASA NTRS1972

Lumped parameter analysis of a stringer reinforced plate excited by band limited noise

The maximum root-mean-square response of a square clamped plate, subjected to a stationary random excitation, was determined both theoretically and empirically. For the tests, a 40 x 40 x 1/4 aluminum sheet was milled out to provide a thin waffle plate with 9 panels. The plate was acoustically excited, with the frequency range limited between 25 Hz and 500 Hz. The root-mean-square power of the random excitations, 149 decibels, was nearly constant for all natural frequencies of the plate system. Strain gage readings at 14 points were plotted as power spectral densities and root-mean-square displacements. A modal damping ratio matrix was determined from the response curves. Damping ratios were found to be a function of frequency, but not of location on the plate. For comparisons with the theoretical response, the plate was subdivided into 14 modes and anlayzed as a damped, lumped parameter system by use of an approximate normal-mode method. This method gave the best predictions of the power spectral densities for the lower frequencies. That prediction errors increased for the higher frequencies is attributed to improper assumptions for mass distribution and the insufficient number of lumped mass points.

Bilyeu, D. J.↗
NASA NTRS1975

Status of input design for aircraft parameter identification

Results are presented on the design of aircraft inputs (i.e. elevator, rudder and aeleron deflection time histories) to identify aircraft stability and control derivatives from flight test data. The problem is first reduced to an optimization problem with differential and integral constraints. The criteria used are either expressed in terms of the Cramer-Rao lower bound on the covariance matrix of the parameter estimates or in terms of the maximum prediction error variance. Both time-domain longitudinal and lateral dynamics of C-8 and Jet Star aircrafts and comparison with doublet type inputs are made.

Mehra, R. K.↗
NASA NTRS1978

Kalman filter divergence and aircraft motion estimators

Kalman filters designed for many aerospace systems turn out to be unsatisfactory. The estimate errors become large compared to the errors predicted by the theory ('divergence'). One of the principal causes of this failure is that the system model contains states or modes that are undisturbed by the modeled process noise, and are neutrally stable (NS). One cure for such problems is periodic restarting of a time-varying Kalman filter. Other cures include minimum variance observers with eigenvalue constraints, added noise, pole-shifting, and destabilization. Several examples are given, including effective time-invariant estimators for the longitudinal and lateral motions of an airplane where several NS modes are undisturbed by wind gusts. An interpretation of these estimators as a 'strapdown IMU' without accelerometers, gimbaled gyros, or servos is given.

Bryson, A. E., Jr.↗
NASA NTRS1978

A note on the diurnal averaging of aeronomical models

An approximate technique for diurnally time-averaging atmospheric photochemical-dynamical models which eliminates the need for a detailed numerical resolution of sunrise and sunset transitions is developed. The scheme is equivalent to scaling certain chemical rate constants and photodissociation coefficients by appropriate aeronomical factors. To calculate the scaling factors, diurnal variations are parameterized with a step-function behavior, assuming that each species has a constant day-time and night-time concentration whose ratio can be determined by analyzing the chemical interactions occurring after sunset. The solution accounts for the effects of night-time reactions on the 24 h average values of species abundances, and on the average daily rates of the catalytic processes consuming ozone in the stratosphere. The accuracy of the technique is demonstrated by comparing its predictions to those of a full diurnal simulation; typically, the precision is better than 10%. By contrast, it is shown that the use of some other well-known computational schemes can result in significantly larger predictive errors.

Turco, R. P.↗
NASA NTRS1978

Precision orbit computations for Starlette

The Starlette satellite, launched in February 1975 was designed to minimize the effects of nongravitational forces and to obtain the highest possible accuracy for laser range measurements. Analyses of the first four months of laser tracking data from nine stations have confirmed the stability of the orbit and the precision to which the satellite's position can be established. Initial orbit computations using the GSFC GEM - 7 gravity model produced rms fits of about 8 to 10 meters for arc lengths of 5 days. After tailoring a gravity model specifically to Starlette, the rms fits for the 5 day arcs were reduced significantly to the 1 to 2 meter level. An rms fit of 4.3 meters was obtained for a 90 day arc. Five day arcs overlapped by 2.5 days showed rms satellite position differences generally less than 2 meters. Prediction errors at the end of two months were less than 30 milliseconds.

Marsh, J. G.↗