Search NASA⌕ Search

SEARCH · Search NASA

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Doppler global velocimetry: Development of a flight research instrumentation system for application to non-intrusive measurements of the flow field

Doppler Global Velocimetry (DGV) is a new diagnostic tool that offers potential for flow field measurements in flight by acquiring three-component velocity data in near real-time during flight maneuvers. The feasibility of implementation of a flight DGV system aboard NASA's High-Angle-of-Attack Research Vehicle (HARV) was addressed in this work by identifying the essential characteristics of a flight measurement system and by performing calibration and error tests. Results from this work were: an outline that establishes a preliminary basis for system configurations by analyzing measurement errors, installation issues, and operating requirements; measurement of the accuracy of the DGV technique using a laboratory breadboard DGV system based on a frequency-doubled Nd: YAG laser and iodine Absorption Line Filter (ALF), which showed excellent agreement between the DGV data and pilot measurements on a laminar flow jet with velocities of up to 150 m/sec; a survey of DGV system components and technologies that are relevant to the design of a flight measurement system, including a survey of cameras for the next generation DGV receivers; an assessment of the candidate lasers and absorption line filters for the flight system, resulting in a near-term recommendation of Nd: host lasers and an iodine ALF for both flight and wind tunnel applications.

Komine, Hiroshi↗
DOE OSTI2026

Representativity error scaling of models of the high temperature test facility

Error scaling is a critical step toward the validation of modeling capabilities for high-temperature gas-cooled reactors (HTGRs). Extensive effort is being made to bring HTGRs into the validation basis of numerous thermal-hydraulics codes. Here, this paper demonstrates how systems-level codes can be leveraged to perform error scaling analyses between an experimental facility and a plant-to-be facility. Specifically, we focus on two conduction cooldown experiments from the High Temperature Test Facility (HTTF) and the General Atomics 350 MW th modular high-temperature gas-cooled reactor (MHTGR-350). The error scaling methodology employed in this study is representativity, which in the context of this work was used to quantify how well experiments captured the physics of the plant facility by comparing sensitivity vectors between the two facilities. In addition, two different RELAP5–3D models of the HTTF were included in the comparison to determine if modeling methodologies notably impact the representativity results. The key figures of merit are the maximum block temperature and the coolant outlet temperature. The time-dependent maximum block temperature had a low representativity of below 0.1 for both models across both transients. The coolant outlet temperature had a higher representativity of around 0.6 for both models during the pressurized conduction cooldown, but it was below 0.2 for the depressurized conduction cooldown. Overall, the HTTF experiments were not representative of the transients in the MHTGR-350. However, these results can play a significant role in informing future potential experiments for HTGR systems that iterate on what the HTTF accomplished.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRSDate not supplied

A Machine Learning Framework for Error Compensation in Radiative Transfer Calculations

Radiative heat transfer influences the amount of heat flux transferred to the surface of the hypersonic vehicle, which is essential to evaluate the performance of thermal protection systems. The radiative heat flux is found to be computationally prohibitive while accounting for the variation in spatial, angular, and spectral domains. A new methodology has been recently developed to alleviate the cost of computation in the spectral domain by constructing flow-agnostic reduced-order models (ROMs). The developed spectral ROM databases provide grouping strategies that account for non-equilibrium absorption and emission as well as interaction between disparate species due to spectral overlap in associated radiative processes. However, the developed ROMs need to be optimized for a specific combination of interacting gas species and would need to re-calibrated in case individual species are added/omitted. In this work, we use various machine learning (ML) techniques to approximate the radiative intensities determined by a ROM optimized for a specific gas mixture. The ML model relies on the ROM databases developed for a single species which ignores any spectral overlap. Thus, radiation evaluation starts with a simple summation of radiative intensities predicted using these non-calibrated ROMs for the contributing species. The ML framework then provides a correction to account for the interplay in the frequency, i.e., emission of photons by one species and absorption by another, and yields mixture-specific radiation fields. Once trained on the individual ROM databases, the ML framework offers instantaneous corrections that serves as a time/cost effective alternative to the optimization of ROMs for a specific gas mixture. The ML framework is trained on both the high fidelity and ROM evaluated line of sight (LOS) data from Orion, Stardust, and FIRE II cases to obtain a general purpose correction model for earth re-entry scenarios when radiation contributions from both atomic nitrogen and atomic oxygen are considered. A geometric length scale parameter is used in the training process to account for errors introduced in the ROM databases as a consequence of high optical thickness. The efficacy of the ML framework is underscored through extensive analysis of train and test errors with respect to all the re-entry scenarios. The applicability of such an ML framework was further corroborated by embedding it in a state-of-the-art US3D - NERO system for determining the radiative heat flux transferred to the hypersonic vehicle surface.

Radiation↗
NASA NTRS1995

AXAF Alignment Test System Autocollimating Flat Error Correction

The alignment test system for the advanced x ray astrophysics facility (AXAF) high-resolution mirror assembly (HRMA) determines the misalignment of the HRMA by measuring the displacement of a beam of light reflected by the HRMA mirrors and an autocollimating flat (ACF). This report shows how to calibrate the system to compensate for errors introduced by the ACF, using measurements taken with the ACF in different positions. It also shows what information can be obtained from alignment test data regarding errors in the shapes of the HRMA mirrors. Simulated results based on measured ACF surface data are presented.

Lewis, Timothy S.↗
DOE OSTI2022

Biomaniac

Los Alamos National Laboratory researchers are developing a machine-learning based algorithm to revolutionize how biopolymers are designed and optimized. BioManIAC is a software platform that fills the gaps in data to gain insight into new potential polymer properties without making and testing them. Polymer engineers are able to use BioManIAC software to extrapolate and tune new biopolymer properties that allow the user to create small smart libraries, rather than largescale trial and error testing. This targeted design is expected to improve both time to market and R&D expenditure, as well as the resulting mechanical properties of biopolymers, enabling for more direct competition with traditional petroleum-based polymers. Los Alamos is seeking partners to further validate our software platform.

36 MATERIALS SCIENCE↗
DOE OSTI2026

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1992

Integrating Test Results With Analysis to Improve Safe Separation Flight Tests

Although extensive ground testing, utilizing both the Captive Trajectory system (CTS) and grid method, generally precedes flight testing of new aircraft/weapon combinations, the flight test results often do not match the wind tunnel predictions. These discrepancies are generally attributed to model scale, wind tunnel test errors and Reynolds Number effects, and may have been the cause of several previous aircraft/weapon incidents. The paper describes the procedure used at the Naval Air Warfare Center, Aircraft Division, Warminster (NAWCADWAR) during the early phases of wind tunnel testing and analysis, as well as subsequent flight testing to validate the predicted trajectories. This approach is designed to improve the safety of the flight tests for the critical portions of the aircraft envelope.

Flight Testing↗
DOE OSTI2025

Parameter uncertainties for imperfect surrogate models in the low-noise regime

Abstract Bayesian regression determines model parameters by minimizing the expected loss, an upper bound to the true generalization error. However, this loss ignores model form error, or misspecification, meaning parameter uncertainties are significantly underestimated and vanish in the large data limit. As misspecification is the main source of uncertainty for surrogate models of low-noise calculations, such as those arising in atomistic simulation, predictive uncertainties are systematically underestimated. We analyze the true generalization error of misspecified, near-deterministic surrogate models, a regime of broad relevance in science and engineering. We show that posterior parameter distributions must cover every training point to avoid a divergence in the generalization error and design a compatible ansatz which incurs minimal overhead for linear models. The approach is demonstrated on model problems before application to thousand-dimensional datasets in atomistic machine learning. Our efficient misspecification-aware scheme gives accurate prediction and bounding of test errors in terms of parameter uncertainties, allowing this important source of uncertainty to be incorporated in multi-scale computational workflows.

Swinburne, Thomas D. (ORCID:0000000232554257)↗
DOE OSTI2023

Single-Point Extrapolation to the Complete Basis Set Limit through Deep Learning

Machine learning (ML) offers an attractive method for making predictions about molecular systems while circumventing the need to run expensive electronic structure calculations. Once trained on ab initio data, the promise of ML is to deliver accurate predictions of molecular properties that were previously computationally infeasible. In this work, we develop and train a graph neural network model to correct the basis set incompleteness error (BSIE) between a small and large basis set at the RHF and B3LYP levels of theory. Our results show that, when compared to fitting to the total potential, an ML model fitted to correct the BSIE is better at generalizing to systems not seen during training. We test this ability by training on single molecules while evaluating on molecular complexes. We also show that ensemble models yield better behaved potentials in situations where the training data is insufficient. However, even when only fitting to the BSIE, acceptable performance is only achieved when the training data sufficiently resemble the systems one wants to make predictions on. As a result, the test error of the final model trained to predict the difference between the cc-pVDZ and cc-pV5Z potential is 0.184 kcal/mol for the B3LYP density functional, and the ensemble model accurately reproduces the large basis set interaction energy curves on the S66x8 dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Reliability, biological variability, and accuracy of multi-frequency bioelectrical impedance analysis for measuring body composition components

Introduction Bioelectrical impedance analysis (BIA) systems are gaining popularity for use in research and fitness assessments as the technology improves and becomes more affordable and easier to use. Multifrequency BIA (MF-BIA) may improve accuracy and precision using octopolar contacts for segmental analyses. Purpose Evaluate reliability, biological variability, and accuracy of component measures (total body water, mass, and composition) of commercially available MF-BIA system (InBody 770, Cerritos, California, USA). Methods Fourteen healthy military-age adults were assessed by MF-BIA in duplicate on five laboratory visits across 3 weeks (10 measures each). Participants were evaluated at the same time of day after refraining from strenuous exercise (> 48 h), alcohol consumption (> 24 h), and caffeine, nicotine, and food (> 10 h). Systematic error (test–retest reliability) and biological variability (day-to-day reliability) were summarized by intraclass correlation coefficient (ICC) values determined for body mass (fat, fat-free, total) and body water (extracellular, intracellular, total). Body composition measurements derived from BIA on the second visit were also tested for accuracy compared to dual-energy x-ray absorptiometry (DXA). Results Test–retest reliability was very high for all measurements of whole-body water and mass (ICC ≥ 0.999) and high for regional body water and mass (ICC 0.973–1.000). Biological variability was observable with very minor differences between tests (same day) for total and regional body water (0.0–0.2 L) and total and regional body mass measurements (0.0–0.2 kg); while between day differences were slightly higher (0.0–0.5 L and 0.1–0.7 kg). Compared to DXA, the MF-BIA whole-body measures showed an offset in %BF (Bias −4.0 ± 2.8%; Standard error of the estimate (SEE), 2.6%), an overprediction for total body fat-free mass (Bias 2.8 ± 2.1 kg; SEE 2.2 kg) and an underprediction of total body fat mass (Bias −2.9 ± 2.0 kg; SEE 1.9 kg). Conclusion Under controlled conditions with fit and healthy men and women, this MF-BIA system has high methodological reliability and demonstrates stable day-to-day measurements of major body composition components. Previously reported ~3% body fat offset compared to criterion methods was again confirmed. Precision of the InBody 770 shows consistency and supports further testing of this specific device as a new military standards method and suitability across a wider range of %BF.

Nutrition & Dietetics↗
NASA NTRS2011

Spectral Kernel Approach to Study Radiative Response of Climate Variables and Interannual Variability of Reflected Solar Spectrum

The radiative kernel approach provides a simple way to separate the radiative response to different climate parameters and to decompose the feedback into radiative and climate response components. Using CERES/MODIS/Geostationary data, we calculated and analyzed the solar spectral reflectance kernels for various climate parameters on zonal, regional, and global spatial scales. The kernel linearity is tested. Errors in the kernel due to nonlinearity can vary strongly depending on climate parameter, wavelength, surface, and solar elevation; they are large in some absorption bands for some parameters but are negligible in most conditions. The spectral kernels are used to calculate the radiative responses to different climate parameter changes in different latitudes. The results show that the radiative response in high latitudes is sensitive to the coverage of snow and sea ice. The radiative response in low latitudes is contributed mainly by cloud property changes, especially cloud fraction and optical depth. The large cloud height effect is confined to absorption bands, while the cloud particle size effect is found mainly in the near infrared. The kernel approach, which is based on calculations using CERES retrievals, is then tested by direct comparison with spectral measurements from Scanning Imaging Absorption Spectrometer for Atmospheric Cartography (SCIAMACHY) (a different instrument on a different spacecraft). The monthly mean interannual variability of spectral reflectance based on the kernel technique is consistent with satellite observations over the ocean, but not over land, where both model and data have large uncertainty. RMS errors in kernel ]derived monthly global mean reflectance over the ocean compared to observations are about 0.001, and the sampling error is likely a major component.

Jin, Zhonghai↗
DOE OSTI2023

Design Rules for Two–Dimensional Organic Semiconductor–Incorporated Perovskites (OSiP) Gleaned from Thousands of Simulated Structures

Two-dimensional (2D) halide perovskites are an attractive class of hybrid perovskites that have additional optoelectronic tunability due to their accommodation of relatively large organic ligands. Nevertheless, contemporary ligand design depends on either expensive trial-and-error testing of whether a ligand can be integrated within the lattice or conservative heuristics that unduly limit the scope of ligand chemistries. Here, the structural determinants of stable ligand incorporation within Ruddlesden-Popper (RP) phase perovskites are established by molecular dynamics (MD) simulations of over ten-thousand RP-phase perovskites and training of machine learning classifiers capable of predicting structural stability based solely on generalizable ligand features. The simulation results show near-perfect predictions of positive and negative literature examples, predict trade-offs between several ligand features and stability, and ultimately predict an inexhaustibly large 2D-compatible ligand design-space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Invertible neural networks for real-time control of extrusion additive manufacturing

Material extrusion additive manufacturing (AM) has enabled an elegant fabrication pathway for a vast material library. Nonetheless, each material requires optimization of printing parameters generally determined through significant trial-and-error testing. To eliminate arduous, iteration-based optimization approaches, many researchers have used machine learning (ML) algorithms which provide opportunities for automated process optimization. Here, in this work, we demonstrate the use of an ML-driven approach for real-time material extrusion print-parameter optimization through in-situ monitoring of printed line geometry. To do this, we use deep invertible neural networks (INNs) which can solve both forward and inverse, or optimization, problems using a single network. By combining in-situ computer vision and deep INNs, the printing parameters can be autonomously optimized to print a target line width in 1.2 s. Furthermore, defects that occur during printing can be rapidly identified and corrected autonomously. The methods developed and presented in this work eliminate user-intensive, time-consuming, and iterative parameter discovery approaches that currently limit accelerated implementation of extrusion-based AM processes. Furthermore, the presented approach can be generalized to provide real-time monitoring and optimization pathways for increasingly complex AM environments.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Monte Carlo simulation of order-disorder transition in refractory high entropy alloys: A data-driven approach

High entropy alloys (HEAs) are a series of novel materials that demonstrate many exceptional mechanical properties. To understand the origin of these attractive properties, it is important to investigate the thermodynamics and elucidate the evolution of various chemical phases. In this work, we introduce a machine learning approach to construct the effective Hamiltonian and study the thermodynamics of HEAs through canonical Monte Carlo simulation. The main characteristic of our method is to use pairwise interactions between atoms as the machine learning features and systematically improve the representativeness of the dataset using active learning from the Monte Carlo samples. We find this method produces highly robust and accurate effective Hamiltonians that give less than 0.1 mRy test error for all the three refractory HEAs: MoNbTaW, MoNbTaVW, and MoNbTaTiW. Using replica exchange to speed up the MC simulation, we calculated the specific heats and short-range order parameters in a wide range of temperatures. For all the studied materials, we find there are two major order-disorder transitions occurring respectively at T 1 and T 2 , where T 1 is near room temperature but T 2 is much higher. Further, we demonstrate that the transition at T 1 is caused by W and Nb while the one at T 2 is caused by the other elements. By comparing with experiments, the results demonstrate that the order-disorder transitions have a profound impact on the strength and ductility of HEAs.

36 MATERIALS SCIENCE↗
DOE OSTI2024

PINN surrogate of Li-ion battery models for parameter inference, Part II: Regularization and application of the pseudo-2D model

Bayesian parameter inference is useful to improve Li-ion battery diagnostics and can help formulate battery aging models. However, it is computationally intensive and cannot be easily repeated for multiple cycles, multiple operating conditions, or multiple replicate cells. To reduce the computational cost of Bayesian calibration, numerical solvers for physics-based models can be replaced with faster surrogates. A physics-informed neural network (PINN) is developed as a surrogate for the pseudo-2D (P2D) battery model calibration. For the P2D surrogate, additional training regularization was needed as compared to the PINN single-particle model (SPM) developed in Part I. Both the PINN SPM and P2D surrogate models are exercised for parameter inference and compared to data obtained from a direct numerical solution of the governing equations. A parameter inference study highlights the ability to use these PINNs to calibrate scaling parameters for the cathode Li diffusion and the anode exchange current density. By realizing computational speed-ups of ~2250x for the P2D model, as compared to using standard integrating methods, the PINN surrogates enable rapid state-of-health diagnostics. Finally, in the low-data availability scenario, the testing error was estimated to ~2 mV for the SPM surrogate and ~10 mV for the P2D surrogate which could be mitigated with additional data.

25 ENERGY STORAGE↗
DOE OSTI2023

Multifidelity Neural Network Formulations for Prediction of Reactive Molecular Potential Energy Surfaces

Here, this paper focuses on the development of multifidelity modeling approaches using neural network surrogates, where training data arising from multiple model forms and resolutions are integrated to predict high-fidelity response quantities of interest at lower cost. We focus on the context of quantum chemistry and the integration of information from multiple levels of theory. Important foundations include the use of symmetry function-based atomic energy vector constructions as feature vectors for representing structures across families of molecules and single-fidelity neural network training capabilities that learn the relationships needed to map feature vectors to potential energy predictions. These foundations are embedded within several multifidelity topologies that decompose the high-fidelity mapping into model-based components, including sequential formulations that admit a general nonlinear mapping across fidelities and discrepancy-based formulations that presume an additive decomposition. Methodologies are first explored and demonstrated on a pair of simple analytical test problems and then deployed for potential energy prediction for C 5 H 5 using B2PLYP-D3/6-311++G(d,p) for high-fidelity simulation data and Hartree–Fock 6-31G for low-fidelity data. For the common case of limited access to high-fidelity data, our computational results demonstrate that multifidelity neural network potential energy surface constructions achieve roughly an order of magnitude improvement, either in terms of test error reduction for equivalent total simulation cost or reduction in total cost for equivalent error.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Efficient Training of Deep Neural Operator Networks via Randomized Sampling

Neural operators (NOs) employ deep neural networks to learn the mappings between infinitedimensional function spaces. Deep operator network (DeepONet), a popular NO architecture, has demonstrated success in the real-time prediction of complex dynamics across various scientific and engineering applications. In this work, we introduce a random sampling technique to be adopted during the training of DeepONet, aimed at improving the generalization ability of the model, while significantly reducing the computational time. The proposed approach targets the trunk network of the DeepONet model that outputs the basis functions corresponding to the spatiotemporal locations of the bounded domain on which the physical system is defined. While constructing the loss function, DeepONet training traditionally considers a uniform grid of spatiotemporal points at which all the output functions are evaluated for each iteration. This approach leads to a larger batch size, resulting in poor generalization and increased memory demands, due to the limitations of the stochastic gradient descent (SGD) optimizer. The proposed random sampling over the inputs of the trunk net mitigates these challenges, improving generalization and reducing the memory requirements during training, resulting in significant computational gains. We validate our hypothesis through three benchmark examples, demonstrating substantial reductions in training time while achieving comparable or lower overall test errors relative to the traditional training approach. Our results indicate that incorporating randomization in the trunk network inputs during training enhances the efficiency and robustness of DeepONet, offering a promising avenue for improving the framework’s performance in modeling complex physical systems.

Karumuri, Sharmila [Department of Civil & Systems ↗
DOE OSTI2022

Automated Stellar Spectra Classification with Ensemble Convolutional Neural Network

Large sky survey telescopes have produced a tremendous amount of astronomical data, including spectra. Machine learning methods must be employed to automatically process the spectral data obtained by these telescopes. Classification of stellar spectra by applying deep learning is an important research direction for the automatic classification of high-dimensional celestial spectra. In this paper, a robust ensemble convolutional neural network (ECNN) was designed and applied to improve the classification accuracy of massive stellar spectra from the Sloan digital sky survey. We designed six classifiers which consist six different convolutional neural networks (CNN), respectively, to recognize the spectra in DR16. Then, according the cross-entropy testing error of the spectra at different signal-to-noise ratios, we integrate the results of different classifiers in an ensemble learning way to improve the effect of classification. The experimental result proved that our one-dimensional ECNN strategy could achieve 95.0% accuracy in the classification task of the stellar spectra, a level of accuracy that exceeds that of the classical principal component analysis and support vector machine model.

79 ASTRONOMY AND ASTROPHYSICS↗