Search NASA⌕ Search

SEARCH · Search NASA

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Modeling Noise: Paths toward AI-Enabled Stochastic Earth System Models and Parameterizations

Some of the key challenges in Earth system prediction arise from an uncertain representation of unpredictable natural variability, across time and space scales. This variability, hereafter referred to as noise, represents the quantity against which the strength of a signal of interest is measured to assess predictability. Underestimating or overestimating this noise in Earth system models can lead to issues ranging between overconfidence in an erroneous prediction and a lack thereof in an otherwise accurate one. Noise is part of the physical processes in the Earth system and can amplify or damp a signal of interest in a complex manner that is not systematically characterized. Specifically, while there has been significant progress in our understanding of multiscale interactions among known modes of variability (potentially predictable signals), how these are impacted by the noise is not clear. Recent effort toward stochastic parametrization schemes that provide a representation of noise due to uncertain sub-grid processes in climate models (Berner et al., 2017 and references therein) has shown promise not only in reducing biases and improving probabilistic prediction but also in improving the representation of natural variability in the model toward what is observed. However, today’s standard schemes for stochastic parametrization are still simplistic as they do not take the state of the atmosphere into account (other than by the use of multiplicative noise for model tendencies). Furthermore they require hand-tuning and trial-and-error testing for the magnitude of the added noise, which is difficult in a chaotic system that is as complex as the Earth system.

58 GEOSCIENCES↗
DOE OSTI2022

Hardness Prediction by Incorporating Heat Transfer and Molten Pool Fluid Flow in a Multi-pass, Multi-layer Weld for Onsite Repair of Grade 91 steel

Introduction: In the current fleet of fossil-fired power plants, creep strength enhanced ferritic steels (CSEF) are used to sustain the harsh service conditions. Enhanced properties of Grade 91 steel result from tempered martensite with a fine distribution of MX and M23C6 carbides. Grade 91 steel is subjected to onsite welding repair to remedy their degradation due to extreme service condition. Knowledge of weld repairability of these steels, such as as-welded hardness distribution, is essential to establishing sound repair procedures. Experimental trial and error tests can consume a lot of time as many welding variables need to be studied. For numerical modelling, most of the multi-pass multi-layer models are based on finite element method, which are limited to solve the heat conduction equation and ignore convective heat transfer due to melt flow. Moreover, the mesh has to be pre-built based on a known or assumed weld cross-section geometry. These finite element based models thus have limited predictive capability as defects are not considered and nugget size are pre-assumed. This research aims at developing a thermal and microstructure evolution model incorporating molten pool dynamics in a multi-pass multi-layer material deposition to predict the as-welded hardness distribution. Technical Approach: All the thermal, physical, and metallurgical properties of Grade 91 as a function of temperature are collected from the literature and inputted into the thermo-fluid model based on Flow-3D, a computational fluid dynamics software. A multi-pass, multi-layer material deposition is simulated where the melting of filler wire into the molten pool is directly considered based on the volume of fluid (VOF) method. The flow behaviour of the molten pool is used to understand the formation of deposition geometry and defects. The temperature profiles during the multi-pass, multi-layer welding are calculated. The results computed using the new model are compared against the experimental data of fusion zone geometry and thermal cycles. Hardness prediction in the heat-affected zone (HAZ) are made using Johnson-Mehl-Avrami (JMA) equation for solid-state phase transformation kinetics. The JMA parameters are extracted from the experimental data available in the literature. For comparison, a standard finite element heat conduction model is also developed to predict the thermal cycles and hardness distribution in the multi-pass, multi-layer weld. Expected Result: Results obtained using the molten pool dynamic simulation versus the finite element heat conduction model are compared. Specifically, the effects of convective heat transfer on the accuracy of the calculated thermal history, bead shape and size, and HAZ hardness distribution are examined.

Modeling, Grade 91 steel, Multi-pass multi-layer d↗
DOE OSTI2026

Multimodal Approaches for Leveraging Domain Knowledge with State-of-the-Art Machine Learning to Engineer Biocatalysts

This grant aimed to accelerate the development of specialized enzymes—biological catalysts essential for sustainable manufacturing and medicine—by integrating traditional laboratory evolution with cutting-edge artificial intelligence. To achieve this, we developed a suite of high-throughput sequencing tools and a centralized database to bridge the gap between a protein’s genetic "code" and its physical function. By training machine learning models on large datasets, we also demonstrated the ability to move beyond slow, trial-and-error testing to a "generative" approach, where AI can independently design new, versatile enzymes like tryptophan synthases. Ultimately, these findings demonstrate that combining laboratory data with computer-guided design enables the engineering of highly efficient biological tools with unprecedented speed and precision.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

2024 Incubator Final Report: Active Hybrid Mooring

This Incubator project has defined and developed a representation of an active hybrid mooring (AHM) system in Simulink to assess whether the speed and accuracy of AHM is sufficient to warrant further investigation in a larger project. We first built a representative mooring system for the VolturnUS-S 15MW floating offshore wind turbine (FOWT) in 1,000-meter water depth to provide baseline loads and displacements needed in the AHM system, with the results showing off-the-shelf actuators would be practical. We then defined model configurations for the numerical and physical substructures, using standalone MoorDyn v2 with a novel input strategy and chained hydraulic actuators represented in Simulink Simscape, respectively. The remainder of the project has focused on verifying the existing models for speed and accuracy against OpenFAST simulations, increasing their complexity to enable six degree of freedom (6DOF) operation, and connecting the numerical and physical substructures into a single holistic model. The verification phase of the project has shown promising results, though further refinement is needed to resolve accuracy discrepancies and for robust performance across a wider range of metocean conditions. The numerical model we developed is computationally stable and operates faster than real time using a time step of 0.01 seconds or shorter, indicating the model is likely fast enough for our AHM design to operate successfully. Additionally, the Simscape model of a hydraulic actuator operates with less than 0.3% relative error when actuating mooring loads from an OpenFAST simulation of the VolturnUS-S 1,000-meter mooring system. The aforementined refinements will be performed in the next year as a Continuing Incubator, with key remaining tasks include programming the predictor-corrector loop to minimize movement error, testing against more complex nonlinear wave cases, and expanding to enable loads from connected shared mooring lines.

17 WIND ENERGY↗
DOE OSTI2023

Heliostat Consortium: Gap Analysis on Wind Load for Achieving a Fully Competitive Heliostat Industry

The Heliostat Consortium (HelioCon) Wind Load Subtask was initiated with the aim of bringing research work pertaining to wind load measurement, characterization, and prediction taking place across several tasks, including Advanced Manufacturing, Components and Controls, and Field Deployment. The cross-cutting wind load subtopic in the HelioCon roadmap report [1] highlighted standardized methods and tools that are needed for a more detailed understanding of the static and dynamic loads on a heliostat. This will enable cost reduction of wind-dependent heliostat components to avoid unnecessarily conservative, overly constrained designs and increase field efficiency/reliability, to reduce the risk of component failures due to high-wind events (>15 m/s). Gaps related to heliostat wind load include site characterization for wind measurements, critical load cases for heliostat design, turbulence impacts on heliostat tracking error, testing of heliostat array configurations, understanding spatial variation of maximum loads across the solar field, and heliostat field layout and operating strategies. The recommended highest-priority pathway as first steps taken by HelioCon to address these gaps are to develop site characterization guidelines for heliostat design and field load measurements.

Emes, Matthew (ORCID:0000000341474387)↗
DOE OSTI2026

Estimators and Fusers for Fiber Delay Estimation Using Environmental Measurements

The properties of deployed network fiber are affected by environmental factors due to their exposure to the elements. Particularly for quantum networks, the resultant delay variations may have significant impacts due to the extreme sensitivity of synchronization, coincidence counting, and other critical operations. In this paper, the delays of 15 km aerial-inground fiber connections are measured, and effects due to temperature, humidity and wind speed are analyzed over multiple periods spanning four seasons of a year. Machine learning methods are first utilized to reveal surprisingly pronounced effects of humidity on the delay, in addition to the expected temperature and its seasonal variations. Estimator and fusion methods are developed to estimate the delay using temperature, humidity and wind speed measurements, by utilizing smooth Gaussian Process Regression (GPR) and nonsmooth Ensemble of Trees (EOT) methods. Measurements from winter and summer periods are temporally fused using twelve different methods, and eight methods provide estimates for the delay throughout the year with median test errors under 1.28%. The results reveal distinct temperature-humidity trends across the seasons, and the ability of estimator and temporal fusion methods to exploit them for estimating the delay. These results constitute a case study of machine learning analytical results, wherein generalization equations explain the performance of various estimator and fuser methods.

Rao, Nageswara [ORNL] (ORCID:0000000234085941)↗
DOE OSTI2023

Quantification and prediction of error in MIMO tests

Dynamic testing of systems is most realistic of real-world conditions when multiple input and multiple output (MIMO) techniques are used. To replicate measured environmental conditions, a series of desired outputs (responses) on the system must be realized by inverting the frequency response functions (FRF) matrix for input estimation. System identification is dependent on the number of inputs and outputs, which affect the type of solutions. In input estimation, the auto spectra of the determined inputs are affected by both the auto spectra and cross spectra of the desired outputs. This research evaluates errors and investigates two sources in an experimental setting. The first significant error source is test-to-test variability in FRFs from system identification tests, quantified by magnitude variability from long-duration tests. The second significant error source is the realization of time histories from frequency domain inputs. The spectral content of the realized random process deviates from the desired content and is also quantified. The structure is a linear three-story frame fixed at the base; two inputs are provided uniaxially with the use of suspended electrodynamic shakers. The proposed model for error sources was found to be effective in predicting errors in a SISO (single-input single-output) and a square (2-input 2-output) MIMO test.

Yousef, Odey↗
DOE OSTI2023

Metal hydride composition-derived parameters as machine learning features for material design and H 2 storage

Though hydrogen is a promising energy carrier for a green future, many challenges persist. One is the difficulty in engineering storage solutions, with metal hydrides being a leading contender among solid-state strategies. To facilitate efficient searching of candidate materials, ridge regression, simple decision trees, random forest ensembles, and gradient boosting ensembles were employed to predict the energy of formation, with the random forest ensemble resulting in the lowest test set error. First, two public databases, Materials Project and HydPark, were searched for metal hydrides. Feature engineering was performed before the models were developed, resulting in electronegativity, density, atomic density, d-character, f-character, band gap, hydrogen weight fraction, magnetization, temperature, and pressure being retained. The models were then benchmarked by the lowest test error before a random forest ensemble was used to populate entries missing energy of formation. Furthermore, all were then scored by hydrogen storage capacity and energy of formation suitability. Readily available features including several derived from only the chemical formula which were found to be highly predictive. and so are promising for high-throughput screening of arbitrary novel hydride formulations and blends for thermodynamic feasibility.

25 ENERGY STORAGE↗
DOE OSTI2021

Uncertainty Analysis and Software Verification

Uncertainty analyses are an important part of calibrations and testing. They allow researchers insight on how to reduce and mitigate errors in testing. Each device used in testing introduces error in a system, as well as other sources such as environmental conditions, electronics, analog to digital, and random errors. Each source is carefully examined to identify how much error it introduces to a system. These sources are then combined using various methods of uncertainty calculations. To verify and validate software, a manual calculation is required to ensure the software is performing as intended. Using Excel to verify the calculations, we can identify discrepancies within the software. The root of the sum of the squares uncertainty (RSS) is used to find the combined uncertainty of a device at one and two standard deviations of the mean. Calibrations on accelerometers are performed using a vibration system along with a back-toback reference accelerometer. The vibration system takes a reference point at 100Hz frequency at 10g amplitude. The sensitivities are collected at each dialed in frequency. The sensitivity of the device represents the electrical output of the UUT (mV, pC, etc.) per unit of acceleration (g). The full history of sensitivities of selected accelerometers are used to find the averaged, standard deviation, and uncertainty of the device at each frequency tested. The uncertainty calculations from excel and the software are then compared.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Part-scale microstructure prediction for laser powder bed fusion Ti-6Al-4V using a hybrid mechanistic and machine learning model

Laser powder bed fusion (LPBF) Ti-6Al-4V is widely studied for use in structural applications in aerospace and medical industries, but mechanical anisotropy and microstructural inhomogeneity prohibits its wider adoption. Although successful microstructure prediction models have been developed, a remaining challenge is their limited integration across length/time scales and validation by experimental studies. Here, this work proposes a physics-augmented machine learning surrogate model to unite predictions of LPBF temperature, β phase morphology and texture, and α/α’ formation into a single framework that is calibrated and validated with experiments. First, a phase field (PF) model of the martensitic β→α’ transformation is developed and calibrated using data from in-situ synchrotron cyclic heating/cooling studies quantifying the variation of α phase fraction with time. In parallel, an established finite difference-Monte Carlo (FDMC) model predicts the part-scale temperature profile and β grain formation during solidification. A dataset is developed using LPBF cyclic temperature descriptors from the FDMC model as inputs and corresponding α/α’ phase fraction and width from the PF model as outputs. Five machine learning (ML) regression models are tested and optimized, having mean absolute error in testing ≤ 4 %, and the k-nearest neighbors (KNN) model is selected as the best performing. The KNN model is called at the nodal level during post-processing of the FDMC model to replace and downscale the response of the PF model. The combined agility and accuracy of the hybrid FDMC-ML model enables part-scale microstructure predictions that can be further used for property predictions to accelerate AM process optimization.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Bayesian learning for rapid prediction of lithium-ion battery-cycling protocols

Advancing lithium-ion battery technology requires the optimization of cycling protocols. A new data-driven methodology is demonstrated for rapid, accurate prediction of the cycle life obtained by new cycling protocols using a single test lasting only 3 cycles, enabling rapid exploration of cycling protocol design spaces with orders of magnitude reduction in testing time. We achieve this by combining lifetime early prediction with a hierarchical Bayesian model (HBM) to rapidly predict performance distributions without the need for extensive repetitive testing. The methodology is applied to a comprehensive dataset of lithium-iron-phosphate/graphite comprising 29 different fast-charging protocols. HBM alone provides high protocol-lifetime prediction performance, with 6.5% of overall test average percent error, after cycling only one battery to failure. Here, by combining HBM with a battery lifetime prediction model, we achieve a test error of 8.8% using a single 3-cycle test. In addition, the generalizability of the HBM approach is demonstrated for lithium-manganese-cobalt-oxide/graphite cells.

25 ENERGY STORAGE↗
DOE OSTI2025

Dark Energy Survey Year 6 results: cell-based coadds and METADETECTION weak lensing shape catalogue

We present the metadetection weak lensing galaxy shape catalogue from the 6-yr Dark Energy Survey (DES Y6) imaging data. This data set is the final release from DES, spanning 4422 deg 2 of the southern sky. We describe how the catalogue was constructed, including the two new major processing steps, cell-based image coaddition, and shear measurements with metadetection. The DES Y6 M etadetection weak lensing shape catalogue consists of 151 922 791 galaxies detected over riz bands, with an effective number density of n eff = 8.22 galaxies per arcmin 2 and shape noise of σ e = 0.29. We carry out a suite of validation tests on the catalogue, including testing for point spread function (PSF) leakage, testing for the impact of PSF modelling errors, and testing the correlation of the shear measurements with galaxy, PSF, and survey properties. In addition to demonstrating that our catalogue is robust for weak lensing science, we use the DES Y6 image simulation suite to estimate the overall multiplicative shear bias of our shear measurement pipeline. We find no detectable multiplicative bias at the roughly half-per cent level, with m = (3.4 ± 6.1) x 10 –3 , at 3σ uncertainty. This is the first time both cell-based coaddition and Metadetection algorithms are applied to observational data, paving the way to the Stage-IV weak lensing surveys.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Classification Analytics of Pu-239 and U-235 Source Signatures Using Gamma Spectral Regions

Machine learning detection methods using gamma signatures from spectral measurements of low-intensity Pu-239 and U-235 sources are studied. NaI detectors located at different distances fromthe source have been used to collect the training and independent testing data sets. The source is introduced via a shielded conduit into the facility where it is surrounded by 21 NaI detectors deployed over 6 x 6 meters area in the formation of two concentric circles and a spiral. The counts in gamma spectral regions associated with these two sources are estimated at 1 second intervals for each NaI detector, and are used as classifier features for detecting the source presence. Eight different classifiers with five basic properties — namely, smooth, non-smooth, statistical, structural, and hyper-parameter tuning — are trained and tested using the background and source measurements collected over multiple experimental runs. While the overall classifier performance improved as detectors closer to the source are used, some identically produced detectors under-performed but differently between two sources. Some classifiers achieved lower training error but their testing error based on independent measurements is higher for both sources. Overall, these results indicate significant over-fitting by these methods, and illustrate the complexity of training and selecting the machine learning methods to solve these detection problems.

Rao, Nageswara↗
DOE OSTI2020

Measured Energy-Dependent Neutron Attenuation Through the Stacked Printed Circuit Boards

Engineers often stack printed circuit boards (PCBs), populated with semiconductor devices, one behind the other in neutron beams to improve the error statistics in radiation-effects tests. As the neutron beam traverses through the boards, the neutron flux is both attenuated and the energy spectrum changes, which may have a significant impact on the results of such tests. In this work, we have developed a technique to measure the energy-dependent neutron attenuation due to the PCBs and to determine the energy-dependent effective cross section of neutron interactions with a single PCB. With this effective cross section, engineers can calculate the change in the neutron energy spectrum and the total neutron attenuation after any number of identical PCBs in the stack. This information will allow test engineers to partially correct inaccuracies in soft error tests.

42 ENGINEERING↗
DOE OSTI2024

On the use of Graphs for Test Sequence Selection

This report demonstrates that applying graph theory techniques provides a way to obtain sufficient statistics in finding errors when testing complex state machines. It discusses how to define the tests, then demonstrates how to automatically generate test suites that diversify test cases, subject to constraints. If included within a continuous integration approach, these constructs provide an unbiased means to systematically check for errors within the latest controller software release.

97 MATHEMATICS AND COMPUTING↗