Search NASA⌕ Search

SEARCH · Search NASA

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Improved Treatment of 1–4 Interactions in Force Fields for Molecular Dynamics Simulations

Traditional force fields commonly use a combination of bonded torsional terms and empirically scaled nonbonded interactions to capture 1-4 energies and forces of atoms separated by three bonds in a molecule. While this approach can yield accurate torsional energy barriers, it often leads to inaccurate forces and erroneous geometries and creates an interdependence between dihedral terms and nonbonded interactions, complicating parametrization and reducing transferability. Here, in this paper, we demonstrate that 1-4 interactions can be accurately modeled using only bonded coupling terms, eliminating the need for arbitrarily scaled nonbonded interactions altogether. Furthermore, by leveraging the automated parametrization capabilities of the Q-Force toolkit, we efficiently determine the necessary coupling terms without the need for manual adjustment. Our approach is first validated on a range of small molecule systems, encompassing both flexible and rigid structures, and shows a significant improvement in force field accuracy, obtaining subkcal/mol mean absolute error for every molecule tested. We further extend the bonded-only model for 1-4 interactions to Amber ff14sb, CHARMM36, and OPLS-AA force fields to reproduce ab initio gas and implicit solvent ϕ,ψ surfaces of alanine dipeptide.

Abdullah, Aalim S. [University of California, Berk↗
DOE OSTI2022

Polyethylene in Dead-End Silica Nanopores: Forces and Mobility from Non-Equilibrium Statistical Mechanics and Exchange Spectroscopy Nuclear Magnetic Resonance

Billions of tons of plastic have been produced, and only a small fraction of this has been recycled. Tennakoon et al. [Nature Catalysis 3, 893 (2020)] developed a catalyst that repeatedly cleaves C 10 –C 30 hydrocarbons from the end of a polyethylene chain. The reaction occurs at a Pt nanoparticle at the base of a cylindrical silica mesopore with a diameter of 2 nm and a length of 110 nm. Portions of the polymer situated inside the pore can be differentiated from those outside using 13 C nuclear magnetic resonance (NMR), allowing the dynamics and extent of polymer threading to be monitored using two-dimensional (2D) exchange spectroscopy NMR. Here we construct a Fokker–Planck equation for the polymer dynamics by assuming a reptation diffusivity and a graduated adsorption free energy that depends linearly on the depth of polymer penetration in the pore. The solutions allow us to predict the intensities of the 2D NMR resonances as a function of time. We use the solutions to extract a polymer diffusivity at each temperature and estimate the per-segment desorption free energy, enthalpy, and entropy. Random and systematic errors are examined to test key assumptions in the theory and interpretation of the experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Reduced‐Order Probabilistic Emulation of Physics‐Based Ring Current Models: Application to RAM‐SCB Particle Flux

Abstract In this work, we address the computational challenge of large‐scale physics‐based simulation models for the ring current. Reduced computational cost allows for significantly faster than real‐time forecasting, enhancing our ability to predict and respond to dynamic changes in the ring current, valuable for space weather monitoring and mitigation efforts. Additionally, it can also be used for a comprehensive investigation of the system. Thus, we aim to create an emulator for the Ring current‐Atmosphere interactions Model with Self‐Consistent magnetic field (RAM‐SCB) particle flux that not only improves efficiency but also facilitates forecasting with reliable estimates of prediction uncertainties. The probabilistic emulator is built upon the methodology developed by Licata and Mehta (2023), https://doi.org/10.1029/2022sw003345 . A novel discrete sampling is used to identify 30 simulation periods over 20 years of solar and geomagnetic activity. Focusing on a subset of particle flux, we use Principal Component Analysis for dimensionality reduction and Long Short‐Term Memory (LSTM) neural networks to perform dynamic modeling. Hyperparameter space was explored extensively resulting in about 5% median symmetric accuracy across all data sets for one‐step dynamic prediction. Using a hierarchical ensemble of LSTMs, we have developed a reduced‐order probabilistic emulator (ROPE) tailored for time‐series forecasting of particle flux in the ring current. This ROPE offers accurate predictions of omnidirectional flux at a single energy with no pitch angle information, providing robust predictions on the test set with an error score below 11% and calibration scores under 8% with bias under 2% providing a significant speed up as compared to the full RAM‐SCB run.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Galactic ArchaeoLogIcaL ExcavatiOns (GALILEO) II. t-SNE portrait of local fossil relics and structures

Based on high-quality Apache Point Observatory Galactic Evolution Experiment (APOGEE) DR17 and Gaia DR3 data for 1742 red giants stars within 5 kpc of the Sun and not rotating with the Galactic disk (V φ < 100 km s -1 ), we used the nonlinear technique of unsupervised analysis t-Distributed Stochastic Neighbor Embedding (t-SNE) to detect coherent structures in the space of ten chemical-abundance ratios: [Fe/H], [O/Fe], [Mg/Fe], [Si/Fe], [Ca/Fe], [C/Fe], [N/Fe], [Al/Fe], [Mn/Fe], and [Ni/Fe]. Additionally, we obtained orbital parameters for each star using the nonaxisymmetric gravitational potential GravPot16. Seven structures are detected, including Splash, Gaia-Sausage-Enceladus (GSE), the high-α heated-disk population, N-C-O peculiar stars, and inner disk-like stars, plus two other groups that did not match anything previously reported in the literature, here named Galileo 5 and Galileo 6 (G5 and G6). These two groups overlap with Splash in [Fe/H], with G5 having a lower metallicity than G6, and they are both between GSE and Splash in the [Mg/Mn] versus [Al/Fe] plane, with G5 being in the α-rich in situ locus and G6 on the border of the α-poor in situ one. Nonetheless, their low [Ni/Fe] hints at a possible ex situ origin. Their orbital energy distributions are between Splash and GSE, with G5 being slightly more energetic than G6. We verified the robustness of all the obtained groups by exploring a large range of t-SNE parameters, applying it to various subsets of data, and also measuring the effect of abundance errors through Monte Carlo tests.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

ZTF-SEDm Type Ia supernova sample for Twins Embedding spectrophotometric standardization

Aims. This paper has two aims: the first aim is to build a large homogeneous spectrophotometric sample of Type Ia supernovae (SNe Ia) from the second data release of the Zwicky Transient Facility (ZTF DR2). We used the spectrum sample from the low-resolution ( R ∼ 100) SEDmachine (SEDm) Integral Field Spectrograph (IFS) that gathered 3069 spectra. This is one of the largest samples of such collections that can attempt to reproduce the Twins Embedding (TE) spectrophotometric standardization method. This is our second objective. The method was developed based on high-quality spectra from 200 SNe Ia of the Nearby Supernova factory (SNfactory) and led to an exceptionally low value of 0.073 mag for the intrinsic scatter. Methods. As the SEDm is not designed as a spectrophotometric instrument, we first improved the flux-calibration accuracy of the SN Ia spectrum sample using the ZTF photometric data, which were calibrated at the percent level. We corrected the spectra for second-order polynomials, fitted by comparing the synthetic photometry in the ZTF g , r , i filters with the light-curve (LC) data. We then applied the three steps of the TE parameterization to a subset of 783 ZTF SN spectra near maximum light while comparing results from SNfactory and ZTF. We finally analyzed the standardization methods based on the TE parameters. Results. The precision of the phase-correction model, which is the first step of the TE, is estimated at 0.01 mag in g band based on ZTF data. Despite the challenge posed by the spectrum-extraction pipeline associated with the SEDm (flux calibration, leftover host signal, low signal-to-noise ratio, and low resolution), we applied a first standardization in color based on the second step of the TE, called read between the lines (RBTL), to the ZTF sample. We reached a Hubble residual scatter of 0.153 mag, all in normalized median absolute deviation, which is to be compared to the ∼0.11 mag obtained with the SNfactory data. The SALT color and stretch standardization reaches a scatter of 0.164 mag for the same ZTF SN Ia sample, and its host steps are ∼0.1 mag and zero for RBTL. When considering the scatter due to the redshift error and flux calibration error, we estimated a RBTL scatter of ∼0.129 mag for this ZTF sample as an upper limit because we identified an additional contribution from a systematic error in color. We tested the standardization based on the nonlinear TE parameters, and, as expected from the low spectrum quality, it did not improve the overall dispersion. Conclusions. We release 1897 flux calibrated spectra of 1607 SNe Ia with an estimated photometric accuracy of 0.07 mag. We further demonstrate that some amount of spectrophotometric SN Ia standardization can be done with limited-quality spectra. The RBTL standardization is more efficient than that of SALT with one parameter less, and the resulting host steps are consistent with zero. This makes it less prone to astrophysical bias. For future spectroscopic surveys, targeting the extraction pipeline for a thorough flux calibration and good signal-to-noise ratio would enable us to compute the full TE standardization, which would further reduce the scatter in the distance estimate.

Ganot, C↗
DOE OSTI2021

Mitigating baryonic effects with a theoretical error covariance

ABSTRACT One of the primary sources of uncertainties in modelling the cosmic-shear power spectrum on small scales is the effect of baryonic physics. Accurate cosmology for stage-IV surveys requires knowledge of the matter power spectrum deep in the non-linear regime at the per cent level. Therefore, it is important to develop reliable mitigation techniques to take into account baryonic uncertainties if information from small scales is to be considered in the cosmological analysis. In this work, we develop a new mitigation method for dealing with baryonic physics for the case of the shear angular power spectrum. The method is based on an augmented covariance matrix that incorporates baryonic uncertainties informed by hydrodynamical simulations. We use the results from 13 hydrodynamical simulations and the residual errors arising from a fit to a ΛCDM model using the extended halo model code HMCode to account for baryonic physics. These residual errors are used to model a so-called theoretical error covariance matrix that is added to the original covariance matrix. In order to assess the performance of the method, we use the 2D tomographic shear from four hydrodynamical simulations that have different extremes of baryonic parameters as mock data and run a likelihood analysis comparing the residual bias on Ωm and σ8 of our method and the HMCode for an LSST-like survey. We use different modelling of the theoretical error covariance matrix to test the robustness of the method. We show that it is possible to reduce the bias in the determination of the tested cosmological parameters at the price of a modest decrease in the precision.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Implementation of higher-order velocity mapping between marker particles and grid in the particle-in-cell code XGC

The global total-f gyrokinetic particle-in-cell code XGC, used to study transport in magnetic fusion plasmas or to couple with a core gyrokinetic code while functioning as an edge gyrokinetic code, implements a 5-dimensional (5D) continuum grid to perform the dissipative operations, such as plasma collisions, or to exchange the particle distribution function information with a core code. To transfer the distribution function between marker particles and a rectangular 2D velocity-space grid, XGC employs a bilinear mapping. The conservation of particle density and momentum is accurate enough in this bilinear operation, but the error in the particle energy conservation can become undesirably large and cause non-negligible numerical heating in a steep edge pedestal. In the present work we update XGC to use a novel mapping technique, based on the calculation of a pseudo-inverse, to exactly preserve moments up to the order of the discretization space. We describe the details of the implementation and we demonstrate the reduced interpolation error for a tokamak test plasma by using 1st- and 2nd-order elements with the pseudo-inverse method and comparing to the bilinear mapping.

Fusion Plasma↗
DOE OSTI2024

Transfer learning for metamaterial design and simulation

Abstract We demonstrate transfer learning as a tool to improve the efficacy of training deep learning models based on residual neural networks (ResNets). Specifically, we examine its use for study of multi-scale electrically large metasurface arrays under open boundary conditions in electromagnetic metamaterials. Our aim is to assess the efficiency of transfer learning across a range of problem domains that vary in their resemblance to the original base problem for which the ResNet model was initially trained. We use a quasi-analytical discrete dipole approximation (DDA) method to simulate electrically large metasurface arrays to obtain ground truth data for training and testing of our deep neural network. Our approach can save significant time for examining novel metasurface designs by harnessing the power of transfer learning, as it effectively mitigates the pervasive data bottleneck issue commonly encountered in deep learning. We demonstrate that for the best case when the transfer task is sufficiently similar to the target task, a new task can be effectively trained using only a few data points yet still achieve a test mean absolute relative error of 3 % with a pre-trained neural network, realizing data reduction by a factor of 1000.

Peng, Rixi↗
DOE OSTI2020

One-Step Ahead Prediction of Thermal Mixing Tee Sensors with Long Short Term Memory (LSTM) Neural Networks

High-temperature advanced reactors under development, such as sodium fast reactors (SFR) and molten salt cooled reactors (MSCR), are expected to offer lower levelized cost of energy (LCOE) compared to existing light water reactor (LWR’s). In the existing light water reactors (LWR’s), operation and maintenance (O&M) expenses constitute the largest fraction of the total operating cost. Some of the O&M costs are related maintenance of sensors which can fail due to exposure to harsh environment in a reactor. The O&M costs of Advanced Reactor (AR)’s are expected to constitute a significant fraction of the total cost as well, because of high temperature and radiation level in AR are likely to cause material fatigue and premature failure of sensors and components. The O&M costs in AR’s could be reduced through integration of advanced informatics of performance-related sensors into a digital twin designed for reactor monitoring. For example, machine learning (ML) could be employed for real-time validation and correction of performance-related sensors, and reducing the number of performance-related physical sensor units through virtual sensing. As part of the effort, we investigate real-time validation of thermal hydraulic sensors through one-step ahead forecasting of sensor values using long short-term memory (LSTM) recurrent neural networks (RNN). The sensors are installed in a flow loop containing a thermal mixing tee, which is a common experimental model to study thermal fatigue in a thermal hydraulic loop. In addition, nonlinear transients generated in a thermal mixing tee constitute a good challenge data set for training and validation of ML algorithms. Sensors in this study include thermocouples, flow meters, and optical fibers for distributed temperature sensing. In one experiment, measurement data sets were obtained for a loop was filled with water, and in another experiment, measurements were performed on a loop filled with liquid metal Galinstan. We have also conducted preliminary investigation of one-step ahead prediction of fiber optics-based distributed temperature sensing with LSTM networks. In predicting fiber-based temperature measurements, we treated each gauge pitch of the fiber as an independent sensor. Accuracy of one-step ahead forecasting was estimated by calculating root mean square error (RMSE) for the test segment of time series of each sensor. RMSE’s for temperature sensors in water loop were, for the most part, lower than for the same sensors in Galinstan loop. The RMSE’s for flow meters were similar for both loops. The RMSE’s for distributed temperature measured with the fiber optic sensor were similar to those of the point sensors. Results of this study demonstrated the capability of LSTM one-step ahead forecasting with RMSE comparable to uncertainty in sensor measurements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Monitoring of Temperature Measurements for Different Flow Regimes in Water and Galinstan with Long Short-Term Memory Networks and Transfer Learning of Sensors

Temperature sensing is one of the most common measurements of a nuclear reactor monitoring system. The coolant fluid flow in a reactor core depends on the reactor power state. We investigated the monitoring and estimation of the thermocouple time series using machine learning for a range of flow regimes. Measurement data were obtained, in two separate experiments, in a flow loop filled with water and with liquid metal Galinstan. We developed long short-term memory (LSTM) recurrent neural networks (RNNs) for sensor predictions by training on the sensor’s own prior history, and transfer learning LSTM (TL-LSTM) by training on a correlated sensor’s prior history. Sensor cross-correlations were identified by calculating the Pearson correlation coefficient of the time series. The accuracy of LSTM and TL-LSTM predictions of temperature was studied as a function of Reynolds number (Re). The root-mean-square error (RMSE) for the test segment of time series of each sensor was shown to linearly increase with Re for both water and Galinstan fluids. Using linear correlations, we estimated the range of values of Re for which RMSE is smaller than the thermocouple measurement uncertainty. For both water and Galinstan fluids, we showed that both LSTM and TL-LSTM provide reliable estimations of temperature for typical flow regimes in a nuclear reactor. The LSTM runtime was shown to be substantially smaller than the data acquisition rate, which allows for performing estimation and validation of sensor measurements in real time.

Pantopoulou, Stella↗
DOE OSTI2022

Numerical modeling based machine learning approach for the optimization of falling - film evaporator in thermal desalination application

Scale formation that drastically increases thermal resistance and reduces freshwater production remains a critical challenge in thermal desalination. Novel designs of falling film evaporator and optimal operating condition hold great promise to mitigate scale formation, and increase heat transfer performance and fresh water production. In this work, CFD simulation based machine learning and multi-objective optimization are performed to identify optimal conditions and tube arrangement for evaporator. Non-dominated sorting genetic algorithm is adopted to determine and analyze the optimal pareto front for multiple objectives in desalination criteria. The errors of training, validation, and testing set are computed to identify an optimal hyperparameter set. For performance ratio, fouling resistance, and water production rate, the average relative error is 2.26%, 3.67%, and 3.24%. At pareto front, both performance ratio and water production rate increase at high temperature with fouling resistance (thermal resistance of the fouling layer) increasing as well. Tradeoffs between mitigating scale formation and enhancing desalination performance are evaluated in optimizations for different objectives. Finally, potential optima are identified and can be applied as guidelines to determine evaporator design and system operating conditions.

42 ENGINEERING↗
DOE OSTI2025

Investigating lab-scaled offshore wind aerodynamic testing failure and developing solutions for early anomaly detections

As offshore wind systems become more complex, the risk of human error or equipment malfunction increases during experimental testing. This study investigates a lab-scale incident involving a 1 : 50 scale 5 MW wind turbine, where a generator failure led to rotor overspeed and a blade–tower strike. To improve early fault detection, we propose a data-driven method based on multivariate long short-term memory (LSTM) models. High-frequency measurements are projected onto principal components, and anomalies are identified using reconstruction error and its time derivative. Two models are trained on different healthy datasets and tested using single- and multi-principal component (1PC and MPC) variations. Results show that combining both error and error derivative improves detection accuracy. The 1PC model detects faults faster, has a higher recall rate, and achieves a 43 % improvement in anomaly detection accuracy, while the MPC model yields higher precision. This approach provides a simple and effective tool for early anomaly detection in lab-scale experiments, helping to reduce the risk of future failures during the testing of new technologies.

17 WIND ENERGY↗
DOE OSTI2024

Cholla-MHD: An Exascale-capable Magnetohydrodynamic Extension to the Cholla Astrophysical Simulation Code

Abstract We present an extension of the massively parallel, GPU native, astrophysical hydrodynamics code Cholla to magnetohydrodynamics (MHD). Cholla solves the ideal MHD equations in their Eulerian form on a static Cartesian mesh utilizing the Van Leer + constrained transport integrator, the HLLD Riemann solver, and reconstruction methods at second and third order. Cholla’s MHD module can perform ≈260 million cell updates per GPU-second on an NVIDIA A100 while using the HLLD Riemann solver and second order reconstruction. The inherently parallel nature of GPUs combined with increased memory in new hardware allows Cholla’s MHD module to perform simulations with resolutions ∼500 3 cells on a single high-end GPU (e.g., an NVIDIA A100 with 80 GB of memory). We employ GPU direct Message Passing Interface to attain excellent weak scaling on the exascale supercomputer Frontier, while using 74,088 GPUs and simulating a total grid size of over 7.2 trillion cells. A suite of test problems highlights the accuracy of Cholla’s MHD module and demonstrates that zero magnetic divergence in solutions is maintained to round off error. We also present new testing and CI tools using GoogleTest, GitHub Actions, and Jenkins that have made development more robust and accurate and ensure reliability in the future.

Astronomy & Astrophysics↗
DOE OSTI2023

Noise analysis for the Sorkin and Peres tests performed on a quantum computer

We use quantum computers to test the foundations of quantum mechanics through quantum algorithms that implement some of the experimental tests as the basis of the theory's postulates. These algorithms can be used as a test of the physical theory under the premise of a perfect hardware or as a test of the hardware under the premise that quantum theory is correct. In this paper, we show how the algorithms can be used to test the efficacy of a quantum computer in obeying the postulates of quantum mechanics. We study the effect of different types of errors on the results of experimental tests of the postulates. A salient feature of this error analysis is that it is deeply rooted in the fundamentals of quantum mechanics as it highlights how systematic errors affect the quantumness of the quantum computer.

Sadana, Simanraj↗
DOE OSTI2020

Prediction of Research/Motor Octane Number and Octane Sensitivity Using Artificial Neural Networks

Octane sensitivity (OS), dfined as the research octane number (RON) minus the motor octane number (MON) of a given fuel, has gained interest among researchers due to its apparent ffect on knocking conditions in internal combustion engines. Compounds with a high OS enable higher efficiencies, especially with respect to advanced compression ignition engines. RON/MON must be experimentally tested to determine OS; however, the experimental methods utilized require a substantial amount of time, a significant monetary investment, and specialized equipment. To this end, predictive computational models trained with existing experimental data and molecular properties would allow for the preemptive screening of compounds prior to performing these experiments. The present work proposes two methods for predicting the OS of a given compound: using artficial neural networks (ANNs) trained with quantitative structure-property relationship (QSPR) descriptors to predict RON and MON individually to compute OS from RON/MON predictions (derived octane sensitivity, dOS), and using an ANN trained with QSPR descriptors to directly predict OS. ANNs trained to predict RON and MON achieved test set root-mean-square errors (RMSEs) of 10.499 and 7.551 respectively. dOS calculations were found to have a test set RMSE of 6.432 while predicting OS directly resulted in a test set RMSE of 7.019, showing it is more bene cial to obtain OS from RON/MON predictions than predicting it directly. Furthermore, relationships between individual QSPR descriptors and RON/MON/OS are discussed, highlighting correlations between specfic molecular features and these properties.

09 BIOMASS FUELS↗
DOE OSTI2020

Design of BLDC Motor Diagnostic Device Based on Surge Test for Phase to Ground Fault

BLDC motor is essential in the industrial world, especially it been used for an electric vehicle. The benefit of using BLDC motor is that it has high rate efficiency and low mechanical losses. However, to know the isolation condition of winding and increase reliability, it needs to be tested. With the implementation of surge test based fault detection device of BLDC motor, the condition of BLDC motor can be monitored and maintained according to analysis of its condition. The surge test method used because it is sensitive in detecting the initial damage in the isolation failure process on stator winding. A surge voltage is generated from the Cockroft-Walton and switching circuit with capacitors. The result is analyzed using Error Area Ratio (EAR). The test result shows that the higher the value of resistance and inductance, the smaller the frequency of the surge wave. When the BLDC motor in a parallel short circuit condition, the threshold value of the EAR test-reff has a minimum value of 5.28%, an average of 13.52%, and a maximum of 28.55%.

BLDC motor↗
DOE OSTI2021

Verification Testing For Solid-Element Material Models 11-19 in DYNA3D/ParaDyn

This technical report documents the creation and implementation of verification tests for solid-element material models 11 through 19 available in DYNA3D/ParaDyn. The verification tests covered all aspects of each material model, except for the Weibull distribution functionality in material models 15 and 19. General test cases were created to verify the elastic and plastic behavior of the material models. Other additional tests were developed to examine the intricacies of each material model. Each test involved the use a kinematic load case and specification of material parameters necessary to activate corresponding features of the material model. The load cases prescribed the full time history of the kinematic motion for the solid elements, and these loads are independent of the material model or element formulation. When possible, closed form solutions were then derived for each verification test in a continuum setting. The DYNA3D simulations for each test were carried out over a unit time interval, t ϵ [0, 1], and the as implemented DYNA3D response was compared to the closed form solutions evaluated at discrete points in time. A relative error measure was determined for each test to justify the proper implementation of the material model. The relative errors comparing the DYNA3D solution to the analytical solution were, in general, on the order of machine precision except where noted. This signifies the proper implementation of solid-element material models 11-19. In the development of these verification tests, six bugs were found and fixed in the source code. Additionally, this work generated eighteen DYNA3D input decks and answer extraction scripts in the DYNA3D/ParaDyn Software Quality Assurance test suite, which are comprised of a total of 285 solid-element tests. Testing for each material model utilizes two input decks and answer extraction scripts, where one focuses on the linear elastic response and the other examines the inelastic and remaining functionalities of the material model. In total, this work added 285 individual verification test problems in the DYNA3D/ParaDyn test suite.

42 ENGINEERING↗