Search NASA⌕ Search

SEARCH · Search NASA

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Experimental study of error sources in skin-friction balance measurements

An experimental study has been performed to determine potential error sources in skin-friction balance measurements. A floating-element balance, large enough to contain the instrumentation needed to systematically investigate these error sources has been constructed and tested in the thick turbulent boundary layer on the sidewall of a large supersonic wind tunnel. Test variables include element-to-case misalignment, gap size, and Reynolds number. The effects of these variables on the friction, lip, and normal forces have been analyzed. It was found that larger gap sizes were preferable to smaller ones; that small element recession below the surrounding test surface produced errors comparable to the same amount of protrusion above the test surface; and that normal forces on the element were, in some cases, large compared to the friction force.

Allen, J. M.↗

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗

Control structural interaction testbed: A model for multiple flexible body verification

Conventional end-to-end ground tests for verification of control system performance become increasingly complicated with the development of large, multiple flexible body spacecraft structures. The expense of accurately reproducing the on-orbit dynamic environment and the attendant difficulties in reducing and accounting for ground test effects limits the value of these tests. TRW has developed a building block approach whereby a combination of analysis, simulation, and test has replaced end-to-end performance verification by ground test. Tests are performed at the component, subsystem, and system level on engineering testbeds. These tests are aimed at authenticating models to be used in end-to-end performance verification simulations: component and subassembly engineering tests and analyses establish models and critical parameters, unit level engineering and acceptance tests refine models, and subsystem level tests confirm the models' overall behavior. The Precision Control of Agile Spacecraft (PCAS) project has developed a control structural interaction testbed with a multibody flexible structure to investigate new methods of precision control. This testbed is a model for TRW's approach to verifying control system performance. This approach has several advantages: (1) no allocation for test measurement errors is required, increasing flight hardware design allocations; (2) the approach permits greater latitude in investigating off-nominal conditions and parametric sensitivities; and (3) the simulation approach is cost effective, because the investment is in understanding the root behavior of the flight hardware and not in the ground test equipment and environment.

Chory, M. A.↗

A Visual Comparison of Silent Error Propagation

High-performance computing (HPC) systems play a critical role in facilitating scientific discoveries. Their scale and complexity (e.g., the number of computational units and software stack) continue to grow as new systems are expected to process increasingly more data and reduce computing time. However, with more processing elements, the probability that these systems will experience a random bit-flip error that corrupts a program's output also increases, which is often recognized as silent data corruption. Analyzing the resiliency of HPC applications in extreme-scale computing to silent data corruption is crucial but difficult. An HPC application often contains a large number of computation units that need to be tested, and error propagation caused by error corruption is complex and difficult to interpret. Here, to accommodate this challenge, we propose an interactive visualization system that helps HPC researchers understand the resiliency of HPC applications and compare their error propagation. Our system models an application's error propagation to study a program's resiliency by constructing and visualizing its fault tolerance boundary. Coordinating with multiple interactive designs, our system enables domain experts to efficiently explore the complicated spatial and temporal correlation between error propagations. At the end, the system integrated a nonmonotonic error propagation analysis with an adjustable graph propagation visualization to help domain experts examine the details of error propagation and answer such questions as why an error is mitigated or amplified by program execution.

97 MATHEMATICS AND COMPUTING↗

Effect of spark-timing regularity on the knock of engine performance

Tests on a high-speed single-cylinder engine are described. The regularity of the spark timing was varied by driving the timer from different engine shafts. A simple and reasonably accurate method of determining the spark timing is described. The results show that irregular spark timing may cause large errors in tests of the knocking properties of fuels. For the engine tested, it was found that a change of one crankshaft degree in spark restart was equivalent to an 0.85 inch Hg change in allowable inlet pressure.

Biermann, Arnold E↗

Behavior and mechanisms of Doppler wind lidar error in varying stability regimes

Abstract. Wind lidars are widespread and important tools in atmospheric observations. An intrinsic part of lidar measurement error is due to atmospheric variability in the remote-sensing scan volume. This study describes and quantifies the distribution of measurement error due to turbulence in varying atmospheric stability. While the lidar error model is general, we demonstrate the approach using large ensembles of virtual WindCube V2 lidar performing a profiling Doppler-beam-swinging scan in quasi-stationary large-eddy simulations (LESs) of convective and stable boundary layers. Error trends vary with the stability regime, time averaging of results, and observation height. A systematic analysis of the observation error explains dominant mechanisms and supports the findings of the empirical results. Treating the error under a random variable framework allows for informed predictions about the effect of different configurations or conditions on lidar performance. Convective conditions are most prone to large errors (up to 1.5 m s−1 in 1 Hz wind speed in strong convection), driven by the large vertical velocity variances in convective conditions and the high elevation angle of the scanning beams (62∘). Range-gate weighting induces a negative bias into the horizontal wind speeds near the surface shear layer (−0.2 m s−1 in the stable test case). Errors in the horizontal wind speed and direction computed from the wind components are sensitive to the background wind speed but have negligible dependence on the relative orientation of the instrument. Especially during low winds and in the presence of large errors in the horizontal velocity estimates, the reported wind speed is subject to a systematic positive bias (up to 0.4 m s−1 in 1 Hz measurements in strong convection). Vector time-averaged measurements can improve the behavior of the error distributions (reducing the 10 min wind speed error standard deviation to <0.3 m s−1 and the bias to <0.1 m s−1 in strong convection) with a predictable effectiveness related to the number of decorrelated samples in the time window. Hybrid schemes weighting the 10 min scalar- and vector-averaged lidar measurements are shown to be effective at reducing the wind speed biases compared to cup measurements in most of the simulated conditions, with time averages longer than 10 min recommended for best use in some unstable conditions. The approach in decomposing the error mechanisms with the help of the LES flow field could be extended to more complex measurement scenarios and scans.

17 WIND ENERGY↗

A Logarithmic Bayesian Approach to Quantum Error Detection

We consider the problem of continuous quantum error correction from a Bayesian perspective, proposing a pair of digital filters using logarithmic probabilities that are able to achieve near-optimal performance on a three-qubit bit-flip code, while still being reasonable to implement on low-latency hardware. These practical filters are approximations of an optimal filter that we derive explicitly for finite time steps, in contrast with previous work that has relied on stochastic differential equations such as the Wonham filter. By utilizing logarithmic probabilities, we are able to eliminate the need for explicit normalization and can reduce the Gaussian noise distribution to a simple quadratic expression. The state transitions induced by the bit-flip errors are modeled using a Markov chain, which for log-probabilities must be evaluated using a LogSumExp function. We develop the two versions of our filter by constraining this LogSumExp to have either one or two inputs, which favors either simplicity or accuracy, respectively. Using simulated data, we demonstrate that the single-term and two-term filters are able to significantly outperform both a double threshold scheme and a linearized version of the Wonham filter in tests of error detection under a wide variety of error rates and time steps.

97 MATHEMATICS AND COMPUTING↗

A data-driven approach to real-time vertical position estimation for NSTX-U vertical stability control

In this paper, a database of 77 996 plasma equilibrium reconstructions from 727 discharges during the initial operation of the NSTX-U spherical tokamak is analyzed to develop a statistically robust model of the plasma vertical position for real-time control. A variety of regression models are developed and tested, ranging in complexity from linear models to deep neural networks, and including input signals ranging from the four pairs of flux loops used historically on NSTX-U up to the full set of 389 real-time signals available to the plasma control system. A linear model based on 140 real-time magnetics signals is found to offer excellent accuracy, with a coefficient of determination R 2 = 0.906. The robustness of this model to limited training data, new operating scenarios, and signal errors is tested, and a procedure is demonstrated to tune the model parameters to optimize its robustness. A time-dependent plasma equilibrium solver, TokaMaker, is used to simulate vertical stability control in NSTX-U, demonstrating that it should be possible to iteratively tune the parameters of a linear vertical position model to stabilize both positive and negative triangularity plasmas in future experiments.

magnetic diagnostics↗

SEU System Analysis: Not Just the Sum of All Parts

Single event upset (SEU) analysis of complex systems is challenging. Currently, system SEU analysis is performed by component level partitioning and then either: the most dominant SEU cross-sections (SEUs) are used in system error rate calculations; or the partition SEUs are summed to eventually obtain a system error rate. In many cases, system error rates are overestimated because these methods generally overlook system level derating factors. The problem with overestimating is that it can cause overdesign and consequently negatively affect the following: cost, schedule, functionality, and validation/verification. The scope of this presentation is to discuss the risks involved with our current scheme of SEU analysis for complex systems; and to provide alternative methods for improvement.

Single Event Upset (SEU) Testing↗

Measuring He i Stark Line Shapes in the Laboratory to Examine Differences in Photometric and Spectroscopic DB White Dwarf Masses

Abstract Accurate helium White Dwarf (DB) masses are critical for understanding the star’s evolution. DB masses derived from the spectroscopic and photometric methods are inconsistent. Photometric masses agree better with currently accepted DB evolutionary theories and are mostly consistent across a large range of surface temperatures. Spectroscopic masses rely on untested He i Stark line-shape and Van der Waals broadening predictions, show unexpected surface temperature trends, and are thus viewed as less reliable. To test this conclusion, we present in this paper detailed He i Stark line-shape measurements at conditions relevant to DB atmospheres ( T electron ≈12,000–17,000 K, n electron ≈ 10 17 cm −3 ). We use X-rays from Sandia National Laboratories’ Z -machine to create a uniform ≈120 mm long hydrogen–helium mixture plasma. Van der Waals broadening is negligible at our experimental conditions, allowing us to measure He i Stark profiles only. H β , which has been well-studied in our platform and elsewhere, serves as the n e diagnostic. We find that He i Stark broadening models used in DB analyses are accurate within errors at tested conditions. It therefore seems unlikely that line-shape models are solely responsible for the observed spectroscopic mass trends. Our results should motivate the WD community to further scrutinize the validity of other spectroscopic and photometric input parameters, like atmospheric structure assumptions and convection corrections. These parameters can significantly change the derived DB mass. Identifying potential weaknesses in any input parameters could further our understanding of DBs, help elucidate their evolutionary origins, and strengthen confidence in both spectroscopic and photometric masses.

Schaeuble, M. -A. (ORCID:0000000188695203)↗

Determining Aircraft Moments of Inertia from Flight Test Data

Flight test maneuver design and dynamic modeling techniques were developed for determining aircraft moments of inertia from flight test data. Full nonlinear rigid-body rotational equations of motion were used in the analysis, with aerodynamic moment dependencies modeled by linear expansions in the aircraft states and controls. Aerodynamic parameters were estimated simultaneously with inertia parameters using equation-error modeling applied to flight test data from maneuvers designed specifically for this problem. The approach was demonstrated using a nonlinear F-16 simulation, then applied to a remotely-piloted subscale aircraft flight test. Errors in the aircraft moment of inertia parameters determined from simulated F-16 flight test maneuver data were less than 6 percent compared to the true values in the simulation. Flight test results for the subscale aircraft were within 6 percent of ground-test values obtained using the same aircraft.

moments of inertia↗

Computer-aided Veress needle guidance using endoscopic optical coherence tomography and convolutional neural networks

During laparoscopic surgery, the Veress needle is commonly used in pneumoperitoneum establishment. Precise placement of the Veress needle is still a challenge for the surgeon. In this study, a computer-aided endoscopic optical coherence tomography (OCT) system was developed to effectively and safely guide Veress needle insertion. This endoscopic system was tested by imaging subcutaneous fat, muscle, abdominal space, and the small intestine from swine samples to simulate the surgical process, including the situation with small intestine injury. Each tissue layer was visualized in OCT images with unique features and subsequently used to develop a system for automatic localization of the Veress needle tip by identifying tissue layers (or spaces) and estimating the needle-to-tissue distance. We used convolutional neural networks (CNNs) in automatic tissue classification and distance estimation. In conclusion, the average testing accuracy in tissue classification was 98.53 ± 0.39%, and the average testing relative error in distance estimation reached 4.42 ± 0.56% (36.09 ± 4.92 μm).

59 BASIC BIOLOGICAL SCIENCES↗

Physics-informed State-space Neural Networks for transport phenomena

This work introduces Physics -informed State -space neural network Models (PSMs), a novel solution to achieving real-time optimization, flexibility, and fault tolerance in autonomous systems, particularly in transportdominated systems such as chemical, biomedical, and power plants. Traditional data -driven methods fall short due to a lack of physical constraints like mass conservation; PSMs address this issue by training deep neural networks with sensor data and physics -informing using components' Partial Differential Equations (PDEs), resulting in a physics -constrained, end -to -end differentiable forward dynamics model. Further, through two in silico experiments - a heated channel and a cooling system loop - we demonstrate that PSMs offer a more accurate approach than a purely data -driven model. In the former experiment, PSMs demonstrated significantly lower average root -mean -square errors across test datasets compared to a purely data -driven neural network, with reductions of 44 %, 48 %, and 94 % in predicting pressure, velocity, and temperature, respectively. Beyond accuracy, PSMs demonstrate a compelling multitask capability, making them highly versatile. In this work, we showcase two: supervisory control of a nonlinear system through a sequentially updated state -space representation and the proposal of a diagnostic algorithm using residuals from each of the PDEs. The former demonstrates PSMs' ability to handle constant and time -dependent constraints, while the latter illustrates their value in system diagnostics and fault detection.

42 ENGINEERING↗

Inversion-based correction of Double-Torsion (DT) subcritical crack growth tests for crack profile geometry

Because of its simplicity and the ability to produce a stable, slow-propagating crack, the Double-Torsion (DT) method has been used widely for investigating the critical and subcritical propagation of a slow-propagating tensile (mode-I) crack. However, to determine the complex relationship between the crack velocity $\mathcal{v_c}$ vs. the strain energy release rate $\mathscr{G}$ (or the stress intensity factor K) from laboratory measurements, several corrections must be made to account for the impact of sample and crack geometry. Particularly, DT test typically produces a crack with a curved edge profile instead of a straight line, causing the local $\mathcal{v_c}$ and $\mathscr{G}$ vary along the crack front. The experimentally measured $\mathcal{v_c}$ and $\mathscr{G}$ data merely reflect collective, averaged behavior of the crack. This makes inversion for the intrinsic, “true” crack growth kinetics necessary, based upon the knowledge of the crack geometry. Simple and effective correction methods have been proposed and validated for the slow, chemical-reaction-controlled part (Region I) of the $\mathcal{v_c}$-$\mathscr{G}$ curve. However, reliable methods for the highly nonlinear, transport-dominated part (Region II) and its sudden transition to the dynamic propagation part (Region III) are still lacking. Here we propose a method for determining the intrinsic $\mathcal{v_c}$-$\mathscr{G}$ relationship across all three Regions based upon DT test data, using a simple model function and its numerical inversion. The performance of this approach is examined and demonstrated using both synthetic and laboratory data for subcritical crack growth in soda lime glass.

42 ENGINEERING↗

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

Model ensembles are effective tools for estimating prediction uncertainty in deep learning atomistic force fields. However, their widespread adoption is hindered by high computational costs and overconfident error estimates. In this work, we address these challenges by leveraging distributions of per-sample errors obtained during training and employing a distance-based similarity search in the model latent space. Our method, which we call LTAU (Loss Trajectory Analysis for Uncertainty), efficiently estimates the full probability distribution function of errors for any test point using the logged training errors, achieving speeds that are 2–3 orders of magnitudes faster than typical ensemble methods and allowing it to be used for tasks where training or evaluating multiple models would be infeasible. We apply LTAU towards estimating parametric uncertainty in atomistic force fields (LTAU-FF), demonstrating that it produces well-calibrated confidence intervals and predicts errors that correlate strongly with the true errors for data near the training domain. Furthermore, we show that the errors predicted by LTAU-FF can be used in practical applications for detecting out-of-domain data, tuning model performance, and predicting failure during simulations. We believe that LTAU will be a valuable tool for uncertainty quantification in atomistic force fields and is a promising method that should be further explored in other domains of machine learning.

97 MATHEMATICS AND COMPUTING↗