Search NASA⌕ Search

SEARCH · Search NASA

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

ARETE: Accurate Error Assessment via Machine Learning-Guided Dynamic-Timing Analysis

Nanometer circuits are increasingly prone to timing errors, escalating the need for fault injection frameworks to accurately evaluate their impact on applications. Here in this paper, we propose ARETE, a novel cross-layer, fault-injection framework that combines dynamic-binary instrumentation with machine learning-guided dynamic-timing analysis. ARETE enables accurate fault-injection into any application by estimating the location of the injecting errors via dynamic-timing analysis. To accelerate fault-injection, we develop a novel, data-aware, machine learning-based mechanism that dynamically pre-selects the error-prone instructions and limits the application of the costly dynamic-timing analysis only to them. To evaluate ARETE's accuracy, our fully automated toolflow is configured to support fault-injection based on detailed post-layout gate-level simulations as well as via existing workload-agnostic error models. Our results for various workloads, including an autonomous-driving library, show that the location and time of injected errors performed by ARETE, is 89.9% consistent with fault-injection based on full gate-level simulation. On average, ARETE executes 84.6x faster than gate-level simulation and at a cost of 3.4% loss in the program output quality estimation. When compared to the existing statistical fault-injection tools that are based on workload-agnostic error models, ARETE improves the accuracy of fault-injection rate and output quality estimation by 143.9% and 40.4% on average, respectively.

97 MATHEMATICS AND COMPUTING↗

Monitoring Noble Gases (Xe and Kr) and Aerosols (Cs and Rb) in a Molten Salt Reactor Surrogate Off-Gas Stream Using Laser-Induced Breakdown Spectroscopy (LIBS)

In this study with surrogate materials we show that laser-induced breakdown spectroscopy (LIBS) is a robust tool with promising capability toward monitoring gaseous (Xe and Kr) and aerosol (Cs and Rb) species in an off-gas stream from a molten salt reactor (MSR). MSRs will continually evolve fission products into the cover gas flowing across the reactor headspace. The cover gas entrains Xe and Kr gases, along with aerosol particles, before passing into an off-gas treatment system. Univariate models of Xe and Kr peaks showed a strong correlation to concentration indicated by their coefficients of determination of 0.983 and 0.997, respectively. Multivariate models were built for all four analytes using partial least squares regression coupled with preprocessing steps including normalization, trimming, and/or genetic algorithm derived filters. The models were evaluated by predicting the concentrations of the analytes in four validation samples, in which all calibration models were successfully validated at a confidence interval of 99.9%. Finally, pressure controllers were used to regulate the mass flow rate of Kr flowing into the measurement cell in sinusoidal and stepwise waveforms to test the real-time monitoring capabilities of the regression models. Both univariate and partial least squares Kr models were able to successfully quantify the gas concentration in the real-time evaluation. The root mean squared error of prediction (RMSEP) values for these real-time tests were calculated to be 0.051, 0.060, and 0.121 mol% demonstrating the measurement systems’ capability to perform online monitoring with acceptable accuracy.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

WE-AB-BRA-04: Evaluation of the Tumor Registration Error in Biopsy Procedures Performed Under Real Time PET/CT Guidance

Purpose: PET/CT guidance is used for biopsies of metabolically active lesions, which are not well seen on CT alone or to target the metabolically active tissue in tumor ablations. It has also been shown that PET/CT guided biopsies provide an opportunity to verify the location of the lesion border at the place of needle insertion. However the error in needle placement with respect to the metabolically active region may be affected by motion between the PET/CT scan performed at the start of the procedure and the CT scan performed with the needle in place and this error has not been previously quantified. Methods: Specimens from 31 PET/CT guided biopsies were investigated and correlated to the intraoperative PET scan under an IRB approved HIPAA compliant protocol. For 4 of the cases in which larger motion was suspected a second PET scan was obtained with the needle in place. The CT and the PET images obtained before and after the needle insertion were used to calculate the displacement of the voxels along the needle path. CTpost was registered to CTpre using a free form deformable registration and then fused with PETpre. The shifts between the PET image contours (42% of SUVmax) for PETpre and PETpost were obtained at the needle position. Results: For these extreme cases the displacement of the CT voxels along the needle path ranged from 2.9 to 8 mm with a mean of 5 mm. The shift of the PET image segmentation contours (42% of SUVmax) at the needle position ranged from 2.3 to 7 mm between the two scans. Conclusion: Evaluation of the mis-registration between the CT with the needle in place and the pre-biopsy PET can be obtained using deformable registration of the respective CT scans and can be used to indicate the need of a second PET in real-time. This work is supported in part by a grant from Biospace Lab, S.A.

60 APPLIED LIFE SCIENCES↗

Accuracy assessment system and operation

The accuracy and reliability of LACIE estimates of wheat production, area, and yield is determined at regular intervals throughout the year by the accuracy assessment subsystem which also investigates the various LACIE error sources, quantifies the errors, and relates then to their causes. Timely feedback of these error evaluations to the LACIE project was the only mechanism by which improvements in the crop estimation system could be made during the short 3 year experiment.

Pitts, D. E.↗

Application of Consider Covariance to the Extended Kalman Filter

The extended Kalman filter (EKF) is the basis for many applications of filtering theory to real-time problems where estimates of the state of a dynamical system are to be computed based upon some set of observations. The form of the EKF may vary somewhat from one application to another, but the fundamental principles are typically unchanged among these various applications. As is the case in many filtering applications, models of the dynamical system (differential equations describing the state variables) and models of the relationship between the observations and the state variables are created. These models typically employ a set of constants whose values are established my means of theory or experimental procedure. Since the estimates of the state are formed assuming that the models are perfect, any modeling errors will affect the accuracy of the computed estimates. Note that the modeling errors may be errors of commission (errors in terms included in the model) or omission (errors in terms excluded from the model). Consequently, it becomes imperative when evaluating the performance of real-time filters to evaluate the effect of modeling errors on the estimates of the state.

Lundberg, John B.↗

Predicting the von Neumann entanglement entropy using a graph neural network

Calculating the von Neumann entanglement entropy from experimental data is challenging due to its dependence on the complete wavefunction, forcing reliance on approximations such as classical mutual information (MI). We propose a machine learning approach using a graph neural network to predict the von Neumann entropy directly from experimentally accessible bitstrings. We test this approach on a Rydberg ladder system and achieve a mean absolute error of $3.6\,\times 10^{-3}$ when evaluating within the training range on a dataset with entropy values ranging from 0 to 1.9. The model achieves a mean absolute percentage error of 1.44% and outperforms MI-based bounds. When tested beyond the training range, the model maintains reasonable accuracy. Furthermore, we demonstrate that fine-tuning the model with small datasets significantly improves performance on data outside the original training range.

graph neural networks↗

Using Neural Network Force Fields to Ascertain the Quality of Ab Initio Simulations of Liquid Water

Accurately simulating the properties of bulk water, despite the apparent simplicity of the molecule, is still a challenge. In order to fully understand and reproduce its complex phase diagram, it is necessary to perform simulations at the ab initio level, including quantum mechanical effects both for electrons and nuclei. This comes at a high computational cost, given that the structural and dynamical properties tend to require long timescales and large simulation cells. In this work, we evaluate the errors that density functional theory (DFT)-based simulations routinely incur into due time- and size-scale limitations. These errors are evaluated using neural-network-trained force fields that are accurate at the level of DFT methods. We compare different exchange and correlation potentials for properties of bulk water that require large timescales. Here we show that structural properties are less dependent on the system size and that dynamical properties such as the diffusion coefficient have a strong dependence on the simulation size and timescale. Our results facilitate comparisons of DFT-based simulation results with experiments and offer a path to discriminate between model and convergence errors in these simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stochastic goal-oriented error estimation with memory

We propose a stochastic dual-weighted error estimator for the viscous shallow-water equation with boundaries. For this purpose, previous work on memory-less stochastic dual-weighted error estimation is extended by incorporating memory effects. The memory is introduced by describing the local truncation error as a sum of time-correlated random variables. The random variables itself represent the temporal fluctuations in local truncation errors and are estimated from high-resolution information at near-initial times. The resulting error estimator is evaluated experimentally in two classical ocean-type experiments, the Munk gyre and the flow around an island. In these experiments, the stochastic process is adapted locally to the respective dynamical flow regime. Our stochastic dual-weighted error estimator is shown to provide meaningful error bounds for a range of physically relevant goals. We prove, as well as show numerically, that our approach can be interpreted as a linearized stochastic-physics ensemble.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Temporal Decompostion of a Distribution System Quasi-Static Time-Series Simulation

This paper documents the first phase of an investigation into reducing runtimes of complex OpenDSS models through parallelization. As the method seems promising, future work will quantify - and further mitigate - errors arising from this process. In this initial report, we demonstrate how, through the use of temporal decomposition, the run times of a complex distribution-system-level quasi-static time series simulation can be reduced roughly proportional to the level of parallelization. Using this method, the monolithic model runtime of 51 hours was reduced to a minimum of about 90 minutes. As expected, this comes at the expense of control- and voltage-errors at the time-slice boundaries. All evaluations were performed using a real distribution circuit model with the addition of 50 PV systems - representing a mock complex PV impact study. We are able to reduce induced transition errors through the addition of controls initialization, though small errors persist. The time savings with parallelization are so significant that we feel additional investigation to reduce control errors is warranted.

14 SOLAR ENERGY↗

SU-G-JeP4-07: Evaluation of Intrafraction Motion Using 3D Surface Guided Radiation Therapy in Lung SBRT

Purpose: Surface guided radiation therapy (SGRT) uses stereoscopic video images in combination with patterns projected onto the patient’s surface to dynamically capture and reconstruct a 3D surface map. In this work, we used a C-RAD Catalyst HD system (C-RAD) to evaluate intrafraction motion in the delivery of lung SBRT. Methods: The surface acquired from the 4DCT images from our preliminary cohort of eight lung cancer patients treated with SBRT were matched to the surface images acquired prior to each treatment. Additionally, a CBCT image set was acquired. A linear regression model was established between the external and internal motion of tumor during pretreatment and used to predict the CBCT deviation during treatment. The shifts determined from CBCT and the shifts from surface map imaging were compared and assessed using Bland-Altman method. For intrafraction motion, we assessed the percentage of mean errors that fell outside of the threshold of 2 mm, 3 mm, and 5 mm along the translational directions. The required PTV margin was quantified over the course of treatment. The correlation between intrafraction treatment time and mean error of 3D displacement was evaluated using the Pearson coefficient, r Results: A total of 7971 data points were analyzed. Deviations of 2mm, 3mm, and 5mm were observed less than 7%, 2 %, and 0 % of the time along the translational direction. CBCT and Catalyst showed close agreement during patient positioning. Furthermore, the calculated PTV margins were less than our clinical tolerance of 5 mm. Using the Pearson coefficient r,the mean error of 3D displacement showed significant correlation with treatment time (r=0.69, p= 0.000002). Conclusion: SGRT can be used to ensure accurate patient positioning during treatment without an additional delivery of dose to the patient. This study shows that importance of treatment time as a consideration during the treatment planning process.

60 APPLIED LIFE SCIENCES↗

Scalable Prediction of Energy Consumption using Incremental Time Series Clustering

Time series datasets are a canonical form of high velocity Big Data, and often generated by pervasive sensors, such as found in smart infrastructure. Performing predictive analytics on time series data can be computationally complex, and requires approximation techniques. In this paper, we motivate this problem using a real application from the smart grid domain. We propose an incremental clustering technique, along with a novel affinity score for determining cluster similarity, which help reduce the prediction error for cumulative time series within a cluster. We evaluate this technique, along with optimizations, using real datasets from smart meters, totaling ~700,000 data points, and show the efficacy of our techniques in improving the prediction error of time series data within polynomial time.

Simmhan, Yogesh↗

Numerical coupling of aerosol emissions, dry removal, and turbulent mixing in the E3SM Atmosphere Model version 1 (EAMv1) – Part 2: A semi-discrete error analysis framework for assessing coupling schemes

Abstract. Part 1 (Wan et al., 2024) of this study discusses the motivation and empirical evaluation of a revision to the aerosol-related numerical process coupling in the atmosphere component of the Energy Exascale Earth System Model version 1 (EAMv1) to address the previously reported issue of strong sensitivity of the simulated dust aerosol lifetime and dry removal rate to the model's vertical resolution. This paper complements that empirical justification of the revised scheme with a mathematical justification leveraging a semi-discrete analysis framework for assessing the splitting error of process coupling methods. The framework distinguishes the error due to numerical splitting from the error due to the time integration method(s) used for each individual process. Such a distinction results in a framework that provides an intuitive understanding of the causes of the splitting error. The application of this framework to the dust life cycle in EAMv1 confirms (i) that the original EAMv1 scheme artificially strengthens the effect of dry removal processes and (ii) that the revised splitting reduces that artificial strengthening. While the error analysis framework is presented in the context of the dust life cycle in EAMv1, the framework can be broadly leveraged to evaluate process coupling schemes, both in other physical problems and for any number of processes. This framework will be particularly powerful when the various process implementations support a variety of time integration approaches. Whereas traditional local truncation error approaches require separate consideration of each combination of time integration methods, this framework enables evaluation of coupling schemes independent of particular time integration approaches for each process while still allowing for the incorporation of these specific time integration errors if so desired. The framework also explains how the splitting error terms result from (i) the integration of individual processes in isolation from other processes and (ii) the choices of input state and time step size for the isolated integration of processes. Such a perspective has the potential for the rapid development of alternative coupling approaches that utilize knowledge both about the desired accuracy and about the computational costs of individual processes.

58 GEOSCIENCES↗

Robust analysis of trends in noisy tokamak confinement data using geodesic least squares regression

Regression analysis is a very common activity in fusion science for unveiling trends and parametric dependencies, but it can be a difficult matter. We have recently developed the method of geodesic least squares (GLS) regression that is able to handle errors in all variables, is robust against data outliers and uncertainty in the regression model, and can be used with arbitrary distribution models and regression functions. We here report on first results of application of GLS to estimation of the multi-machine scaling law for the energy confinement time in tokamaks, demonstrating improved consistency of the GLS results compared to standard least squares.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Arrival time of satellite-broadened laser pulses

A method for measuring the time of arrival of very narrow laser pulses which have been reflected and randomly broadened by a target is examined. It is known that these return pulses from the target have very small rise times. A threshold detection algorithm that detects the rising edge of the pulse is used for obtaining the pulse arrival times. The errors of the scheme are evaluated numerically for different pulse shapes, and a loose bound on the errors of detecting a typical pulse is obtained. A gamma-density model is used to characterize the random gain processes of the optical receiver, and the effect of such random gains on the errors of threshold detection is analyzed.

Iyer, R. S.↗

Development of display design and command usage guidelines for Spacelab experiment computer applications

Individual Spacelab experiments are responsible for developing their CRT display formats and interactive command scenarios for payload crew monitoring and control of experiment operations via the Spacelab Data Display System (DDS). In order to enhance crew training and flight operations, it was important to establish some standardization of the crew/experiment interface among different experiments by providing standard methods and techniques for data presentation and experiment commanding via the DDS. In order to establish optimum usage guidelines for the Spacelab DDS, the capabilities and limitations of the hardware and Experiment Computer Operating System design had to be considered. Since the operating system software and hardware design had already been established, the Display and Command Usage Guidelines were constrained to the capabilities of the existing system design. Empirical evaluations were conducted on a DDS simulator to determine optimum operator/system interface utilization of the system capabilities. Display parameters such as information location, display density, data organization, status presentation and dynamic update effects were evaluated in terms of response times and error rates.

Dodson, D. W.↗