Search NASA⌕ Search

SEARCH · Search NASA

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

An Objective and Efficient Method for Assessing the Impact of Reduced-Precision Calculations On Solution Correctness

Recent studies have shown that reducing the precision of floating-point calculations in an atmospheric model can improve the models' computational performance without affecting model fidelity, but code changes are needed to accommodate lower precision, and a small number of calculations might need to retain higher precision to prevent undue round-off error. For complex and computationally expensive systems like the Energy Exascale Earth System Model (E3SM), a method is needed to objectively assess the quality of the lower-precision simulations and to quickly identify problematic code pieces This paper demonstrates that solution correctness can be evaluated through a simple and quantitative error metric based on time step convergence. The proposed test method can unambiguously detect the accumulation of precision error and objectively assess its impact on solution accuracy. Since fast physical processes are known to affect key features of the multi-year mean climate in an atmospheric model, we show that the convergence test applied to short simulations can provide useful information about the impact of reduced precision on a model’s long-term behavior. In contrast, the traditional way of climate model evaluation requires multi-year simulations and involves inspecting many physical quantities for statistical significance in the presence of natural variability. The simplicity, computational efficiency, and objectivity of the proposed method makes it very attractive for high-resolution model development. The method is also expected to be applicable to other models that numerically solve time evolution equations.

97 MATHEMATICS AND COMPUTING↗

Towards efficient backward-in-time adjoint computations using data compression techniques

In the context of a posteriori error estimation for nonlinear time-dependent partial differential equations, the state-of-the-practice is to use adjoint approaches which require the solution of a backward-in-time problem defined by a linearization of the forward problem. One of the major obstacles in the practical application of these approaches, we found, is the need to store, or recompute, the forward solution to define the adjoint problem and to evaluate the error representation. Our study considers the use of data compression techniques to approximate forward solutions employed in the backward-in-time integration. The development derives an error representation that accounts for the difference between the standard-approach and the compressed approximation of the forward solution. This representation is algorithmically similar to the standard representation and only requires the computation of the quantity of interest for the forward solution and the data-compressed reconstructed solution (i.e. scalar quantities that can be evaluated as the forward problem is integrated). This approach is then compared with existing techniques, such as checkpointing and time-averaged adjoints. Lastly, we provide numerical results indicating the potential efficiency of our approach on a transient diffusion–reaction equation and on the Navier–Stokes equations. These results demonstrate memory compression ratios up to 450×450× while maintaining reasonable accuracy in the error-estimates.

42 ENGINEERING↗

Application of a four-step HMX kinetic model to an impact-induced fraction ignition problems

There has been a long history of interest in the decomposition kinetics of HMX and HMX-based formulations due to the widespread use of this explosive in high performance systems. The kinetics allow us to predict, or attempt to predict, the behavior of the explosive when subjected to thermal hazard scenarios that lead to ignition via impact, spark, friction or external heat. The latter, commonly referred to as 'cook off', has been widely studied and contemporary kinetic and transport models accurately predict time and location of ignition for simple geometries. However, there has been relatively little attention given to the problem of localized ignition that results from the first three ignition sources of impact, spark and friction. The use of a zero-order single-rate expression describing the exothermic decomposition of explosives dates to the early work of Frank-Kamanetskii in the late 1930s and continued through the 60's and 70's. This expression provides very general qualitative insight, but cannot provide accurate spatial or timing details of slow cook off ignition. In the 70s, Catalano, et al., noted that single step kinetics would not accurately predict time to ignition in the one-dimensional time to explosion apparatus (ODTX). In the early 80s, Tarver and McGuire published their well-known three step kinetic expression that included an endothermic decomposition step. This scheme significantly improved the accuracy of ignition time prediction for the ODTX. However, the Tarver/McGuire model could not produce the internal temperature profiles observed in the small-scale radial experiments nor could it accurately predict the location of ignition. Those factors are suspected to significantly affect the post-ignition behavior and better models were needed. Brill, et al. noted that the enthalpy change due to the beta-delta crystal phase transition was similar to the assumed endothermic decomposition step in the Tarver/McGuire model. Henson, et al., deduced the kinetics and thermodynamics of the phase transition, providing Dickson, et al. with the information necessary to develop a four-step model that included a two-step nucleation and growth mechanism for the {beta}-{delta} phase transition. Initially, an irreversible scheme was proposed. That model accurately predicted the spatial and temporal cook off behavior of the small-scale radial experiment under slow heating conditions, but did not accurately capture the endothermic phase transition at a faster heating rate. The current version of the four-step model includes reversibility and accurately describes the small-scale radial experiment over a wide range of heating rates. We have observed impact-induced friction ignition of PBX 9501 with grit embedded between the explosive and the lower anvil surface. Observation was done using an infrared camera looking through the sapphire bottom anvil. Time to ignition and temperature-time behavior were recorded. The time to ignition was approximately 500 microseconds and the temperature was approximately 1000 K. The four step reversible kinetic scheme was previously validated for slow cook off scenarios. Our intention was to test the validity for significantly faster hot-spot processes, such as the impact-induced grit friction process studied here. We found the model predicted the ignition time within experimental error. There are caveats to consider when evaluating the agreement. The primary input to the model was friction work over an area computed by a stress analysis. The work rate itself, and the relative velocity of the grit and substrate both have a strong dependence on the initial position of the grit. Any errors in the analysis or the initial grit position would affect the model results. At this time, we do not know the sensitivity to these issues. However, the good agreement does suggest the four step kinetic scheme may have universal applicability for HMX systems.

36 MATERIALS SCIENCE↗

Evaluation of quantitative imaging methods for organ activity and residence time estimation using a population of phantoms having realistic variations in anatomy and uptake

Estimating organ residence times is an essential part of patient-specific dosimetry for radioimmunotherapy (RIT). Quantitative imaging methods for RIT are often evaluated using a single physical or simulated phantom but are intended to be applied clinically where there is variability in patient anatomy, biodistribution, and biokinetics. To provide a more relevant evaluation, the authors have thus developed a population of phantoms with realistic variations in these factors and applied it to the evaluation of quantitative imaging methods both to find the best method and to demonstrate the effects of these variations. Using whole body scans and SPECT/CT images, organ shapes and time-activity curves of 111In ibritumomab tiuxetan were measured in dosimetrically important organs in seven patients undergoing a high dose therapy regimen. Based on these measurements, we created a 3D NURBS-based cardiac-torso (NCAT)-based phantom population. SPECT and planar data at realistic count levels were then simulated using previously validated Monte Carlo simulation tools. The projections from the population were used to evaluate the accuracy and variation in accuracy of residence time estimation methods that used a time series of SPECT and planar scans. Quantitative SPECT (QSPECT) reconstruction methods were used that compensated for attenuation, scatter, and the collimator-detector response. Planar images were processed with a conventional (CPlanar) method that used geometric mean attenuation and triple-energy window scatter compensation and a quantitative planar (QPlanar) processing method that used model-based compensation for image degrading effects. Residence times were estimated from activity estimates made at each of five time points. The authors also evaluated hybrid methods that used CPlanar or QPlanar time-activity curves rescaled to the activity estimated from a single QSPECT image. The methods were evaluated in terms of mean relative error and standard deviation of the relative error in the residence time estimates taken over the phantom population. The mean errors in the residence time estimates over all the organs were <9.9% (pure QSPECT), <13.2% (pure QPLanar), <7.2% (hybrid QPlanar/QSPECT), <19.2% (hybrid CPlanar/QSPECT), and 7%-159% (pure CPlanar). The standard deviations of the errors for all the organs over all the phantoms were <9.9%, <11.9%, <10.8%, <22.0%, and <107.9% for the same methods, respectively. The processing methods differed both in terms of their average accuracy and the variation of the accuracy over the population of phantoms, thus demonstrating the importance of using a phantom population in evaluating quantitative imaging methods. Hybrid CPlanar/QSPECT provided improved accuracy compared to pure CPlanar and required the addition of only a single SPECT acquisition. The QPlanar or hybrid QPlanar/QSPECT methods had mean errors and standard deviations of errors that approached those of pure QSPECT while providing simplified image acquisition protocols, and thus may be more clinically practical.

61 RADIATION PROTECTION AND DOSIMETRY↗

Method of Determining the Reliability of Real-Time In-reactor Monitoring of VVER

A methodological approach and the basic tenets for evaluating the reliability of in-reactor monitoring of VVER are presented. The method is based on the statistical analysis of indications in real time and includes methods for evaluating the admissible maximum error of the measurement channels used for monitoring as well as the average value and admissible deviation of indications in groups of parallel monitoring channels, as well as a method of evaluating reliability by comparing the values of a parameter with the regime values. In comparing the indications of a monitoring channel with the indications of other parallel channels, the median value is proposed as the baseline value. The developed method is implemented in the Diagnostika SVRK special software, which has been successfully tested during the commissioning of the No. 1 unit at the Novovoronezh NPP-2.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Machine learning for endoleak detection after endovascular aortic repair

Diagnosis of endoleak following endovascular aortic repair (EVAR) relies on manual review of multi-slice CT angiography (CTA) by physicians which is a tedious and time-consuming process that is susceptible to error. We evaluate the use of a deep neural network for the detection of endoleak on CTA for post-EVAR patients using a novel data efficient training approach. 50 CTAs and 20 CTAs with and without endoleak respectively were identified based on gold standard interpretation by a cardiovascular subspecialty radiologist. The Endoleak Augmentor, a custom designed augmentation method, provided robust training for the machine learning (ML) model. Predicted segmentation maps underwent post-processing to determine the presence of endoleak. The model was tested against 3 blinded general radiologists and 1 blinded subspecialist using a held-out subset (10 positive endoleak CTAs, 10 control CTAs). Model accuracy, precision and recall for endoleak diagnosis were 95%, 90% and 100% relative to reference subspecialist interpretation (AUC = 0.99). Accuracy, precision and recall was 70/70/70% for generalist1, 50/50/90% for generalist2, and 90/83/100% for generalist3. The blinded subspecialist had concordant interpretations for all test cases compared with the reference. In conclusion, our ML-based approach has similar performance for endoleak diagnosis relative to subspecialists and superior performance compared with generalists.

60 APPLIED LIFE SCIENCES↗

Impact of device level faults in a digital avionic processor

This study describes an experimental analysis of the impact of gate and device-level faults in the processor of a Bendix BDX-930 flight control system. Via mixed mode simulation, faults were injected at the gate (stuck-at) and at the transistor levels and, their propagation through the chip to the output pins was measured. The results show that there is little correspondence between a stuck-at and a device-level fault model, as far as error activity or detection within a functional unit is concerned. In so far as error activity outside the injected unit and at the output pins are concerned, the stuck-at and device models track each other. The stuck-at model, however, overestimates, by over 100 percent, the probability of fault propagation to the output pins. An evaluation of the Mean Error Durations and the Mean Time Between Errors at the output pins shows that the stuck-at model significantly underestimates (by 62 percent) the impact of an internal chip fault on the output pins. Finally, the study also quantifies the impact of device fault by location, both internally and at the output pins.

Suk, Ho Kim↗

Crew performance and communication: Performing a terrain navigation task

A study was conducted to examine the map and route cues pilots use while navigating under controlled, but realistic, nap-of-the-earth (NOE) flight conditions. US Army helicopter flight crews were presented a map and route overlay and asked to perform normal mission planning. They then viewed a video-recording of the out-the-window scene during low-level flights, without the route overlay, and were asked periodically to locate their current position on the map. The pilots and navigators were asked to communicate normally during the planning and flight phases. During each flight the navigator's response time, accuracy, and subjective workload were assessed. Post-flight NASA-TLX workload ratings were collected. No main effect of map orientation (north-up vs. track-up) was found for errors or response times on any of the tasks evaluated. Navigators in the north-up group rated their workload lower than those in the track-up group.

Battiste, Vernol↗

An Alternate Method for Estimating Dynamic Height from XBT Profiles Using Empirical Vertical Modes

A technique is presented that applies modal decomposition to estimate dynamic height (0-450 db) from Expendable BathyThermograph (XBT) temperature profiles. Salinity-Temperature-Depth (STD) data are used to establish empirical relationships between vertically integrated temperature profiles and empirical dynamic height modes. These are then applied to XBT data to estimate dynamic height. A standard error of 0.028 dynamic meters is obtained for the waters of the Gulf of Alaska- an ocean region subject to substantial freshwater buoyancy forcing and with a T-S relationship that has considerable scatter. The residual error is a substantial improvement relative to the conventional T-S correlation technique when applied to this region. Systematic errors between estimated and true dynamic height were evaluated. The 20-year-long time series at Ocean Station P (50 deg N, 145 deg W) indicated weak variations in the error interannually, but not seasonally. There were no evident systematic alongshore variations in the error in the ocean boundary current regime near the perimeter of the Alaska gyre. The results prove satisfactory for the purpose of this work, which is to generate dynamic height from XBT data for coanalysis with satellite altimeter data, given that the altimeter height precision is likewise on the order of 2-3 cm. While the technique has not been applied to other ocean regions where the T-S relation has less scatter, it is suggested that it could provide some improvement over previously applied methods, as well.

Lagerloef, Gary S. E.↗

Characterizing Performance of Freshwater Wetland Methane Models Across Time Scales at FLUXNET-CH 4 Sites Using Wavelet Analyses

Process-based land surface models are important tools for estimating global wetland methane (CH 4 ) emissions and projecting their behavior across space and time. So far there are no performance assessments of model responses to drivers at multiple time scales. In this study, we apply wavelet analysis to identify the dominant time scales contributing to model uncertainty in the frequency domain. We evaluate seven wetland models at 23 eddy covariance tower sites. Our study first characterizes site-level patterns of freshwater wetland CH 4 fluxes (FCH 4 ) at different time scales. A Monte Carlo approach was developed to incorporate flux observation error to avoid misidentification of the time scales that dominate model error. Our results suggest that (a) significant model-observation disagreements are mainly at multi-day time scales (<15 days); (b) most of the models can capture the CH 4 variability at monthly and seasonal time scales (>32 days) for the boreal and Arctic tundra wetland sites but have significant bias in variability at seasonal time scales for temperate and tropical/subtropical sites; (c) model errors exhibit increasing power spectrum as time scale increases, indicating that biases at time scales <5 days could contribute to persistent systematic biases on longer time scales; and (d) differences in error pattern are related to model structure (e.g., proxy of CH 4 production). Our evaluation suggests the need to accurately replicate FCH 4 variability, especially at short time scales, in future wetland CH 4 model developments.

58 GEOSCIENCES↗

Effect of Above Real Time Training and Post Flight Feedback in Training of Novice Pilots in a PC-Based Flight Simulator

The use of Post-Flight Feedback (PFFB) and Above Real-Time Training (ARTT) while training novice pilots to perform a coordinated level turn on a PC-based flight simulator was investigated. One group trained at 1.5 ARTT followed by an equal number of flights at 2.0 ARTT; the second group experienced Real Time Training (RTT). The total number of flights for both groups was equal. Each group was further subdivided into two groups one of which was provided PFFB while the other was not. Then, all participants experienced two challenging evaluation missions in real time. Performance was assessed by comparing root-mean-square error in bank-angle and altitude. Participants in the 1.512.0 ARTT No-PFFB sequence did not show improvement in performance across training sessions. An ANOVA on performance in evaluation flights found that the PFFB groups performed significantly better than those with No-PFFB. Also, the RTT groups performed significantly better than the ARTT groups. Data from two additional groups trained under a 2.011.5 ARTT PFFB and No-PFFB regimes were collected and combined with data from the previously Trainers, Real-time simulation, Personal studied groups and reanalyzed to study the computers, Man-in-the-loop simulation influence of sequence. An ANOVA on test trials found no significant effects between groups. Under training situations involving ARTT we recommend that appropriate PFFB be provided.

Khan, M. Javed↗

Interleaver design for trellis-coded differential 8-PSK modulation with non-coherent detection

The effect of finite interleaver size on bit error rate (BER) performance of coded 8-DPSK is determined by means of computer simulations. The losses evaluated in this way include the SNR degradation due to the timing and frequency errors of the symbol synchronizer and the automatic frequency control (AFC) of the receiver. BER measurements are presented using a conventional 2/3 rate convolutional 8-state trellis-code for typical Rayleigh and Rician fading channels. It is shown that for a Rician channel with a Rician parameter of 7 dB, a Doppler spread of 100 Hz and a data rate of 2400 bps, an interleaver with size 16 x 16 symbols performs nearly as well as a very large interleaver. It is also shown that for very fast Rayleigh channels, the BER-curves flatten out at large SNR.

Edbauer, Franz↗

Flight Test Results: CTAS Cruise/Descent Trajectory Prediction Accuracy for En route ATC Advisories

The Center/TRACON Automation System (CTAS), under development at NASA Ames Research Center, is designed to assist controllers with the management and control of air traffic transitioning to/from congested airspace. This paper focuses on the transition from the en route environment, to high-density terminal airspace, under a time-based arrival-metering constraint. Two flight tests were conducted at the Denver Air Route Traffic Control Center (ARTCC) to study trajectory-prediction accuracy, the key to accurate Decision Support Tool advisories such as conflict detection/resolution and fuel-efficient metering conformance. In collaboration with NASA Langley Research Center, these test were part of an overall effort to research systems and procedures for the integration of CTAS and flight management systems (FMS). The Langley Transport Systems Research Vehicle Boeing 737 airplane flew a combined total of 58 cruise-arrival trajectory runs while following CTAS clearance advisories. Actual trajectories of the airplane were compared to CTAS and FMS predictions to measure trajectory-prediction accuracy and identify the primary sources of error for both. The research airplane was used to evaluate several levels of cockpit automation ranging from conventional avionics to a performance-based vertical navigation (VNAV) FMS. Trajectory prediction accuracy was analyzed with respect to both ARTCC radar tracking and GPS-based aircraft measurements. This paper presents detailed results describing the trajectory accuracy and error sources. Although differences were found in both accuracy and error sources, CTAS accuracy was comparable to the FMS in terms of both meter-fix arrival-time performance (in support of metering) and 4D-trajectory prediction (key to conflict prediction). Overall arrival time errors (mean plus standard deviation) were measured to be approximately 24 seconds during the first flight test (23 runs) and 15 seconds during the second flight test (25 runs). The major source of error during these tests was found to be the predicted winds aloft used by CTAS. Position and velocity estimates of the airplane provided to CTAS by the ATC Host radar tracker were found to be a relatively insignificant error source for the trajectory conditions evaluated. Airplane performance modeling errors within CTAS were found to not significantly affect arrival time errors when the constrained descent procedures were used. The most significant effect related to the flight guidance was observed to be the cross-track and turn-overshoot errors associated with conventional VOR guidance. Lateral navigation (LNAV) guidance significantly reduced both the cross-track and turn-overshoot error. Pilot procedures and VNAV guidance were found to significantly reduce the vertical profile errors associated with atmospheric and aircraft performance model errors.

Green, S.↗

First Demonstration of Combined kV/MV Image-Guided Real-Time Dynamic Multileaf-Collimator Target Tracking

Purpose: For intrafraction motion management, a real-time tracking system was developed by combining fiducial marker-based tracking via simultaneous kilovoltage (kV) and megavoltage (MV) imaging and a dynamic multileaf collimator (DMLC) beam-tracking system. Methods and Materials: The integrated tracking system employed a Varian Trilogy system equipped with kV/MV imaging systems and a Millennium 120-leaf MLC. A gold marker in elliptical motion (2-cm superior-inferior, 1-cm left-right, 10 cycles/min) was simultaneously imaged by the kV and MV imagers at 6.7 Hz and segmented in real time. With these two-dimensional projections, the tracking software triangulated the three-dimensional marker position and repositioned the MLC leaves to follow the motion. Phantom studies were performed to evaluate time delay from image acquisition to MLC adjustment, tracking error, and dosimetric impact of target motion with and without tracking. Results: The time delay of the integrated tracking system was {approx}450 ms. The tracking error using a prediction algorithm was 0.9 {+-} 0.5 mm for the elliptical motion. The dose distribution with tracking showed better target coverage and less dose to surrounding region over no tracking. The failure rate of the gamma test (3%/3-mm criteria) was 22.5% without tracking but was reduced to 0.2% with tracking. Conclusion: For the first time, a complete tracking system combining kV/MV image-guided target tracking and DMLC beam tracking was demonstrated. The average geometric error was less than 1 mm, and the dosimetric error was negligible. This system is a promising method for intrafraction motion management.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Discovering Communicable Scientific Knowledge from Spatio-Temporal Data

This paper describes how we used regression rules to improve upon a result previously published in the Earth science literature. In such a scientific application of machine learning, it is crucially important for the learned models to be understandable and communicable. We recount how we selected a learning algorithm to maximize communicability, and then describe two visualization techniques that we developed to aid in understanding the model by exploiting the spatial nature of the data. We also report how evaluating the learned models across time let us discover an error in the data.

Schwabacher, Mark↗

Discovering Communicable Models from Earth Science Data

This chapter describes how we used regression rules to improve upon results previously published in the Earth science literature. In such a scientific application of machine learning, it is crucially important for the learned models to be understandable and communicable. We recount how we selected a learning algorithm to maximize communicability, and then describe two visualization techniques that we developed to aid in understanding the model by exploiting the spatial nature of the data. We also report how evaluating the learned models across time let us discover an error in the data.

Schwabacher, Mark↗

Estimating Rain Rates from Tipping-Bucket Rain Gauge Measurements

This paper describes the cubic spline based operational system for the generation of the TRMM one-minute rain rate product 2A-56 from Tipping Bucket (TB) gauge measurements. Methodological issues associated with applying the cubic spline to the TB gauge rain rate estimation are closely examined. A simulated TB gauge from a Joss-Waldvogel (JW) disdrometer is employed to evaluate effects of time scales and rain event definitions on errors of the rain rate estimation. The comparison between rain rates measured from the JW disdrometer and those estimated from the simulated TB gauge shows good overall agreement; however, the TB gauge suffers sampling problems, resulting in errors in the rain rate estimation. These errors are very sensitive to the time scale of rain rates. One-minute rain rates suffer substantial errors, especially at low rain rates. When one minute rain rates are averaged to 4-7 minute or longer time scales, the errors dramatically reduce. The rain event duration is very sensitive to the event definition but the event rain total is rather insensitive, provided that the events with less than 1 millimeter rain totals are excluded. Estimated lower rain rates are sensitive to the event definition whereas the higher rates are not. The median relative absolute errors are about 22% and 32% for 1-minute TB rain rates higher and lower than 3 mm per hour, respectively. These errors decrease to 5% and 14% when TB rain rates are used at 7-minute scale. The radar reflectivity-rainrate (Ze-R) distributions drawn from large amount of 7-minute TB rain rates and radar reflectivity data are mostly insensitive to the event definition.

Wang, Jianxin↗