Search NASA⌕ Search

SEARCH · Search NASA

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Information Theoretic Evaluation of Satellite Soil Moisture Retrievals

Microwave radiometry has a long legacy of providing estimates of remotely sensed near surfacesoil moisture measurements over continental and global scales. A consistent assessment of theerrors and uncertainties associated with these retrievals is important for their effective utilization in modeling, data assimilation and end-use application environments. This article presents an evaluationof soil moisture retrieval products from AMSR-E, ASCAT, SMOS, AMSR2 and SMAPinstruments using information theory-based metrics. These metrics rely on time series analysis ofsoil moisture retrievals for estimating the measurement error, level of randomness (entropy) andregularity (complexity) of the data. The results of the study indicate that the measurement errors inthe remote sensing retrievals are significantly larger than that of the ground soil moisture measurements.The SMAP retrievals, on the other hand, were found to have reduced errors (comparable to Preprint submitted to Remote Sensing of Environment October 1, 2017those of in-situ datasets), particularly over areas with moderate vegetation. The SMAP retrievals also demonstrate high information content relative to other retrieval products, with higher levelsof complexity and reduced entropy. Finally, a joint evaluation of the entropy and complexity ofremotely sensed soil moisture products indicates that the information content of the AMSR-E, ASCAT,SMOS and AMSR2 retrievals is low, whereas SMAP retrievals show better performance. The use of information theoretic assessments is effective in quantifying the required levels of improvements needed in the remote sensing soil moisture retrievals to enhance their utility and information content.

Information theory↗

Using regime analysis to identify the contribution of clouds to surface temperature errors in weather and climate models

Many global circulation models (GCMs) exhibit a persistent bias in the 2 m temperature over the midlatitude continents, present in short-range forecasts as well as long-term climate simulations. A number of hypotheses have been proposed, revolving around deficiencies in the soil–vegetation–atmosphere energy exchange, poorly resolved low-level boundary-layer clouds or misrepresentations of deep-convective storms. A common approach to evaluating model biases focuses on the model-mean state. However, this makes difficult an unambiguous interpretation of the origins of a bias, given that biases are the result of the superposition of impacts of clouds and land-surface deficiencies over multiple time steps. This article presents a new methodology to objectively detect the role of clouds in the creation of a surface warm bias. A unique feature of this study is its focus on temperature-error growth at the time-step level. It is shown that compositing the temperature-error growth by the coinciding bias in total downwelling radiation provides unambiguous evidence for the role that clouds play in the creation of the surface warm bias during certain portions of the day. Furthermore, the application of an objective cloud-regime classification allows for the detection of the specific cloud regimes that matter most for the creation of the bias. We applied this method to two state-of-the-art GCMs that exhibit a distinct warm bias over the Southern Great Plains of the USA. Our analysis highlights that, in one GCM, biases in deep-convective and low-level clouds contribute most to the temperature-error growth in the afternoon and evening respectively. In the second GCM, deep clouds persist too long in the evening, leading to a growth of the temperature bias. In conclusion, the reduction of the temperature bias in both models in the morning and the growth of the bias in the second GCM in the afternoon could not be assigned to a cloud issue, but are more likely caused by a land-surface deficiency.

54 ENVIRONMENTAL SCIENCES↗

Real-time automatic fiducial marker tracking in low contrast cine-MV images

Purpose: To develop a real-time automatic method for tracking implanted radiographic markers in low-contrast cine-MV patient images used in image-guided radiation therapy (IGRT). Methods: Intrafraction motion tracking using radiotherapy beam-line MV images have gained some attention recently in IGRT because no additional imaging dose is introduced. However, MV images have much lower contrast than kV images, therefore a robust and automatic algorithm for marker detection in MV images is a prerequisite. Previous marker detection methods are all based on template matching or its derivatives. Template matching needs to match object shape that changes significantly for different implantation and projection angle. While these methods require a large number of templates to cover various situations, they are often forced to use a smaller number of templates to reduce the computation load because their methods all require exhaustive search in the region of interest. The authors solve this problem by synergetic use of modern but well-tested computer vision and artificial intelligence techniques; specifically the authors detect implanted markers utilizing discriminant analysis for initialization and use mean-shift feature space analysis for sequential tracking. This novel approach avoids exhaustive search by exploiting the temporal correlation between consecutive frames and makes it possible to perform more sophisticated detection at the beginning to improve the accuracy, followed by ultrafast sequential tracking after the initialization. The method was evaluated and validated using 1149 cine-MV images from two prostate IGRT patients and compared with manual marker detection results from six researchers. The average of the manual detection results is considered as the ground truth for comparisons. Results: The average root-mean-square errors of our real-time automatic tracking method from the ground truth are 1.9 and 2.1 pixels for the two patients (0.26 mm/pixel). The standard deviations of the results from the 6 researchers are 2.3 and 2.6 pixels. The proposed framework takes about 128 ms to detect four markers in the first MV images and about 23 ms to track these markers in each of the subsequent images. Conclusions: The unified framework for tracking of multiple markers presented here can achieve marker detection accuracy similar to manual detection even in low-contrast cine-MV images. It can cope with shape deformations of fiducial markers at different gantry angles. The fast processing speed reduces the image processing portion of the system latency, therefore can improve the performance of real-time motion compensation.

60 APPLIED LIFE SCIENCES↗

SU-E-J-118: Verification of Intrafractional Positional Accuracy Using Ultrasound Autoscan Tracking for Prostate Cancer Treatment

Purpose: Transperineal ultrasound imaging is attractive option for imageguided radiation therapy as there is no need to implant fiducials, no extra imaging dose, and real time continuous imaging is possible during treatment. The aim of this study is to verify the tracking accuracy of a commercial ultrasound system under treatment conditions with a male pelvic phantom. Methods: A CT and ultrasound scan were acquired for the male pelvic phantom. The phantom was then placed in a treatment mimicking position on a motion platform. The axial and lateral tracking accuracy of the ultrasound system were verified using an independent optical tracking system. The tracking accuracy was evaluated by tracking the phantom position detected by the ultrasound system, and comparing it to the optical tracking system under the conditions of beam on (15 MV), beam off, poor image quality with an acoustic shadow introduced, and different phantom motion cycles (10 and 20 second periods). Additionally, the time lag between the ultrasound-detected and actual phantom motion was investigated. Results: Displacement amplitudes reported by the ultrasound system and optical system were within 0.5 mm of each other for both directions and all conditions. The ultrasound tracking performance in axial direction was better than in lateral direction. Radiation did not interfere with ultrasound tracking while image quality affected tracking accuracy. The tracking accuracy was better for periodic motion with 20 second period. The time delay between the ultrasound tracking system and the phantom motion was clinically acceptable. Conclusion: Intrafractional prostate motion is a potential source of treatment error especially in the context of emerging SBRT regimens. It is feasible to use transperineal ultrasound daily to monitor prostate motion during treatment. Our results verify the tracking accuracy of a commercial ultrasound system to be better than 1 mm under typical external beam treatment conditions.

60 APPLIED LIFE SCIENCES↗

Optimizing Umkehr Ozone Profile Retrievals

NOAA Dobson Umkehr ozone profile records have been collected since the 1970s. Umkehr ozone profiles are used to monitor stratospheric ozone recovery predicted to occur by the 2050s. Current operational Dobson Umkehr profile algorithms produce data that have uncertainty on the order of ~ 5 % in the stratosphere. However, when large volcanic eruptions inject aerosols into the stratosphere, the errors can be as large as 70 %. In order to evaluate Umkehr records for aerosol-related and instrumental artifacts, we compare observations with a Hindcast simulation of the NASA Merra-2 Global Modeling Initiative (GMI) Replay (M2GMI, Orbe et al, 2017; Wargan et al, 2018) and Chemistry Transport Model (GMI CTM, Strahan et al, 2013, Strahan et al, 2016). The biases found between the models and observations are summarized for each Dobson calibration and volcanic eruption period, thus providing a reference tool for homogenization of the Umkehr time series and removal of volcanic aerosol errors.

Petropavlovskikh, I.↗

An AeroCom–AeroSat study: intercomparison of satellite AOD datasets for aerosol model evaluation

To better understand and characterize current uncertainties in the important observational constraint of climate models of aerosol optical depth (AOD), we evaluate and intercompare 14 satellite products, representing nine different retrieval algorithm families using observations from five different sensors on six different platforms. The satellite products (super-observations consisting of 1°×1° daily aggregated retrievals drawn from the years 2006, 2008 and 2010) are evaluated with AErosol RObotic NETwork (AERONET) and Maritime Aerosol Network (MAN) data. Results show that different products exhibit different regionally varying biases (both under- and overestimates) that may reach ±50 %, although a typical bias would be 15 %–25 % (depending on the product). In addition to these biases, the products exhibit random errors that can be 1.6 to 3 times as large. Most products show similar performance, although there are a few exceptions with either larger biases or larger random errors. The intercomparison of satellite products extends this analysis and provides spatial context to it. In particular, we show that aggregated satellite AOD agrees much better than the spatial coverage (often driven by cloud masks) within the 1°×1° grid cells. Up to ∼50 % of the difference between satellite AOD is attributed to cloud contamination. The diversity in AOD products shows clear spatial patterns and varies from 10 % (parts of the ocean) to 100 % (central Asia and Australia). More importantly, we show that the diversity may be used as an indication of AOD uncertainty, at least for the better performing products. This provides modellers with a global map of expected AOD uncertainty in satellite products, allows assessment of products away from AERONET sites, can provide guidance for future AERONET locations and offers suggestions for product improvements. We account for statistical and sampling noise in our analyses. Sampling noise, variations due to the evaluation of different subsets of the data, causes important changes in error metrics. The consequences of this noise term for product evaluation are discussed.

Aerosol↗

Online short-term solar power forecasting

This paper describes a new approach to online forecasting of power production from PV systems. The method is suited to online forecasting in many applications and in this paper it is used to predict hourly values of solar power for horizons of up to 36 h. The data used is 15-min observations of solar power from 21 PV systems located on rooftops in a small village in Denmark. The suggested method is a two-stage method where first a statistical normalization of the solar power is obtained using a clear sky model. The clear sky model is found using statistical smoothing techniques. Then forecasts of the normalized solar power are calculated using adaptive linear time series models. Both autoregressive (AR) and AR with exogenous input (ARX) models are evaluated, where the latter takes numerical weather predictions (NWPs) as input. The results indicate that for forecasts up to 2 h ahead the most important input is the available observations of solar power, while for longer horizons NWPs are the most important input. A root mean square error improvement of around 35% is achieved by the ARX model compared to a proposed reference model. (author)

14 SOLAR ENERGY↗

Postprocessing for Improved Accuracy and Resolution of Spread Spectrum Time-Domain Reflectometry

Reflectometry, which is commonly used for locating faults on electrical wires, produces sampled time domain signatures with peaks that are often missed due to this sampling. Resultant errors in these sampled peaks translate to errors in calculating the impedance and location of the fault. Typical signal processing methods to improve the accuracy of these sampled peaks have complexity on the order of O(N 2 ). For embedded fault location applications, algorithms with lower complexity are desired. In this article, we introduce three algorithms for improving the accuracy of the peak with a complexity of O(N). Finally, we evaluate these algorithms on the practical case of calculating the velocity of propagation and the characteristic impedance of a photovoltaic (PV) cable using spread spectrum time-domain reflectometry.

47 OTHER INSTRUMENTATION↗

Prospects for measuring the fuel ion ratio in burning ITER plasmas using a DT neutron emission spectrometer

The fuel ion ratio n{sub t}/n{sub d} is an essential parameter for plasma control in fusion reactor relevant applications, since maximum fusion power is attained when equal amounts of tritium (T) and deuterium (D) are present in the plasma, i.e., n{sub t}/n{sub d} = 1.0. For neutral beam heated plasmas, this parameter can be measured using a single neutron spectrometer, as has been shown for tritium concentrations up to 90%, using data obtained with the MPR (Magnetic Proton Recoil) spectrometer during a DT experimental campaign at the Joint European Torus in 1997. In this paper, we evaluate the demands that a DT spectrometer has to fulfill to be able to determine n{sub t}/n{sub d} with a relative error below 20%, as is required for such measurements at ITER. The assessment shows that a back-scattering time-of-flight design is a promising concept for spectroscopy of 14 MeV DT emission neutrons.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Towards Misregistration-Tolerant Change Detection using Deep Learning Techniques with Object-Based Image Analysis

Co-registrating is a common pre-processing step for existing change detection algorithms, but registering bi-temporal images is nontrivial. The use of image patch as input for deep learning techniques provides a natural avenue to apply them in the OBIA framework, and have shown successful performance in the object-based land cover mapping and change detection applications. Even though attempts of applying deep learning techniques for change detection applications have been made with varying success, its application under OBIA framework for change detection have not been conducted and its tolerance for misregistration among temporal images are neither known. This study performed change detection under OBIA framework using deep learning techniques for the first time, and evaluated its performance regarding their tolerance of image misregistration on training and testing dataset. Our results demonstrate the proposed change detection scheme is surprisingly robust to image misregistration on the testing dataset, while classifiers trained with the training dataset containing image misregistration errors suffer from slight decrease of overall accuracy.

Liu, Tao↗

Evaluation of piezoceramic actuators for control of aircraft interior noise

Results of an experiment to evaluate piezoceramic actuators as the control actuator for active control of interior noise in a large-scale fuselage model are presented. Control was demonstrated for tonal excitation using a time domain least mean squares algorithm. A maximum of four actuator channels and six error signals were used. The actuators were employed for control of noise at frequencies where interior cavity modes were the dominant response and for driven acoustic responses where a structure resonance was dominant. Global reductions of 9 to 12 dB were obtained for the cases examined. The most effective configuration of skin-mounted actuators was found to be a pure in-plane forcing function as opposed to a bending excitation. The frame-mounted actuators were found to be equally effective as the skin-mounted actuators. However, both configurations resulted in local regions of unacceptably high vibration response in the structure.

Silcox, Richard J.↗

Scope of Gradient and Genetic Algorithms in Multivariable Function Optimization

Global optimization of a multivariable function - constrained by bounds specified on each variable and also unconstrained - is an important problem with several real world applications. Deterministic methods such as the gradient algorithms as well as the randomized methods such as the genetic algorithms may be employed to solve these problems. In fact, there are optimization problems where a genetic algorithm/an evolutionary approach is preferable at least from the quality (accuracy) of the results point of view. From cost (complexity) point of view, both gradient and genetic approaches are usually polynomial-time; there are no serious differences in this regard, i.e., the computational complexity point of view. However, for certain types of problems, such as those with unacceptably erroneous numerical partial derivatives and those with physically amplified analytical partial derivatives whose numerical evaluation involves undesirable errors and/or is messy, a genetic (stochastic) approach should be a better choice. We have presented here the pros and cons of both the approaches so that the concerned reader/user can decide which approach is most suited for the problem at hand. Also for the function which is known in a tabular form, instead of an analytical form, as is often the case in an experimental environment, we attempt to provide an insight into the approaches focusing our attention toward accuracy. Such an insight will help one to decide which method, out of several available methods, should be employed to obtain the best (least error) output. *

Shaykhian, Gholam Ali↗

Evaluation of Packing_3D Code for Design of Variable-Depth, Bent-Chamber Acoustic Liners

Increases in the bypass ratio for commercial aircraft engines have caused the broadband fan noise component to become dominant. As a result, there is a need to develop improved acoustic liners suitable for absorption of this fan noise over a wide frequency range, preferably up to at least two octaves. Variable depth liners with bent chambers and three-dimensional geometries present one way to achieve this goal, however, they can be difficult and time-consuming to design due to their complexity and volume constraints. A packing code, called Packing3D, has been developed that automatically designs the chamber configurations of such liners once the chamber dimensions and volume constraints are known. The code uses a randomized trial and error approach to place each chamber in a representation of the liner sample, then returns a colored diagram and sufficient information for the liner sample to be fabricated. For evaluation, the code is used to design four liner samples of varying levels of complexity. These samples are tested with and without a mesh facesheet in the NASA Langley Normal Incidence Tube, and the results are compared to predictions computed in COMSOL. The results indicate that the packing code is able to quickly design samples that are predictable, achieve the desired absorption spectrum, fit the given constraints, and are able to be built. This code is flexible, lends itself to optimization, and allows samples to be designed quickly, accurately, and efficiently.

Marinova, Miroslava M.↗

Failure mode and effect analysis-based quality assurance for dynamic MLC tracking systems

Purpose: To develop and implement a failure mode and effect analysis (FMEA)-based commissioning and quality assurance framework for dynamic multileaf collimator (DMLC) tumor tracking systems. Methods: A systematic failure mode and effect analysis was performed for a prototype real-time tumor tracking system that uses implanted electromagnetic transponders for tumor position monitoring and a DMLC for real-time beam adaptation. A detailed process tree of DMLC tracking delivery was created and potential tracking-specific failure modes were identified. For each failure mode, a risk probability number (RPN) was calculated from the product of the probability of occurrence, the severity of effect, and the detectibility of the failure. Based on the insights obtained from the FMEA, commissioning and QA procedures were developed to check (i) the accuracy of coordinate system transformation, (ii) system latency, (iii) spatial and dosimetric delivery accuracy, (iv) delivery efficiency, and (v) accuracy and consistency of system response to error conditions. The frequency of testing for each failure mode was determined from the RPN value. Results: Failures modes with RPN{>=}125 were recommended to be tested monthly. Failure modes with RPN<125 were assigned to be tested during comprehensive evaluations, e.g., during commissioning, annual quality assurance, and after major software/hardware upgrades. System latency was determined to be {approx}193 ms. The system showed consistent and accurate response to erroneous conditions. Tracking accuracy was within 3%-3 mm gamma (100% pass rate) for sinusoidal as well as a wide variety of patient-derived respiratory motions. The total time taken for monthly QA was {approx}35 min, while that taken for comprehensive testing was {approx}3.5 h. Conclusions: FMEA proved to be a powerful and flexible tool to develop and implement a quality management (QM) framework for DMLC tracking. The authors conclude that the use of FMEA-based QM ensures efficient allocation of clinical resources because the most critical failure modes receive the most attention. It is expected that the set of guidelines proposed here will serve as a living document that is updated with the accumulation of progressively more intrainstitutional and interinstitutional experience with DMLC tracking.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluating radiation impact on transmon qubits in above and underground facilities

Superconducting qubits can be sensitive to energy deposits caused by cosmic rays and ambient radioactivity. While previous studies have explored correlated effects in time and space due to cosmic ray interactions, we present the first direct comparison of a transmon qubit’s performance measured at two distinct sites: the above-ground SQMS facility (Fermilab, US) and the deep-underground Gran Sasso Laboratory (Italy). Despite the stark difference in radiation levels, we observe a similar average qubit relaxation time of approximately 80 microseconds at both locations. To investigate radiation-induced events, we employ a fast decay detection protocol, comparing the relative rates of events between the two environments. Although intrinsic noise remains the dominant source of errors in superconducting qubits, our analysis revealed a significant excess of radiation-induced events for high-coherence transmon qubits operated above-ground. Finally, using γ-ray sources with increasing activity levels, we evaluate the qubit response in a controlled low-background environment.

De Dominicis, Francesco [GSSI, Aquila; INFN, LNS]↗

Geometry-independent microstructure optimization for electron beam powder bed fusion additive manufacturing

The ability to manipulate the formation of microstructure is one of the potential advantages of additive manufacturing. Yet, the additive manufacturing process is riddled with complex interactions between processing parameters, geometry, and spot melting sequence which makes the task of controlling microstructure challenging. This paper proposes a method to solve the microstructure texture optimization problem by leveraging established optimization techniques and increasingly fast and accurate analytical heat transfer models. Respectively, we apply two different optimization algorithms, genetic algorithm and concurrent greedy line search, in order to induce arbitrarily shaped microstructure regions and we use a heat transfer model to evaluate the fitness of solutions in an iterative approach that is far more efficient than pure trial and error. The objective of the optimization algorithm is to control local thermal conditions – hence microstructure formation – during the melting process by manipulating the order and the dwell time of all the points of the infill pattern sequence. We then analyze the optimized sequence to determine important path characteristics that affect the microstructure formation. Through examples, we show that relative order and frequency, as measured by weighted average and variance of spot order, are important factors that influence the final characteristics.

36 MATERIALS SCIENCE↗

Workflow Enhancement (WE) Improves Safety in Radiation Oncology: Putting the WE and Team Together

Purpose: To review the impact of a workflow enhancement (WE) team in reducing treatment errors that reach patients within radiation oncology. Methods and Materials: It was determined that flaws in our workflow and processes resulted in errors reaching the patient. The process improvement team (PIT) was developed in 2010 to reduce errors and was later modified in 2012 into the current WE team. Workflow issues and solutions were discussed in PIT and WE team meetings. Due to tensions within PIT that resulted in employee dissatisfaction, there was a 6-month hiatus between the end of PIT and initiation of the renamed/redesigned WE team. In addition to the PIT/WE team forms, the department had separate incident forms to document treatment errors reaching the patient. These incident forms are rapidly reviewed and monitored by our departmental and institutional quality and safety groups, reflecting how seriously these forms are treated. The number of these incident forms was compared before and after instituting the WE team. Results: When PIT was disbanded, a number of errors seemed to occur in succession, requiring reinstitution and redesign of this team, rebranded the WE team. Interestingly, the number of incident forms per patient visits did not change when comparing 6 months during the PIT, 6 months during the hiatus, and the first 6 months after instituting the WE team (P=.85). However, 6 to 12 months after instituting the WE team, the number of incident forms per patient visits decreased (P=.028). After the WE team, employee satisfaction and commitment to quality increased as demonstrated by Gallup surveys, suggesting a correlation to the WE team. Conclusions: A team focused on addressing workflow and improving processes can reduce the number of errors reaching the patient. Time is necessary before a reduction in errors reaching patients will be seen.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

EVIDENCE FOR EXTENDED STAR FORMATION IN THE OLD, METAL-RICH OPEN CLUSTER, NGC 6791?

NGC 6791 is an old, metal-rich star cluster normally considered to be a disk open cluster. Its red giant branch is broad in color yet, to date, there is no evidence for a metallicity spread among its stars. The turnoff region of the main sequence is also wider than expected from broadband photometric errors. Analysis of the color-magnitude diagram reveals a color gradient between the core of the cluster and its periphery; we evaluate the potential explanations for this trend. While binarity and photometric errors appear unlikely, reddening variations across the face of the cluster cannot be excluded. We argue that a viable alternative explanation for this color trend is an age spread resulting from a protracted formation time for the cluster; the stars of the inner region of NGC 6791 appear to be older by {approx}1 Gyr on average than those of the outer region.

79 ASTRONOMY AND ASTROPHYSICS↗