Search NASA⌕ Search

SEARCH · Search NASA

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

CEDAR-GEM Challenge for Systematic Assessment of Ionosphere/Thermosphere Models in Predicting TEC During the 2006 December Storm Event

In order to assess current modeling capability of reproducing storm impacts on total electron content (TEC), we considered quantities such as TEC, TEC changes compared to quiet time values, and the maximum value of the TEC and TEC changes during a storm. We compared the quantities obtained from ionospheric models against ground-based GPS TEC measurements during the 2006 AGU storm event (14-15 December 2006) in the selected eight longitude sectors. We used 15 simulations obtained from eight ionospheric models, including empirical, physics-based, coupled ionosphere-thermosphere, and data assimilation models. To quantitatively evaluate performance of the models in TEC prediction during the storm, we calculated skill scores such as RMS error, Normalized RMS error (NRMSE), ratio of the modeled to observed maximum increase (Yield), and the difference between the modeled peak time and observed peak time. Furthermore, to investigate latitudinal dependence of the performance of the models, the skill scores were calculated for five latitude regions. Our study shows that RMSE of TEC and TEC changes of the model simulations range from about 3 TECU (total electron content unit, 1 TECU = 1016 el m2) (in high latitudes) to about 13 TECU (in low latitudes), which is larger than latitudinal average GPS TEC error of about 2 TECU. Most model simulations predict TEC better than TEC changes in terms of NRMSE and the difference in peak time, while the opposite holds true in terms of Yield. Model performance strongly depends on the quantities considered, the type of metrics used, and the latitude considered.

Shim, J. S.↗

A Workflow for Accelerating Multimodal Data Collection for Electrodeposited Films

Abstract Future machine learning strategies for materials process optimization will likely replace human capital-intensive artisan research with autonomous and/or accelerated approaches. Such automation enables accelerated multimodal characterization that simultaneously minimizes human errors, lowers costs, enhances statistical sampling, and allows scientists to allocate their time to critical thinking instead of repetitive manual tasks. Previous acceleration efforts to synthesize and evaluate materials have often employed elaborate robotic self-driving laboratories or used specialized strategies that are difficult to generalize. Herein we describe an implemented workflow for accelerating the multimodal characterization of a combinatorial set of 915 electroplated Ni and Ni–Fe thin films resulting in a data cube with over 160,000 individual data files. Our acceleration strategies do not require manufacturing-scale resources and are thus amenable to typical materials research facilities in academic, government, or commercial laboratories. The workflow demonstrated the acceleration of six characterization modalities: optical microscopy, laser profilometry, X-ray diffraction, X-ray fluorescence, nanoindentation, and tribological (friction and wear) testing, each with speedup factors ranging from 13–46x. In addition, automated data upload to a repository using FAIR data principles was accelerated by 64x.

36 MATERIALS SCIENCE↗

System distortion errors in radiorespirometry curves.

Description of a method for evaluating the maximum error producible in the system distortion of a carrier gas type radiorespirometer. The maximum producible error is evaluated on the basis of a second order. The maximum producible decrease in peak height output is calculated as a function of the system's time constant or flow rate by using the system's transfer function and the Laplace transformation equation (Gardner and Barnes, 1961).

Neville, E. D.↗

Cost Sensitive Moving Target Consensus

Consensus is a fundamental approach to implementing fault-tolerant services through replication where there exists a tradeoff between the cost and the resilience. For instance, Crash Fault Tolerant (CFT) protocols have a low cost but can only handle crash failures while Byzantine Fault Tolerant (BFT) protocols handle arbitrary failures but have a higher cost. Hybrid protocols enjoy the benefits of both high performance without failures and high resiliency under failures by switching among different subprotocols. However, it is challenging to determine which subprotocols should be used. We propose a moving target approach to switch among protocols according to the existing system and network vulnerability. At the core of our approach is a formalized cost model that evaluates the vulnerability and performance of consensus protocols based on real-time Intrusion Detection System (IDS) signals. Based on the evaluation results, we demonstrate that a safe, cheap, and unpredictable protocol is always used and a high IDS error rate can be tolerated.

Duan, Sisi↗

Optimizing the performance and structure of the D0 Collie confidence limit evaluator

D0 Collie is a program used to perform limit calculations based on ensembles of pseudo-experiments ('PEs'). Since the application of this program to the crucial Higgs mass limit is quite CPU intensive, it has been deemed important to carefully review this program, with an eye toward identifying and implementing potential performance improvements. At the same time, we identify any coding errors or opportunities for potential structural (or algorithm) improvement discovered in the course of gaining sufficient understanding of the workings of Collie to sensibly explore for optimizations. Based on a careful analysis of the program, a series of code changes with potential for improving performance has been identified. The implementation and evaluation of the most important parts of this series has been done, with gratifying speedup results. The bottom line: We have identified and implemented changes leading to a factor of 2.19 speedup in the example program provided, and expected to translate to a factor of roughly 4 speedup in typical realistic usage.

99 GENERAL AND MISCELLANEOUS↗

MEASURING HIGH-PRECISION ASTROMETRY WITH THE INFRARED ARRAY CAMERA ON THE SPITZER SPACE TELESCOPE

The Infrared Array Camera (IRAC) on the Spitzer Space Telescope currently offers the greatest potential for high-precision astrometry of faint mid-IR sources across arcminute-scale fields, which would be especially valuable for measuring parallaxes of cold brown dwarfs in the solar neighborhood and proper motions of obscured members of nearby star-forming regions. To more fully realize IRAC's astrometric capabilities, we have sought to minimize the largest sources of uncertainty in astrometry with its 3.6 and 4.5 μm bands. By comparing different routines that estimate stellar positions, we have found that Point Response Function (PRF) fitting with the Spitzer Science Center's Astronomical Point Source Extractor produces both the smallest systematic errors from varying intra-pixel sensitivity and the greatest precision in measurements of positions. In addition, self-calibration has been used to derive new 7th and 8th order distortion corrections for the 3.6 and 4.5 μm arrays of IRAC, respectively. These corrections are suitable for data throughout the mission of Spitzer when a time-dependent scale factor is applied to the corrections. To illustrate the astrometric accuracy that can be achieved by combining PRF fitting with our new distortion corrections, we have applied them to archival data for a nearby star-forming region, arriving at total astrometric errors of ∼20 and 70 mas at signal to noise ratios of 100 and 10, respectively.

79 ASTRONOMY AND ASTROPHYSICS↗

Automated evaluation of setup errors in carbon ion therapy using PET: Feasibility study

Purpose: To investigate the possibility of detecting patient mispositioning in carbon-ion therapy with particle therapy positron emission tomography (PET) in an automated image registration based manner. Methods: Tumors in the head and neck (H and N), pelvic, lung, and brain region were investigated. Biologically optimized carbon ion treatment plans were created with TRiP98. From these treatment plans, the reference β{sup +}-activity distributions were calculated using a Monte Carlo simulation. Setup errors were simulated by shifting or rotating the computed tomography (CT). The expected β{sup +} activity was calculated for each plan with shifts. Finally, the reference particle therapy PET images were compared to the “shifted” β{sup +}-activity distribution simulations using the Pearson's correlation coefficient (PCC). To account for different PET monitoring options the inbeam PET was compared to three different inroom scenarios. Additionally, the dosimetric effects of the CT misalignments were investigated. Results: The automated PCC detection of patient mispositioning was possible in the investigated indications for cranio-caudal shifts of 4 mm and more, except for prostate tumors. In the rather homogeneous pelvic region, the generated β{sup +}-activity distribution of the reference and compared PET image were too much alike. Thus, setup errors in this region could not be detected. Regarding lung lesions the detection strongly depended on the exact tumor location: in the center of the lung tumor misalignments could be detected down to 2 mm shifts while resolving shifts of tumors close to the thoracic wall was more challenging. Rotational shifts in the H and N and lung region of +6° and more could be detected using inroom PET and partly using inbeam PET. Comparing inroom PET to inbeam PET no obvious trend was found. However, among the inroom scenarios a longer measurement time was found to be advantageous. Conclusions: This study scopes the use of various particle therapy PET verification techniques in four indications. The automated detection of patients' setup errors was investigated in a broad accumulation of data sets. The evaluation of introduced setup errors is performed automatically, which is of utmost importance to introduce highly required particle therapy monitoring devices into the clinical routine.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Statistically Appraising Process Quality of Affinity Isolation Experiments

Quality affinity isolation experiments are necessary to identify valid protein-protein interactions. Biological error, processing error, and random variability can reduce the quality of an experiment, and thus hinder the identification of protein interaction pairs. Appraising affinity isolation assay quality is essential to inferring protein associations. An important step of the assay is the mass spectrometric identification of proteins. To evaluate this step, a known mixture of proteins is processed through a mass spectrometer as a quality control mixture. If the mass spectrometer yields unexpected results, the process is currently qualitatively evaluated, tuned, and reset. Statistical quality control (SQC) procedures, including the use of cumulative sum, the individual measurement, and moving range charts are implemented to analyze the stability of the mass spectrometric analysis. The SQC measures presented here can assist in establishing preliminary control limits to identify an out-of-control process and investigate assignable causes for shifts in the process mean in real-time.

59 BASIC BIOLOGICAL SCIENCES↗

Automated Voxel-Based Analysis of Volumetric Dynamic Contrast-Enhanced CT Data Improves Measurement of Serial Changes in Tumor Vascular Biomarkers

Objectives: Development of perfusion imaging as a biomarker requires more robust methodologies for quantification of tumor physiology that allow assessment of volumetric tumor heterogeneity over time. This study proposes a parametric method for automatically analyzing perfused tissue from volumetric dynamic contrast-enhanced (DCE) computed tomography (CT) scans and assesses whether this 4-dimensional (4D) DCE approach is more robust and accurate than conventional, region-of-interest (ROI)-based CT methods in quantifying tumor perfusion with preliminary evaluation in metastatic brain cancer. Methods and Materials: Functional parameter reproducibility and analysis of sensitivity to imaging resolution and arterial input function were evaluated in image sets acquired from a 320-slice CT with a controlled flow phantom and patients with brain metastases, whose treatments were planned for stereotactic radiation surgery and who consented to a research ethics board-approved prospective imaging biomarker study. A voxel-based temporal dynamic analysis (TDA) methodology was used at baseline, at day 7, and at day 20 after treatment. The ability to detect changes in kinetic parameter maps in clinical data sets was investigated for both 4D TDA and conventional 2D ROI-based analysis methods. Results: A total of 7 brain metastases in 3 patients were evaluated over the 3 time points. The 4D TDA method showed improved spatial efficacy and accuracy of perfusion parameters compared to ROI-based DCE analysis (P<.005), with a reproducibility error of less than 2% when tested with DCE phantom data. Clinically, changes in transfer constant from the blood plasma into the extracellular extravascular space (K{sub trans}) were seen when using TDA, with substantially smaller errors than the 2D method on both day 7 post radiation surgery (±13%; P<.05) and by day 20 (±12%; P<.04). Standard methods showed a decrease in K{sub trans} but with large uncertainty (111.6 ± 150.5) %. Conclusions: Parametric voxel-based analysis of 4D DCE CT data resulted in greater accuracy and reliability in measuring changes in perfusion CT-based kinetic metrics, which have the potential to be used as biomarkers in patients with metastatic brain cancer.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Dynamic estimation of three-dimensional cerebrovascular deformation from rotational angiography

Purpose: The objective of this study is to investigate the feasibility of detecting and quantifying 3D cerebrovascular wall motion from a single 3D rotational x-ray angiography (3DRA) acquisition within a clinically acceptable time and computing from the estimated motion field for the further biomechanical modeling of the cerebrovascular wall. Methods: The whole motion cycle of the cerebral vasculature is modeled using a 4D B-spline transformation, which is estimated from a 4D to 2D+t image registration framework. The registration is performed by optimizing a single similarity metric between the entire 2D+t measured projection sequence and the corresponding forward projections of the deformed volume at their exact time instants. The joint use of two acceleration strategies, together with their implementation on graphics processing units, is also proposed so as to reach computation times close to clinical requirements. For further characterizing vessel wall properties, an approximation of the wall thickness changes is obtained through a strain calculation. Results: Evaluation on in silico and in vitro pulsating phantom aneurysms demonstrated an accurate estimation of wall motion curves. In general, the error was below 10% of the maximum pulsation, even in the situation when substantial inhomogeneous intensity pattern was present. Experiments on in vivo data provided realistic aneurysm and vessel wall motion estimates, whereas in regions where motion was neither visible nor anatomically possible, no motion was detected. The use of the acceleration strategies enabled completing the estimation process for one entire cycle in 5-10 min without degrading the overall performance. The strain map extracted from our motion estimation provided a realistic deformation measure of the vessel wall. Conclusions: The authors' technique has demonstrated that it can provide accurate and robust 4D estimates of cerebrovascular wall motion within a clinically acceptable time, although it has to be applied to a larger patient population prior to possible wide application to routine endovascular procedures. In particular, for the first time, this feasibility study has shown that in vivo cerebrovascular motion can be obtained intraprocedurally from a 3DRA acquisition. Results have also shown the potential of performing strain analysis using this imaging modality, thus making possible for the future modeling of biomechanical properties of the vascular wall.

60 APPLIED LIFE SCIENCES↗

Evaluation of GEOS Precipitation Flagging for SMAP Soil Moisture Retrieval Accuracy

The precipitation flag in the Soil Moisture Active Passive (SMAP) Level 2 passive soil moisture (L2SMP) retrieval product indicates the presence or absence of heavy precipitation at the time of the SMAP overpass. The flag is based on precipitation estimates from the Goddard Earth Observing System (GEOS) Forward Processing numerical weather prediction system. An error in flagging during an active or recent precipitation event can produce either 1) an overestimation of soil moisture due to short-term surface wetting of vegetation and/or surface ponding (if soil moisture retrieval was attempted in the presence of rain) or 2) an unnecessary nonretrieval of soil moisture and loss of data (if retrieval is flagged due to an erroneous indication of rain). Satellite precipitation estimates from the Integrated Multisatellite Retrievals for GPM (IMERG), version 06, Early Run (latency of ~4 h) precipitationCal product are used here to evaluate the GEOS-based precipitation flag in the L2SMP product for both the 1800 local time (LT) ascending and 0600 LT descending SMAP overpasses over the first five years of the mission (2015–20). Consisting of blended precipitation measurements from the Global Precipitation Mission (GPM) satellite constellation, IMERG is treated as the “truth” when comparing to the GEOS model forecasts of precipitation used by SMAP. Key results include (i) IMERG measurements generally show higher spatial variability than the GEOS forecast precipitation, (ii) the IMERG product has a higher frequency of light precipitation amounts, and (iii) the effect of incorporating IMERG rainfall measurements in lieu of GEOS precipitation forecasts are minimal on the L2SMP retrieval accuracy (determined vs in situ soil moisture measurements at core validation sites). Our results indicate that L2SMP retrievals continue to meet the mission’s accuracy requirement [standard deviation of the unbiased RMSE (ubRMSE) less than 0.04 cu. m/cu. m].

IMERG-precipitationCal↗

Use of sensitivity analysis to predict pilot performance as a function of different displays

A technique for objectively evaluating different displays by sensitivity analysis is described. First, the mathematical model used to analyze static displays is developed. The technique is based on formulating functional relationships between the state variables and the variables observable in the display. The matrix of the partial derivatives of the display variables with respect to the state variables, together with the observer's acuity function, is used to calculate expected errors in the state vector estimation. The technique is expanded by the use of Kalman filtering to process a time series of observation vectors. This provides a tool for analyzing displays of dynamic processes by means of a dynamic display evaluation computer program. Results are reported using this program to simulate an Instrument Landing System approach.

Mout, M. L.↗

Leveraging Machine Learning Capabilities for the Characterization of Irradiated Uranium: A Case Study of Analysis Methods for Nuclear Safeguards and Nuclear Forensics

Nondestructively determining the initial enrichment of irradiated uranium is a complex and laborious multivariable problem due to the presence of fission products. This work demonstrates the capabilities of machine learning to analyze gamma-ray spectral data to determine initial enrichment without knowledge of the decay time of the sample. The approach developed is agnostic to the particular scenario and is applicable to a wide variety of applications in nuclear forensics and nuclear safeguards. We irradiated 5 mg uranium standard reference materials at discrete enrichment values ranging from 0.02% to 97% 235 U (weight percent) in UT Austin’s Nuclear Engineering Teaching Laboratory TRIGA Mark II 1.1 MW research reactor, allowed each to decay for 8 hours, and then measured each sample via gamma-ray spectrometry for 50 hours post-irradiation yielding 1,400 individual gamma-ray spectra discretized into 8,192 energy bins. We then trained decision trees models to analyze individual gamma-ray spectra and estimate the associated initial enrichment without knowledge of the time since end of irradiation. We evaluated the performance of the models with a reserved test set not used for training or calibrating the model. A decision tree model constructed with this procedure achieved a mean absolute error in initial enrichment determination of 2.3% (weight percent 235 U). Next, we implemented a principal component analysis pre-processing routine of the gamma-ray spectrometry data to reduce the dimensionality of the dataset from 8,192 channels in the spectrum to 10 principal components while retaining over 99% of the inherent variance in the data. Decision tree models constructed with these data demonstrated decreased mean absolute error in enrichment determination, reduced computational time, and decreased complexity. A single decision tree model constructed with this procedure achieved a mean absolute error in initial enrichment determination of 0.05% (weight percent 235 U). Furthermore, we analyzed these models with learning curves to ensure that overfitting did not occur. The capabilities provided by these models can be naturally extended to other application-focused measurements in the fields of nuclear safeguards, nuclear forensics, and nuclear non-proliferation.

Drescher, Adam↗

Effects of error covariance structure on estimation of model averaging weights and predictive performance

When conducting model averaging for assessing groundwater conceptual model uncertainty, the averaging weights are often evaluated using model selection criteria such as AIC, AICc, BIC, and KIC (Akaike Information Criterion, Corrected Akaike Information Criterion, Bayesian Information Criterion, and Kashyap Information Criterion, respectively). However, this method often leads to an unrealistic situation in which the best model receives overwhelmingly large averaging weight (close to 100%), which cannot be justified by available data and knowledge. It was found in this study that this problem was caused by using the covariance matrix, CE, of measurement errors for estimating the negative log likelihood function common to all the model selection criteria. This problem can be resolved by using the covariance matrix, Cek, of total errors (including model errors and measurement errors) to account for the correlation between the total errors. An iterative two-stage method was developed in the context of maximum likelihood inverse modeling to iteratively infer the unknown Cek from the residuals during model calibration. The inferred Cek was then used in the evaluation of model selection criteria and model averaging weights. While this method was limited to serial data using time series techniques in this study, it can be extended to spatial data using geostatistical techniques. The method was first evaluated in a synthetic study and then applied to an experimental study, in which alternative surface complexation models were developed to simulate column experiments of uranium reactive transport. It was found that the total errors of the alternative models were temporally correlated due to the model errors. The iterative two-stage method using Cek resolved the problem that the best model receives 100% model averaging weight, and the resulting model averaging weights were supported by the calibration results and physical understanding of the alternative models. Using Cek obtained from the iterative two-stage method also improved predictive performance of the individual models and model averaging in both synthetic and experimental studies.

error correlation↗

Design of set-point weighting PI{sup λ} + D{sup μ} controller for vertical magnetic flux controller in Damavand tokamak

In this paper, a simple method is presented for tuning weighted PI{sup λ} + D{sup μ} controller parameters based on the pole placement controller of pseudo-second-order fractional systems. One of the advantages of this controller is capability of reducing the disturbance effects and improving response to input, simultaneously. In the following sections, the performance of this controller is evaluated experimentally to control the vertical magnetic flux in Damavand tokamak. For this work, at first a fractional order model is identified using output-error technique in time domain. For various practical experiments, having desired time responses for magnetic flux in Damavand tokamak, is vital. To approach this, at first the desired closed loop reference models are obtained based on generalized characteristic ratio assignment method in fractional order systems. After that, for the identified model, a set-point weighting PI{sup λ} + D{sup μ} controller is designed and simulated. Finally, this controller is implemented on digital signal processor control system of the plant to fast/slow control of magnetic flux. The practical results show appropriate performance of this controller.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of a pair-based, joint-likelihood association approach for regional infrasound event identification

SUMMARY A Bayesian framework for the association of infrasonic detections is presented and evaluated for analysis at regional propagation scales. A pair-based, joint-likelihood association approach is developed that identifies events by computing the probability that individual detection pairs are attributable to a hypothetical common source and applying hierarchical clustering to identify events from the pair-based analysis. The framework is based on a Bayesian formulation introduced for infrasonic source localization and utilizes the propagation models developed for that application with modifications to improve the numerical efficiency of the analysis. Clustering analysis is completed using hierarchical analysis via weighted linkage for a non-Euclidean distance matrix defined by the negative log-joint-likelihood values. The method is evaluated using regional synthetic data with propagation distances of hundreds of kilometres in order to study the sensitivity of the method to uncertainties and errors in backazimuth and time of arrival. The method is found to be robust and stable for typical uncertainties, able to effectively distinguish noise detections within the data set from those in events, and can be made numerically efficient due to its ease of parallelization.

58 GEOSCIENCES↗

Fast Euler solver for steady, 1-dimensional flows

A numerical technique to solve the Euler equations for steady, one dimensional flows is presented. The technique is essentially implicit, but is structured as a sequence of explicit solutions for each Riemann variable separately. Each solution is obtained by integrating in the direction prescribed by the propagation of the Riemann variables. The technique is second-order accurate. It requires very few steps for convergence, and each step requires a minimal number of operations. Therefore, it is three orders of magnitude more efficient than a standard time-dependent technique. The technique works very well for transonic flows and provides shock fitting with errors as small as 0.001. Results are presented for subsonic problems. Errors are evaluated by comparison with exact solutions.

Moretti, G.↗

Guidance concepts for time-based flight operations

Airport congestion and the associated delays are severe in today's airspace system and are expected to increase. NASA and the FAA is investigating various methods of alleviating this problem through new technology and operational procedures. One concept for improving airspace productivity is time-based control of aircraft. Research to date has focused primarily on the development of time-based flight management systems and Air Traffic Control operational procedures. Flight operations may, however, require special onboard guidance in order to satisfy the Air Traffic Control imposed time constraints. The results are presented of a simulation study aimed at evaluating several time-based guidance concepts in terms of tracking performance, pilot workload, and subjective preference. The guidance concepts tested varied in complexity from simple digital time-error feedback to an advanced time-referenced-energy guidance scheme.

Vicroy, Dan D.↗