Search NASA⌕ Search

SEARCH · Search NASA

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

Automated segmentation of cerebral vasculature with aneurysms in 3DRA and TOF-MRA using geodesic active regions: An evaluation study

Purpose: To evaluate the suitability of an improved version of an automatic segmentation method based on geodesic active regions (GAR) for segmenting cerebral vasculature with aneurysms from 3D x-ray reconstruction angiography (3DRA) and time of flight magnetic resonance angiography (TOF-MRA) images available in the clinical routine. Methods: Three aspects of the GAR method have been improved: execution time, robustness to variability in imaging protocols, and robustness to variability in image spatial resolutions. The improved GAR was retrospectively evaluated on images from patients containing intracranial aneurysms in the area of the Circle of Willis and imaged with two modalities: 3DRA and TOF-MRA. Images were obtained from two clinical centers, each using different imaging equipment. Evaluation included qualitative and quantitative analyses of the segmentation results on 20 images from 10 patients. The gold standard was built from 660 cross-sections (33 per image) of vessels and aneurysms, manually measured by interventional neuroradiologists. GAR has also been compared to an interactive segmentation method: isointensity surface extraction (ISE). In addition, since patients had been imaged with the two modalities, we performed an intermodality agreement analysis with respect to both the manual measurements and each of the two segmentation methods. Results: Both GAR and ISE differed from the gold standard within acceptable limits compared to the imaging resolution. GAR (ISE) had an average accuracy of 0.20 (0.24) mm for 3DRA and 0.27 (0.30) mm for TOF-MRA, and had a repeatability of 0.05 (0.20) mm. Compared to ISE, GAR had a lower qualitative error in the vessel region and a lower quantitative error in the aneurysm region. The repeatability of GAR was superior to manual measurements and ISE. The intermodality agreement was similar between GAR and the manual measurements. Conclusions: The improved GAR method outperformed ISE qualitatively as well as quantitatively and is suitable for segmenting 3DRA and TOF-MRA images from clinical routine.

60 APPLIED LIFE SCIENCES↗

Statistical change detection of building energy consumption: Applications to savings estimation

The surge in interval meter data availability and associated activity in energy data analytics has inspired new interest in advanced methods for building efficiency savings estimation. Statistical and machine learning approaches are being explored to improve the energy baseline models used to measure and verify savings. One outstanding challenge is the ability to identify and account for operational changes that may confound savings estimates. In the measurement and verification (M&V) context, ‘non-routine events’ (NREs) cause changes in building energy use that are not attributable to installed efficiency measures, and not accounted for in the baseline model’s independent variables. In the M&V process NREs must be accounted for as ‘adjustments’ to appropriately attribute the estimated energy savings to the specific efficiency interventions that were implemented. Currently this is a manual and custom process, conducted using professional judgment and engineering expertise. As such it remains a barrier in scaling and standardizing meter-based savings estimation. Here in this work, a data driven methodology was developed to (partially) automate, and therefore streamline the process of detecting NREs in the post-retrofit period and making associated savings adjustments. The proposed NRE detection algorithm is based on a statistical change point detection method and a dissimilarity metric. The dissimilarity metric measures the proximity between the actual time series of the post-retrofit energy consumption and the projected baseline, which is generated using a statistical baseline model. The suggested approach for NRE adjustment involves the NRE detection algorithm, the M&V practitioner, and a regression modeling algorithm. The performance of the detection and adjustment algorithm was evaluated using a simulation-generated test data set, and two benchmark algorithms. Results show a high true positive detection rate (75%-100% across the test cases), higher than ideal false positive detection rates (20%-70%), and low errors in energy adjustment (<0.7%). These results indicate that the algorithm holds for helping M&V practitioners to streamline the process of handling NREs. Moreover, the change point algorithm and underlying statistical principles could prove valuable for other building analytics applications such as anomaly detection and fault diagnostics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Glass formulation and composition optimization with property models: A review

Abstract Glass is a versatile material with a remarkable history and many practical applications. It plays a critical role in our everyday lives, the advancement of science, and the development of many technologies. The Edisonian type trial‐and‐error method was commonly used for conventional design of glass compositions, which was time‐consuming and costly. With the urgent need to develop new glass compositions for technology applications rapidly, it has become necessary to develop precise property models with predictive powers using large databases and efficient formulation approaches. This paper reviews the design of glass compositions using these analytical and numerical models of composition–structure–property relations of glasses, some based on large databases and machine learning approaches. Aspects of data collection, model fitting, feature extraction, model evaluation, and uncertainty quantification will be covered. Furthermore, advances in the glass optimization framework and available tools are summarized with examples. The outlook and perspective for further glass property model development and formulation approaches are discussed.

Lu, Xiaonan↗

A quick guide for student-driven community genome annotation

High quality gene models are necessary to expand the molecular and genetic tools available for a target organism, but these are available for only a handful of model organisms that have undergone extensive curation and experimental validation over the course of many years. The majority of gene models present in biological databases today have been identified in draft genome assemblies using automated annotation pipelines that are frequently based on orthologs from distantly related model organisms and usually have minor or major errors. Manual curation is time consuming and often requires substantial expertise, but is instrumental in improving gene model structure and identification. Manual annotation may seem to be a daunting and cost-prohibitive task for small research communities but involving undergraduates in community genome annotation consortiums can be mutually beneficial for both education and improved genomic resources. We outline a workflow for efficient manual annotation driven by a team of primarily undergraduate annotators. This model can be scaled to large teams and includes quality control processes through incremental evaluation. Moreover, it gives students an opportunity to increase their understanding of genome biology and to participate in scientific research in collaboration with peers and senior researchers at multiple institutions.

59 BASIC BIOLOGICAL SCIENCES↗

Enabling Explosives and Contraband Detection

We present the design and performance of a proof-of-concept 32 channel material identification system. Our system is based on the energy-dependent attenuation of fast neutrons for four elements: hydrogen, carbon, nitrogen and oxygen. We describe a new approach to obtaining a broad range of neutron energies to probe a sample, as well as our technique for reconstructing the molar densities within a sample. The system's performance as a function of time-of-flight energy resolution is explored using a Geant4-based Monte Carlo. Our results indicate that, with the expected detector response of our system, we will be able to determine the molar density of all four elements to within a 20-30% accuracy in a two hour scan time. In many cases this error is systematically low, thus the ratio between elements is more accurate. This degree of accuracy is enough to distinguish, for example, a sample of water from a sample of pure hydrogen peroxide: the ratio of oxygen to hydrogen is reconstructed to within 8 0.5% of the true value. Finally, with future algorithm development that accounts for backgrounds caused by scattering within the sample itself, the accuracy of molar densities, not ratios, may improve to the 5-10% level for a two hour scan time. Experimental performance was evaluated with various thicknesses of polyethylene. The detector response in terms of energy, particle identification, and timing are presented as well.

42 ENGINEERING↗

Random Forest Regressor-Based Approach for Detecting Fault Location and Duration in Power Systems

Power system failures or outages due to short-circuits or “faults” can result in long service interruptions leading to significant socio-economic consequences. It is critical for electrical utilities to quickly ascertain fault characteristics, including location, type, and duration, to reduce the service time of an outage. Existing fault detection mechanisms (relays and digital fault recorders) are slow to communicate the fault characteristics upstream to the substations and control centers for action to be taken quickly. Fortunately, due to availability of high-resolution phasor measurement units (PMUs), more event-driven solutions can be captured in real time. In this paper, we propose a data-driven approach for determining fault characteristics using samples of fault trajectories. A random forest regressor (RFR)-based model is used to detect real-time fault location and its duration simultaneously. This model is based on combining multiple uncorrelated trees with state-of-the-art boosting and aggregating techniques in order to obtain robust generalizations and greater accuracy without overfitting or underfitting. Four cases were studied to evaluate the performance of RFR: 1. Detecting fault location (case 1), 2. Predicting fault duration (case 2), 3. Handling missing data (case 3), and 4. Identifying fault location and length in a real-time streaming environment (case 4). A comparative analysis was conducted between the RFR algorithm and state-of-the-art models, including deep neural network, Hoeffding tree, neural network, support vector machine, decision tree, naive Bayesian, and K-nearest neighborhood. Experiments revealed that RFR consistently outperformed the other models in detection accuracy, prediction error, and processing time.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Application of Lidar to Synthetic Vision System Integrity

One goal in the development of a Synthetic Vision System (SVS) is to create a system that can be certified by the Federal Aviation Administration (FAA) for use at various flight criticality levels. As part of NASA s Aviation Safety Program, Ohio University and NASA Langley have been involved in the research and development of real-time terrain database integrity monitors for SVS. Integrity monitors based on a consistency check with onboard sensors may be required if the inherent terrain database integrity is not sufficient for a particular operation. Sensors such as the radar altimeter and weather radar, which are available on most commercial aircraft, are currently being investigated for use in a real-time terrain database integrity monitor. This paper introduces the concept of using a Light Detection And Ranging (LiDAR) sensor as part of a real-time terrain database integrity monitor. A LiDAR system consists of a scanning laser ranger, an inertial measurement unit (IMU), and a Global Positioning System (GPS) receiver. Information from these three sensors can be combined to generate synthesized terrain models (profiles), which can then be compared to the stored SVS terrain model. This paper discusses an initial performance evaluation of the LiDAR-based terrain database integrity monitor using LiDAR data collected over Reno, Nevada. The paper will address the consistency checking mechanism and test statistic, sensitivity to position errors, and a comparison of the LiDAR-based integrity monitor to a radar altimeter-based integrity monitor.

Campbell, Jacob L.↗

Probability effects on stimulus evaluation and response processes

This study investigated the effects of probability information on response preparation and stimulus evaluation. Eight subjects responded with one hand to the target letter H and with the other to the target letter S. The target letter was surrounded by noise letters that were either the same as or different from the target letter. In 2 conditions, the targets were preceded by a warning stimulus unrelated to the target letter. In 2 other conditions, a warning letter predicted that the same letter or the opposite letter would appear as the imperative stimulus with .80 probability. Correct reaction times were faster and error rates were lower when imperative stimuli confirmed the predictions of the warning stimulus. Probability information affected (a) the preparation of motor responses during the foreperiod, (b) the development of expectancies for a particular target letter, and (c) a process sensitive to the identities of letter stimuli but not to their locations.

Non-NASA Center↗

The Brewer–Dobson Circulation in CMIP6

The Brewer–Dobson circulation (BDC) is a key feature of the stratosphere that models need to accurately represent in order to simulate surface climate variability and change adequately. For the first time, the Climate Model Intercomparison Project includes in its phase 6 (CMIP6) a set of diagnostics that allow for careful evaluation of the BDC. Here, the BDC is evaluated against observations and reanalyses using historical simulations. CMIP6 results confirm the well-known inconsistency in the sign of BDC trends between observations and models in the middle and upper stratosphere. Nevertheless, the large uncertainty in the observational trend estimates opens the door to compatibility. In particular, when accounting for the limited sampling of the observations, model and observational trend error bars overlap in 40 % of the simulations with available output. The increasing CO2 simulations feature an acceleration of the BDC but reveal a large spread in the middle-to-upper stratospheric trends, possibly related to the parameterized gravity wave forcing. The very close connection between the shallow branch of the residual circulation and surface temperature is highlighted, which is absent in the deep branch. The trends in mean age of air are shown to be more robust throughout the stratosphere than those in the residual circulation.

Brewer–Dobson circulation↗

Characterizing the Impact of Equatorial Plasma Bubbles on GNSS Accuracy for Crop Yield Estimation in Brazil with NASA GOLD Data

In Brazil, equatorial plasma bubbles are the primary space weather phenomenon impacting the performance of Global Navigation Satellite Systems (GNSS), causing signal disruptions and positional inaccuracies in agricultural machinery used for mapping fields, guiding machinery, and ensuring accurate planting, spraying, and harvesting. As a result, farmers and stakeholders face challenges in maintaining accurate operational capabilities, often needing to shut down machinery to mitigate these effects. This project evaluated the feasibility of using NASA’s Heliophysics observations for a case study in March 2024. Data from NASA's Global-scale Observations of the Limb and Disk (GOLD) instrument were used to characterize equatorial plasma bubbles, while amplitude and phase indices from ground-based GNSS receivers confirmed their presence and impact on signal disruptions. Additionally, data from a local farm's rover receiver assessed the practical implications of these disruptions on Real-Time Kinematic (RTK) GNSS-based operations by calculating the 2-dimensional error. The project involved collaboration across multiple different organizations and sectors, including NASA’s Crustal Dynamics Data Information System (CDDIS) researchers, John Deere, a Brazilian farm for data acquisition, and Brazilian universities for data interpretation. The results aim to inform Brazilian farmers about position errors affecting their precision agriculture operations and provide insights into the needs of space weather data users and modeling. Lessons from this case study will guide future integration of space weather data and modeling with end users.

Melissa Marquez↗

Process-Based Balance-of-System Cost Modeling for Offshore Wind Power Plants in the United States: Preprint

This work describes the development of a process based and open source balance of system cost model which provides the capability to evaluate both existing and novel offshore wind technologies. Individual design and installation steps are represented with bottom-up engineering models that compute the times and costs associated with the process; furthermore, operational constraints are assigned to each process so that delays due to weather and presence of marine mammals may be accounted for in the overall project timeline. The model structure, assumptions, inputs, and results are vetted with industry partners and compared against actual projects for validation; installation times are shown to agree with real data with relative errors of less than 35\%. Case studies are presented to demonstrate the functionality of the model. First, individual vessel efficiencies are computed for varying numbers of installation vessels and weather time series to show the diminishing returns of more than two feeder barges. Then, array cable capital costs and installation times are determined for a representative project with different turbine sizes. This quantifies the cost benefit tradeoffs of decreasing number of turbines, increased turbine spacing, and fewer turbine terminations and shows a net cost savings. These results demonstrate that the BOS model features the accuracy, functionality, and accessibility to serve as the foundation for a wide range of analyses to identify cost reduction potentials for offshore wind energy in the United States.

17 WIND ENERGY↗

Simulated building energy demand biases resulting from the use of representative weather stations

Numerical building models are typically forced with weather data from a limited number of “representative cities” or weather stations representing different climate regions. The use of representative weather stations reduces computational costs, but often fails to capture spatial heterogeneity in weather that may be important for simulations aimed at understanding how building stocks respond to a changing climate. We quantify the potential reduction in bias from using an increasing number of weather stations over the western U.S. The approach is based on deriving temperature and load time series using incrementally more weather stations, ranging from 8 to roughly 150, to capture weather across different seasons. Using 8 stations, one from each climate zone, across the western U.S. results in an average absolute summertime temperature bias of 7.2°F with respect to a spatially-resolved gridded dataset. The mean absolute bias drops to 2.8°F using all available weather stations. Temperature biases of this magnitude could translate to absolute summertime mean simulated load biases as high as 13.8%, a significant error for capacity expansion planners who may use these types of simulations. Increasing the size of the domain over which biases are calculated reduces their magnitude as positive and negative biases may cancel out. Using 8 representative weather stations can lead to a 20-40% overestimation of peak building loads during both summer and winter. Using weather stations close to population centers reduces both mean and peak load biases. This approach could be used by others designing aggregate building simulations to understand the sensitivity to their choice of weather stations used to drive the models.

Burleyson, Casey D.↗

A flight evaluation of a trailing anemometer for low-speed calibrations of airspeed systems on research aircraft

Research airspeed systems on three low-speed general aviation airplanes were calibrated by the trailing anemometer method. Each airplane was fitted with an NASA pitot-static pressure tube mounted on either a nose or wing boom. The uncalibrated airspeed systems contained residual static-pressure position errors which were too large for high-accuracy flight research applications. The trailing anemometer calibration was in agreement with the tower flyby calibration for the one aircraft for which the comparison was made. The continuous deceleration technique for the trailing anemometer method offers reduced test time with no appreciable loss of accuracy for airspeed systems with pitot-static system lag characteristics similar to those described.

Fisher, B. D.↗

SU-E-T-638: Evaluation and Comparison of Landauer Microstar (OSLD) Readers

Purpose: To evaluate and compare characteristic performance of a new Landauer nanodot Reader with the previous model. Methods: In order to calibrate and test the reader, a set of nanodots were irradiated using a Varian Truebeam Linac. Solid water slabs and bolus were used in the process of irradiation. Calibration sets of nanodots were irradiated for radiation dose ranges: 0 to 10 and 20 to 1000 cGy, using 6MV photons. Additionally, three sets of nanodots were each irradiated using 6MV, 10MV and 15MV beams. For each beam energy, and selected dose in the range of 3 to 1000 cGy, a pair of nanodots was irradiated and three readings were obtained with both readers. Results: The analysis shows that for 3 photon beam energies and selected ranges of dose, the calculated absorbed dose agrees well with the expected value. The results illustrate that the new Microstar II reader is a highly consistent system and that the repeated readings provide results with a reasonably small standard deviation. For all practical purposes, the response of system is linear for all radiation beam energies. Conclusion: The Microstar II nanodot reader is consistent, accurate, and reliable. The new hardware design and corresponding software contain several advantages over the previous model. The automatic repeat reading mechanism, that helps improve reproducibility and reduce processing time, and the smaller unit size that renders ease of transport, are two of such features. Present study shows that for high dose ranges a polynomial calibration equation provides more consistent results. A 3rd order polynomial calibration curve was used to analyze the readings of dosimeters exposed to high dose range radiation. It was observed that the results show less error compared to those calculated by using linear calibration curves, as provided by Landauer system software for all dose ranges.

60 APPLIED LIFE SCIENCES↗

Diagnosing and Correcting Mass Accuracy and Signal Intensity Error Due to Initial Ion Position Variations in a MALDI TOFMS

Frustrated by worse than expected error for both peak area and time-of-flight (TOF) in matrix assisted laser desorption ionization (MALDI) experiments using samples prepared by electrospray deposition, it was finally determined that there was a correlation between sample location on the target plate and the measured TOF/peak area. Variations in both TOF and peak area were found to be due to small differences in the initial position of ions formed in the source region of the TOF mass spectrometer. These differences arise largely from misalignment of the instrument sample stage, with a smaller contribution arising from the non-ideal shape of the target plates used. By physically measuring the target plates used and comparing TOF data collected from three different instruments, an estimate of the magnitude and direction of the sample stage misalignment was determined for each of the instruments. A correction method was developed to correct the TOFs and peak areas obtained for a given combination of target plate and instrument. Two correction factors are determined, one by initially collecting spectra from each sample position used and another by using spectra from a single position for each set of samples on a target plate. For TOF and mass values, use of the correction factor reduced the error by a factor of 4, with the relative standard deviation (RSD) of the corrected masses being reduced to 12-24 ppm. For the peak areas, the RSD was reduced from 28% to 16% for samples deposited twice onto two target plates over two days. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of SNS Beamline Shielding Configurations using MCNPX Accelerated by ADVANTG

Shielding analyses for the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory pose significant computational challenges, including highly anisotropic high-energy sources, a combination of deep penetration shielding and an unshielded beamline, and a desire to obtain well-converged nearly global solutions for mapping of predicted radiation fields. The majority of these analyses have been performed using MCNPX with manually generated variance reduction parameters (source biasing and cell-based splitting and Russian roulette) that were largely based on the analyst's insight into the problem specifics. Development of the variance reduction parameters required extensive analyst time, and was often tailored to specific portions of the model phase space. We previously applied a developmental version of the ADVANTG code to an SNS beamline study to perform a hybrid deterministic/Monte Carlo analysis and showed that we could obtain nearly global Monte Carlo solutions with essentially uniform relative errors for mesh tallies that cover extensive portions of the model with typical voxel spacing of a few centimeters. The use of weight window maps and consistent biased sources produced using the FW-CADIS methodology in ADVANTG allowed us to obtain these solutions using substantially less computer time than the previous cell-based splitting approach. While those results were promising, the process of using the developmental version of ADVANTG was somewhat laborious, requiring user-developed Python scripts to drive much of the analysis sequence. In addition, limitations imposed by the size of weight-window files in MCNPX necessitated the use of relatively coarse spatial and energy discretization for the deterministic Denovo calculations that we used to generate the variance reduction parameters. We recently applied the production version of ADVANTG to this beamline analysis, which substantially streamlined the analysis process. We also tested importance function collapsing (in space and energy) capabilities in ADVANTG. These changes, along with the support for parallel Denovo calculations using the current version of ADVANTG, give us the capability to improve the fidelity of the deterministic portion of the hybrid analysis sequence, obtain improved weight-window maps, and reduce both the analyst and computational time required for the analysis process.

43 PARTICLE ACCELERATORS↗

ON MACHINE-LEARNED CLASSIFICATION OF VARIABLE STARS WITH SPARSE AND NOISY TIME-SERIES DATA

With the coming data deluge from synoptic surveys, there is a need for frameworks that can quickly and automatically produce calibrated classification probabilities for newly observed variables based on small numbers of time-series measurements. In this paper, we introduce a methodology for variable-star classification, drawing from modern machine-learning techniques. We describe how to homogenize the information gleaned from light curves by selection and computation of real-numbered metrics (features), detail methods to robustly estimate periodic features, introduce tree-ensemble methods for accurate variable-star classification, and show how to rigorously evaluate a classifier using cross validation. On a 25-class data set of 1542 well-studied variable stars, we achieve a 22.8% error rate using the random forest (RF) classifier; this represents a 24% improvement over the best previous classifier on these data. This methodology is effective for identifying samples of specific science classes: for pulsational variables used in Milky Way tomography we obtain a discovery efficiency of 98.2% and for eclipsing systems we find an efficiency of 99.1%, both at 95% purity. The RF classifier is superior to other methods in terms of accuracy, speed, and relative immunity to irrelevant features; the RF can also be used to estimate the importance of each feature in classification. Additionally, we present the first astronomical use of hierarchical classification methods to incorporate a known class taxonomy in the classifier, which reduces the catastrophic error rate from 8% to 7.8%. Excluding low-amplitude sources, the overall error rate improves to 14%, with a catastrophic error rate of 3.5%.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗