Search NASA⌕ Search

SEARCH · Search NASA

Results for “false negative”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Simulation to assess the efficacy of US airport entry scrreening of passengers for pandemic influenza

We present our methodology and stochastic discrete-event simulation developed to model the screening of passengers for pandemic influenza at the US port-of-entry airports. Our model uniquely combines epidemiology modelling, evolving infected states and conditions of passengers over time, and operational considerations of screening in a single simulation. The simulation begins with international aircraft arrivals to the US. Passengers are then randomly assigned to one of three states -- not infected, infected with pandemic influenza and infected with other respiratory illness. Passengers then pass through various screening layers (i.e. pre-departure screening, en route screening, primary screening and secondary screening) and ultimately exit the system. We track the status of each passenger over time, with a special emphasis on false negatives (i.e. passengers infected with pandemic influenza, but are not identified as such) as these passengers pose a significant threat as they could unknowingly spread the pandemic influenza virus throughout our nation.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Simulation Model of Mobile Detection Systems

In this paper, we consider a mobile source that we attempt to detect with man-portable, vehicle-mounted or boat-mounted radiation detectors. The source is assumed to transit an area populated with these mobile detectors, and the objective is to detect the source before it reaches a perimeter. We describe a simulation model developed to estimate the probability that one of the mobile detectors will come in to close proximity of the moving source and detect it. We illustrate with a maritime simulation example. Our simulation takes place in a 10 km by 5 km rectangular bay patrolled by boats equipped with 2-inch x 4-inch x 16-inch NaI detectors. Boats to be inspected enter the bay and randomly proceed to one of seven harbors on the shore. A source-bearing boat enters the mouth of the bay and proceeds to a pier on the opposite side. We wish to determine the probability that the source is detected and its range from target when detected. Patrol boats select the nearest in-bound boat for inspection and initiate an intercept course. Once within an operational range for the detection system, a detection algorithm is started. If the patrol boat confirms the source is not present, it selects the next nearest boat for inspection. Each run of the simulation ends either when a patrol successfully detects a source or when the source reaches its target. Several statistical detection algorithms have been implemented in the simulation model. First, a simple k-sigma algorithm, which alarms with the counts in a time window exceeds the mean background plus k times the standard deviation of background, is available to the user. The time window used is optimized with respect to the signal-to-background ratio for that range and relative speed. Second, a sequential probability ratio test [Wald 1947] is available, and configured in this simulation with a target false positive probability of 0.001 and false negative probability of 0.1. This test is utilized when the mobile detector maintains a constant range to the vessel being inspected. Finally, a variation of the sequential probability ratio test that is more appropriate when source and detector are not at constant range is available [Nelson 2005]. Each patrol boat in the fleet can be assigned a particular zone of the bay, or all boats can be assigned to monitor the entire bay. Boats assigned to a zone will only intercept and inspect other boats when they enter their zone. In our example simulation, each of two patrol boats operate in a 5 km by 5 km zone. Other parameters for this example include: (1) Detection range - 15 m range maintained between patrol boat and inspected boat; (2) Inbound boat arrival rate - Poisson process with mean arrival rate of 30 boats per hour; (3) Speed of boats to be inspected - Random between 4.5 and 9 knots; (4) Patrol boat speed - 10 knots; (5) Number of detectors per patrol boat - 4-2-inch x 4-inch x 16-inch NaI detectors; (6) Background radiation - 40 counts/sec per detector; and (7) Detector response due to radiation source at 1 meter - 1,589 counts/sec per detector. Simulation results indicate that two patrol boats are able to detect the source 81% of the time without zones and 90% of the time with zones. The average distances between the source and target at the end of the simulation is 5,866 km and 5,712 km for non-zoned and zoned patrols, respectively. Of those that did not reach the target, the average distance to the target is 7,305 km and 6,441 km respectively. Note that a design trade-off exists. While zoned patrols provide a higher probability of detection, the nonzoned patrols tend to detect the source farther from its target. Figure 1 displays the location of the source at the end of 1,000 simulations for the 5 x 10 km bay simulation. The simulation model and analysis described here can be used to determine the number of mobile detectors one would need to deploy in order to have a have reasonable chance of detecting a source in transit. By fixing the source speed to zero, the same model could be used to estimate how long it would take to detect a stationary source. For example, the model could predict how long it would take plant staff performing assigned duties carrying dosimeters to discover a contaminated spot in the facility.

61 RADIATION PROTECTION AND DOSIMETRY↗

Sensor Networks for Detecting Toxic Releases in Buildings

Sudden releases of a toxic agent indoors can cause immediate and long-term harm to occupants. In order to protect building occupants from such threats, it is necessary to have a robust air monitoring system that can detect, locate, and characterize accidental or deliberate toxic gas releases. However, developing such a system is complicated by several requirements, in particular the need to operate in real-time. This task is further complicated when monitoring sensors are prone to false positive and false negative readings. We report on work towards developing an indoor monitoring system that is robust even in the presence of poor quality sensor data. The algorithm, named BASSET, combines deterministic modeling and Bayesian statistics to join prior knowledge of the contaminant transport in the building with real-time sensor information. We evaluate BASSET across several data sets, which vary in sensor characteristics such as accuracy, response time, and trigger level. Our results suggest that optimal designs are not always intuitive. For example, a network comprised of slower but more accurate sensors may locate the contaminant source more quickly than a network with faster but less accurate sensors.

54 ENVIRONMENTAL SCIENCES↗

Quantifying the impact of respiratory-gated 4D CT acquisition on thoracic image quality: A digital phantom study

Purpose: Prospective respiratory-gated 4D CT has been shown to reduce tumor image artifacts by up to 50% compared to conventional 4D CT. However, to date no studies have quantified the impact of gated 4D CT on normal lung tissue imaging, which is important in performing dose calculations based on accurate estimates of lung volume and structure. To determine the impact of gated 4D CT on thoracic image quality, the authors developed a novel simulation framework incorporating a realistic deformable digital phantom driven by patient tumor motion patterns. Based on this framework, the authors test the hypothesis that respiratory-gated 4D CT can significantly reduce lung imaging artifacts. Methods: Our simulation framework synchronizes the 4D extended cardiac torso (XCAT) phantom with tumor motion data in a quasi real-time fashion, allowing simulation of three 4D CT acquisition modes featuring different levels of respiratory feedback: (i) “conventional” 4D CT that uses a constant imaging and couch-shift frequency, (ii) “beam paused” 4D CT that interrupts imaging to avoid oversampling at a given couch position and respiratory phase, and (iii) “respiratory-gated” 4D CT that triggers acquisition only when the respiratory motion fulfills phase-specific displacement gating windows based on prescan breathing data. Our framework generates a set of ground truth comparators, representing the average XCAT anatomy during beam-on for each of ten respiratory phase bins. Based on this framework, the authors simulated conventional, beam-paused, and respiratory-gated 4D CT images using tumor motion patterns from seven lung cancer patients across 13 treatment fractions, with a simulated 5.5 cm{sup 3} spherical lesion. Normal lung tissue image quality was quantified by comparing simulated and ground truth images in terms of overall mean square error (MSE) intensity difference, threshold-based lung volume error, and fractional false positive/false negative rates. Results: Averaged across all simulations and phase bins, respiratory-gating reduced overall thoracic MSE by 46% compared to conventional 4D CT (p ∼ 10{sup −19}). Gating leads to small but significant (p < 0.02) reductions in lung volume errors (1.8%–1.4%), false positives (4.0%–2.6%), and false negatives (2.7%–1.3%). These percentage reductions correspond to gating reducing image artifacts by 24–90 cm{sup 3} of lung tissue. Similar to earlier studies, gating reduced patient image dose by up to 22%, but with scan time increased by up to 135%. Beam paused 4D CT did not significantly impact normal lung tissue image quality, but did yield similar dose reductions as for respiratory-gating, without the added cost in scanning time. Conclusions: For a typical 6 L lung, respiratory-gated 4D CT can reduce image artifacts affecting up to 90 cm{sup 3} of normal lung tissue compared to conventional acquisition. This image improvement could have important implications for dose calculations based on 4D CT. Where image quality is less critical, beam paused 4D CT is a simple strategy to reduce imaging dose without sacrificing acquisition time.

60 APPLIED LIFE SCIENCES↗

MSPI False Indication Probability Simulations

This paper examines false indication probabilities in the context of the Mitigating System Performance Index (MSPI), in order to investigate the pros and cons of different approaches to resolving two coupled issues: (1) sensitivity to the prior distribution used in calculating the Bayesian-corrected unreliability contribution to the MSPI, and (2) whether (in a particular plant configuration) to model the fuel oil transfer pump (FOTP) as a separate component, or integrally to its emergency diesel generator (EDG). False indication probabilities were calculated for the following situations: (1) all component reliability parameters at their baseline values, so that the true indication is green, meaning that an indication of white or above would be false positive; (2) one or more components degraded to the extent that the true indication would be (mid) white, and “false” would be green (negative) or yellow (negative) or red (negative). In key respects, this was the approach taken in NUREG-1753. The prior distributions examined were the constrained noninformative (CNI) prior used currently by the MSPI, a mixture of conjugate priors, the Jeffreys noninformative prior, a nonconjugate log(istic)-normal prior, and the minimally informative prior investigated in (Kelly et al., 2010). The mid-white performance state was set at ?CDF = ?10 ? 10-6/yr. For each simulated time history, a check is made of whether the calculated ?CDF is above or below 10-6/yr. If the parameters were at their baseline values, and ?CDF > 10-6/yr, this is counted as a false positive. Conversely, if one or all of the parameters are set to values corresponding to ?CDF > 10-6/yr but that time history’s ?CDF < 10-6/yr, this is counted as a false negative indication. The false indication (positive or negative) probability is then estimated as the number of false positive or negative counts divided by the number of time histories (100,000). Results are presented for a set of base case parameter values, and three sensitivity cases in which the number of FOTP demands was reduced, along with the Birnbaum importance of the FOTP.

99 GENERAL AND MISCELLANEOUS↗

BioID/LID System Cartridge Testing Report

LLNL produced two lots of lyophilized LAMP assay containing cartridges, LNL022818 and LNL071818, for testing on Gen3 BioID systems. Thirty-nine cartridges were tested for lot LNL022818. All thirty-nine cartridges performed as expected regarding correct positive control (IPC) and negative control (NTC) reactions. Five different templates were tested on these 39 cartridges. The BioID system detected 79.1% true positives and 9.3% false positives along with 98.9% true negatives and 2.9% false negatives for cartridge lot LNL022818. Thirty cartridges were tested for lot LNL071818. It was noted early that due to a manufacturing issue with the cartridges related to incomplete sonic welding of the cartridge, a large fraction of lot LNL071818 cartridges leaked. Insufficient funds were available to replace this lot of cartridges. Twenty three of 30 cartridges performed as expected regarding correct positive control (IPC) and negative control (NTC) reactions. Four different templates were tested on these 30 cartridges. The BioID system detected 77% true positives and 23% false positives along with 96.9% true negatives and 3.1% false negatives for cartridge lot LNL071818. For all tested cartridges using DNA template, DNA was added at a final concentration of 25 pg/ul. All reactions contained positive control DNA at 2.5 pg/ul.

42 ENGINEERING↗

SU-E-T-754: Three-Dimensional Patient Modeling Using Photogrammetry for Collision Avoidance

Purpose: To evaluate photogrammetry for creating a three-dimensional patient model. Methods: A mannequin was configured on the couch of a CT scanner to simulate a patient setup using an indexed positioning device. A CT fiducial was placed on the indexed CT table-overlay at the reference index position. Two dimensional photogrammetry targets were placed on the table in known positions. A digital SLR camera was used to obtain 27 images from different positions around the CT table. The images were imported into a commercial photogrammetry package and a 3D model constructed. Each photogrammetry target was identified on 2 to 5 images. The CT DICOM metadata and the position of the CT fiducial were used to calculate the coordinates of the photogrammetry targets in the CT image frame of reference. The coordinates were transferred to the photogrammetry software to orient the 3D model. The mannequin setup was transferred to the treatment couch of a linear accelerator and positioned at isocenter using in-room lasers. The treatment couch coordinates were noted and compared with prediction. The collision free regions were measured over the full range of gantry and table motion and were compared with predictions obtained using a general purpose polygon interference algorithm. Results: The reconstructed 3D model consisted of 180000 triangles. The difference between the predicted and measured couch positions were 5 mm, 1 mm, and 1 mm for longitudinal, lateral, and vertical, respectively. The collision prediction tested 64620 gantry table combinations in 11.1 seconds. The accuracy was 96.5%, with false positive and negative results occurring at the boundaries of the collision space. Conclusion: Photogrammetry can be used as a tool for collision avoidance during treatment planning. The results indicate that a buffer zone is necessary to avoid false negatives at the boundary of the collision-free zone. Testing with human patients is underway. Research partially supported by a grant from Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗

Goal-directed ultrasound in the detection of long-bone fractures

BACKGROUND: New portable ultrasound (US) systems are capable of detecting fractures in the remote setting. However, the accuracy of ultrasound by physicians with minimal ultrasound training is unknown. METHODS: After one hour of standardized training, physicians with minimal US experience clinically evaluated patients presenting with pain and trauma to the upper arm or leg. The investigators then performed a long-bone US evaluation, recording their impression of fracture presence or absence. Results of the examination were compared with routine plain or computer aided radiography (CT). RESULTS: 58 patients were examined. The sensitivity and specificity of US were 92.9% and 83.3%, and of the physical examination were 78.6% and 90.0%, respectively. US provided improved sensitivity with less specificity compared with physical examination in the detection of fractures in long bones. CONCLUSION: Ultrasound scans by minimally trained clinicians may be used to rule out a long-bone fracture in patients with a medium to low probability of fracture.

Validation Studies↗

New Insights Into Error Decomposition for Precipitation Products

Abstract It is very important to quantify errors of precipitation estimation products. However, the existing methods do not describe all error components and are therefore not comprehensive enough. In this study, we propose a four‐component error decomposition method (4CED) that decomposes the total errors of precipitation products into four independent parts: hit positive bias, hit negative bias, false bias, and missed bias. And we use it to evaluate the performance of the three latest satellite precipitation products in the eastern monsoon region of China. Our study reveals 4CED has apparent improvements compared with the previous method. Results also provide new insights for tracking error sources and quantifying the error magnitudes of precipitation products. Moreover, the proposed 4CED can be extended to different spatial and temporal scales. Our new method will not only contribute to product upgrades, but also provide guidance for potential applications.

58 GEOSCIENCES↗

Laboratory studies on surface sampling of Bacillus anthracis contamination: summary, gaps, and recommendations

This article summarizes previous laboratory studies to characterize the performance of methods for collecting, storing/transporting, processing, and analyzing samples from surfaces contaminated by Bacillus anthracis or related surrogates. The focus is on plate culture and count estimates of surface contamination for swab, wipe, and vacuum samples of porous and nonporous surfaces. Summaries of the previous studies and their results were assessed to identify gaps in information needed as inputs to calculate key parameters critical to risk management in biothreat incidents. One key parameter is the number of samples needed to make characterization or clearance decisions with specified statistical confidence. Other key parameters include the ability to calculate, following contamination incidents, the 1) estimates of Bacillus anthracis contamination, as well as the bias and uncertainties in the estimates, and 2) confidence in characterization and clearance decisions for contaminated or decontaminated buildings. Gaps in knowledge and understanding identified during the summary of the studies are discussed. Recommendations are given for future evaluations of data from existing studies and possible new studies.

anthrax↗

Laboratory Studies on Surface Sampling of Bacillus anthracis Contamination: Summary, Gaps, and Recommendations

This report summarizes previous laboratory studies to characterize the performance of methods for collecting, storing/transporting, processing, and analyzing samples from surfaces contaminated by Bacillus anthracis or related surrogates. The focus is on plate culture and count estimates of surface contamination for swab, wipe, and vacuum samples of porous and nonporous surfaces. Summaries of the previous studies and their results were assessed to identify gaps in information needed as inputs to calculate key parameters critical to risk management in biothreat incidents. One key parameter is the number of samples needed to make characterization or clearance decisions with specified statistical confidence. Other key parameters include the ability to calculate, following contamination incidents, the (1) estimates of Bacillus anthracis contamination, as well as the bias and uncertainties in the estimates, and (2) confidence in characterization and clearance decisions for contaminated or decontaminated buildings. Gaps in knowledge and understanding identified during the summary of the studies are discussed and recommendations are given for future studies.

59 BASIC BIOLOGICAL SCIENCES↗

Identifying Sociomarkers of Pediatric Asthma Patients at Risk of Hospital Revisiting

ObjectiveAsthma is one of the most common chronic childhood diseases in the United States [2, 3]. In addition to its pervasiveness, pediatric asthma shows high sensitivity to the environment. Combining medical-social dataset with machine learning methods we demonstrate how socio-markers play an important role in identifying patients at risk of hospital revisits due to pediatric asthma within a year.IntroductionA socio-marker is a measurable indicator of social conditions where a patient is embedded in and exposed to, being analogous with a biomarker indicating the severity or presence of some disease state. Social factors are one of the most clinical health determinants [1], which play a critical role in explaining health outcomes. Socio-markers can help medical practitioners and researchers to reliably identify high-risk individuals in a timely manner.MethodsWe collected data from three different sources: pediatric asthma encounter records from Jan 1st, 2016 to Dec 31st, 2016 at a children’s hospital, the 2010 U.S census data and neighborhood quality survey data by Memphis Property Hub. After merging these datasets we examine the effect of social features in identifying the patients who visited the hospital more than once during the observation period. We only use the first time visit (3,678 cases) to avoid over-counting of the same patients. In addition to demographic features (age, gender, insurance type, and race (African American and White)), we incorporate the social features such as the proportion of individuals living below the federal poverty level, blight prevalence, neighborhood quality, neighborhood quality inequality, trash dumping presence, the broken window pervasiveness within the zip code area of patients’ residence are included.We then implemented a Support Vector Machine (SVM) based classification model using abovementioned 11 social features. The classification outcome is either patient visits the hospital only one-time (class 0) or revisits the hospital within a year (class 1). Among 3,678 unique patients in the dataset, only 823 pediatric patients revisited hospital with asthma. So, to overcome the class imbalance issue, we have used 823 patients’ data (randomly selected in 1,000 iterations) from each class. Further, to avoid overfitting and ensure generalizability, we divided the dataset as training, test, and validation with a proportion of 60%, 20%, and 20%, respectively. The reported test (5-folds cross-validation using training and testing data) and validation accuracy of the SVM method are averaged over 1,000 iterations to avoid sampling error and bias.ResultsThe proposed socio-marker model resulted in an average classification accuracy of 63.70% for the test set and 63.67 % for the validation set. Further, the average specificity (the total true negative cases divided by the sum of true negative and false positive) and sensitivity (the total number of true positive cases divided by the sum of positive predicted cases) is found to be 62.79% and 64.77%, respectively for the test set and 62.79% and 64.83%, respectively for the validation set. Results of this study suggest that socio-marker features that are not directly related to a patient’s medical conditions can still predict whether the patient will come back to the hospital within a year or not with approximately 64% accuracy.ConclusionsBringing the socio-marker features in the surveillance system may ease the burden of detecting the patients at risk of revisiting the hospital. The results should be interpreted with caution because we only used 12-month period of observation and the visit beyond the observation window is not considered. Also the patients may have visited different hospitals which are not captured in the data.References1. Booske BC, Athens JK, Kindig DA, Park H, Remington PL: Different perspectives for assigning weights to determinants of health. University of Wisconsin: Population Health Institute 2010.2. Subbarao P, Mandhane PJ, Sears MR: Asthma: epidemiology, etiology and risk factors. Canadian Medical Association Journal 2009, 181(9):E181-E190.3. Gold DR, Wright R: Population disparities in asthma. Annu Rev Public Health 2005, 26:89-113.

Shin, Eun Kyong↗

Land Classification of South-central Iowa from Computer Enhanced Images

The author has identified the following significant results. Two enhanced false color negatives from multispectral scanner scenes, dated 15 April 1974 and 29 August 1972, were printed at a scale of 1:125,000 to form the basis for land use interpretations in the Wapello County, Iowa test site. The use of geomorphic principles proved valuable in the interpretation of the April scene to form valuable generalizations for planning purposes on soil associations, topography, alluvial valleys, and agricultural land use. The August scene was superior in providing information on urban extent, transportation networks, forest cover, and water bodies.

Lucas, J. R.↗

Improved Predictability of the Indian Ocean Dipole Using a Stochastic Dynamical Model Compared to the North American Multimodel Ensemble Forecast

This study assesses the predictive skill of eight North American Multimodel Ensemble (NMME) models in predicting the Indian Ocean dipole (IOD). We find that the forecasted ensemble-mean IOD–El Niño–Southern Oscillation (ENSO) relationship deteriorates away from the observed relationship with increasing lead time, which might be one reason that limits the IOD predictive skill in coupled models. We are able to improve the IOD predictive skill using a recently developed stochastic dynamical model (SDM) forced by forecasted ENSO conditions. The results are consistent with the previous result that operational IOD predictability beyond persistence at lead times beyond one season is mostly controlled by ENSO predictability and the signal-to-noise ratio of the Indo-Pacific climate system. The multimodel ensemble (MME) investigated here is found to be of superior skill compared to each individual model at most lead times. Importantly, the skill of the SDM IOD predictions forced with forecasted ENSO conditions were either similar or better than those of the MME IOD forecasts. Moreover, the SDM forced with observed ENSO conditions exhibits significantly higher IOD prediction skill than the MME at longer lead times, suggesting the large potential skill increase that could be achieved by improving operational ENSO forecasts. We find that both cold and warm biases of the predicted Niño-3.4 index may cause false alarms of negative and positive IOD events, respectively, in NMME models. Many false alarms for IOD forecasts at lead times longer than one season in the original forecasts disappear or are significantly reduced in the SDM forced by forecasted ENSO conditions.

54 ENVIRONMENTAL SCIENCES↗

Enhancing Network Anomaly Detection Using Graph Neural Networks

In the world of Internet of Things (IoT) networks, where devices are constantly communicating, keeping them secure from cyber threats is critical. This paper introduces a novel approach to detecting unusual and potentially harmful activities in these networks using graph neural networks (GNNs). We combine two specific types of GNNs-GraphSAGE and graph attention networks (GAT)-to create a model that understands and represents the behaviors and interactions in a network. GraphSAGE creates an embedding of network activities by examining local data interactions, while GAT directs the model's focus to the most critical interactions. By integrating these two methods in a single model that considers different types of interactions (both host and flow nodes), we aim to create a system that accurately represents the current state of a network and can also spot anomalies effectively while reducing false positives and negatives. Our innovative approach has demonstrated promising results, achieving an accuracy of 98% on the UNSW-NB15 dataset, significantly outperforming standalone GraphSAGE and GAT models. This underscores its potential as a robust framework for securing IoT networks against cyber threats and anomalies.

Marfo, William↗

Condition monitoring and anomaly detection in cyber-physical systems

The modern industrial environment is equipping myriads of smart manufacturing machines where the state of each device can be monitored continuously. Such monitoring can help identify possible future failures and develop a cost-effective maintenance plan. However, it is a daunting task to perform early detection with low false positives and negatives from the huge volume of collected data. This requires developing a holistic machine learning framework to address the issues in condition monitoring of high priority components and develop efficient techniques to detect anomalies that can detect and possibly localize the faulty components. This paper presents a comparative analysis of recent machine learning approaches for robust, cost-effective anomaly detection in cyber-physical systems. While detection has been extensively studied, very few researchers have analyzed the localization of the anomalies. We show that supervised learning outperforms unsupervised algorithms. For supervised cases, we achieve near-perfect accuracy of 98% (specifically for tree-based algorithms). In contrast, the best-case accuracy in the unsupervised cases was 63%—the area under the receiver operating characteristic curve (AUC) exhibits similar outcomes as an additional metric.

Marfo, William↗

Evaluating Alerting and Guidance Performance of a UAS Detect-And-Avoid System

A key challenge to the routine, safe operation of unmanned aircraft systems (UAS) is the development of detect-and-avoid (DAA) systems to aid the UAS pilot in remaining "well clear" of nearby aircraft. The goal of this study is to investigate the effect of alerting criteria and pilot response delay on the safety and performance of UAS DAA systems in the context of routine civil UAS operations in the National Airspace System (NAS). A NAS-wide fast-time simulation study was conducted to assess UAS DAA system performance with a large number of encounters and a broad set of DAA alerting and guidance system parameters. Three attributes of the DAA system were controlled as independent variables in the study to conduct trade-off analyses: UAS trajectory prediction method (dead-reckoning vs. intent-based), alerting time threshold (related to predicted time to LoWC), and alerting distance threshold (related to predicted Horizontal Miss Distance, or HMD). A set of metrics, such as the percentage of true positive, false positive, and missed alerts, based on signal detection theory and analysis methods utilizing the Receiver Operating Characteristic (ROC) curves were proposed to evaluate the safety and performance of DAA alerting and guidance systems and aid development of DAA system performance standards. The effect of pilot response delay on the performance of DAA systems was evaluated using a DAA alerting and guidance model and a pilot model developed to support this study. A total of 18 fast-time simulations were conducted with nine different DAA alerting threshold settings and two different trajectory prediction methods, using recorded radar traffic from current Visual Flight Rules (VFR) operations, and supplemented with DAA-equipped UAS traffic based on mission profiles modeling future UAS operations. Results indicate DAA alerting distance threshold has a greater effect on DAA system performance than DAA alerting time threshold or ownship trajectory prediction method. Further analysis on the alert lead time (time in advance of predicted loss of well clear at which a DAA alert is first issued) indicated a strong positive correlation between alert lead time and DAA system performance (i.e. the ability of the UAS pilot to maneuver the unmanned aircraft to remain well clear). While bigger distance thresholds had beneficial effects on alert lead time and missed alert rate, it also generated a higher rate of false alerts. In the design and development of DAA alerting and guidance systems, therefore, the positive and negative effects of false alerts and missed alerts should be carefully considered to achieve acceptable alerting system performance by balancing false and missed alerts. The results and methodology presented in this study are expected to help stakeholders, policymakers and standards committees define the appropriate setting of DAA system parameter thresholds for UAS that ensure safety while minimizing operational impacts to the NAS and equipage requirements for its users before DAA operational performance standards can be finalized.

UAS Detect-and-Avoid (DAA) System↗

ROCker: accurate detection and quantification of target genes in short-read metagenomic data sets by modeling sliding-window bitscores

Functional annotation of metagenomic and metatranscriptomic data sets relies on similarity searches based on e-value thresholds resulting in an unknown number of false positive and negative matches. To overcome these limitations, we introduce ROCker, aimed at identifying position-specific, most-discriminant thresholds in sliding windows along the sequence of a target protein, accounting for non-discriminative domains shared by unrelated proteins. ROCker employs the receiver operating characteristic (ROC) curve to minimize false discovery rate (FDR) and calculate the best thresholds based on how simulated shotgun metagenomic reads of known composition map onto well-curated reference protein sequences and thus, differs from HMM profiles and related methods. We showcase ROCker using ammonia monooxygenase (amoA) and nitrous oxide reductase (nosZ) genes, mediating oxidation of ammonia and the reduction of the potent greenhouse gas, N 2 O, to inert N 2 , respectively. ROCker typically showed 60-fold lower FDR when compared to the common practice of using fixed e-values. Previously uncounted ‘atypical’ nosZ genes were found to be two times more abundant, on average, than their typical counterparts in most soil metagenomes and the abundance of bacterial amoA was quantified against the highly-related particulate methane monooxygenase (pmoA). Therefore, ROCker can reliably detect and quantify target genes in short-read metagenomes.

59 BASIC BIOLOGICAL SCIENCES↗