Search NASA⌕ Search

SEARCH · Search NASA

Results for “ROC”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Computerized detection of noncalcified plaques in coronary CT angiography: Evaluation of topological soft gradient prescreening method and luminal analysis

Purpose: The buildup of noncalcified plaques (NCPs) that are vulnerable to rupture in coronary arteries is a risk for myocardial infarction. Interpretation of coronary CT angiography (cCTA) to search for NCP is a challenging task for radiologists due to the low CT number of NCP, the large number of coronary arteries, and multiple phase CT acquisition. The authors conducted a preliminary study to develop machine learning method for automated detection of NCPs in cCTA. Methods: With IRB approval, a data set of 83 ECG-gated contrast enhanced cCTA scans with 120 NCPs was collected retrospectively from patient files. A multiscale coronary artery response and rolling balloon region growing (MSCAR-RBG) method was applied to each cCTA volume to extract the coronary arterial trees. Each extracted vessel was reformatted to a straightened volume composed of cCTA slices perpendicular to the vessel centerline. A topological soft-gradient (TSG) detection method was developed to prescreen for NCP candidates by analyzing the 2D topological features of the radial gradient field surface along the vessel wall. The NCP candidates were then characterized by a luminal analysis that used 3D geometric features to quantify the shape information and gray-level features to evaluate the density of the NCP candidates. With machine learning techniques, useful features were identified and combined into an NCP score to differentiate true NCPs from false positives (FPs). To evaluate the effectiveness of the image analysis methods, the authors performed tenfold cross-validation with the available data set. Receiver operating characteristic (ROC) analysis was used to assess the classification performance of individual features and the NCP score. The overall detection performance was estimated by free response ROC (FROC) analysis. Results: With our TSG prescreening method, a prescreening sensitivity of 92.5% (111/120) was achieved with a total of 1181 FPs (14.2 FPs/scan). On average, six features were selected during the tenfold cross-validation training. The average area under the ROC curve (AUC) value for training was 0.87 ± 0.01 and the AUC value for validation was 0.85 ± 0.01. Using the NCP score, FROC analysis of the validation set showed that the FP rates were reduced to 3.16, 1.90, and 1.39 FPs/scan at sensitivities of 90%, 80%, and 70%, respectively. Conclusions: The topological soft-gradient prescreening method in combination with the luminal analysis for FP reduction was effective for detection of NCPs in cCTA, including NCPs causing positive or negative vessel remodeling. The accuracy of vessel segmentation, tracking, and centerline identification has a strong impact on NCP detection. Studies are underway to further improve these techniques and reduce the FPs of the CADe system.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

WE-G-BRD-09: Prediction of Local Control/Failure by Using Feature Histogram Selection in Follow-Up T2-Weighted MR Image in Spinal Tumors After Stereotactic Body Radiation Therapy

Purpose: In follow-up T2-weighted MR images of spinal tumor patients treated with stereotactic body radiation therapy (SBRT), high intensity features embedded in dark surroundings may suggest a local failure (LF). We investigated image intensity histogram in imaging features to predict LF and local control (LC). Methods: Sixty-seven spinal tumors were treated with SBRT at our institution with scheduled follow-up MR T2-weighted (TR 3200–6600ms; TE 75-132ms) imaging. The LF group included 10 tumors with 8.7 months median follow-up, while the LC group had 11 tumors with 24.1 months median follow-up. The follow-up images were fused to the planning CT. Image intensity histograms of the GTV were calculated. Voxels in greater than 90% (V90), 80% (V80), and peak (Vpeak) of the histogram were grouped into sub-ROIs to determine the best feature histogram. The intensity of each sub-ROI was evaluated using the mean T2-weighted signal ratio (intensity in sub-ROI / intensity in normal vertebrae). An ROC curve in predicting LF for each sub-ROI was calculated to determine the best feature histogram parameter for LF prediction. Results: Mean T2-weighted signal ratio in the LF group was significantly higher than that in the LC group for all sub-ROIs (1.1±0.4 vs. 0.7±0.2, 1.2±0.4 vs. 0.8±0.2, 1.4±0.5 vs. 0.8±0.2, for V90, V80, and Vpeak, p=0.02, 0.02, and 0.002, respectively). The corresponding areas-under-curve (AUC) of ROC were 0.78, 0.80, and 0.87, p=0.02, 0.03, 0.004, respectively. No correlation was found between T2-weighted signal ratio in Vpeak and follow-up time (Pearson's ρ=0.15). Conclusion: Increased T2-weighted signal can be used to identify local failure while decreased signal indicates local control after spinal SBRT. By choosing the best histogram parameter (here the Vpeak), the AUC of the ROC can be substantially improved, which implies reliable prediction of LC and LF. These results are being further studied and validated with large multi-institutional data.

60 APPLIED LIFE SCIENCES↗

Toward optimizing patient-specific IMRT QA techniques in the accurate detection of dosimetrically acceptable and unacceptable patient plans

Purpose: The authors investigated the performance of several patient-specific intensity-modulated radiation therapy (IMRT) quality assurance (QA) dosimeters in terms of their ability to correctly identify dosimetrically acceptable and unacceptable IMRT patient plans, as determined by an in-house-designed multiple ion chamber phantom used as the gold standard. A further goal was to examine optimal threshold criteria that were consistent and based on the same criteria among the various dosimeters. Methods: The authors used receiver operating characteristic (ROC) curves to determine the sensitivity and specificity of (1) a 2D diode array undergoing anterior irradiation with field-by-field evaluation, (2) a 2D diode array undergoing anterior irradiation with composite evaluation, (3) a 2D diode array using planned irradiation angles with composite evaluation, (4) a helical diode array, (5) radiographic film, and (6) an ion chamber. This was done with a variety of evaluation criteria for a set of 15 dosimetrically unacceptable and 9 acceptable clinical IMRT patient plans, where acceptability was defined on the basis of multiple ion chamber measurements using independent ion chambers and a phantom. The area under the curve (AUC) on the ROC curves was used to compare dosimeter performance across all thresholds. Optimal threshold values were obtained from the ROC curves while incorporating considerations for cost and prevalence of unacceptable plans. Results: Using common clinical acceptance thresholds, most devices performed very poorly in terms of identifying unacceptable plans. Grouping the detector performance based on AUC showed two significantly different groups. The ion chamber, radiographic film, helical diode array, and anterior-delivered composite 2D diode array were in the better-performing group, whereas the anterior-delivered field-by-field and planned gantry angle delivery using the 2D diode array performed less well. Additionally, based on the AUCs, there was no significant difference in the performance of any device between gamma criteria of 2%/2 mm, 3%/3 mm, and 5%/3 mm. Finally, optimal cutoffs (e.g., percent of pixels passing gamma) were determined for each device and while clinical practice commonly uses a threshold of 90% of pixels passing for most cases, these results showed variability in the optimal cutoff among devices. Conclusions: IMRT QA devices have differences in their ability to accurately detect dosimetrically acceptable and unacceptable plans. Field-by-field analysis with a MapCheck device and use of the MapCheck with a MapPhan phantom while delivering at planned rotational gantry angles resulted in a significantly poorer ability to accurately sort acceptable and unacceptable plans compared with the other techniques examined. Patient-specific IMRT QA techniques in general should be thoroughly evaluated for their ability to correctly differentiate acceptable and unacceptable plans. Additionally, optimal agreement thresholds should be identified and used as common clinical thresholds typically worked very poorly to identify unacceptable plans.

60 APPLIED LIFE SCIENCES↗

TU-AB-303-06: Does Online Adaptive Radiation Therapy Mean Zero Margin for Intermediate-Risk Prostate Cancer? An Intra-Fractional Seminal Vesicles Motion Analysis

Purpose: To provide benchmark for seminal vesicles (SVs) margin selection to account for intra-fractional motion; and to investigate the effectiveness of two motion surrogates in predicting intra-fractional SV underdosage. Methods: 9 prostate SBRT patients were studied; each has five pairs of pre-treatment and post-treatment cone-beam CTs (CBCTs). Each pair of CBCTs was registered based on fiducial markers in the prostate. To provide “ground truth” for coverage evaluation, all pre-treatment SVs were expanded with isotropic margin of 1,2,3,5 and 8mm, and their overlap with post-treatment SVs were used to quantify intra-fractional coverage. Two commonly used motion surrogates, the center-of-mass (COM) and the border of contour (the most distal points in SI/AP/LR directions) were evaluated using Receiver-Operating Characteristic (ROC) analyses for predicting SV underdosage due to intra-fractional motion. Action threshold of determining underdosage for each surrogate was calculated by selecting the optimal balancing between sensitivity and specificity. For comparison, margin for each surrogate was also calculated based on traditional margin recipe. Results: 90% post-treatment SV coverage can be achieved in 47%, 82%, 91%, 98% and 98% fractions for 1,2,3,5 and 8mm margins. 3mm margin ensured the 90% intra-fractional SV coverage in 90% fractions when prostate was aligned. The ROC analysis indicated the AUC for COM and border were 0.88 and 0.72. The underdosage threshold was 2.9mm for COM and 4.1mm for border. The Van Herk’s margin recipe recommended 0.5, 0 and 1.8mm margin in LR, AP and SI direction based on COM and for border, the corresponding margin was 2.1, 4.5 and 3mm. Conclusion: 3mm isotropic margin is the minimum required to mitigate the intra-fractional SV motion when prostate is aligned. ROC analysis reveals that both COM and border are acceptable predictors for SV underdosage with 2.9mm and 4.1mm action threshold. Traditional margin calculation is less reliable for this application. This work is partially supported a master research grant from Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗

TU-G-BRD-08: In-Vivo EPID Dosimetry: Quantifying the Detectability of Four Classes of Errors

Purpose: EPID dosimetry is an emerging method for treatment verification and QA. Given that the in-vivo EPID technique is in clinical use at some centers, we investigate the sensitivity and specificity for detecting different classes of errors. We assess the impact of these errors using dose volume histogram endpoints. Though data exist for EPID dosimetry performed pre-treatment, this is the first study quantifying its effectiveness when used during patient treatment (in-vivo). Methods: We analyzed 17 patients; EPID images of the exit dose were acquired and used to reconstruct the planar dose at isocenter. This dose was compared to the TPS dose using a 3%/3mm gamma criteria. To simulate errors, modifications were made to treatment plans using four possible classes of error: 1) patient misalignment, 2) changes in patient body habitus, 3) machine output changes and 4) MLC misalignments. Each error was applied with varying magnitudes. To assess the detectability of the error, the area under a ROC curve (AUC) was analyzed. The AUC was compared to changes in D99 of the PTV introduced by the simulated error. Results: For systematic changes in the MLC leaves, changes in the machine output and patient habitus, the AUC varied from 0.78–0.97 scaling with the magnitude of the error. The optimal gamma threshold as determined by the ROC curve varied between 84–92%. There was little diagnostic power in detecting random MLC leaf errors and patient shifts (AUC 0.52–0.74). Some errors with weak detectability had large changes in D99. Conclusion: These data demonstrate the ability of EPID-based in-vivo dosimetry in detecting variations in patient habitus and errors related to machine parameters such as systematic MLC misalignments and machine output changes. There was no correlation found between the detectability of the error using the gamma pass rate, ROC analysis and the impact on the dose volume histogram. Funded by grant R18HS022244 from AHRQ.

60 APPLIED LIFE SCIENCES↗

SU-F-R-14: PET Based Radiomics to Predict Outcomes in Patients with Hodgkin Lymphoma

Purpose: To identify PET-based radiomics features associated with high refractory/relapsed disease risk for Hodgkin lymphoma patients. Methods: A total of 251 Hodgkin lymphoma patients including 19 primary refractory and 9 relapsed patients were investigated. All patients underwent an initial pre-treatment diagnostic FDG PET/CT scan. All cancerous lymph node regions (ROIs) were delineated by an experienced physician based on thresholding each volume of disease in the anatomical regions to SUV>2.5. We extracted 122 image features and evaluated the effect of ROI selection (the largest ROI, the ROI with highest mean SUV, merged ROI, and a single anatomic region [e.g. mediastinum]) on classification accuracy. Random forest was used as a classifier and ROC analysis was used to assess the relationship between selected features and patient’s outcome status. Results: Each patient had between 1 and 9 separate ROIs, with much intra-patient variability in PET features. The best model, which used features from a single anatomic region (the mediastinal ROI, only volumes>5cc: 169 patients with 12 primary refractory) had a classification accuracy of 80.5% for primary refractory disease. The top five features, based on Gini index, consist of shape features (max 3D-diameter and volume) and texture features (correlation and information measure of correlation1&2). In the ROC analysis, sensitivity and specificity of the best model were 0.92 and 0.80, respectively. The area under the ROC (AUC) and the accuracy were 0.86 and 0.86, respectively. The classification accuracy was less than 60% for other ROI models or when ROIs less than 5cc were included. Conclusion: This study showed that PET-based radiomics features from the mediastinal lymph region are associated with primary refractory disease and therefore may play an important role in predicting outcomes in Hodgkin lymphoma patients. These features could be additive beyond baseline tumor and clinical characteristics, and may warrant more aggressive treatment.

60 APPLIED LIFE SCIENCES↗

SU-G-BRB-11: On the Sensitivity of An EPID-Based 3D Dose Verification System to Detect Delivery Errors in VMAT Treatments

Purpose: To investigate the sensitivity of an EPID-based 3D dose verification system to detect delivery errors in VMAT treatments. Methods: For this study 41 EPID-reconstructed 3D in vivo dose distributions of 15 different VMAT plans (H&N, lung, prostate and rectum) were selected. To simulate the effect of delivery errors, their TPS plans were modified by: 1) scaling of the monitor units by ±3% and ±6% and 2) systematic shifting of leaf bank positions by ±1mm, ±2mm and ±5mm. The 3D in vivo dose distributions where then compared to the unmodified and modified treatment plans. To determine the detectability of the various delivery errors, we made use of a receiver operator characteristic (ROC) methodology. True positive and false positive rates were calculated as a function of the γ-parameters γmean, γ1% (near-maximum γ) and the PTV dose parameter ΔD{sub 50} (i.e. D{sub 50}(EPID)-D{sub 50}(TPS)). The ROC curve is constructed by plotting the true positive rate vs. the false positive rate. The area under the ROC curve (AUC) then serves as a measure of the performance of the EPID dosimetry system in detecting a particular error; an ideal system has AUC=1. Results: The AUC ranges for the machine output errors and systematic leaf position errors were [0.64 – 0.93] and [0.48 – 0.92] respectively using γmean, [0.57 – 0.79] and [0.46 – 0.85] using γ1% and [0.61 – 0.77] and [ 0.48 – 0.62] using ΔD{sub 50}. Conclusion: For the verification of VMAT deliveries, the parameter γmean is the best discriminator for the detection of systematic leaf position errors and monitor unit scaling errors. Compared to γmean and γ1%, the parameter ΔD{sub 50} performs worse as a discriminator in all cases.

60 APPLIED LIFE SCIENCES↗

Class-specific Error Bounds for Ensemble Classifiers

The generalization error, or probability of misclassification, of ensemble classifiers has been shown to be bounded above by a function of the mean correlation between the constituent (i.e., base) classifiers and their average strength. This bound suggests that increasing the strength and/or decreasing the correlation of an ensemble's base classifiers may yield improved performance under the assumption of equal error costs. However, this and other existing bounds do not directly address application spaces in which error costs are inherently unequal. For applications involving binary classification, Receiver Operating Characteristic (ROC) curves, performance curves that explicitly trade off false alarms and missed detections, are often utilized to support decision making. To address performance optimization in this context, we have developed a lower bound for the entire ROC curve that can be expressed in terms of the class-specific strength and correlation of the base classifiers. We present empirical analyses demonstrating the efficacy of these bounds in predicting relative classifier performance. In addition, we specify performance regions of the ROC curve that are naturally delineated by the class-specific strengths of the base classifiers and show that each of these regions can be associated with a unique set of guidelines for performance optimization of binary classifiers within unequal error cost regimes.

99 GENERAL AND MISCELLANEOUS↗

The Prediction Model of Risk Factors for COVID-19 Developing into Severe Illness Based on 1046 Patients with COVID-19

This study analyzed the risk factors for patients with COVID-19 developing severe illnesses and explored the value of applying the logistic model combined with ROC curve analysis to predict the risk of severe illnesses at COVID-19 patients’ admissions. The clinical data of 1046 COVID-19 patients admitted to a designated hospital in a certain city from July to September 2020 were retrospectively analyzed, the clinical characteristics of the patients were collected, and a multivariate unconditional logistic regression analysis was used to determine the risk factors for severe illnesses in COVID-19 patients during hospitalization. Based on the analysis results, a prediction model for severe conditions and the ROC curve were constructed, and the predictive value of the model was assessed. Logistic regression analysis showed that age (OR = 3.257, 95% CI 10.466–18.584), complications with chronic obstructive pulmonary disease (OR = 7.337, 95% CI 0.227–87.021), cough (OR = 5517, 95% CI 0.258–65.024), and venous thrombosis (OR = 7322, 95% CI 0.278–95.020) were risk factors for COVID-19 patients developing severe conditions during hospitalization. When complications were not taken into consideration, COVID-19 patients’ ages, number of diseases, and underlying diseases were risk factors influencing the development of severe illnesses. The ROC curve analysis results showed that the AUC that predicted the severity of COVID-19 patients at admission was 0.943, the optimal threshold was −3.24, and the specificity was 0.824, while the sensitivity was 0.827. The changes in the condition of severe COVID-19 patients are related to many factors such as age, clinical symptoms, and underlying diseases. This study has a certain value in predicting COVID-19 patients that develop from mild to severe conditions, and this prediction model is a useful tool in the quick prediction of the changes in patients’ conditions and providing early intervention for those with risk factors.

Lian, Zhichuang↗

An improved dataset for predicting mammal infecting viruses from genetic sequence information

There have been several attempts to develop machine learning (ML) models to identify human infecting viruses from their genomic sequences, with varying degrees of success. Direct comparison between models is problematic, because these models are typically trained and evaluated on different datasets with alternative data splitting schemes, features, and model performance metrics. In this paper we present a standardized dataset of mammal infecting and non-infecting viral pathogens, refined from the previous work of Mollentze et al. to include the latest literature evidence, roughly doubling the number of curated host-virus records available to the community, and new host target labels, primate and mammal. The new host labels were included for several reasons, including previous reports that classification performance is better at broader taxonomic ranks and the idea that there may be more data for primate infection that might serve as a suitable proxy for zoonotic potential and avoidance of false positives for human infection due to absence of evidence. On this dataset, we report the performance of eight machine learning models for predicting mammal-infecting viruses from their genomic sequences. We find that randomly assigning cases in our improved dataset to training/testing sets, when compared to the original assignments into training/testing in Mollentze et al., increases the overall average ROC AUC of prediction of human infection from 0.663 ± 0.070 to 0.784 ± 0.013, consistent with the reduction in phylogenetic distance between train and test sets (relative entropy change from 3.00 to 0.08). The broadest host category of mammal infection can be predicted most reliably at 0.850 ± 0.020. We share our improved dataset and code to enable standardized comparisons of machine learning methods to predict human host infections. Overall, we have presented preliminary evidence that classification of virus host infection is more tractable at higher taxonomic ranks, that unsurprisingly reducing the phylogenetic distance between training and test sets can improve predictive performance, that peptide kmer features appear to be harmful to out of sample model performance, and we are left with the question of whether models for virus host prediction can reasonably be expected to perform well in out of sample scenarios given the likelihood that viruses do not share a common ancestor. Consistent with this concern, when the data is resampled such that there is no overlap between viral families in training and test sets (relative entropy > 24), models perform no better than random chance at prediction of human infection regardless of whether kmers are included (ROC AUC 0.50 ± 0.08) or not (ROC AUC 0.50 ± 0.04).

59 BASIC BIOLOGICAL SCIENCES↗

Tonopah Test Range Air Monitoring: CY2017 Meteorological, Radiological, and Wind Transported Particulate Observations

In 1963, the U.S. Department of Energy (DOE) (formerly the Atomic Energy Commission [AEC]), implemented Operation Roller Coaster on the Tonopah Test Range (TTR) and an adjacent area of the Nevada Test and Training Range (NTTR) (formerly the Nellis Air Force Range). This operation resulted in radionuclide-contaminated soils at the Double Tracks site and Clean Slate I, II, and III sites. This report documents observations made during ongoing monitoring of radiological, meteorological, and dust conditions at stations installed adjacent to the Clean Slate sites and at the TTR Sandia National Laboratories (SNL) Range Operations Center (ROC). The primary objective of the monitoring effort is to support the DOE Environmental Management Nevada Program (EM NV) in the safe cleanup of the environmental legacy of nuclear device development and testing by determining if wind blowing across the Clean Slate sites is transporting particles of radionuclide-contaminated soil beyond the physical and administrative boundaries of the sites. The monitoring program underwent a significant change during 2017 with the decommissioning of one monitoring station and the establishment of three new stations. Station 400, located within TTR Area 3 and near the ROC, monitors conditions near the local workforce center and was in operation the full calendar year. Stations 401 and 403 are located on the northwest and southeast perimeter fence lines, respectively, of the Clean Slate III site. Station 401 operated throughout 2017, whereas Station 403 began operation at the end of April 2017. Stations 404 and 405 are along the northern and eastern boundary fence, respectively, at Clean Slate II and both began data collection at the end of April 2017. Also at the end of April, the Clean Slate I monitoring site, Station 402, was decommissioned. The stations are located to be generally downwind of the contaminated areas during either north-northwesterly or south-southeasterly winds, which are the predominant wind directions. The stations—which are similar in design to the Community Environmental Monitoring Program (CEMP) stations operating at locations surrounding the Nevada National Security Site and TTR—include meteorological instruments and continuous-flow, low-volume air samplers. Three pressurized ionization chambers for measuring gamma energy are in use at Stations 400, 401, and 403 (formerly at 402). Saltation sensors and saltation traps are deployed at the stations adjacent to the Clean Slate sites. Detailed meteorological data are recorded on data loggers, with periodic uploads via a satellite system to the Western Regional Climate Center (WRCC) at Desert Research Institute (DRI), to monitor instrument and site conditions. Air filter samples are collected every two weeks and the deposits in the saltation traps are collected when a sufficient sample mass for analysis has accumulated (generally a six- to eight-month interval). Dust transport by suspension and saltation is strongly dependent on wind speed. Concentrations of PM10 (particulate matter of aerodynamic diameter ≤10 micrometers [μm], a size fraction of small particles that are suspended in the air and can be easily inhaled) remain low until winds exceed approximately 32 km/hr (20 mph). Saltation particle counts also increase above the same general threshold wind speed. Wind speeds in excess of 32 km/hr (20 mph) occur less than three percent of the time. High winds are associated with two predominant directions: north-northwest and south. In 2017, the very highest winds were from the north, but all winds above 40 km/hr (25 mph) were approximately evenly split between south and northwest directions. The low-volume air samplers collect total suspended dust, and saltating particles are captured by the passive saltation traps, both for radiological analysis. Radionuclide monitoring at the ROC in TTR Area 3 (Station 400) found natural background levels of gross alpha and gross beta radiation. Similar background levels were found on filter samples analyzed using gamma and alpha spectroscopy. The gamma exposure rate data from pressurized ionization chambers (PIC) are comparable to those from the regional CEMP stations. Plutonium concentrations above background values were measured during 2017 from soil samples collected in passive saltation traps and on select air filters from the monitoring stations adjacent to the Clean Slate sites. The background for soils in the region is assumed to be 0.014 pCi/g plutonium-239+240 ( 239+240 Pu) as measured by Turner et al. (2003), whereas the background concentration of suspended 239+240Pu is assumed to be 9.5 x 10 -19 μCi/ml, which was determined by continuous air monitoring at the TTR airport in 1996 and 1997 (SNL, 1998). Background concentrations are exceeded by one to four orders of magnitude by the majority of samples from Clean Slate I, II, and III. The gross alpha and gross beta measurements of the air filters are also generally higher than those measured at the regional CEMP stations, although the gamma exposure rates determined by the PICs located at Clean Slate I and III are similar to CEMP measurements. The highest radionuclide concentrations of suspended dust are associated with individual filter samples from Clean Slate II Station 404 and Clean Slate III Station 401. Both of the stations are downwind of their respective sites during southerly winds, but they are also geographically closer to the highly contaminated detonation areas than the other monitoring stations. Considering all the analyzed samples, the 239+240Pu concentrations are generally higher for the Clean Slate II samples compared with those from Clean Slate III. The highest gross alpha and gross beta results are also observed for the Clean Slate II stations. The highest radionuclide concentrations are measured on the smaller (≤63 μm) saltation-sized particles and particulate matter collected downwind of each site. Nonetheless, traps oriented to collect dust moving toward the contamination areas also had plutonium concentrations significantly above background values, which is consistent with observations of low-level contamination dispersed beyond the fenced area. All the observed 239+240 Pu concentrations are below the risk-based action level (25 millirem per year, equivalent to a 239+240 Pu concentration of 4,120 pCi/g for an industrial worker scenario; U.S. DOE, 2014). The meteorological and particulate matter monitoring indicate that conditions for wind-borne contaminant movement exist at the Clean Slate sites, and that transport of radionuclide-contaminated soil by both suspension and saltation is occurring. The Corrective Action Unit (CAU) closure strategy uses a risk-based approach, whereby acceptable contaminant concentrations are determined as a function of anticipated human exposure. This strategy is consistent with the fence lines at the Clean Slate sites encircling areas of higher concentration and the observed presence of lower concentrations of contamination outside the fences.

54 ENVIRONMENTAL SCIENCES↗

Tonopah Test Range Air Monitoring: CY2018 Meteorological, Radiological, and Wind Transported Particulate Observations

In 1963, the U.S. Department of Energy (DOE) (formerly the Atomic Energy Commission [AEC]), implemented Operation Roller Coaster on the Tonopah Test Range (TTR) and an adjacent area of the Nevada Test and Training Range (NTTR) (formerly the Nellis Air Force Range). This operation resulted in radionuclide-contaminated soils at the Double Tracks site and Clean Slate I, II, and III sites. This report documents observations made during ongoing monitoring of radiological, meteorological, and dust conditions at stations installed adjacent to the Clean Slate sites and at the TTR Sandia National Laboratories (SNL) Range Operations Center (ROC). The primary objective of the monitoring effort is to support the DOE Environmental Management Nevada Program (EM NV) in the safe remediation of the environmental legacy of nuclear device development and testing by determining if wind blowing across the Clean Slate sites is transporting particles of radionuclide-contaminated soil beyond the physical and administrative boundaries of the sites, and to provide information for designing long-term monitoring of the sites. The monitoring program in 2018 included five stations. Station 400, located within TTR Area 3 and near the ROC, monitors conditions near the local workforce center. Stations 401 and 403 are located on the northern and southeastern perimeter fence lines, respectively, of the Clean Slate III site. Stations 404 and 405 are along the northern and eastern boundary fence, respectively, at Clean Slate II. The stations are generally downwind of the contaminated areas during either northwesterly or southerly winds, which are the predominant wind directions. The stations—which are similar in design to the Community Environmental Monitoring Program (CEMP) stations operating at locations surrounding the Nevada National Security Site and TTR—include meteorological instruments and continuous-flow, low-volume air samplers. Three pressurized ionization chambers for measuring gamma energy are in use at Stations 400, 401, and 403. Saltation sensors and saltation traps are deployed at the stations adjacent to the Clean Slate sites. Detailed meteorological data are recorded on data loggers, with periodic uploads via a satellite system to the Western Regional Climate Center (WRCC) at Desert Research Institute (DRI), to monitor instrument and site conditions. Air filter samples are collected every two weeks and the deposits in the saltation traps are collected when a sufficient sample mass for analysis has accumulated (generally a six- to eight-month interval). Monitoring at TTR in calendar year (CY) 2018 provided surveillance of both ambient conditions, and ground disturbance associated with remediation activities at Clean Slate II and III. The first half of CY2018 data from Stations 404 and 405 at Clean Slate II were collected during remediation activities at that site, and data collected during the final third of the year at Stations 401 and 403 at Clean Slate III coincided with remediation work at the site. Ambient conditions prevailed at Station 400 throughout the year. Dust transport by suspension and saltation is strongly dependent on wind speed. Concentrations of PM 10 (particulate matter of aerodynamic diameter ≤10 micrometers [μm], a size fraction of small particles that are suspended in the air and can be easily inhaled) remain low until winds exceed approximately 32 kilometers per hour (km/hr) (20 miles per hour [mph]). Saltation particle counts also increase above the same general threshold wind speed. Wind speeds in excess of 32 km/hr (20 mph) occur less than three percent of the time at the sites. Ground disturbing remediation activities were carried out at Clean Slate II from October 31, 2017, until July 26, 2018. Station 404 is located closest to the remediation area and is downwind of the area when winds are from the south. By late November, analysis of dust from the air sampler at Station 404 registered increases in plutonium-239+240 ( 239+240 Pu) concentrations. Peak plutonium concentrations, accompanied by elevated gross alpha concentrations and the detection of americium-241 ( 241 Am) by gamma spectroscopy, occurred between March and May 2018. During spring and early summer of 2018, elevated radionuclide concentrations were also measured in dust collected from the air sampler at Station 405, which is more than twice the distance from the remediation activity as Station 404. A minor but sustained increase in gross alpha concentration of suspended dust collected at Stations 400, 401, and 403 was also observed starting in May 2018 and continuing into August. Stations 401 and 403 are approximately 4.8 to 6.4 km (three to four miles) from Clean Slate II and Station 400 is approximately 13 km (eight miles) from that site. The radionuclide content of material that saltated into the passive Big Spring Number Eight (BSNE) traps during the Clean Slate II remediation period increased in both the traps facing toward and away from the fenced contamination area at Station 404, with the largest increases in concentration (almost five times the previous 239+240 Pu concentration) observed in the traps facing the fenced area. The radionuclide concentration in material in the trap facing away from the fence more than doubled from that measured in 2017. A similar increase was observed for the saltation trap facing away from the fenced area at Station 405, although no increase was observed for material captured in the trap facing the fenced area. Particles ranging in size from 50 to 500 µm generally move by saltation processes and are not expected to significantly contribute to dose for someone breathing in the standard respiratory zone for adult humans (1.5 to 1.7 m [4.9 to 5.6 ft] above ground level) because they are too large to be entrained in the air as suspended dust. Remediation activities at Clean Slate III began on September 5, 2018, and continued until a brief hiatus started on December 20, 2018. Although Station 401 is much closer to the remediation area than Station 403, the first increase in gross alpha and 239+240 Pu concentrations was noted in dust from filters collected at Station 403 in early November 2018. The highest radionuclide concentrations of 2018 at the Clean Slate III stations were recorded in air samples taken from Stations 401 and 403 in late December 2018 and these concentrations were comparable between the two station locations. Gamma rate data measured by the PICs was slightly higher than the annual average at Stations 401 and 403 after remediation activities began, but no single measurement was outside of the range observed in 2018 prior to remediation activities. No increase in radionuclide concentration was observed for the Clean Slate III remediation time period on air filters collected from the other stations. Radiological monitoring at Station 400—which is located at the ROC, and therefore the closest regularly staffed work location to the Clean Slate sites—recorded a higher mean gross alpha activity from dust collected on air sampler filters than in previous years. The individual biweekly air filters yielded measurements of gross alpha that were at or below the mean plus one standard deviation measured in CY2017, except for the period from April 25, 2018, through September 12, 2018. Nonetheless, gamma spectroscopy of all air filters from Station 400 identified only naturally occurring radionuclides, with no detection of americium-241 ( 241 Am) (which is used as an indicator of plutonium-241[ 241 Pu]). Alpha spectroscopy of selected air filters collected at Station 400 did not detect plutonium-238 ( 238 Pu) or 239+240 Pu above the analytical detection limit. Gross beta and gamma exposure rate data were comparable to data from regional CEMP stations. No saltation traps are deployed at Station 400. Considering the ambient monitoring periods during CY2018, the monitoring stations adjacent to the Clean Slate sites recorded above-background 238 Pu and 239+240 Pu concentrations (SNL, 1998; Turner et al., 2003) in samples collected by passive saltation traps and on selected air filters. These observations were consistent with previous years and indicated that radionuclide movement occurred under ambient conditions by processes of both saltation and suspension. The presence of radionuclides in all saltation traps, both upwind and downwind of the fenced contamination areas, was consistent with previous radiological survey results (EG&G, 1979) that show lower concentration radiologically contaminated material dispersed outside the fenced area. Although 239+240 Pu concentrations in the air filter samples were sometimes orders of magnitude higher than background, the concentrations were below risk-based action levels defined for an industrial area worker scenario (U.S. DOE, 2014). The interception of airborne dust with above-background radionuclide concentrations demonstrates that dispersal processes are continuing. Strong winds are the driver for both suspension and saltation of dust and soil. The recorded wind speed and PM10 during remediation activities at Clean Slate II and III identified discrete wind events lasting approximately five to eight hours each, which accounted for the greatest PM 10 concentrations at the monitoring stations. These events captured the effect of winds from the northwest and from the south. The observed differences in dust loading and radionuclide concentrations for the monitoring stations when they were either upwind or downwind of the contamination area identify the remediation area as a source of plutonium contaminated dust. The increase in concentration of radionuclides in airborne dust during the remediation activities, compared with measurements under previous ambient conditions (mean 239+240 Pu concentrations during remediation activities are approximately nine to 40 times higher compared to pre-remediation concentrations, depending on monitoring station), highlights the impact of land disturbance on wind-borne contaminant transport from the Clean Slate test areas. The meteorological and particulate matter monitoring indicated that conditions for wind-borne contaminant movement exist at the Clean Slate sites, and that transport of radionuclide-contaminated soil by both suspension and saltation occurred under ambient conditions and accelerated when the sites were disturbed. The 239+240 Pu alpha spectroscopy results indicated that airborne concentrations during remediation activities ranged from 2 × 10-16 to 380 × 10-16 µCi/ml. These results can be compared to the derived air concentration limit for 239 Pu of 6 × 10-11 µCi/ml for occupational workers contained in Code of Federal Regulations 10 CFR 835, Occupational Radiation Protection. Even though the air sampling results document an increase in concentration during remediation activities, the observed concentrations are less than 0.06 percent of the occupational limit. The Corrective Action Unit (CAU) closure strategy uses a risk-based approach, whereby acceptable contaminant concentrations are determined as a function of anticipated human exposure.

54 ENVIRONMENTAL SCIENCES↗

NORTH DAKOTA CARBONSAFE PHASE III: SITE CHARACTERIZATION AND PERMITTING OF GEOLOGIC STORAGE OF CARBON DIOXIDE

The Energy & Environmental Research Center (EERC), in partnership with Minnkota Power Cooperative Inc. (Minnkota), SLB, and Computer Modelling Group Ltd. (CMG), supported wide-scale deployment of carbon capture and storage (CCS) as part of the U.S. Department of Energy (DOE) National Energy Technology Laboratory Carbon Storage Assurance Facility Enterprise (CarbonSAFE) Initiative Phase III. This phase included the acquisition, analysis, and development of information to fully characterize two storage complexes to demonstrate viable storage resources for commercial volumes of CO2 (defined by DOE as a minimum of 50 million tonnes [MMt] of CO2 within a 30-year period) (National Energy Technology Laboratory, 2024). Phase III also involved the preparation, submission, and approval of North Dakota underground injection control (UIC) Class VI storage facility permits (SFPs)—required precursors to applications for Class VI injection well permits. The presumed viability of commercial-scale CCS, situated adjacent to Minnkota’s Milton R. Young Station (MRYS), is validated by Minnkota’s continued pursuit of Project Tundra—an initiative to build the world’s largest lignite-based CCS project in central North Dakota (www.projecttundrand.com). Project Tundra comprises two scopes of work, Tundra Capture (installation of postcombustion CO2 capture at MRYS) and Tundra SGS (secure geologic storage). The efforts of North Dakota CarbonSAFE Phase III, Site Characterization and Permitting, supported Tundra SGS. Extensive site-specific characterization activities included a successful multimeasurement geophysical approach and drilling a stratigraphic test well (J-ROC 1, subsequently renamed Liberty-1) adjacent to MRYS. Core collection and analyses, downhole testing and fluid sampling, and geophysical logging were performed on J-ROC 1 and on a nearby stratigraphic test well (known as J-LOC 1), which was drilled, cored, and tested under a complementary project funded by the North Dakota Lignite Research Program. The injection tests performed on J-LOC 1 positively impacted the CarbonSAFE project, resulting in fewer proposed injection wells and significant construction, operations, and monitoring cost savings. The characterization data collected and analyses performed were integrated into geologic models, and successive numerical simulations were run to determine CO2 plume extent and subsurface pressure buildup associated with the planned CO2 injection rate of nearly 4 MMt per year. The latter doubles the CarbonSAFE Initiative goal with an estimated 100 MMt of CO2 stored in 20 years. Application of the U.S. Environmental Protection Agency’s (EPA’s) method for estimating the Class VI Rule area of review (AOR) to the overpressurized Broom Creek Formation inspired an alternative method of calculation, called risk-based AOR delineation. This peer-reviewed method was applied for the first time during the storage facility-permitting process. The two SFP applications submitted in 2021 successfully resulted in North Dakota Industrial Commission (NDIC) orders in 2022 authorizing the creation of the storage facility areas and amalgamation of pore space as well as establishing financial responsibility requirements. After approval of the SFPs, Minnkota filed in 2022 applications for permits to reenter the J-ROC 1 well and to drill two new wells—all with the intended purpose to become Class VI injection wells. To establish eligibility under the Internal Revenue Code for Section 45Q tax incentives, a monitoring, reporting, and verification (MRV) plan was prepared and submitted by Minnkota to EPA in 2022, resulting in the first such plan approved in North Dakota. Also in 2022, under the National Environmental Policy Act (NEPA), Minnkota prepared and submitted an environmental information volume (EIV) describing the proposed CCS project and associated potential environmental impacts. Based on the EIV, DOE determined that the proposed construction project required an environmental assessment, and Minnkota submitted the first draft in 2023 and a revised draft in 2024. Both submissions were followed by a public comment period. Subsequently, DOE issued a finding of no significant impact (FONSI) on September 13, 2024. A successful outreach program, strongly based in the production, presentation, and dissemination of informational material, fostered an environment to aid stakeholders in making informed decisions regarding the planned project. Opportunities for public input were provided at various steps along the way, including at county planning and zoning meetings, before and during the SFP administrative hearing, and during environmental assessment public comment periods. In addition, land/pore space owners and mineral owners had various points of contact, including granting access rights, securing pore space leasing, and mineral owner notifications. Based upon the successful storage facility permitting issued by NDIC, approval of the MRV plan by EPA, and receipt of a FONSI under the NEPA, Minnkota is continuing its pursuit of Project Tundra. In December 2023, the Office of Clean Energy Demonstrations under its Carbon Capture Demonstrations Projects Program announced funding for the capture system (Office of Clean Energy Demonstrations, 2023) and a proposal for CarbonSAFE Phase IV: Construction funding was submitted in March 2024 for the storage project. A go/no-go decision to proceed with construction and operations in the Broom Creek Formation is anticipated in 2024. References National Energy Technology Laboratory, CarbonSafe Initiative, https://netl.doe.gov/carbon-management/carbon-storage/carbonsafe (accessed August 2024). Office of Clean Energy Demonstrations, 2023, OCED selects three projects in CA, ND, and TX to reduce harmful carbon pollution, create new economic opportunities, and advance carbon reducing technologies, December, www.energy.gov/oced/articles/oced-selects-three-projects-ca-nd-and-tx-reduce-harmful-carbon-pollution-create-new (accessed August 2024).

Peck, Wesley↗

Towards Universal Non-Dimensional Characterization of the Oscillatory Dynamics of Wind Turbine Rotors of Multiple Sizes

One concern in the field of Horizontal Axis Wind Turbines (HAWTs) is what control strategies are needed to handle gust pulses in the wind to prevent extreme oscillations of the blades to reduce fatigue stress, prevent blade rupture, and extend the turbine’s operational life. In order to design innovative control strategies to modify the blade’s oscillatory response, it is crucial to establish the fundamental vibrational behavior of the blades when excited by gust pulses of different frequencies and amplitudes present in the fluctuating wind inflow. In a series of previous works, the authors presented a novel Reduced-Order Characterization (ROC) technique that provided an energy-based characterization of the fundamental modes of oscillation of wind turbine rotors when excited by combinations of wind gust pulses of different frequencies and amplitudes. The main focus of the present work is to extend these original notions of energy-based ROC to a universal technique expressed in terms of non-dimensional quantities that could be applied to turbines of any size, operating in any set of wind conditions, as long as they share geometrical and material similarity. The ROC technique provides a simple formula that is capable of predicting the dominant vibrational modes of a blade with sufficient precision to be useful in the determination of a control decision that can be computed in real time, an aspect of fundamental importance in dealing with rapid fluctuations in wind conditions.

Yates, North (ORCID:000900052204261X)↗

Meeting report of the RNA Ontology Consortium January 8-9, 2011

This report summarizes the proceedings of the structure mapping working group meeting of the RNA Ontology Consortium (ROC), held in Kona, Hawaii on January 8-9, 2011. The ROC hosted this workshop to facilitate collaborations among those researchers formalizing concepts in RNA, those developing RNA-related software, and those performing genome annotation and standardization. The workshop included three software presentations, extended round-table discussions, and the constitution of two new working groups, the first to address the need for better software integration and the second to discuss standardization and benchmarking of existing RNA annotation pipelines. These working groups have subsequently pursued concrete implementation of actions suggested during the discussion. Further information about the ROC and its activities can be found at http://roc.bgsu.edu/.

59 BASIC BIOLOGICAL SCIENCES↗

Processes and process development in Taiwan

Silicon material research in the Republic of China (ROC) parallels its development in the electronic industry. A brief outline of the historical development in ROC silicon material research is given. Emphasis is placed on the recent Silane Project managed by the National Science Council, ROC, including project objectives, task forces, and recent accomplishments. An introduction is also given to industrialization of the key technologies developed in this project.

Hwang, H. L.↗

High Frequency QRS ECG Accurately Detects Cardiomyopathy

High frequency (HF, 150-250 Hz) analysis over the entire QRS interval of the ECG is more sensitive than conventional ECG for detecting myocardial ischemia. However, the accuracy of HF QRS ECG for detecting cardiomyopathy is unknown. We obtained simultaneous resting conventional and HF QRS 12-lead ECGs in 66 patients with cardiomyopathy (EF = 23.2 plus or minus 6.l%, mean plus or minus SD) and in 66 age- and gender-matched healthy controls using PC-based ECG software recently developed at NASA. The single most accurate ECG parameter for detecting cardiomyopathy was an HF QRS morphological score that takes into consideration the total number and severity of reduced amplitude zones (RAZs) present plus the clustering of RAZs together in contiguous leads. This RAZ score had an area under the receiver operator curve (ROC) of 0.91, and was 88% sensitive, 82% specific and 85% accurate for identifying cardiomyopathy at optimum score cut-off of 140 points. Although conventional ECG parameters such as the QRS and QTc intervals were also significantly longer in patients than controls (P less than 0.001, BBBs excluded), these conventional parameters were less accurate (area under the ROC = 0.77 and 0.77, respectively) than HF QRS morphological parameters for identifying underlying cardiomyopathy. The total amplitude of the HF QRS complexes, as measured by summed root mean square voltages (RMSVs), also differed between patients and controls (33.8 plus or minus 11.5 vs. 41.5 plus or minus 13.6 mV, respectively, P less than 0.003), but this parameter was even less accurate in distinguishing the two groups (area under ROC = 0.67) than the HF QRS morphologic and conventional ECG parameters. Diagnostic accuracy was optimal (86%) when the RAZ score from the HF QRS ECG and the QTc interval from the conventional ECG were used simultaneously with cut-offs of greater than or equal to 40 points and greater than or equal to 445 ms, respectively. In conclusion 12-lead HF QRS ECG employing RAZ scoring is a simple, accurate and inexpensive screening technique for cardiomyopathy. Although HF QRS ECG is highly sensitive for cardiomyopathy, its specificity may be compromised in patients with cardiac pathologies other than cardiomyopathy, such as uncomplicated coronary artery disease or multiple coronary disease risk factors. Further studies are required to determine whether HF QRS might be useful for monitoring cardiomyopathy severity or the efficacy of therapy in a longitudinal fashion.

Schlegel, Todd T.↗

Predicting Ares I Reaction Control System Performance by Utilizing Analysis Anchored with Development Test Data

The Ares I launch vehicle is an integral part of NASA s Constellation Program, providing a foundation for a new era of space access. The Ares I is designed to lift the Orion Crew Module and will enable humans to return to the Moon as well as explore Mars.1 The Ares I is comprised of two inline stages: a Space Shuttle-derived five-segment Solid Rocket Booster (SRB) First Stage (FS) and an Upper Stage (US) powered by a Saturn V-derived J-2X engine. A dedicated Roll Control System (RoCS) located on the connecting interstage provides roll control prior to FS separation. Induced yaw and pitch moments are handled by the SRB nozzle vectoring. The FS SRB operates for approximately two minutes after which the US separates from the vehicle and the US Reaction Control System (ReCS) continues to provide reaction control for the remainder of the mission. A representation of the Ares I launch vehicle in the stacked configuration and including the Orion Crew Exploration Vehicle (CEV) is shown in Figure 1. Each Reaction Control System (RCS) design incorporates a Gaseous Helium (GHe) pressurization system combined with a monopropellant Hydrazine (N2H4) propulsion system. Both systems have two diametrically opposed thruster modules. This architecture provides one failure tolerance for function and prevention of catastrophic hazards such as inadvertent thruster firing, bulk propellant leakage, and over-pressurization. The pressurization system on the RoCS includes two ambient pressure-referenced regulators on parallel strings in order to attain the required system level single Fault Tolerant (FT) design for function while the ReCS utilizes a blow-down approach. A single burst disk and relief valve assembly is also included on the RoCS to ensure single failure tolerance for must-not-occur catastrophic hazards. The Reaction Control Systems are designed to support simultaneously firing multiple thrusters as required

Stein, William B.↗