Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Semantic Segmentation of High-Resolution Satellite Imagery using Generative Adversarial Networks with Progressive Growing

With increase in urbanization and Earth Sciences research into urban areas, the need to quickly and accurately segment urban rooftop maps has never been greater. Cur-rent machine learning techniques struggle to produce high accuracy maps in dense urban zones where there is high image noise and foot print overlap. In this paper, we evaluate a training methodology for pixel-wise segmentation for high resolution satellite imagery using progressive growing of generative adversarial networks as a solution. We apply our model to segmenting building rooftops and compare these results to conventional methods for rooftop segmentation. We evaluate our approach using the SpaceNet version 2 and xView datasets. Our experiments show that for SpaceNet, progressive Generative Adversarial Network (GAN) training achieved a test accuracy of 93% compared to 89% for traditional GAN training and 87% for U-Net architecture, while for xView, we achieved 71% accuracy using progressive GAN training compared to 69% through traditional GAN training and 65% using U-Net.

Semantic↗

Re-Evaluation of Low Cloud Amount Relationships With Lower-Tropospheric Stability and Estimated Inversion Strength

Lower-tropospheric stability (LTS) and estimated inversion strength (EIS) have a widely accepted relationship with low cloud amount and are key observational foundations for understanding and modeling low-level stratiform clouds. Using the updated surface-based and satellite cloud data, we find that low cloud amount is not as strongly correlated with LTS, and not as sensitive to LTS, as established in the past. EIS does not provide a stronger correlation with low cloud amount than LTS over all eight regions (including the midlatitudes). Further analyzing the relationships between LTS and EIS with different types of low clouds, we find that there is a strong correlation of LTS and EIS with stratocumulus only. This explains the weaker correlation of low cloud fraction (including cumulus, stratocumulus, and stratus) to both LTS and EIS. These results also suggest the need to re-evaluate these relationships in Earth system models. Plain Language Summary: Low-level clouds play an important role in the global radiation budget. Low cloud amount has two established linear relationships with lower-tropospheric stability (LTS) and estimated inversion strength (ETS). These two relationships are re-evaluated here using three separate observational cloud and two reanalysis datasets for three distinct but overlapping time periods. The analysis shows that the strength of the LTS and ETS relationships with low cloud amount varies, depending on the cloud data used. They have a strong relationship with stratocumulus cloud amount only.

Lauren Cutler↗

The Next Frontier for Remote Sensing of Freshwater HABS: Utilizing Imaging Spectroscopy Data to Identify Cyanobacteria Bloom Types

Cyanobacteria Harmful Algal Blooms (HABs) and their associated toxicity are a concern for inland waters. Due to the extensive spatial coverage and frequent data availability of satellite-based sensors, multi-spectral remote sensing tools have demonstrated utility for monitoring, understanding, and managing these blooms. The next frontier is utilizing high spectral resolution imaging spectroscopy data, such as from NASA’s upcoming PACE, GLIMR, and SBG missions planned for this decade, which allow for the development of more sophisticated cyanobacteria detection algorithms. We evaluate the performance of cyanobacteria genera differentiation algorithms using precursor datasets in support of these upcoming hyperspectral missions. In situ measurements of lake optical, biological, chemical, and physical properties are used to characterize cyanobacteria blooms in hypereutrophic Clear Lake, CA, USA, which supports large, diverse algal and cyanobacteria populations. Data collection occurred during 12 field events in 2021-2022 across all seasons. Three field events were conducted concurrently with hyperspectral data acquisitions from the DESIS sensor on the International Space Station. The results of this study will support the development of future tools utilizing satellite-based imaging spectroscopy data to identify the cyanobacteria genera present in a bloom, and thus the potential for cyanotoxin production. This outcome – the ability to quickly characterize a cyanobacteria bloom at a low cost – will have enormous benefits for public health.

remote sensing↗

Quantitative Assessment of the HLS Surface Reflectance Consistency

The Harmonized Landsat and Sentinel-2 (HLS) project produces compatible surface reflectance (SR) from observations acquired by Landsat-8/9 OLI and Sentinel-2A/2B MSI. The HLS harmonization procedures include atmosphere correction, cloud masking, view angle normalization, and bandpass adjustment. The objective of this study is to quantitatively assess the reflectance consistency between Landsat and Sentinel-2 within the Version 2 HLS data. We collected 545 pairs of same-day Landsat/Sentinel-2 images across the globe to represent a wide range of vegetation types and climate regimes. The mean absolute difference (MAD) in reflectance between Landat and Sentinel-2 was calculated as a consistency indicator for each harmonization step. The MAD generally increased after the atmosphere correction, and then greatly decreased after the BRDF and bandpass adjustments, to smaller than the top-of-atmosphere MAD values. The MAD ranged from 0.0048 to 0.0093 for the six common spectral bands (blue, green, red, NIR, SWIR1, and SWIR2) in the final products, only slightly greater than the difference between Landsat and Sentinel-2 calibrations.. An evaluation on a few commonly used vegetation indices also showed good agreement between Landsat and Sentinel-2 reflectance. All these evaluations demonstrate that the HLS project produces a consistent SR dataset from Landsat-OLI and Sentinel-MSI, which will be a valuable resource for a wide range of remote sensing applications.

Qiang Zhou↗

An analysis of gamma-ray data collected at traffic intersections in Northern Virginia

Gamma-ray spectral data were collected from sensors mounted to traffic signals around Northern Virginia. The data were collected over a span of approximately fifteen months. A subset of the data were analyzed manually and subsequently used to train machine-learning models to facilitate the evaluation of the remaining 50k anomalous events identified in the dataset. We describe the analysis approach used here and discuss the results in terms of radioisotope classes and frequency patterns over day-of-week and time-of-day spans. Data from this work has been archived and is available for future and ongoing research applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Low-Temperature Geothermal Play Fairway Analysis for the Denver Basin

This project is part of a national initiative to showcase the benefits of incorporating low-temperature geothermal resource assessment into the deployment of geothermal heating, combined heat and power (CHP), and geothermal direct-use (GDU) technologies. The initiative was established to accelerate the country's decarbonization efforts by identifying potential for low-temperature geothermal resource utilization (<150 degrees C, e.g., CHP and GDU) in selected sedimentary basins with numerous population centers. The play fairway analysis (PFA) methodologies in this study were adapted from previous PFA investigations of sedimentary basin geothermal play types (SBGPTs) that evaluated the potential for low-temperature resources (<150 degrees C). Workflows, relevant datasets, a new Python library, and common and composite geological criteria maps are utilized to develop low-temperature geothermal resource favorability maps for the Denver Basin, a sedimentary basin spanning Colorado, Nebraska, and Wyoming. The replication of these methodologies in other SBGPTs can evaluate potential for low-temperature resources. To facilitate future assessment of low-temperature geothermal resources in SBGPTs, this project provides PFA workflows, data, tools, and favorability maps that will ultimately support the utilization of low-temperature geothermal resources in sedimentary basins.

combined heat and power↗

The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Inter-comparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.

54 ENVIRONMENTAL SCIENCES↗

AviSense: A Real-time System for Detection, Classification, and Analysis of Aviation Signals

Wireless systems are an integral part of aviation. Apart from their apparent use in air-to-ground communication, wireless systems play a crucial role in avionic functions including navigation and landing. An interference-free wireless environment is therefore critical for the uninterrupted operation and safety of an aircraft. Hence, there is an urgency for airport facilities to acquire the capability to continuously monitor aviation frequency bands for real-time detection of interference and anomalies. To meet this critical need, we design and build AviSense, an SDR-based real-time, versatile system for monitoring aviation bands. AviSense detects and characterizes signal activities to enable practical and effective anomaly detection. We identify and tackle the challenges posed by a diverse set of critical aviation bands and technologies. We evaluate our methodology with real-world aviation signal measurements and two custom datasets of anomalous signals. We find that our signal classification capability achieves a true positive rate of ~99%, with few exceptions, and a false positive rate of less than 4%. We also demonstrate that AviSense can effectively distinguish between different types of anomalies. We build and evaluate a prototype implementation of AviSense that supports distributed monitoring.

42 ENGINEERING↗

Market Assessment for Hydropower Turbine Design Tools Using Integrated Datasets of Dams, Turbines, Owners, and Fish

A Department of Energy funded project titled Biologically Based Design and Evaluation of Hydropower Turbines (BioDE) has developed modeling tools and data that are intended to inform the design and installation of more environmentally friendly hydropower turbines. A market assessment was conducted to identify prospective users of these products within the hydropower industry and regulatory community. The market assessment included the development of a dataset of hydropower turbines and their defining characteristics (both physical and biological) for the purpose of refining program outreach and marketing of BioDE tools and data. A specific objective of the analysis was to identify hydropower owners and operators whose turbines were likely candidates for refurbishing or replacement because of senescence or re-licensing. This report describes a dataset that combines turbine properties, licensing status, fish resources, and ownership information on nearly 5,500 turbines at nearly 2,200 hydropower projects throughout the United States. The data analysis categorizes turbines by design type, geographic region, owner, age, license expiration, fish species presence, and regulatory authority. The ultimate result is the identification of the federal and non-federal owners with the most turbines of various types and the most turbines that have the potential to interact with fish species of concern.

13 HYDRO ENERGY↗

Wind Turbine Gearbox Condition Monitoring Vibration Analysis Benchmarking Datasets

Wind turbine condition monitoring (CM) can potentially help the wind industry reduce turbine downtime and operation and maintenance (O&M) cost. NREL CM research has investigated various condition-monitoring techniques such as acoustic emission (AE specifically stress wave), vibration, electrical signature, lubricant and debris monitoring based on the Gearbox Reliability Collaborative dynamometer and field tests, and other test turbines and resources accessible by NREL. During the past several years, NREL CM research has shown that there are very few validation and verification efforts on commercial wind turbine CM systems. One of the reasons might be limited benchmarking datasets accessible by stakeholders. To fill this gap, NREL executed a data collection effort. The targeted users of these datasets include those investigating vibration-based wind turbine CM research, evaluating commercially available vibration-based CM systems, or testing prototyped vibration-based CM systems. NREL collected data from a healthy and a damaged gearbox of the same design tested by the GRC. Vibration data were collected by accelerometers along with high-speed shaft RPM signals during the dynamometer testing. The healthy gearbox was only tested in the dynamometer. The damaged gearbox was first tested in the dynamometer and later sent to a wind farm close to NREL for field testing. In the field test, it experienced two loss-of-oil events that damaged its internal bearings and gear elements. The gearbox was brought back to NREL and it was retested in the dynamometer with CM systems deployed under controlled loading conditions that would not cause catastrophic failure of the gearbox. The objective of releasing these datasets to the public along with information about the real damage that occurred to the damaged gearbox is to provide the wind industry with some benchmarking datasets. These datasets will benefit research, development, validation, verification, and advancement of vibration-based wind condition-monitoring techniques. By accessing this data you acknowledge the terms outlined in the "License Information" document. Please contract Shawn Sheng (NREL) if you have any questions on the data or would like to collaborate on publications based on the datasets.

Array↗

SU-E-T-630: Predictive Modeling of Mortality, Tumor Control, and Normal Tissue Complications After Stereotactic Body Radiotherapy for Stage I Non-Small Cell Lung Cancer

Purpose: While rates of local control have been well characterized after stereotactic body radiotherapy (SBRT) for stage I non-small cell lung cancer (NSCLC), less data are available characterizing survival and normal tissue toxicities, and no validated models exist assessing these parameters after SBRT. We evaluate the reliability of various machine learning techniques when applied to radiation oncology datasets to create predictive models of mortality, tumor control, and normal tissue complications. Methods: A dataset of 204 consecutive patients with stage I non-small cell lung cancer (NSCLC) treated with stereotactic body radiotherapy (SBRT) at the University of Pennsylvania between 2009 and 2013 was used to create predictive models of tumor control, normal tissue complications, and mortality in this IRB-approved study. Nearly 200 data fields of detailed patient- and tumor-specific information, radiotherapy dosimetric measurements, and clinical outcomes data were collected. Predictive models were created for local tumor control, 1- and 3-year overall survival, and nodal failure using 60% of the data (leaving the remainder as a test set). After applying feature selection and dimensionality reduction, nonlinear support vector classification was applied to the resulting features. Models were evaluated for accuracy and area under ROC curve on the 81-patient test set. Results: Models for common events in the dataset (such as mortality at one year) had the highest predictive power (AUC = .67, p < 0.05). For rare occurrences such as radiation pneumonitis and local failure (each occurring in less than 10% of patients), too few events were present to create reliable models. Conclusion: Although this study demonstrates the validity of predictive analytics using information extracted from patient medical records and can most reliably predict for survival after SBRT, larger sample sizes are needed to develop predictive models for normal tissue toxicities and more advanced machine learning methodologies need be consider in the future.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

CGSim: A Simulation Framework for Large Scale Distributed Computing Environment

Large-scale distributed computing infrastructures such as the Worldwide LHC Computing Grid (WLCG) require comprehensive simulation tools for evaluating performance, testing new algorithms, and optimizing resource allocation strategies. However, existing simulators suffer from limited scalability, hardwired algorithms, lack of real-time monitoring, and inability to generate datasets suitable for modern machine learning approaches. We present CGSim, a simulation framework for large-scale distributed computing environments that addresses these limitations. Built upon the validated SimGrid simulation framework, CGSim provides high-level abstractions for modeling heterogeneous grid environments while maintaining accuracy and scalability. Key features include a modular plugin mechanism for testing custom workflow scheduling and data movement policies, interactive real-time visualization dashboards, and automatic generation of event-level datasets suitable for AI-assisted performance modeling. We demonstrate CGSim’s capabilities through a comprehensive evaluation using production ATLAS PanDA workloads, showing significant calibration accuracy improvements across WLCG computing sites. Scalability experiments show near-linear scaling for multi-site simulations, with distributed workloads achieving 6 × better performance compared to single-site execution. The framework enables researchers to simulate WLCG-scale infrastructures with hundreds of sites and thousands of concurrent jobs within practical time budget constraints on commodity hardware.

Vatsavai, Sairam Sri [Brookhaven National Laborato↗

Quantitative resilience evaluation on recovery from emergency situations in nuclear power plants

Here, this paper mainly introduces how to develop a resilience evaluation model by quantifying the relationship between resilience and resilience components in regard to recovering from emergency situations in nuclear power plants (NPPs). It is an extension of the author’s previous researches. To develop the model, the first step was to analyze event reports published in Republic of Korea in terms of resilience factors from different safety perspectives. Second, statistical methods such as factor analysis, principal component analysis, and multivariate regression analysis were applied to the dataset to identify relations among resilience factors and develop a quantitative resilience evaluation model for recovery from emergency situations in NPPs. Third, the model was validated using the recent event report data released in Korea. Lastly, we present a discussion on how to apply the quantitative resilience evaluation model to results from stress tests performed in Korea.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Metadata Evaluation and Improvement: Evolving Analysis and Reporting

ESIP Community members create and manage a large collection of environmental datasets that span multiple decades, the entire globe, and many parts of the solar system. Metadata are critical for discovering, accessing, using and understanding these data effectively and ESIP community members have successfully created large collections of metadata describing these data. As part of the White House Big Earth Data Initiative (BEDI), ESDIS has developed a suite of tools for evaluating these metadata in native dialects with respect to recommendations from many organizations. We will describe those tools and demonstrate evolving techniques for sharing results with data providers.

metadata recommendations↗

SU-E-T-147: Beam Specific Planning Target Volumes Incorporating 4DCT for Pencil Beam Scanning Proton Therapy of Thoracic Tumors

Purpose: The purpose of this study is to determine whether organ sparing and target coverage can be simultaneously maintained for pencil beam scanning (PBS) proton therapy treatment of thoracic tumors in the presence of motion, stopping power uncertainties and patient setup variations. Methods: Ten consecutive patients that were previously treated with proton therapy to 66.6/1.8 Gy (RBE) using double scattering (DS) were replanned with PBS. Minimum and maximum intensity images from 4DCT were used to introduce flexible smearing in the determination of the beam specific PTV (BSPTV). Datasets from eight 4DCT phases, using ±3% uncertainty in stopping power, and ±3 mm uncertainty in patient setup in each direction were used to create 8*12*10=960 PBS plans for the evaluation of ten patients. Plans were normalized to provide identical coverage between DS and PBS. Results: The average lung V20, V5, and mean doses were reduced from 29.0%, 35.0%, and 16.4 Gy with DS to 24.6%, 30.6%, and 14.1 Gy with PBS, respectively. The average heart V30 and V45 were reduced from 10.4% and 7.5% in DS to 8.1% and 5.4% for PBS, respectively. Furthermore, the maximum spinal cord, esophagus and heart dose were decreased from 37.1 Gy, 71.7 Gy and 69.2 Gy with DS to 31.3 Gy, 67.9 Gy and 64.6 Gy with PBS. The conformity index (CI), homogeneity index (HI), and global maximal dose were improved from 3.2, 0.08, 77.4 Gy with DS to 2.8, 0.04 and 72.1 Gy with PBS. All differences are statistically significant, with p values <0.05, with the exception of the heart V45 (p= 0.146). Conclusion: PBS with BSPTV achieves better organ sparing and improves target coverage using a repainting method for the treatment of thoracic tumors. Incorporating motion-related uncertainties is essential This work was supported by the US Army Medical Research and Materiel Command under Contract Agreement No. DAMD17-W81XWH-07-2-0121 and W81XWH-09-2-0174.

60 APPLIED LIFE SCIENCES↗

Shorter function summaries for finite state machine-based high consequence systems using logic synthesis and tautologies (Final Report LDRD 24-1302)

Computer programs are often viewed as collections of functions – each function has parameters (inputs) and computes a return value, and each has potential side effects that modify program state (outputs). In this research, a Sandia symbolic execution tool designed to support “human-in-the-loop” analysis was modified to automatically create “function summaries,” and a new tool, “diaboolical,” was created to support enhancing readability of the summary using a novel approach to bit-vector simplification that leverages logic synthesis and tautologies. For this effort, students at Auburn University created several finite state machines (FSMs) to serve as exemplars for high-consequence systems. Function summaries for each of the machines were obtained, and then portions of the summaries were simplified using both diaboolical and the simplification procedure of a popular SMT solver. A comparison of the results shows that diaboolical can often produce smaller function summaries, with expression length improvements over the unsimplified function summaries ranging from 0% to 90% for diaboolical and 0% to 65% for the SMT solver, though diaboolical had a significantly greater cost in time. Diaboolical was evaluated against a collection of “arbitrary” C-code as well as FSM exemplars, and for both datasets it achieved an approximately 10% improvement in expression length compared to simplifications that could be obtained using existing techniques. Function summaries can assist assurance efforts that evaluate existing systems and their executable code. A smaller function summary is likely easier for humans to understand and could thus increase the ability and efficacy of assurance practices centered around the analysis of executable artifacts.

97 MATHEMATICS AND COMPUTING↗

SU-C-207B-02: Maximal Noise Reduction Filter with Anatomical Structures Preservation

Purpose: All medical images contain noise, which can result in an undesirable appearance and can reduce the visibility of anatomical details. There are varieties of techniques utilized to reduce noise such as increasing the image acquisition time and using post-processing noise reduction algorithms. However, these techniques are increasing the imaging time and cost or reducing tissue contrast and effective spatial resolution which are useful diagnosis information. The three main focuses in this study are: 1) to develop a novel approach that can adaptively and maximally reduce noise while preserving valuable details of anatomical structures, 2) to evaluate the effectiveness of available noise reduction algorithms in comparison to the proposed algorithm, and 3) to demonstrate that the proposed noise reduction approach can be used clinically. Methods: To achieve a maximal noise reduction without destroying the anatomical details, the proposed approach automatically estimated the local image noise strength levels and detected the anatomical structures, i.e. tissue boundaries. Such information was used to adaptively adjust strength of the noise reduction filter. The proposed algorithm was tested on 34 repeating swine head datasets and 54 patients MRI and CT images. The performance was quantitatively evaluated by image quality metrics and manually validated for clinical usages by two radiation oncologists and one radiologist. Results: Qualitative measurements on repeated swine head images demonstrated that the proposed algorithm efficiently removed noise while preserving the structures and tissues boundaries. In comparisons, the proposed algorithm obtained competitive noise reduction performance and outperformed other filters in preserving anatomical structures. Assessments from the manual validation indicate that the proposed noise reduction algorithm is quite adequate for some clinical usages. Conclusion: According to both clinical evaluation (human expert ranking) and qualitative assessment, the proposed approach has superior noise reduction and anatomical structures preservation capabilities over existing noise removal methods. Senior Author Dr. Deshan Yang received research funding form ViewRay and Varian.

60 APPLIED LIFE SCIENCES↗