Search NASA⌕ Search

SEARCH · Search NASA

Results for “data classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Robust Measurement of Stellar Streams around the Milky Way: Correcting Spatially Variable Observational Selection Effects in Optical Imaging Surveys

Observations of density variations in stellar streams are a promising probe of low-mass dark matter substructure in the Milky Way. However, survey systematics such as variations in seeing and sky brightness can also induce artificial fluctuations in the observed densities of known stellar streams. These variations arise because survey conditions affect both object detection and star–galaxy misclassification rates. To mitigate these effects, we use Balrog synthetic source injections in the Dark Energy Survey (DES) Y3 data to calculate detection rate variations and classification rates as functions of survey properties. We show that these rates are nearly separable with respect to survey properties and can be estimated with sufficient statistics from the synthetic catalogs. Applying these corrections reduces the standard deviation of relative detection rates across the DES footprint by a factor of 5, and our corrections significantly change the inferred linear density of the Phoenix stream when including faint objects. Additionally, for artificial streams with DES-like survey properties we are able to recover density power spectra with reduced bias. We also find that uncorrected power-spectrum results for Legacy Survey of Space and Time (LSST)-like data can be around 5 times more biased, highlighting the need for such corrections in future ground-based surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Correlation between aircraft MSS and LIDAR remotely sensed data on a forested wetland in South Carolina

Wetlands in a portion of the Savannah River swamp forest, the Steel Creek Delta, were mapped using April 26, 1985 high-resolution aircraft multispectral scanner (MSS) data. Due to the complex spectral characteristics of the wetland vegetation, it was necessary to implement several techniques in the classification of the MSS imagery of the Steel Creek Delta. In particular, when performing unsupervised classification, an iterative cluster busting technique was used which simplified the cluster labeling process. In addition to the MSS data, light detecting and ranging (LIDAR) data were acquired by National Aeronautics and Space Administration (NASA) personnel along two flightlines over the Steel Creek Delta. These data were registered with the wetland classification map and correlated. Statistical analyses demonstrated that the laser derived canopy height information was significantly correlated with the Steel Creek Delta wetland classes encountered along the profiling transect of the LIDAR data.

Jensen, John R.↗

Correlation between aircraft MSS and LIDAR remotely sensed data on a forested wetland in South Carolina

Wetlands in a portion of the Savannah River swamp forest, the Steel Creek Delta, were mapped using April 26, 1985 high-resolution aircraft multispectral scanner (MSS) data. Due to the complex spectral characteristics of the wetland vegetation, it was necessary to implement several techniques in the classification of the MSS imagery of the Steel Creek Delta. In particular, when performing unsupervised classification, an iterative cluster busting technique was used which simplified the cluster labeling process. In addition to the MSS data, light detecting and ranging (LIDAR) data were acquired by National Aeronautics and Space Administration (NASA) personnel along two flightlines over the Steel Creek Delta. These data were registered with the wetland classification map and correlated. Statistical analyses demonstrated that the laser derived canopy height information was significantly correlated with the Steel Creek Delta wetland classes encountered along the profiling transect of the LIDAR data.

Jensen, John R.↗

Sentiment analysis of the United States public support of nuclear power on social media using large language models

This study utilized large language models (LLMs) to analyze public sentiment in the United States (US) regarding nuclear power on social media, focusing on X/Twitter, considering climate change challenges and advancements in nuclear power technology. Approximately, 1.26 million nuclear tweets from 2008–2023 were examined to fine-tune LLMs for sentiment classification. We found the crucial role of accurate data labeling for model performance, with potential implications for a 15% improvement, achieved through high-confidence labels. LLMs demonstrated better performance compared to traditional machine learning classifiers, with reduced susceptibility to overfitting and up to 96% classification accuracy. LLMs are used to segment the US public tweets into policy and energy-related categories, revealing that 68% are politically themed. Policy tweets tended to convey negative sentiment, often reflecting opposing political perspectives and focusing on nuclear deals and international relations. Energy-related tweets covered diverse topics with predominantly neutral to positive sentiment, indicating broad support for nuclear power in 48 out of 50 US states. The US public positive sentiments toward nuclear power stemmed from its high power density, reliability regardless of weather conditions, environmental benefits, application versatility, and recent innovations and advancements in both fission and fusion technologies. Negative sentiments primarily focused on waste management, high capital costs, and safety concerns. The neutral campaign highlighted global nuclear facts and advancements, with varying tones leaning towards positivity or negativity. An interesting neutral theme was the advocacy for the combined use of renewable and nuclear energy to attain net-zero goals.

Energy & Fuels↗

SPECTRAL CLASSIFICATION OF GALAXIES AT 0.5 {<=} z {<=} 1 IN THE CDFS: THE ARTIFICIAL NEURAL NETWORK APPROACH

The aim of this work is to combine spectral energy distribution (SED) fitting with artificial neural network techniques to assign spectral characteristics to a sample of galaxies at 0.5 < z < 1. The sample is selected from the spectroscopic campaign of the ESO/GOODS-South field, with 142 sources having photometric data from the GOODS-MUSIC catalog covering bands between {approx}0.4 and 24 {mu}m in 10-13 filters. We use the CIGALE code to fit photometric data to Maraston's synthesis spectra to derive mass, specific star formation rate, and age, as well as the best SED of the galaxies. We use the spectral models presented by Kinney et al. as targets in the wavelength interval {approx}1200-7500 A. Then a series of neural networks are trained, with average performance {approx}90%, to classify the best SED in a supervised manner. We consider the effects of the prominent features of the best SED on the performance of the trained networks and also test networks on the galaxy spectra of Coleman et al., which have a lower resolution than the target models. In this way, we conclude that the trained networks take into account all the features of the spectra simultaneously. Using the method, 105 out of 142 galaxies of the sample are classified with high significance. The locus of the classified galaxies in the three graphs of the physical parameters of mass, age, and specific star formation rate appears consistent with the morphological characteristics of the galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Flood Detection with Synthetic Aperture Radar: A Case Study of Houston, Texas Following Hurricane Harvey (2017) using C- and X-Band Observations

Hurricane Harvey produced record-breaking rainfall of up to 60 inches resulting in extensive flooding in Houston, Texas, in late August and early September of 2017. The slow forward motion of the storm following landfall left much of the area unobservable to optical remote sensing instruments for several days due to cloud cover. The active nature of Synthetic Aperture Radar (SAR) instruments allows for observations through clouds, which can supplement efforts to estimate hurricane-induced flood impacts. A growing fleet of SAR constellations has helped lower the latency of imagery following a hurricane, allowing for more timely detections of flooding to help support emergency response efforts. In this study, we leverage publicly available C-band SAR observations from the European Space Agency’s Sentinel-1B (S1B) satellite, collected on 30 August, and X-band SAR imagery collected on 1 September by the Airbus TanDEM-X (TDX) satellite made available through the NASA Commercial Smallsat Data Acquisition (CSDA) program. For each dataset, one co-polarized, StripMap, Radiometric Terrain Corrected (RTC) image was used to create a binary water/no water classification map by referencing permanent water in the Cropland Data Layer (CDL) dataset to determine thresholds. A validation dataset of randomly distributed “ground truth” points was generated using optical imagery from PlanetScope on 31 August, where the domain had relatively little cloud cover. We found that the S1B- and TDX-derived open water maps achieved overall accuracies of 94.17% and 91.57%, respectively. The variation in performance is attributed to both the penetrative abilities of C- and X-band SAR wavelengths in vegetated areas and the increased spatial resolution of the commercial SAR (~3 m) over Sentinel-1 (30 m). While publicly available Sentinel-1 observations are commonly relied upon in response and recovery efforts, these results suggest that including commercial X-band SAR imagery could be beneficial by providing both increased spatial resolution and more frequent revisits when deriving post-event flood mapping products.

Alexander M Melancon↗

HEMLOCK

HEMLOCK (Heterogeneous Ensemble Machine Learning Open Classification Kit) is a software tool for constructing, evaluating, and applying heterogeneous ensemble data models for use in solving supervised machine learning problems. Specifically, the main class of problems targeted by HEMLOCK is the problem of multiple-class classification (also called labeling or categorization) of data with continuous or discrete features. HEMLOCK consists of various data readers, machine learning algorithms, model combination and comparison routines, evaluation methods for model performance testing, and interfaces to external, state-of-the-art machine learning software libraries.

Gilpin, Sean Andrew↗

The effect of spatial resolution upon texture-based cloud field classifications

The loss of cloud-classification accuracy as a function of spatial resolution is assessed by investigating the variation of textural measures as a function of spatial resolution. Landsat MSS imagery is progressively averaged to produce degraded imagery of 1/8-km, 1/4-km, 1/2-km, and 1-km spatial resolution, and textural measures are computed from the Gray Level Difference Vector (GLDV) approach described by Chen et al. (1989). It is found that the classification accuracies obtained using the 1/8-km spatial resolution data are similar to those obtained using the full-resolution (1/16 km) texture measures, indicating that there is no advantage in using even higher spatial resolution 30-m Landsat Thematic Mapper and 10-m SPOT imagery for cloud classification.

Welch, R. M.↗

A Novel Machine Learning-Based Gap-Filling of Fine-Resolution Remotely Sensed Snow Cover Fraction Data By Combining Downscaling and Regression

Satellite-based remotely sensed observations of snow cover fraction (SCF) can have data gaps in spatially distributed coverage from sensor and orbital limitations. We mitigate these limitations in the example fine-resolution Moderate Resolution Imaging Spectroradiometer (MODIS) data by gap-filling using auxiliary 1-km datasets that either aid in downscaling from coarser-resolution (5 km) MODIS SCF wherever not fully covered by clouds, or else by themselves via regression wherever fully cloud covered. This study’s prototype predicts a 1-km version of the 500-m MOD10A1 SCF target. Due to noncollocatedness of spatial gaps even across input and auxiliary datasets, we consider a recent gap-agnostic advancement of partial convolution in computer vision for both training and predictive gap-filling. Partial convolution accommodates spatially consistent gaps across the input images, effectively implementing a two-dimensional masking. To overcome reduced usable data from noncollocated spatial gaps across inputs, we innovate a fully generalized three-dimensional masking in this partial convolution. This enables a valid output value at a pixel even if only a single valid input variable and its value exist in the neighborhood covered by the convolutional filter zone centered around that pixel. Thus, our gap-agnostic technique can use significantly more examples for training (∼67%) and prediction (∼100%), instead of only less than 10% for the previous partial convolution. We train an example simple three-layer legacy super-resolution convolutional neural network (SRCNN) to obtain downscaling and regression component performances that are better than baseline values of either climatology or MOD10C1 SCF as relevant. Our generalized partial convolution can enable multiple Earth science applications like downscaling, regression, classification, and segmentation that were hindered by data gaps.

Soni Yatheendradas↗

Enabling modern data discovery for atmospheric measurements

The Atmospheric Radiation Measurement (ARM) user facility is a US Department of Energy Office of Science user facility that is managed and operated through a collaborative effort led by nine US Department of Energy national laboratories. The ARM Data Center, located at Oak Ridge National Laboratory, is responsible for the timely collection, processing, and delivery of data products to the scientific community. The ARM Data Center holds more than 11,000 data products, including metadata collected from field campaigns, instruments, value-added products, and principal investigator–contributed data. These data sets are checked for successful transfer (for most data, this transfer is carried out automatically via the network; however, some of the largest data sets and some of the most remote sites require manual shipping of hard disks) and both the data and metadata are processed to a standard format, which is an ARM-standardized structure, via the Network Common Data Form. The Network Common Data Form is a self-describing binary format with many compatible software tools. Once processed, the data are cataloged, stored in the ARM Data Archive, and made discoverable through association with an array of metadata-characterizing information, such as location and measurement classification. These metadata enable powerful search capabilities through the ARM Data Center Data Discovery interface. This paper discusses the workflow of how the new discovery system has been redesigned from user requirements and how the data are distributed to the scientific community.

54 ENVIRONMENTAL SCIENCES↗

Generalization in quantum machine learning from few training data

Modern quantum machine learning (QML) methods involve variationally optimizing a parameterized quantum circuit on a training data set, and subsequently making predictions on a testing data set (i.e., generalizing). In this work, we provide a comprehensive study of generalization performance in QML after training on a limited number N of training data points. We show that the generalization error of a quantum machine learning model with T trainable gates scales at worst as $\sqrt{T/N}$. When only K$\ll$T gates have undergone substantial change in the optimization process, we prove that the generalization error improves to $\sqrt{K/N}$. Our results imply that the compiling of unitaries into a polynomial number of native gates, a crucial application for the quantum computing industry that typically uses exponential-size training data, can be sped up significantly. We also show that classification of quantum states across a phase transition with a quantum convolutional neural network requires only a very small training data set. Other potential applications include learning quantum error correcting codes or quantum dynamical simulation. Our work injects new hope into the field of QML, as good generalization is guaranteed from few training data.

97 MATHEMATICS AND COMPUTING↗

Analysis of AIS Data of the Recluse Oil Field, Recluse, Wyoming

Airborne Imaging Spectrometer (AIS) data were flown over the Recluse, Wyoming oil field on September 9, 1984. Processing software was developed at Earth Satellite Corporation (EarthSat) for interactive analysis of the AIS data. EarthSat's AIS processing capabilities include destriping, solar irradiance corrections, residual calculations, geometric resampling, equal energy normalization, interactive spectral classifications and a variety of compressive algorithms to reduce the data to 8-bit format with a minimum of information loss. The in-house photolab facilities of EarthSat can routinely produce high-quality color renditions of the enhanced AIS data. A total of 80 lithologic samples were collected under the AIS flight lines. Correlation (within the atmospheric windows) between the laboratory and the AIS spectra of sample sites was generally poor. Reasonable correlation was only possible in large, freshly plowed fields. Mixed pixels and contrast between the natural and sample's surfaces were believed responsible for the poor correlation. Finally, a drift of approximately three channels was observed in the diffraction grating position within the 1.8 to 2.1 micron quadrant.

Dykstra, J. D.↗

Prediction of Cognitive States During Flight Simulation Using Multimodal Psychophysiological Sensing

The Commercial Aviation Safety Team found the majority of recent international commercial aviation accidents attributable to loss of control inflight involved flight crew loss of airplane state awareness (ASA), and distraction was involved in all of them. Research on attention-related human performance limiting states (AHPLS) such as channelized attention, diverted attention, startle/surprise, and confirmation bias, has been recommended in a Safety Enhancement (SE) entitled "Training for Attention Management." To accomplish the detection of such cognitive and psychophysiological states, a broad suite of sensors was implemented to simultaneously measure their physiological markers during a high fidelity flight simulation human subject study. Twenty-four pilot participants were asked to wear the sensors while they performed benchmark tasks and motion-based flight scenarios designed to induce AHPLS. Pattern classification was employed to predict the occurrence of AHPLS during flight simulation also designed to induce those states. Classifier training data were collected during performance of the benchmark tasks. Multimodal classification was performed, using pre-processed electroencephalography, galvanic skin response, electrocardiogram, and respiration signals as input features. A combination of one, some or all modalities were used. Extreme gradient boosting, random forest and two support vector machine classifiers were implemented. The best accuracy for each modality-classifier combination is reported. Results using a select set of features and using the full set of available features are presented. Further, results are presented for training one classifier with the combined features and for training multiple classifiers with features from each modality separately. Using the select set of features and combined training, multistate prediction accuracy averaged 0.64 +/- 0.14 across thirteen participants and was significantly higher than that for the separate training case. These results support the goal of demonstrating simultaneous real-time classification of multiple states using multiple sensing modalities in high fidelity flight simulators. This detection is intended to support and inform training methods under development to mitigate the loss of ASA and thus reduce accidents and incidents.

Harrivel, Angela R.↗

Event Selection and Background Rejection in Time Projection Chambers Using Convolutional Neural Networks and a Specific Application to the AdEPT Gamma-ray Polarimeter Mission

The Advanced Energetic Pair Telescope gamma-ray polarimeter uses a time projection chamber for measuring pair production events and is expected to generate a raw instrument data rate four orders of magnitude greater than is transmittable with typical satellite data communications. GammaNet, a convolutional neural network, proposes to solve this problem by performing event classification on-board for pair production and background events, reducing the data rate to a level that can be accommodated by typical satellite communication systems. In order to train GammaNet, a set of 1.1 × 10(exp 6) pair production events and 10(exp 6) background events were simulated for the Advanced Energetic Pair Telescope using the Geant4 Monte Carlo code. An additional set of 10(exp 6) pair production and 10 background events were simulated to test GammaNet’s capability for background discrimination. With optimization, GammaNet has achieved the proposed background rejection requirements for Galactic Cosmic Ray proton events. Given the best case assumption for downlink speeds, signal sensitivity for pair production ranged between 1.1 ± 0.5% to 69 ± 2% for 5 and 250 MeV incident gamma rays. This range became 0.1 ± 0.1% to 17 ± 2% for the worst case scenario of downlink speeds. The application of a feature visualization algorithm to GammaNet demonstrated decreased response to electronic noise and events exiting or entering the frame and increased response to parallel tracks that are close in proximity. GammaNet has been successfully implemented and shows promising results.

Richard L. Garnett↗

Determining Coal Ash Impacts on Radium and Thorium Background Levels in Soil Using Rare Earth Element Analyses - 18604

One challenge at large remediation sites contaminated with radiological materials is differentiating between low-level site-related contamination and NORM. This is because sites contaminated with radiological materials, such as thorium processing and mining and milling facilities, often generate wastes that contain contaminants that are similar to NORM deposits. For sites in urban areas, this issue is further compounded due to the presence of historic industrial fill (historic fill) containing materials such as fly ash, coal ash, and red brick, that exhibit elevated radioactivity levels. These materials often have activity levels near, or even well above, a site's cleanup goal. At a large Superfund Site in the eastern US (Site), many of the suspected Site-related fill areas are commingled with coal and fly ash. As the cleanup criteria for the radionuclides of concern (ROC), radium (Ra) and thorium (Th), is 5 pico-Curies per gram above background, a four-pronged approach was developed to determine if the coal and fly ash are impacting the background levels of the ROCs. This evaluation included a review of boring logs to visually confirm the presence of historic fill, as well as coal fragments and coal ash; a literature review to establish the typical concentrations of Ra and Th found in coal and fly ash from US sources; the use of rare earth analyses to establish chemical signatures for non-Site related historic fill containing coal ash versus Site-related fill; and a quantitative analysis of Site-related data to determine if the radioactivity levels in historic fill containing coal were elevated. Soil samples were collected from two locations at the Site; fill areas containing coal ash that were not suspected to be impacted by Site activities, as well as fill areas containing coal ash that were associated with the former processing facility. These samples were analyzed for rare earth elements (REE), as well as Ra-228 and Th-232 and the ratios of lanthanum, cerium, and neodymium to Ra-228 and Th-232 were established for each sample. Based on a comparison of these data, a strong correlation was established between the rare earth/thorium decay chain ratios and the classification of material as either Site or non-Site related. These data were used to develop a higher background activity for fill areas containing non-Site related NORM. While the cleanup level defined in the Record of Decision remained unchanged, the higher background derived from the fly ash/coal ash material, as identified by REE analyses, resulted in higher project screening levels, which ensured that excavation activities did not 'chase' material that was not Site-related. To date, use of the coal ash background level has saved millions of dollars in cleanup costs since non-Site related contamination is not being remediated. Use of this approach to determine the appropriate background level for a site is relatively straightforward since it relies on visual observation of the soil for coal and fly ash, along with REE analyses, which is an inexpensive, quick, and established analytical method for soil samples. As long as a good rare earth profile of both contaminated and natural (in this case fly ash and coal ash) material can be established, the results can be quite definitive, which could result in significant volume reduction by minimizing the amount of material excavated and disposed of. This will lead to cost and time savings for what could be an otherwise costly and potentially complex excavation. Anyone performing environmental remediation of NORM contaminated sites may benefit from this paper and presentation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of visible/infrared/microwave agriculture classification and biomass estimation algorithms

This paper describes the results of a study to determine if crop acreage and biomass estimates could be improved by using visible IR and microwave data. The objectives were to (1) develop and test agricultural crop classification models using two or more spectral regions (visible through microwave), and (2) estimate biomass by including microwave with visible and infrared data. Aircraft multispectral data collected during the study included visible and infrared data (multiband data from 0.5 m - 12 m), and active microwave data K band (2 cm), C band (6 cm), L band (20 cm), and P band (75 cm) HH and HV polarizations. Ground truth data from each field consisted of soil moisture and biomass measurements. Results indicated that C, L, and P band active microwave data combined with visible and infrared data improved crop discrimination and biomass estimates compared to results using only visible and infrared data. The active microwave frequencies were sensitive to different biomass levels; K and C being sensitive to differences at low biomass levels, while P band was sensitive to differences at high biomass levels.

Rosenthal, W. D.↗

Development of advanced acreage estimation methods

The use of the AMOEBA clustering/classification algorithm was investigated as a basis for both a color display generation technique and maximum likelihood proportion estimation procedure. An approach to analyzing large data reduction systems was formulated and an exploratory empirical study of spatial correlation in LANDSAT data was also carried out. Topics addressed include: (1) development of multiimage color images; (2) spectral spatial classification algorithm development; (3) spatial correlation studies; and (4) evaluation of data systems.

Guseman, L. F., Jr.↗