Search NASA⌕ Search

SEARCH · Search NASA

Results for “data classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

The analysis of forest policy using Landsat multi-spectral scanner data and geographic information systems

The role of Landsat multi-spectral scanner (MSS) data for forest policy analysis in the state of California has been investigated. The combined requirements for physical, socio-economic, and institutional data in policy analysis were studied to explain potential data needs. A statewide MSS data and general land cover classification was created from which country-wide data sets could be extracted for detailed analyses. The potential to combine point sample data with MSS data was examined as a means to improve specificity in estimations. MSS data was incorporated into geographic information systems to demonstrate modeling techniques using abiotic, biotic, and socio-economic data layers. The review of system configurations to help the California Department of Forestry (CDF) acquire the capability demonstrated resulted in a sequence of options for implementation.

Peterson, D. L.↗

Classification of particle height in a hopper bin from limited discharge data using convolutional neural network models

Hopper bin discharge processes are ubiquitous in many industrial applications. The preponderance of previous studies of this system has been focused on the forward discharge process given an initial particle packing configuration. Motivated by the needs in reaction design and optimization, we develop here an inverse reconstruction procedure that enables one to obtain the particle height information in the initial packing configuration in the hopper bin from limited discharge dynamics data and particle characteristics. Our procedure is based on convolutional neural network (CNN) models, which take experimentally measurable particle residence time, diameter and density as input, and provide a classification of particle height in the initial packing as output. Using MFIX-DEM simulations with enhanced physical modeling capabilities, we generate extensive discharge data for hoppers containing two distinct solid phase particles with four distinct classes of initial packing geometries. The CNN reconstruction models are subsequently trained and tested using the discharge data. Here, we find that the reconstruction (i.e., particle height classification) accuracy strongly depends on the initial packing geometry. For hopper-specific CNN models exclusively trained using discharge data from a single hopper, the classification can attain an accuracy up to almost 90%. The accuracy decreases for generic reconstruction models trained using a collection of discharge data for multiple hoppers. Finally, we apply the CNN model to accurately reconstruct a hopper containing four distinct solid phases with a layered configuration to further demonstrate its utility.

42 ENGINEERING↗

Computer-aided analysis of Landsat-1 MSS data - A comparison of three approaches, including a 'modified clustering' approach

Three approaches for analyzing Landsat-1 data from Ludwig Mountain in the San Juan Mountain range in Colorado are considered. In the 'supervised' approach the analyst selects areas of known spectral cover types and specifies these to the computer as training fields. Statistics are obtained for each cover type category and the data are classified. Such classifications are called 'supervised' because the analyst has defined specific areas of known cover types. The second approach uses a clustering algorithm which divides the entire training area into a number of spectrally distinct classes. Because the analyst need not define particular portions of the data for use but has only to specify the number of spectral classes into which the data is to be divided, this classification is called 'nonsupervised'. A hybrid method which selects training areas of known cover type but then uses the clustering algorithm to refine the data into a number of unimodal spectral classes is called the 'modified-supervised' approach.

Fleming, M. D.↗

Classifying and analyzing small-angle scattering data using weighted k nearest neighbors machine learning techniques

A consistent challenge for both new and expert practitioners of small-angle scattering (SAS) lies in determining how to analyze the data, given the limited information content of said data and the large number of models that can be employed. Machine learning (ML) methods are powerful tools for classifying data that have found diverse applications in many fields of science. Here, ML methods are applied to the problem of classifying SAS data for the most appropriate model to use for data analysis. The approach employed is built around the method of weighted k nearest neighbors (wKNN), and utilizes a subset of the models implemented in the SasView package (https://www.sasview.org/) for generating a well defined set of training and testing data. The prediction rate of the wKNN method implemented here using a subset of SasView models is reasonably good for many of the models, but has difficulty with others, notably those based on spherical structures. A novel expansion of the wKNN method was also developed, which uses Gaussian processes to produce local surrogate models for the classification, and this significantly improves the classification accuracy. Further, by integrating a stochastic gradient descent method during post-processing, it is possible to leverage the local surrogate model both to classify the SAS data with high accuracy and to predict the structural parameters that best describe the data. The linking of data classification and model fitting has the potential to facilitate the translation of measured data into results for both novice and expert practitioners of SAS.

97 MATHEMATICS AND COMPUTING↗

Data product development for cold cloud and precipitation process analysis/Snow regime classifications from the NSA snow product

This grant funded work focused first on developing a data product for cold-cloud precipitation and second, under a continuation, on examining distinct snowfall regimes occurring at the North Slope Alaska (NSA) facility. The overarching goal under the first phase was to provide a data product that quantifies the vertically- and temporally-resolved properties of cold, precipitating clouds and that will enable future analyses of the processes that control their formation and evolution. The data product derives from observations at the NSA Utqiagvik (BRW) and Oliktok Point (OLI) sites, its algorithm utilizing radar observations supplemented with in situ and other collocated remote sensing measurements to constrain an optimal estimation retrieval.

54 ENVIRONMENTAL SCIENCES↗

Urban area update procedures using Landsat data

Landsat digital enhancements and classification maps are shown to be useful for updating the urban expansion of standard metropolitan statistical areas on a macro scale. Automated procedures for detecting nonurban to urban land coverage change using multitemporal Landsat data are investigated for five metropolitan areas, showing an overall delineation similar to that obtained from large scale aerial photography. The evaluated change detection procedures include image differencing, principal component transformation prior to differencing, and post classification comparison. Results show that image differencing techniques in MSS band 5 provide the most accurate land cover change detections.

Toll, D. L.↗

Application of LANDSAT images to wetland study and land use classification in west Tennessee, part 1

The author has identified the following significant results. densitometric analysis was performed on LANDSAT data to permit numerical classification of objects observed in the imagery on the basis of measurements of optical density. Relative light transmission measurements were taken on four types of scene elements in each of three LANDSAT black and white bands in order to determine which classification could be distinguished. The analysis of band 6 determined forest and agricultural classifications, but not the urban and wetlands. Both bands 4 and 5 showed a significant difference existed between the confirmed classification of wetlands-agriculture, and urban areas. Therefore, the combination of band 6 with either 4 or 5 would permit the separation of the urban from the wetland classification. To enhance the urban and wetland boundaries, the LANDSAT black and white bands were combined in a multispectral additive color viewer. Several combinations of filters and light intensities were used to obtain maximum discrimination between points of interest. The best results for enhancing wetland boundaries and urban areas were achieved by using a color composite (a blue, green, and red filter on bands 4, 5 and 6 respectively).

Shahrokhi, F.↗

Discrimination of natural and cultivated vegetation using Thematic Mapper spectral data

The availability of high quality spectral data from the current suite of earth observation satellite systems offers significant improvements in the ability to survey and monitor food and fiber production on both a local and global basis. Current research results indicate that Landsat TM data when used in either digital or analog formats achieve higher land-cover classification accuracies than MSS data using either comparable or improved spectral bands and spatial resolution. A review of these quantitative results is presented for both natural and cultivated vegetation.

Degloria, Stephen D.↗

Empirical Analysis and Automated Classification of Security Bug Reports

With the ever expanding amount of sensitive data being placed into computer systems, the need for effective cybersecurity is of utmost importance. However, there is a shortage of detailed empirical studies of security vulnerabilities from which cybersecurity metrics and best practices could be determined. This thesis has two main research goals: (1) to explore the distribution and characteristics of security vulnerabilities based on the information provided in bug tracking systems and (2) to develop data analytics approaches for automatic classification of bug reports as security or non-security related. This work is based on using three NASA datasets as case studies. The empirical analysis showed that the majority of software vulnerabilities belong only to a small number of types. Addressing these types of vulnerabilities will consequently lead to cost efficient improvement of software security. Since this analysis requires labeling of each bug report in the bug tracking system, we explored using machine learning to automate the classification of each bug report as a security or non-security related (two-class classification), as well as each security related bug report as specific security type (multiclass classification). In addition to using supervised machine learning algorithms, a novel unsupervised machine learning approach is proposed. An ac- curacy of 92%, recall of 96%, precision of 92%, probability of false alarm of 4%, F-Score of 81% and G-Score of 90% were the best results achieved during two-class classification. Furthermore, an accuracy of 80%, recall of 80%, precision of 94%, and F-score of 85% were the best results achieved during multiclass classification.

Cybersecurity↗

Semisupervised Learning for Seismic Monitoring Applications

The impressive performance that deep neural networks demonstrate on a range of seismic monitoring tasks depends largely on the availability of event catalogs that have been manually curated over many years or decades. However, the quality, duration, and availability of seismic event catalogs vary significantly across the range of monitoring operations, regions, and objectives. Semisupervised learning (SSL) enables learning from both labeled and unlabeled data and provides a framework to leverage the abundance of unreviewed seismic data for training deep neural networks on a variety of target tasks. We apply two SSL algorithms (mean-teacher and virtual adversarial training) as well as a novel hybrid technique (exponential average adversarial training) to seismic event classification to examine how unlabeled data with SSL can enhance model performance. In general, we find that SSL can perform as well as supervised learning with fewer labels. We also observe in some scenarios that almost half of the benefits of SSL are the result of the meaningful regularization enforced through SSL techniques and may not be attributable to unlabeled data directly. Lastly, the benefits from unlabeled data scale with the difficulty of the predictive task when we evaluate the use of unlabeled data to characterize sources in new geographic regions. Finally, in geographic areas where supervised model performance is low, SSL significantly increases the accuracy of source-type classification using unlabeled data.

58 GEOSCIENCES↗

Improving Land Cover Classification Using Extended Multi-Attribute Profiles (EMAP) Enhanced Color, Near Infrared, and LiDAR Data

Hyperspectral (HS) data have found a wide range of applications in recent years. Researchers observed that more spectral information helps land cover classification performance in many cases. However, in some practical applications, HS data may not be available, due to cost, data storage, or bandwidth issues. Instead, users may only have RGB and near infrared (NIR) bands available for land cover classification. Sometimes, light detection and ranging (LiDAR) data may also be available to assist land cover classification. A natural research problem is to investigate how well land cover classification can be achieved under the aforementioned data constraints. In this paper, we investigate the performance of land cover classification while only using four bands (RGB+NIR) or five bands (RGB+NIR+LiDAR). A number of algorithms have been applied to a well-known dataset (2013 IEEE Geoscience and Remote Sensing Society Data Fusion Contest). One key observation is that some algorithms can achieve better land cover classification performance by using only four bands as compared to that of using all 144 bands in the original hyperspectral data with the help of synthetic bands generated by Extended Multi-attribute Profiles (EMAP). Moreover, LiDAR data do improve the land cover classification performance even further.

58 GEOSCIENCES↗

Automatic Detection of Clear-Sky Periods From Irradiance Data

Recent degradation studies have illustrated the importance of considering cloud cover when calculating degradation rates, finding more reliable values when the data are restricted to clear sky periods. Several automated methods of determining clear sky periods have been previously developed, but parameterizing and testing the models has been difficult. Here, we use clear sky classifications determined from satellite data to develop an algorithm that determines clear sky periods using only measured irradiance values and modeled clear sky irradiance as inputs. This approach is tested on global horizontal irradiance (GHI) data from ground collectors at six sites across the United States and compared against independent satellite-based classifications. First, 30 separate models were optimized on each individual site at GHI data intervals of 1, 5, 10, 15, and 30 min (sampled on the first minute of the interval). The models had an average F 0.5 score of 0.949 ± 0.035 on a holdout test set. Next, optimizations were performed by aggregating data from different locations at the same interval, yielding one model per data interval. This paper yielded an average F 0.5 of 0.946 ± 0.037. A final, 'universal' optimization that was trained on data from all sites at all intervals provided an F 0.5 score of 0.943 ± 0.040. The optimizations all provide improvements on a prior, unoptimized clear sky detection algorithm that produces F 0.5 scores that average to 0.903 ± 0.067. Our paper indicates that a single algorithm can accurately classify clear sky periods across locations and data sampling intervals.

14 SOLAR ENERGY↗

The use of expert systems in combination with active and passive microwave data to classify sea ice

The authors report on a system for sea ice classification which combines passive and active microwave data with algorithmic and heuristic classification techniques in order to classify sea ice unambiguously. They describe initial algorithmic classification, extraction of features and symbolic information, the application of data-dependent expert systems, and the establishment of feature correspondence between data sets.

Haverkamp, Donna↗

Crop species recognition and mensuration in the Sacramento Valley

The goal of the second recognition map was to delineate various crop species in a portion of the Sacramento Valley, and at the same time to determine how accurately each could be classified and measured from ERTS-1 data. The new recognition map, a new and concise display of the old map, and classification and mensuration accuracy data are presented and discussed. The mensuration accuracy, in particular, is affected by the presence of an edge effect one resolution wide surrounding nearly all fields. Points on the edge are misclassified because they contain a mixture of, crop and bare soil. Using a processing technique to estimate the proportions of unresolved objects in this edge region, a much improved mensuration capability will be demonstrated.

Thomson, F. J.↗

YOLO for Radio Frequency Signal Classification

Radio frequency signal classification plays a pivotal role in various applications, including spectrum management, wireless security, and cognitive radio. Extant signal classification methods require significant data throughput and are not multilabel. We propose a novel approach to radio frequency signal classification by leveraging the You Only Look Once (YOLO) object detection method. YOLO is a state-of-the-art deep learning model renowned for its real-time object detection capabilities in computer vision applications. We adapt YOLO for signal classification to enable the automatic and efficient identification of various signal types within a power spectral density image. Index Terms—radio-frequency analysis, object detection, neural networks, machine learning, deep learning.

42 ENGINEERING↗

Automated Classification and Analysis of Non-metallic Inclusion Data Sets

The aim of this study is to utilize principal component analysis (PCA), clustering methods, and correlation analysis to condense and examine large, multivariate data sets produced from automated analysis of non-metallic inclusions. Non-metallic inclusions play a major role in defining the properties of steel and their examination has been greatly aided by automated analysis in scanning electron microscopes equipped with energy dispersive X-ray spectroscopy. The methods were applied to analyze inclusions on two sets of samples: two laboratory-scale samples and four industrial samples from a near-finished 4140 alloy steel components with varying machinability. The laboratory samples had well-defined inclusions chemistries, composed of MgO-Al{sub 2}O{sub 3}-CaO, spinel (MgO-Al{sub 2}O{sub 3}), and calcium aluminate inclusions. The industrial samples contained MnS inclusions as well as (Ca,Mn)S + calcium aluminate oxide inclusions. PCA could be used to reduce inclusion chemistry variables to a 2D plot, which revealed inclusion chemistry groupings in the samples. Clustering methods were used to automatically classify inclusion chemistry measurements into groups, i.e., no user-defined rules were required.

36 MATERIALS SCIENCE↗

Early Time-Series Classification with Reliability Guarantee

We consider the early classification of (incomplete) time-series data given a complete time series training set. The early classification problem arises naturally when test sample data is collected over time, or when costs must be incurred to collect the data. For example, for missile defense, it is important to determine the target type long before it reaches its target. A practical goal is to assign a class label as soon as enough data is available to make a good decision. This objective is formalized through the notion of reliability—the probability that a label assigned to the early, incomplete data matches that assigned to the complete data, and we propose a method to classify incomplete data only if a user-specified reliability threshold is met. Our approach models the complete data as a random variable whose distribution is dependent on the current incomplete data and the training data. The method differs from standard strategies in that our focus is on determining the reliability of the early classification decision, not only the accuracy. Proposed methods are tested on a set of open-domain time-series datasets; where the goal is to classify the time-series as early as possible while still guaranteeing that the reliability threshold is met.

Anderson, Hyrum S.↗

Automatic Detection of Clear-Sky Periods Using Ground and Satellite Based Solar Resource Data

Solar resource availability and variability are important aspects of monitoring performance of photovoltaic installations. For example, recent degradation studies have highlighted the importance of considering cloud cover when calculation degradation rates. With this in mind, we present a method for optimizing clear sky detection algorithms given only modeled clear sky irradiance and ground-measured irradiance values. This method is tested on global horizontal irradiance (GHI) data from ground collectors at six sites across the US and was trained against clear sky classifications determined from satellite data. Thirty models were optimized on each individual site at GHI data frequencies of 1, 5, 10, 15, and 30 minutes. The models had an average F 0.5 score of 0.945 +/- .021 on a holdout test set. In comparison, the un-optimized clear sky detection algorithm produced F 0.5 score that averaged to 0.707 +/- 0.187.

14 SOLAR ENERGY↗