Search NASA⌕ Search

SEARCH · Search NASA

Results for “categorical data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Countering Weapons of Mass Destruction Office (CWMD) Data Categorization Study: Chemical, Biological, Radiological, and Nuclear (CBRN) Detection Device Data

Pacific Northwest National Laboratory (PNNL) seeks to address critical questions related to chemical, biological, radiological, and nuclear (CBRN) detection devices. This research aims to enhance the security and understanding of these devices by investigating various aspects of their identification, communication, and functionality. The primary focus is on network security, malware detection, device identification, and intelligence gathering. CBRN data can be categorized in various ways depending on the purpose of CBRN detection devices and the specific context of the applications for analysis. Criteria that can be used to assist in this effort include but are not limited to data type, data protocol, source/destination, application, time, security, and content. This study will inform additional paths for data classification, data profiling, data mapping, and data modeling. This will help the Countering Weapons of Mass Destruction Office (CWMD) better understand their data and make informed decisions based on the insights gained from this study and their application. The CBRN Data Categorization study will include the identification of 5–10 different CBRN detection devices with unique characteristics for assessing and analyzing the data that is being produced by and transmitted from these devices.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Optimal decision trees for categorical data via integer programming

Decision trees have been a very popular class of predictive models for decades due to their interpretability and good performance on categorical features. However, they are not always robust and tend to overfit the data. Additionally, if allowed to grow large, they lose interpretability. In this paper, we present a mixed integer programming formulation to construct optimal decision trees of a prespecified size. We take the special structure of categorical features into account and allow combinatorial decisions (based on subsets of values of features) at each node. Our approach can also handle numerical features via thresholding. Here we show that very good accuracy can be achieved with small trees using moderately-sized training sets. The optimization problems we solve are tractable with modern solvers.

97 MATHEMATICS AND COMPUTING↗

Standardization of Borehole Data to Support Vadose Zone Flow and Transport Modeling

Numerical representation of the geologic framework and its hydrologic and geochemical properties is an integral part of all vadose zone flow and transport modeling. Historically, the geologic framework and the physical distribution of flow and transport properties have been represented by simple homogeneous and horizontally stratified hydrogeologic units. To capture more of the heterogeneity, small-scale variability, and uncertainty within a model, the physical and geochemical parameters may be represented by probability density functions loosely correlated to individual hydrogeologic units. As computer-processing capabilities have become more advanced, there has been more emphasis on improving spatial resolution and quantifying uncertainty in key model parameters. One of the more popular approaches has focused on geostatistical simulation of the flow and transport properties themselves, with little regard to the geologic strata and sedimentary sequences. However, newer approaches are focusing more on geostatistical simulation of the sequence-stratigraphic relations of lithofacies and the geostatistical distributions of flow and transport properties within those facies. These approaches require more rigorous quantitative treatment of geologic data than are normally supported by the mostly qualitative nature of borehole geologic information. Thus at the Hanford Site, efforts are being made to systematize borehole geologic data to be used in a more quantitative way to define the spatial distribution of flow and transport properties in support of vadose flow and transport simulations. New detailed procedures translate qualitative descriptive information into categorical data, and translate inconsistent quantitative and semi-quantitative data into common parametric data sets. A geologic data management system is being developed to manage and integrate these new interpreted categorical data sets with other existing databases to support synergistic analysis and to improve numerical representation of the geologic architecture.

borehole data↗

Carbon Storage Technical Viability Approach (CS TVA) Database

The Carbon Storage Technical Viability Approach (CS TVA) database was developed to support the implementation of the CS TVA Matrix to a national data availability assessment for technically viable carbon storage. This database leverages the efforts of multiple adjacent and overlapping databases by non-redundantly combining the databases into a single database along with additionally providing tags facilitating the CS TVA. The non-redundant aspect of the database permits an accurate assessment of the concentration of available data, aiding in spatial and categorical data gaps analysis relative to the individual CS TVA Matrix Components. Version 2.0 of the database is an expansion of Version 1.0. Version 2.0 was created to include additional data gathered to fill gaps in the existing data set. Downloading the CS TVA v2.0 database will result in two separate databases, the version 1.0 original .gdb, and a second addendum .gdb with the new data gathered, together these two databases make up v2.0. Please see the ReadMe file below for full details, metadata information, use disclaimer, and attributions.

Coal↗

A methodology for collecting valid software engineering data

An effective data collection method for evaluating software development methodologies and for studying the software development process is described. The method uses goal-directed data collection to evaluate methodologies with respect to the claims made for them. Such claims are used as a basis for defining the goals of the data collection, establishing a list of questions of interest to be answered by data analysis, defining a set of data categorization schemes, and designing a data collection form. Feasibility of the data collection methodology was demonstrated by applying it to five different projects in two different environments (other NRL Reports). The application showed that the methodology was both feasible and useful.

Basili, V. R.↗

A methodology for collecting valid software engineering data

An effective data collection method for evaluating software development methodologies and for studying the software development process is described. The method uses goal-directed data collection to evaluate methodologies with respect to the claims made for them. Such claims are used as a basis for defining the goals of the data collection, establishing a list of questions of interest to be answered by data analysis, defining a set of data categorization schemes, and designing a data collection form. The data to be collected are based on the changes made to the software during development, and are obtained when the changes are made. To insure accuracy of the data, validation is performed concurrently with software development and data collection. Validation is based on interviews with those people supplying the data. Results from using the methodology show that data validation is a necessary part of change data collection. Without it, as much as 50% of the data may be erroneous. Feasibility of the data collection methodology was demonstrated by applying it to five different projects in two different environments. The application showed that the methodology was both feasible and useful.

Basili, Victor R.↗

Visually Exploring Worldwide Incidents Tracking System Data

This paper presents refinements of an existing analytic tool, Juxter, which was developed for the visualization of multi-dimensional categorical data, and explores its application to support exploration and interaction with open source Worldwide Incidents Tracking System (WITS) data. The volume and complexity of data available on terrorism makes it hard to analyze. Information systems that can efficiently and effectively collect, access, analyze, and report terrorist incidents can help in further studies focused on preventing, detecting, and responding to terrorist attacks. Existing interfaces to the WITS data support advanced search capabilities, and geolocation but lack functionality for identifying patterns and trends. To better support efficient browsing we have refined Juxter’s existing capabilities for filtering, selecting, and sorting elements and categories within the visualization.

99 GENERAL AND MISCELLANEOUS↗

An analysis and comparison of LANDSAT-1, Skylab (S-192) and aircraft data for delineation of land-water cover types of the Green Swamp, Florida

The author has identified the following significant results. LANDSAT 1 and Skylab (S192) data from the Green Swamp area of central Florida were categorized into five classes: water, cypress, other wetlands, pine, and pasture. These categories were compared with similar categories on a detailed vegetative map made using low altitude aerial photography. Agreement of LANDSAT and Skylab categorized data with the vegetation map was 87 percent and 83 percent respectively. The Green Swamp vegetative categories may be widespread but often consist of numerous small isolated areas, because LANDSAT has a greater resolution than Skylab, it is more favorable for mapping the small vegetative categories.

Higer, A. L.↗

A Reference Based Analysis Framework for Analyzing System Call Traces

Reference based analysis (RBA) is a novel data mining tool for exploring a test data set with respect to a reference data set. The power of RBA lies in it ability to transform any complex data type, such as symbolic sequences and multi-variate categorical data instances, into a multivariate continuous representation. The transformed representation not only allows visualization of the complex data, which cannot be otherwise visualized in its original form, but also allows enhanced anomaly detection in the transformed feature space. We demonstrate the application of the RBA framework in analyzing system call traces and show how the transformation results in improved intrusion detection performance over state of art data mining based intrusion detection methods developed for system call traces.

99 GENERAL AND MISCELLANEOUS↗

Shuttle landing facility cloud cover study: Climatological analysis and two tenths cloud cover rule evaluation

The two-tenths cloud cover rule in effect for all End Of Mission (EOM) STS landings at the Kennedy Space Center (KSC) states: 'for scattered cloud layers below 10,000 feet, cloud cover must be observed to be less than or equal to 0.2 at the de-orbit burn go/no-go decision time (approximately 90 minutes before landing time)'. This rule was designed to protect against a ceiling (below 10,000 feet) developing unexpectedly within the next 90 minutes (i.e., after the de-orbit burn decision and before landing). The Applied Meteorological Unit (AMU) developed and analyzed a database of cloud cover amounts and weather conditions at the Shuttle Landing Facility for a five-year (1986-1990) period. The data indicate the best time to land the shuttle at KSC is during the summer while the worst time is during the winter. The analysis also shows the highest frequency of landing opportunities occurs for the 0100-0600 UTC and 1300-1600 UTC time periods. The worst time of the day to land a shuttle is near sunrise and during the afternoon. An evaluation of the two-tenths cloud cover rule for most data categorizations has shown that there is a significant difference in the proportions of weather violations one and two hours subsequent to initial conditions of 0.2 and 0.3 cloud cover. However, for May, Oct., 700 mb northerly wind category, 1500 UTC category, and 1600 UTC category there is some evidence that the 0.2 cloud cover rule may be overly conservative. This possibility requires further investigation. As a result of these analyses, the AMU developed nomograms to help the Spaceflight Meteorological Group (SMG) and the Cape Canaveral Forecast Facility (CCFF) forecast cloud cover for EOM and Return to Launch Site (RTLS) at KSC. Future work will include updating the two tenths database, further analysis of the data for several categorizations, and developing a proof of concept artificial neural network to provide forecast guidance of weather constraint violations for shuttle landings.

Atchison, Michael K.↗

Power generation forecasting for solar plants based on Dynamic Bayesian networks by fusing multi-source information

A Dynamic Bayesian network (DBN) model for solar power generation forecasting in solar plants is proposed in this paper. The key idea is to fuse sensor data, operational indicators, meteorological data, lagged output power information, and model errors for more accurate short-term (e.g., hours) and mid-term (e.g., days to weeks) power generation forecasting. The proposed DBN augments automated data-driven structure learning with expert knowledge encoding using continuous and categorical data given constraints to represent causal relationships within a solar inverter system. Additionally, an error compensation mechanism is proposed to capture temporal fluctuation. The effectiveness of the DBN on solar power generation forecasting was evaluated by rolling window analysis with one-year testing data collected from a local solar plant. The proposed DBN is compared with four state-of-art methods including support-vector regression (SVR), k-nearest neighbors (kNN), artificial neural network (ANN), and long short-term memory (LSTM) models. The result show that the proposed DBN achieves better accuracy in general, and it is not as data-hungry as some neural network-based models. The proposed DBN is also shown to have robust and consistent forecasting power with different forecasting horizons. The accuracy is 92% - 95% from one hour to one week ahead forecasting.

14 SOLAR ENERGY↗

Machine Learning–Based Condition Monitoring of a Circulating Water System of a Canadian Nuclear Plant

With the need to maintain long-term reliable energy using nuclear power plants, there is an underlying demand to ensure that the maintenance of plant components and systems is also done in an efficient and cost-effective manner. One way to achieve this is by moving from time-based maintenance to condition-based maintenance. The research presented in this paper focuses on applying statistical and machine-learning-based methods to capture anomalies within data for fault detection to further develop into condition monitoring. This paper focuses on system data for a circulating water system (CWS) of a pressurized heavy-water reactor for detecting anomalies. The different methodologies used for detecting and capturing anomalies in the CWS data are matrix profile, density-based spatial clustering of applications with noise (DBSCAN), and support vector machines (SVMs). Matrix profile and DBSCAN are used to distinguish between normal data and anomalous data. This paper presents a hybrid method using DBSCAN and SVM when a portion of the data is used for DBSCAN to generate clusters. This portion of data is then used to train the SVM along with the clusters generated by DBSCAN as output. SVM is then tested on unseen data as a predictive tool, which can work in real time to categorize data points as either normal or anomalous. This paper presents results that show the high accuracies of DBSCAN and SVM in capturing anomalies within the data for a CWS for fault detection. Thus, the maintenance plan would be focused on component condition rather than a time-based schedule by switching to an automated system to identify and predict faults within a CWS.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Human Factors Analysis of EVA Time Requirements

Human Factors Engineering (HFE) is a discipline whose goal is to engineer a safer, more efficient interface between humans and machines. HFE makes use of a wide range of tools and techniques to fulfill this goal. One of these tools is known as motion and time study, a technique used to develop time standards for given tasks. During the summer of 1995, a human factors motion and time study was initiated with the goals of developing a database of EVA task times and developing a method of utilizing the database to predict how long an EVA should take. Initial development relied on the EVA activities performed during the STS-61 (Hubble) mission. The first step of the study was to become familiar with EVA's, the previous task-time studies, and documents produced on EVA's. After reviewing these documents, an initial set of task primitives and task-time modifiers was developed. Data was collected from videotaped footage of two entire STS-61 EVA missions and portions of several others, each with two EVA astronauts. Feedback from the analysis of the data was used to further refine the primitives and modifiers used. The project was continued during the summer of 1996, during which data on human errors was also collected and analyzed. Additional data from the STS-71 mission was also collected. Analysis of variance techniques for categorical data was used to determine which factors may affect the primitive times and how much of an effect they have. Probability distributions for the various task were also generated. Further analysis of the modifiers and interactions is planned.

Pate, Dennis W.↗

A procedure for detection and measurement of interfaces in remotely acquired data using a digital computer

A technique developed and evaluated for the detection and measurement of surface feature interfaces in remotely acquired data is described. A computer implementation of this technique has been effected to automatically process categorized data derived from various sources such as the LANDSAT multispectral scanner and other scanner type sensors. The basic elements of the operational theory of the technique are described together with details of the procedure. An example application of the technique to the analysis of tidal shoreline length is given with a breakdown of manpower requirements.

Faller, K. H.↗

An evaluation of Landsat data for input to a state geographic information system

The results of a study to evaluate Landsat digital data, categorized by land cover, for input to the Maryland Automated Geographic Information (MAGI) system, the state georeferenced data base, are presented. Good correspondence is found between the MAGI system and Landsat data for six of seven categories: forest, water, crop/pasture, medium-density residential, low-density residential, and transitional (disturbed land, construction). Discrepancies between the results are found for commercial/industrial/institutional areas which are due to differences in interpretative methodologies, not to deficiencies in either data source. It is concluded that Landsat data are suitable for future Maryland land cover inventories, and can also be used to augment MAGI system data.

Middleton, E. M.↗

Data Mining in Multi-Dimensional Functional Data for Manufacturing Fault Diagnosis

Multi-dimensional functional data, such as time series data and images from manufacturing processes, have been used for fault detection and quality improvement in many engineering applications such as automobile manufacturing, semiconductor manufacturing, and nano-machining systems. Extracting interesting and useful features from multi-dimensional functional data for manufacturing fault diagnosis is more difficult than extracting the corresponding patterns from traditional numeric and categorical data due to the complexity of functional data types, high correlation, and nonstationary nature of the data. This chapter discusses accomplishments and research issues of multi-dimensional functional data mining in the following areas: dimensionality reduction for functional data, multi-scale fault diagnosis, misalignment prediction of rotating machinery, and agricultural product inspection based on hyperspectral image analysis.

42 ENGINEERING↗