Clustering Using Monte Carlo Cross-Validation
In this paper, a new cross-validated likelihood criterion is investigated for determining cluster structure.
data mining knowledge discovery data clusters↗
SEARCH · Search NASA
Results for “data mining”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Models of Weather Impact on Air Traffic
Flight delays have been a serious problem in the national airspace system costing about $30B per year. About 70 of the delays are attributed to weather and upto two thirds of these are avoidable. Better decision support tools would reduce these delays and improve air traffic management tools. Such tools would benefit from models of weather impacts on the airspace operations. This presentation discusses use of machine learning methods to mine various types of weather and traffic data to develop such models.
data mining↗
Increasing Efficiency of Underground Geologic Mapping by Integrating Mine Vision System FaceCapture™ Data Collection with Datamine 3D Modeling Software
Explore the source record for details and available documents.
58 GEOSCIENCES↗
Mining CRRES IDM Pulse Data and CRRES Environmental Data to Improve Spacecraft Charging/Discharging Models and Guidelines
One can truly predict the charging and pulsing in space over a year's time using only the physics that worked for periods of an hour and less in prior publications. All portions of the task were achieved, including the optional portion of determining a value for conductivity that best .t the data. Fortran statements were developed that are required for the NUMIT runs to work with this kind of data from space. In addition to developing the Fortran for NUMIT, simple correlations between the IDM pulsing history and the space radiation were observed because we now have a better characterization of the space radiation. The study showed that: (1) the new methods for measurement of charge storage and conduction in insulators provide the correct values to use for prediction of charging and pulsing in space; (2) the methods in NUMIT that worked well for time durations less than hours now work well for durations of months; (3) an average spectrum such as AE8 is probably not a good guide for predicting pulsing in space one must take time dependence into account in order to understand insulator pulsing; and (4) the old method for predicting pulse rates in space that was based on the CRRES data could be improved to include dependencies on material parameters.
Brautigam, D. H.↗
Comparing digital data processing techniques for surface mine and reclamation monitoring
The results of three techniques used for processing Landsat digital data are compared for their utility in delineating areas of surface mining and subsequent reclamation. An unsupervised clustering algorithm (ISOCLS), a maximum-likelihood classifier (CLASFY), and a hybrid approach utilizing canonical analysis (ISOCLS/KLTRANS/ISOCLS) were compared by means of a detailed accuracy assessment with aerial photography at NASA's Goddard Space Flight Center. Results show that the hybrid approach was superior to the traditional techniques in distinguishing strip mined and reclaimed areas.
Witt, R. G.↗
Shuttle Data Center File-Processing Tool in Java
A Java-language computer program has been written to facilitate mining of data in files in the Shuttle Data Center (SDC) archives. This program can be executed on a variety of workstations or via Web-browser programs. This program is partly similar to prior C-language programs used for the same purpose, while differing from those programs in that it exploits the platform-neutrality of Java in implementing several features that are important for analysis of large sets of time-series data. The program supports regular expression queries of SDC archive files, reads the files, interleaves the time-stamped samples according to a chosen output, then transforms the results into that format. A user can choose among a variety of output file formats that are useful for diverse purposes, including plotting, Markov modeling, multivariate density estimation, and wavelet multiresolution analysis, as well as for playback of data in support of simulation and testing.
Barry, Matthew R.↗
Development of a tree classifier for discrimination of surface mine activity from Landsat digital data
In a cooperative project with the Geological Survey of Alabama, the Mississippi State Remote Sensing Applications Program has developed a single purpose, decision-tree classifier using band-ratioing techniques to discriminate various stages of surface mining activity. The tree classifier has four levels and employs only two channels in classification at each level. An accurate computation of the amount of disturbed land resulting from the mining activity can be made as a product of the classification output. The utilization of Landsat data provides a cost-efficient, rapid, and accurate means of monitoring surface mining activities.
Solomon, J. L.↗
Application of multispectral scanner data to the study of an abandoned surface coal mine
The utility of aircraft multispectral scanner data for describing the land cover features of an abandoned contour-mined coal mine is considered. The data were obtained with an 11 band multispectral scanner at an altitude of 1.2 kilometers. Supervised, maximum-likelihood statistical classifications of the data were made to establish land-cover classes and also to describe in more detail the barren surface features as they may pertain to the reclamation or restoration of the area. The scanner data for the surface-water areas were studied to establish the variability and range of the spectral signatures. Both day and night thermal images of the area are presented. The results of the study show that a high degree of statistical separation can be obtained from the multispectral scanner data for the various land-cover features.
Spisz, E. W.↗
X-Windows PVT Widget Class
The X-Windows Process Validation Table (PVT) Widget Class ( Class is used here in the object-oriented-programming sense of the word) was devised to simplify the task of implementing network registration services for Information Sharing Protocol (ISP) graphical-user-interface (GUI) computer programs. Heretofore, ISP PVT programming tasks have required many method calls to identify, query, and interpret the connections and messages exchanged between a client and a PVT server. Normally, programmers have utilized direct access to UNIX socket libraries to implement the PVT protocol queries, necessitating the use of many lines of source code to perform frequent tasks. Now, the X-Windows PVT Widget Class encapsulates ISP client server network registration management tasks within the framework of an X Windows widget. Use of the widget framework enables an X Windows GUI program to interact with PVT services in an abstract way and in the same manner as that of other graphical widgets, making it easier to program PVT clients. Wrapping the PVT services inside the widget framework enables a programmer to treat a PVT server interface as though it were a GUI. Moreover, an alternate subclass could implement another service in a widget of the same type. This program was written by Matthew R. Barry of United Space Alliance for Johnson Space Center. For further information, contact the Johnson Technology Transfer Office at (281) 483-3809. MSC-23582 Shuttle Data Center File- Processing Tool in Java A Java-language computer program has been written to facilitate mining of data in files in the Shuttle Data Center (SDC) archives. This program can be executed on a variety of workstations or via Web-browser programs. This program is partly similar to prior C-language programs used for the same purpose, while differing from those programs in that it exploits the platform-neutrality of Java in implementing several features that are important for analysis of large sets of time-series data. The program supports regular expression queries of SDC archive files, reads the files, interleaves the time-stamped samples according to a chosen output, then transforms the results into that format. A user can choose among a variety of output file formats that are useful for diverse purposes, including plotting, Markov modeling, multivariate density estimation, and wavelet multiresolution analysis, as well as for playback of data in support of simulation and testing.
Barry, Matthew R.↗
Application of advanced computing techniques to the analysis and display of space science measurements
A prototype system has been developed to aid the experimental space scientist in the display and analysis of spaceborne data acquired from direct measurement sensors in orbit. We explored the implementation of a rule-based environment for semi-automatic generation of visualizations that assist the domain scientist in exploring one's data. The goal has been to enable rapid generation of visualizations which enhance the scientist's ability to thoroughly mine his data. Transferring the task of visualization generation from the human programmer to the computer produced a rapid prototyping environment for visualizations. The visualization and analysis environment has been tested against a set of data obtained from the Hot Plasma Composition Experiment on the AMPTE/CCE satellite creating new visualizations which provided new insight into the data.
Klumpar, D. M.↗
Intelligent Systems Technologies to Assist in Utilization of Earth Observation Data
With the launch of several Earth observing satellites over the last decade, we are now in a data rich environment. From NASA's Earth Observing System (EOS) satellites alone, we are accumulating more than 3 TB per day of raw data and derived geophysical parameters. The data products are being distributed to a large user community comprising scientific researchers, educators and operational government agencies. Notable progress has been made in the last decade in facilitating access to data. However, to realize the full potential of the growing archives of valuable scientific data, further progress is necessary in the transformation of data into information, and information into knowledge that can be used in particular applications. Sponsored by NASA s Intelligent Systems Project within the Computing, Information and Communication Technology (CICT) Program, a conceptual architecture study has been conducted to examine ideas to improve data utilization through the addition of intelligence into the archives in the context of an overall knowledge building system. Potential Intelligent Archive concepts include: 1) Mining archived data holdings using Intelligent Data Understanding algorithms to improve metadata to facilitate data access and usability; 2) Building intelligence about transformations on data, information, knowledge, and accompanying services involved in a scientific enterprise; 3) Recognizing the value of results, indexing and formatting them for easy access, and delivering them to concerned individuals; 4) Interacting as a cooperative node in a web of distributed systems to perform knowledge building (i.e., the transformations from data to information to knowledge) instead of just data pipelining; and 5) Being aware of other nodes in the knowledge building system, participating in open systems interfaces and protocols for virtualization, and collaborative interoperability. This paper presents some of these concepts and identifies issues to be addressed by research in future intelligent systems technology.
Ramapriyan, Hampapuram K.↗
Adaptive System Modeling for Spacecraft Simulation
This invention introduces a methodology and associated software tools for automatically learning spacecraft system models without any assumptions regarding system behavior. Data stream mining techniques were used to learn models for critical portions of the International Space Station (ISS) Electrical Power System (EPS). Evaluation on historical ISS telemetry data shows that adaptive system modeling reduces simulation error anywhere from 50 to 90 percent over existing approaches. The purpose of the methodology is to outline how someone can create accurate system models from sensor (telemetry) data. The purpose of the software is to support the methodology. The software provides analysis tools to design the adaptive models. The software also provides the algorithms to initially build system models and continuously update them from the latest streaming sensor data. The main strengths are as follows: Creates accurate spacecraft system models without in-depth system knowledge or any assumptions about system behavior. Automatically updates/calibrates system models using the latest streaming sensor data. Creates device specific models that capture the exact behavior of devices of the same type. Adapts to evolving systems. Can reduce computational complexity (faster simulations).
Thomas, Justin↗
Intelligent Systems Technologies and Utilization of Earth Observation Data
The addition of raw data and derived geophysical parameters from several Earth observing satellites over the last decade to the data held by NASA data centers has created a data rich environment for the Earth science research and applications communities. The data products are being distributed to a large and diverse community of users. Due to advances in computational hardware, networks and communications, information management and software technologies, significant progress has been made in the last decade in archiving and providing data to users. However, to realize the full potential of the growing data archives, further progress is necessary in the transformation of data into information, and information into knowledge that can be used in particular applications. Sponsored by NASA s Intelligent Systems Project within the Computing, Information and Communication Technology (CICT) Program, a conceptual architecture study has been conducted to examine ideas to improve data utilization through the addition of intelligence into the archives in the context of an overall knowledge building system (KBS). Potential Intelligent Archive concepts include: 1) Mining archived data holdings to improve metadata to facilitate data access and usability; 2) Building intelligence about transformations on data, information, knowledge, and accompanying services; 3) Recognizing the value of results, indexing and formatting them for easy access; 4) Interacting as a cooperative node in a web of distributed systems to perform knowledge building; and 5) Being aware of other nodes in the KBS, participating in open systems interfaces and protocols for virtualization, and achieving collaborative interoperability.
Ramapriyan, H. K.↗
Development of Machine Learning-Derived Microbiological and Immune Signatures: Applications in Adaptive Risk Assessment of Infectious Disease During Spaceflight
Infectious diseases represent an urgent risk for spaceflight with consequences ranging from loss in crew performance to crew incapacitation or loss of life should an outbreak occur. The resident environmental microbiome on the International Space Station has been monitored through routine surveillance over almost twenty years, beginning with culture-based microbial detection which has advanced to molecular methods in recent years. This has created a wealth of data that we have begun mining to define the microbial ecology of the ISS. Summarized here is our analysis of data from the historical microbial population defined by culture-based monitoring from the past two decades, organized by their likelihood to cause disease into clinical categories. As expected, many residents of the normal microflora in environments where people work and live were detected. However, some known pathogens were also detected. As the spaceflight environment can predispose humans to infection, crew health records were used to source additional data for the set to uncover clinical relevance. Data mining was performed on crew health records to capture adverse health events that may be related to infectious disease. Machine learning, specifically Random Forest analysis, was used to analyze the microbial and crew health datasets. The symptom categories were not explained by the ranked bacteria, due to lack of sufficient data for some categories and due to poor ranking of the pathogens for others. Poor ranking of the bacteria could be due to the clinical symptoms being linked to other disease-causing factors, such as allergy or viral infection. These findings suggest a lack of relationship between bacteria detected on surfaces in the ISS and historical health events experienced by astronauts.
Kristyn Hoffman↗
Simulation of Helium-3 Extraction from Lunar Ilmenite
Knowledge of the trapping mechanisms and diffusion characteristics of solar-wind implanted isotopes in the minerals of the lunar regolith will enable the optimization of the processes to extract solar wind gases from regolith particles. Extraction parameters include the temperature and duration of extraction, particle size, and gas yield. Diffusion data will increase the efficiency and profitability of future mining ventures. This data will also assist in optimizing the evaluations of various potential mining sites based on remote sensing data. For instance, if magnesian ilmenite (Mg,Fel.,Ti03) is found to retain He better than stoichiometric ilmenite (FeTi03), remote sensing data for Mg could be considered in addition to Ti and maturity data. The context of the currently discussed work is the mining of helium-3 for potential use as a fuel for fusion energy generation. However, the potential resources deposited by the solar wind include hydrogen (and derived water), helium-4, nitrogen and carbon. Implantation experiments such as those performed for helium isotopes in ilmenite are important for the optimized extraction of these additional resources. These experiments can easily be reproduced for most elements or isotopes of interest.
Kuhlman, K. R.↗
NETL Coal Energy Atlas: A Collection of Coal/Energy Related Maps
The NETL Coal Energy Atlas contains a comprehensive collection of coal and energy-related maps and graphics curated by the National Energy Technology Laboratory (NETL) Systems Analysis group. It serves as a living document providing an overview of the U.S. coal and energy sectors. The volume is structurally organized into six key thematic areas. Ultimately, the atlas functions as a modular baseline for data integration, allowing researchers to drill down into specific regional locations or customize geographic base layers for advanced systems analysis.
bituminous coal↗
Determining Component Probability using Problem Report Data for Ground Systems used in Manned Space Flight
During the shuttle era NASA utilized a failure reporting system called the Problem Reporting and Corrective Action (PRACA) it purpose was to identify and track system non-conformance. The PRACA system over the years evolved from a relatively nominal way to identify system problems to a very complex tracking and report generating data base. The PRACA system became the primary method to categorize any and all anomalies from corrosion to catastrophic failure. The systems documented in the PRACA system range from flight hardware to ground or facility support equipment. While the PRACA system is complex, it does possess all the failure modes, times of occurrence, length of system delay, parts repaired or replaced, and corrective action performed. The difficulty is mining the data then to utilize that data in order to estimate component, Line Replaceable Unit (LRU), and system reliability analysis metrics. In this paper, we identify a methodology to categorize qualitative data from the ground system PRACA data base for common ground or facility support equipment. Then utilizing a heuristic developed for review of the PRACA data determine what reports identify a credible failure. These data are the used to determine inter-arrival times to perform an estimation of a metric for repairable component-or LRU reliability. This analysis is used to determine failure modes of the equipment, determine the probability of the component failure mode, and support various quantitative differing techniques for performing repairable system analysis. The result is that an effective and concise estimate of components used in manned space flight operations. The advantage is the components or LRU's are evaluated in the same environment and condition that occurs during the launch process.
Monaghan, Mark W.↗
Adaptive Modeling of the International Space Station Electrical Power System
Software simulations provide NASA engineers the ability to experiment with spacecraft systems in a computer-imitated environment. Engineers currently develop software models that encapsulate spacecraft system behavior. These models can be inaccurate due to invalid assumptions, erroneous operation, or system evolution. Increasing accuracy requires manual calibration and domain-specific knowledge. This thesis presents a method for automatically learning system models without any assumptions regarding system behavior. Data stream mining techniques are applied to learn models for critical portions of the International Space Station (ISS) Electrical Power System (EPS). We also explore a knowledge fusion approach that uses traditional engineered EPS models to supplement the learned models. We observed that these engineered EPS models provide useful background knowledge to reduce predictive error spikes when confronted with making predictions in situations that are quite different from the training scenarios used when learning the model. Evaluations using ISS sensor data and existing EPS models demonstrate the success of the adaptive approach. Our experimental results show that adaptive modeling provides reductions in model error anywhere from 80% to 96% over these existing models. Final discussions include impending use of adaptive modeling technology for ISS mission operations and the need for adaptive modeling in future NASA lunar and Martian exploration.
Thomas, Justin Ray↗