Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Mining”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Martian Dust Abrasion Damage on Solar Arrays: HALT Experimental Investigation and Opportunity Rover Performance Analysis

We explored the utility of ground-based highly accelerated life testing (HALT) on epitaxial lift-off (ELO) triple-junction coverglass interconnected cells (CICs) after exposure to simulated Martian dust storms. Dust storm impingement was replicated by sandblasting CICs with Mars dust simulant replicating conditions similar to the weather conditions reported by the Viking landers. We observed that even in cases when there are no observable open circuit voltage (VOC) losses, the minority carrier lifetime is reduced. Short circuit current (JSC) losses can be recovered upon cleaning, suggesting JSC losses are not linked to permanent damage, like cell cracking. This suggests a permanent degradation could be determined by quantifying the difference between recoverable and non-recoverable power loss. We mined field data from the Mars Exploration Rover, Opportunity and extracted a degradation rate to compare to our experimental data. We found exceptional agreement between 4.9 Martian years of mined field data (9.4%) and the irreversible damage observed in our HALT experiment (9.7%). We demonstrate that the laboratory method for exposing CICs to Martian dust storm conditions well represents the physical reality of long duration CIC operation on Mars.

Lyndsey McMillon-Brown↗

Monitoring strip mining and reclamation with LANDSAT data in Belmont County, Ohio

The utility of LANDSAT digital data for mapping and monitoring surface mines in Belmont County, Ohio was investigated. Two data sets from 1976 and 1979 were processed to classify level 1 land covers and three strip mine categories in order to examine change over time and assess reclamation efforts. The two classifications were compared with aerial photographs. Results of the accuracy assessment show that both classifications are approximately 86 per cent correct, and that surface mine change detection (date-to-date comparison) is facilitated by the digital format of LANDSAT data.

Witt, R. G.↗

Automatic mapping of strip mine operations from spacecraft data

The author has identified the following significant results. Computer techniques were applied to process ERTS tapes acquired over coal mining operations in southeastern Ohio on 21 August 1972 and 3 September 1973. ERTS products obtained included geometrically-correct map overlays, at scales from 1:24,000 to 1:250,000, showing stripped earth, partially reclaimed earth, water, and natural vegetation. Computer-generated tables listing the area covered by each land-water category in square kilometers were also produced. By comparing these mapping products, the study demonstrates the capability of ERTS to monitor changes in the extent of stripping and reclamation. NASA C-130 photography acquired on 7 September 1973 when compared with the ERTS products generated from the 3 September 1973 tape established the categorization accuracy to be better than 90%. It is estimated that the stripping and reclamation maps and data were produced from the ERTS CCTs at a tenth of the cost of conventional techniques.

Rogers, R. H.↗

Utilization of Machine Learning Techniques for Managing the Tracking and Data Relay Satellite Constellation

National Aeronautics and Space Administration’s (NASA) Goddard Space Flight Center (GSFC) operates a constellation of ten geosynchronous Tracking and Data Relay Satellites (TDRS). The TDRS constellation consists of multiple geosynchronous communication relay satellites located around the equator so they can provide continual coverage of any mission in low earth orbit. The TDRS are located primarily in three oceanic regions around the earth. NASA’s White Sands Complex provides the ground communication support for TDRS located over the Atlantic and Pacific Oceans. Another TDRS ground station in Guam supports the TDRS over the Indian Ocean. With these satellites the TDRS network can provide continuous coverage of satellites in low-earth orbit. The NASA Space Network (SN) project office at GSFC manages the constellation of spacecraft. Major customers of the TDRS constellation include, but are not limited to, the International Space Station and the Hubble Space Telescope. The TDRS constellation has three generations of satellites and has been active for over 30 years providing reliable communication links between customer satellites and corresponding ground stations. However, one of the major concerns for TDRS, and in any space mission, is to ensure the health and safety of the spacecraft. Generally, engineers use telemetry data to monitor and analyze the performance and state of health of the spacecraft. Telemetry data contains hundreds of parameters that monitor each important component in the spacecraft, which can be utilized to recognize and characterize the behavior of the spacecraft. Each parameter contains considerable information to represent time-dependent properties of each spacecraft subsystem and component. During the entire life of a TDRS spacecraft, thousands of gigabytes of telemetry data are transmitted in real-time from the spacecraft to the ground station at the White Sands Complex in Las Cruces, New Mexico, and recorded as historical data sets for engineers to process and analyze the events that occurred on-orbit. These parameters contain the function of multiple spacecraft subsystems, such as the attitude control system (ACS), Thermal, Electrical Power Subsystem (EPS), etc. . The first and second generations have exceeded their required lifetime and NASA is keen to manage these spacecrafts carefully in order to maximize the remaining life using the spacecraft telemetry. The challenge is to know when the risk of losing a spacecraft in geosynchronous orbit exceeds the benefit of continued operations for customer support. In the TDRS fleet, the EPS is the most critical subsystem related to spacecraft operations. Failure of the EPS would strand a spacecraft in geosynchronous orbit. Since EPS provides power to the spacecraft, component failures ultimately lead to the inability to support the spacecraft loads and the communications payload. For instance, TDRS-8 has several anomalies in EPS including the Bus Voltage Limiter (BVL) shunt current, solar array loss of circuits, and failed battery cells. Any of these anomalies can cause critical issues to the spacecraft. Therefore, developing a system to analyze and perform early detection of a potential anomaly is an important issue in telemetry data analysis. In recent years, Telemetry Mining (TM) has been proposed to process telemetry data by using Data Mining (DM) techniques such as classification, clustering, regression and anomaly detection. Anomaly detection, also known as outlier detection, has been widely used in many data mining areas such as remote sensing, medical data processing and digital image processing. The goal of anomaly detection is to detect abnormal data, which contains a relatively low probability of occurrence among the entire data set. Early detection of anomalies is one of the most significant issues in managing the spacecraft configuration. If anomalies can be detected early enough, then the redundant resources can be used to extend the life of the operational spacecraft. We present an unsupervised anomaly detection method to process the EPS data extracted from TDRS-8. This is different from traditional analytical methods, which use telemetry data to illustrate behavior and physical meaning of each spacecraft component. TM connects multiple parameters as a vector and then conducts data analysis on this high dimension telemetry vector. This method is looking at the properties of a high dimensional vector that is able to consider the relationship between different parameters in the anomaly detection problem. This kind of method performs much better than the traditional limit checking method. In addition, we propose a new approach of real-time anomaly detection to process telemetry data in real-time, which can then be applied to spacecraft monitoring with high reliability, low cost and high accuracy.

Machine Learning (ML)↗

Active Storage with Analytics Capabilities and I/O Runtime System for Petascale Systems

Computational scientists must understand results from experimental, observational and computational simulation generated data to gain insights and perform knowledge discovery. As systems approach the petascale range, problems that were unimaginable a few years ago are within reach. With the increasing volume and complexity of data produced by ultra-scale simulations and high-throughput experiments, understanding the science is largely hampered by the lack of comprehensive I/O, storage, acceleration of data manipulation, analysis, and mining tools. Scientists require techniques, tools and infrastructure to facilitate better understanding of their data, in particular the ability to effectively perform complex data analysis, statistical analysis and knowledge discovery. The goal of this work is to enable more effective analysis of scientific datasets through the integration of enhancements in the I/O stack, from active storage support at the file system layer to MPI-IO and high-level I/O library layers. We propose to provide software components to accelerate data analytics, mining, I/O, and knowledge discovery for large-scale scientific applications, thereby increasing productivity of both scientists and the systems. Our approaches include 1) design the interfaces in high-level I/O libraries, such as parallel netCDF, for applications to activate data mining operations at the lower I/O layers; 2) Enhance MPI-IO runtime systems to incorporate the functionality developed as a part of the runtime system design; 3) Develop parallel data mining programs as part of runtime library for server-side file system in PVFS file system; and 4) Prototype an active storage cluster, which will utilize multicore CPUs, GPUs, and FPGAs to carry out the data mining workload.

97 MATHEMATICS AND COMPUTING↗

The application of satellite data in monitoring strip mines

Strip mines in the New River Drainage Basin of Tennessee were studied through use of Landsat-1 imagery and aircraft photography. A multilevel analysis, involving conventional photo interpretation techniques, densitometric methods, multispectral analysis and statistical testing was applied to the data. The Landsat imagery proved adequate for monitoring large-scale change resulting from active mining and land-reclamation projects. However, the spatial resolution of the satellite imagery rendered it inadequate for assessment of many smaller strip mines, in the region which may be as small as a few hectares.

Sharber, L. A.↗

Towards standards for data exchange and integration and their impact on a public database such as CEBS (Chemical Effects in Biological Systems)

Integration, re-use and meta-analysis of high content study data, typical of DNA microarray studies, can increase its scientific utility. Access to study data and design parameters would enhance the mining of data integrated across studies. However, without standards for which data to include in exchange, and common exchange formats, publication of high content data is time-consuming and often prohibitive. The MGED Society ( (www.mged.org)) was formed in response to the widespread publication of microarray data, and the recognition of the utility of data re-use for meta-analysis. The NIEHS has developed the Chemical Effects in Biological Systems (CEBS) database, which can manage and integrate study data and design from biological and biomedical studies. As community standards are developed for study data and metadata it will become increasingly straightforward to publish high content data in CEBS, where they will be available for meta-analysis. Different exchange formats for study data are being developed: Standard for Exchange of Nonclinical Data (SEND; (www.cdisc.org)); Tox-ML ( (www.Leadscope.com)) and Simple Investigation Formatted Text (SIFT) from the NIEHS. Data integration can be done at the level of conclusions about responsive genes and phenotypes, and this workflow is supported by CEBS. CEBS also integrates raw and preprocessed data within a given platform. The utility and a method for integrating data within and across DNA microarray studies is shown in an example analysis using DrugMatrix data deposited in CEBS by Iconix Pharmaceuticals.

60 APPLIED LIFE SCIENCES↗

Models of Weather Impact on Air Traffic

Flight delays have been a serious problem in the national airspace system costing about $30B per year. About 70 of the delays are attributed to weather and upto two thirds of these are avoidable. Better decision support tools would reduce these delays and improve air traffic management tools. Such tools would benefit from models of weather impacts on the airspace operations. This presentation discusses use of machine learning methods to mine various types of weather and traffic data to develop such models.

data mining↗

Incremental Anomaly Detection Approach for Characterizing Unusual Profiles

The detection of unusual profiles or anomalous behavioral characteristics from sensor data is especially complicated in security applications where the threat indicators may or may not be known in advance. Predictive modeling of massive volumes of historical data can yield insights on usual or baseline profiles, which in turn can be utilized to isolate unusual profiles when new data are observed in real-time. Thus, an incremental anomaly detection approach is proposed. This is a two-stage approach in which the first stage processes the available historical data and develops statistics that are in turn used by the second stage in characterizing the new incoming data for realtime decisions. The first stage adopts a mixture model of probabilistic principal component analyzers to quantify each historical observation by probabilistic measures. The second stage is a chi-square based anomaly detection approach that utilizes the probabilistic measures obtained in the first stage to determine if the incoming data is an anomaly. The proposed anomaly detection approach performs satisfactorily on simulated and benchmark datasets. The approach is also illustrated in the context of detecting commercial trucks that may pose safety and security risk. It is able to consistently identified trucks with anomalous features in the scenarios investigated.

99 GENERAL AND MISCELLANEOUS↗

Mining Archived HYSPEC User Data to Analyze the Prompt Pulse at the SNS

The Hybrid-Spectrometer (HYSPEC) is one of 17 instruments currently operated at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratories (ORNL). The secondary spectrometer of this instrument is located inside an out-building off the north side of the SNS instrument hall. HYSPEC has experienced a larger background feature than similar inelastic instruments since its commissioning in 2011. This background feature is caused by a phenomenon known as the “prompt pulse” which is an essential part of neutron production in a pulsed spallation source but comes with unfortunate side effects.

background↗

Mining CRRES IDM Pulse Data and CRRES Environmental Data to Improve Spacecraft Charging/Discharging Models and Guidelines

One can truly predict the charging and pulsing in space over a year's time using only the physics that worked for periods of an hour and less in prior publications. All portions of the task were achieved, including the optional portion of determining a value for conductivity that best .t the data. Fortran statements were developed that are required for the NUMIT runs to work with this kind of data from space. In addition to developing the Fortran for NUMIT, simple correlations between the IDM pulsing history and the space radiation were observed because we now have a better characterization of the space radiation. The study showed that: (1) the new methods for measurement of charge storage and conduction in insulators provide the correct values to use for prediction of charging and pulsing in space; (2) the methods in NUMIT that worked well for time durations less than hours now work well for durations of months; (3) an average spectrum such as AE8 is probably not a good guide for predicting pulsing in space one must take time dependence into account in order to understand insulator pulsing; and (4) the old method for predicting pulse rates in space that was based on the CRRES data could be improved to include dependencies on material parameters.

Brautigam, D. H.↗

Comparing digital data processing techniques for surface mine and reclamation monitoring

The results of three techniques used for processing Landsat digital data are compared for their utility in delineating areas of surface mining and subsequent reclamation. An unsupervised clustering algorithm (ISOCLS), a maximum-likelihood classifier (CLASFY), and a hybrid approach utilizing canonical analysis (ISOCLS/KLTRANS/ISOCLS) were compared by means of a detailed accuracy assessment with aerial photography at NASA's Goddard Space Flight Center. Results show that the hybrid approach was superior to the traditional techniques in distinguishing strip mined and reclaimed areas.

Witt, R. G.↗

Real-time individualized training vectors for experiential learning.

Military training utilizing serious games or virtual worlds potentially generate data that can be mined to better understand how trainees learn in experiential exercises. Few data mining approaches for deployed military training games exist. Opportunities exist to collect and analyze these data, as well as to construct a full-history learner model. Outcomes discussed in the present document include results from a quasi-experimental research study on military game-based experiential learning, the deployment of an online game for training evidence collection, and results from a proof-of-concept pilot study on the development of individualized training vectors. This Lab Directed Research & Development (LDRD) project leveraged products within projects, such as Titan (Network Grand Challenge), Real-Time Feedback and Evaluation System, (America's Army Adaptive Thinking and Leadership, DARWARS Ambush! NK), and Dynamic Bayesian Networks to investigate whether machine learning capabilities could perform real-time, in-game similarity vectors of learner performance, toward adaptation of content delivery, and quantitative measurement of experiential learning.

99 GENERAL AND MISCELLANEOUS↗

Data and Communications in Basic Energy Sciences: Creating a Pathway for Scientific Discovery

This report is based on the Department of Energy (DOE) Workshop on “Data and Communications in Basic Energy Sciences: Creating a Pathway for Scientific Discovery” that was held at the Bethesda Marriott in Maryland on October 24-25, 2011. The workshop brought together leading researchers from the Basic Energy Sciences (BES) facilities and Advanced Scientific Computing Research (ASCR). The workshop was co-sponsored by these two Offices to identify opportunities and needs for data analysis, ownership, storage, mining, provenance and data transfer at light sources, neutron sources, microscopy centers and other facilities. Their charge was to identify current and anticipated issues in the acquisition, analysis, communication and storage of experimental data that could impact the progress of scientific discovery, ascertain what knowledge, methods and tools are needed to mitigate present and projected shortcomings and to create the foundation for information exchanges and collaboration between ASCR and BES supported researchers and facilities. The workshop was organized in the context of the impending data tsunami that will be produced by DOE’s BES facilities. Current facilities, like SLAC National Accelerator Laboratory’s Linac Coherent Light Source, can produce up to 18 terabytes (TB) per day, while upgraded detectors at Lawrence Berkeley National Laboratory’s Advanced Light Source will generate ~10TB per hour. The expectation is that these rates will increase by over an order of magnitude in the coming decade. The urgency to develop new strategies and methods in order to stay ahead of this deluge and extract the most science from these facilities was recognized by all. The four focus areas addressed in this workshop were: Workflow Management - Experiment to Science: Identifying and managing the data path from experiment to publication. Theory and Algorithms: Recognizing the need for new tools for computation at scale, supporting large data sets and realistic theoretical models. Visualization and Analysis: Supporting near-real-time feedback for experiment optimization and new ways to extract and communicate critical information from large data sets. Data Processing and Management: Outlining needs in computational and communication approaches and infrastructure needed to handle unprecedented data volume and information content. It should be noted that almost all participants recognized that there were unlikely to be any turn-key solutions available due to the unique, diverse nature of the BES community, where research at adjacent beamlines at a given light source facility often span everything from biology to materials science to chemistry using scattering, imaging and/or spectroscopy. However, it was also noted that advances supported by other programs in data research, methodologies, and tool development could be implemented on reasonable time scales with modest effort. Adapting available standard file formats, robust workflows, and in-situ analysis tools for user facility needs could pay long-term dividends. Workshop participants assessed current requirements as well as future challenges and made the following recommendations in order to achieve the ultimate goal of enabling transformative science in current and future BES facilities: Theory and analysis components should be integrated seamlessly within experimental workflow. Develop new algorithms for data analysis based on common data formats and toolsets. Move analysis closer to experiment. Move the analysis closer to the experiment to enable real-time (in-situ) streaming capabilities, live visualization of the experiment and an increase of the overall experimental efficiency. Match data management access and capabilities with advancements in detectors and sources. Remove bottlenecks, provide interoperability across different facilities/beamlines and apply forefront mathematical techniques to more efficiently extract science from the experiments. This workshop report examines and reviews the status of several BES facilities and highlights the successes and shortcomings of the current data and communication pathways for scientific discovery. It then ascertains what methods and tools are needed to mitigate present and projected data bottlenecks to science over the next 10 years. The goal of this report is to create the foundation for information exchanges and collaborations among ASCR and BES supported researchers, the BES scientific user facilities, and ASCR computing and networking facilities. To jumpstart these activities, there was a strong desire to see a joint effort between ASCR and BES along the lines of the highly successful Scientific Discovery through Advanced Computing (SciDAC) program in which integrated teams of engineers, scientists and computer scientists were engaged to tackle a complete end-to-end workflow solution at one or more beamlines, to ascertain what challenges will need to be addressed in order to handle future increases in data

97 MATHEMATICS AND COMPUTING↗

Tensile Property and Lifetime Prediction for Low-Temperature Aged Uranium-Niobium Alloys

Thermal aging models and lifetime predictions for uranium-niobium (U-Nb) alloys were created using an approach similar to those previously employed. Lifetime estimates for generic U-6Nb components were thus updated; the reported value being 800 years. This update represents a small change in lifetime vs. that of the 2012 assessment (540 years). This lifetime estimate emerged from consideration of several model fits specific to the aging datasets and properties chosen. Aging was quantified using quasi-static tensile properties measured on specimens artificially aged for up to 10 years. The major change relative to the most recent 2012 LANL assessment was that a more comprehensive body of U-Nb literature data was mined, in addition to being augmented by the latest LANL and UK AWE data. The tensile data compilation was published separately (LANL report LA-14493, December 2016). Recognizing the chemical banding of industrially produced U-6Nb, models were developed for the mid-range (6 wt.%) and extrema (4 and 8 wt.%) compositions. Lifetime estimates were calculated for all three alloy classes (4, 6, 8 wt.% nominal) and two measures of total tensile elongation (TE) to failure, namely TE-ext. — extensometer method, and TE-NCD — normalized crosshead displacement method. The conservative assumption was made that whichever composition (4, 6, or 8 wt.% Nb) and property (TE-ext or TE-NCD) was the first to cross the ductility failure threshold would limit the lifetime of the entire component. Tensile strength properties did not figure into the lifetime predictions, but could be useful as age-sensitive diagnostics and were also modeled. Of these, only first yield strength is expected to show a change at 40°C aging vs. time = 0 over the ~100-year timespan of engineering interest. Second yield strength evolves more slowly, and ultimate tensile strength slower still. Among all the models, the apparent activation energies for aging were mostly in the narrow 29– 37 kcal/mol range, which is close to that for diffusion of Nb in gamma-uranium. This agreement may be coincidental. The data from recent long-term aging studies substantially improved the model fit quality and robustness of the lifetimes. Appendices document sensitivity studies of the model fits and lifetimes with respect to using more limited datasets. These results highlight the limitations of relying solely on data from scattered literature studies and smaller datasets more generally.

36 MATERIALS SCIENCE↗

Shuttle Data Center File-Processing Tool in Java

A Java-language computer program has been written to facilitate mining of data in files in the Shuttle Data Center (SDC) archives. This program can be executed on a variety of workstations or via Web-browser programs. This program is partly similar to prior C-language programs used for the same purpose, while differing from those programs in that it exploits the platform-neutrality of Java in implementing several features that are important for analysis of large sets of time-series data. The program supports regular expression queries of SDC archive files, reads the files, interleaves the time-stamped samples according to a chosen output, then transforms the results into that format. A user can choose among a variety of output file formats that are useful for diverse purposes, including plotting, Markov modeling, multivariate density estimation, and wavelet multiresolution analysis, as well as for playback of data in support of simulation and testing.

Barry, Matthew R.↗