SEARCH · Search NASA

Results for “spatial data mining”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRS1989

Decorrelation distance of snow in the Colorado River Basin

The problem of estimating areal averages from point measurement has been extensively studied by mining engineers and hydrologists. Its application to satellite measurements has recently been introduced. The semivariaogram has been used in many geostatistical applications to estimate spatial structures of observed properties, such as mineral distributions. An examination is made of snow variations in Colorado from daily snow data collected in 11 SNOTEL stations. The associated semivariogram is estimated. The objective is to estimate the spatial structure of the snow field so that the point data can be used for comparison with, and validation for, satellite measurements.

Chang, A. T. C.↗

NASA NTRS2011

Determining the Number of Clusters in a Data Set Without Graphical Interpretation

Cluster analysis is a data mining technique that is meant ot simplify the process of classifying data points. The basic clustering process requires an input of data points and the number of clusters wanted. The clustering algorithm will then pick starting C points for the clusters, which can be either random spatial points or random data points. It then assigns each data point to the nearest C point where "nearest usually means Euclidean distance, but some algorithms use another criterion. The next step is determining whether the clustering arrangement this found is within a certain tolerance. If it falls within this tolerance, the process ends. Otherwise the C points are adjusted based on how many data points are in each cluster, and the steps repeat until the algorithm converges,

Aguirre, Nathan S.↗

DOE OSTI2011

PRELIMINARY RESULTS FROM NEOWISE: AN ENHANCEMENT TO THE WIDE-FIELD INFRARED SURVEY EXPLORER FOR SOLAR SYSTEM SCIENCE

The Wide-field Infrared Survey Explorer (WISE) has surveyed the entire sky at four infrared wavelengths with greatly improved sensitivity and spatial resolution compared to its predecessors, the Infrared Astronomical Satellite and the Cosmic Background Explorer. NASA's Planetary Science Division has funded an enhancement to the WISE data processing system called 'NEOWISE' that allows detection and archiving of moving objects found in the WISE data. NEOWISE has mined the WISE images for a wide array of small bodies in our solar system, including near-Earth objects (NEOs), Main Belt asteroids, comets, Trojans, and Centaurs. By the end of survey operations in 2011 February, NEOWISE identified over 157,000 asteroids, including more than 500 NEOs and {approx}120 comets. The NEOWISE data set will enable a panoply of new scientific investigations.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

Multi-Level Structural Damage Characterization Using Sparse Acoustic Sensor Networks and Knowledge Transferred Deep Learning

Standard structural health monitoring techniques face well-known difficulties for comprehensive defect diagnosis in real-world structures that have structural, material, or geometric complexity. This motivates the exploration of machine-learning-based structural health monitoring methods in complex structures. However, creating sufficient training data sets with various defects is an ongoing challenge for data-driven machine (deep) learning algorithms. The ability to transfer the knowledge of a trained neural network from one component to another or to other sections of the same component would drastically reduce the required training data set. Also, it would facilitate computationally inexpensive machine learning based inspection systems. In this work, a machine-learning-based multi-level damage characterization is demonstrated with the ability to transfer trained knowledge within the sparse sensor network. A novel network spatial assistance and an adaptive convolution technique are proposed for efficient knowledge transfer within the deep learning algorithm. Proposed structural health monitoring method is experimentally evaluated on an aluminum plate with artificially induced defects. It was observed that the method improves the performance of knowledge transferred damage characterization by 50% during localization and 24% during severity assessment. Further, experiments using time windows with and without multiple edge reflections are studied. Results reveal that multiply scattered waves contain rich and deterministic defect signatures that can be mined using deep learning neural networks, improving the accuracy of both identification and quantification. In the case of a fixed sensor network, using multiply scattered waves shows 100% prediction accuracy at all levels of damage characterization.

36 MATERIALS SCIENCE↗

DOE OSTI2013

How Analysts Cognitively “Connect the Dots”

As analysts attempt to make sense of a collection of documents, such as intelligence analysis reports, they may wish to “connect the dots” between pieces of information that may initially seem unrelated. This process of synthesizing information between information requires users to make connections between pairs of documents, creating a conceptual story. We conducted a user study to analyze the process by which users connect pairs of documents and how they spatially arrange information. Users created conceptual stories that connected the dots using organizational strategies that ranged in complexity. We propose taxonomies for cognitive connections and physical structures used when trying to “connect the dots” between two documents. We compared the user-created stories with a data-mining algorithm that constructs chains of documents using co-occurrence metrics. Using the insight gained into the storytelling process, we offer design considerations for the existing data mining algorithm and corresponding tools to combine the power of data mining and the complex cognitive processing of analysts.

data mining↗

DOE OSTI2021

Significant DBSCAN+: Statistically Robust Density-based Clustering

Cluster detection is important and widely used in a variety of applications, including public health, public safety, transportation, and so on. Given a collection of data points, we aim to detect density-connected spatial clusters with varying geometric shapes and densities, under the constraint that the clusters are statistically significant. The problem is challenging, because many societal applications and domain science studies have low tolerance for spurious results, and clusters may have arbitrary shapes and varying densities. As a classical topic in data mining and learning, a myriad of techniques have been developed to detect clusters with both varying shapes and densities (e.g., density-based, hierarchical, spectral, or deep clustering methods). However, the vast majority of these techniques do not consider statistical rigor and are susceptible to detecting spurious clusters formed as a result of natural randomness. On the other hand, scan statistic approaches explicitly control the rate of spurious results, but they typically assume a single “hotspot” of over-density and many rely on further assumptions such as a tessellated input space. To unite the strengths of both lines of work, we propose a statistically robust formulation of a multi-scale DBSCAN, namely Significant DBSCAN+, to identify significant clusters that are density connected. As we will show, incorporation of statistical rigor is a powerful mechanism that allows the new Significant DBSCAN+ to outperform state-of-the-art clustering techniques in various scenarios. We also propose computational enhancements to speed-up the proposed approach. Experiment results show that Significant DBSCAN+ can simultaneously improve the success rate of true cluster detection (e.g., 10–20% increases in absolute F1 scores) and substantially reduce the rate of spurious results (e.g., from thousands/hundreds of spurious detections to none or just a few across 100 datasets), and the acceleration methods can improve the efficiency for both clustered and non-clustered data.

Computer Science↗

NASA NTRS2020

Amazonia Disasters: Assessing Methods for Gold Mining-related Deforestation Detection in Amazonia Using NASA Earth Observations

Artisanal and small-scale gold mining (ASGM) is responsible for a large fraction of deforestation and disturbance in Amazonia. These activities cause severe impacts on the rainforest ecosystem and socioeconomic state of the region. NASA DEVELOP partnered with the Asociación para la Conservación de la Cuenca Amazónica (ACCA), NASA SERVIR Science Coordination Office, and the Spatial Informatics Group to enhance ASGM-related deforestation detection methods. ACCA currently uses the Omnibus Q-test Change Point Detection Algorithm to identify changes in Synthetic Aperture Radar (SAR) monthly-aggregated temporal data from the Sentinel-1 satellite. The team determined the algorithm's accuracy by comparing a stratified random sample of change points against data from January 2019 to June 2020 identified using PlanetScope and Landsat 8 Operational Land Imager (OLI) Earth observations through Collect Earth Online. Our results indicated a users' accuracy of 55% for temporal change detection and producer's and user's accuracies of 99% and 97%, respectively, for detecting when change did not occur. Of the labeled change points, only 19% were due to mining activity. This research can help our partners have a more accurate understanding of where illegal gold mining may be taking place and inform decisions to remediate this activity.

DEVELOP Project Summary↗

NASA NTRS2020

Amazonia Disasters: Assessing Methods for Gold Mining-Related Deforestation Detection in Amazonia Using NASA Earth Observations

DEVELOP Tech Paper↗

NASA NTRS2004

Robotic Subsurface Analyzer and Sample Handler for Resource Reconnaissance and Preliminary Site Assessment for ISRU Activities at the Lunar Cold Traps

Since the 1960s, claims have been made that water ice deposits should exist in permanently shadowed craters near both lunar poles. Recent interpretations of data from the Lunar Prospector-Neutron Spectrometer (LP- NS) confirm that significant concentrations of hydrogen exist, probably in the form of water ice, in the permanently shadowed polar cold traps. Yet, due to the large spatial resolution (45-60 Ian) of the LP-NS measurements relative to these shadowed craters (approx.5-25 km), these data offer little certainty regarding the precise location, form or distribution of these deposits. Even less is known about how such deposits of water ice might effect lunar regolith physical properties relevant to mining, excavation, water extraction and construction. These uncertainties will need to be addressed in order to validate fundamental lunar In Situ Resource Utilization (ISRU) precepts by 2011. Given the importance of the in situ utilization of water and other resources to the future of space exploration a need arises for the advanced deployment of a robotic and reconfigurable system for physical properties and resource reconnaissance. Based on a collection of high-TRL. designs, the Subsurface Analyzer and Sample Handler (SASH) addresses these needs, particularly determining the location and form of water ice and the physical properties of regolith. SASH would be capable of: (1) subsurface access via drilling, on the order of 3-10 meters into both competent targets (ice, rock) and regolith, (2) down-hole analysis through drill string embedded instrumentation and sensors (Neutron Spectrometer and Microscopic Imager), enabling water ice identification and physical properties measurements; (3) core and unconsolidated sample acquisition from rock and regolith; (4) sample handling and processing, with minimized contamination, sample containerization and delivery to a modular instrument payload. This system would be designed with three mission enabling goals, including: (1) a self-contained, low power, low mass, "black box'' configuration for operations from a lander, various classes of rovers or a surface-based platform with human assistance or robotic anchoring mechanisms; (2) reconfigurable and scalable sample handling for delivery to various types of instrumentation, depending on mission requirements; and (3) the use of advanced automation control and diagnostic techniques that will afford local human deployed, remote teleoperation and fully autonomous intelligent operations. Though a great deal of technology has been advanced toward these objectives, the SASH system faces significant design challenges, including the low gravity environment, various levels of autonomy in operations, radiation exposure, dust contamination, and temperature extremes and deltas. Significant input from the scientific and engineering communities, as well as a significant environmental testing program, will be required to guide the design process.

Gorevan, S. P.↗

DOE OSTI2016

Data mining graphene: Correlative analysis of structure and electronic degrees of freedom in graphenic monolayers with defects

The link between changes in the material crystal structure and its mechanical, electronic, magnetic, and optical functionalities known as the structure-property relationship is the cornerstone of the contemporary materials science research. The recent advances in scanning transmission electron and scanning probe microscopies (STEM and SPM) have opened an unprecedented path towards examining the materials structure property relationships on the single-impurity and atomic-configuration levels. Lacking, however, are the statistics-based approaches for cross-correlation of structure and property variables obtained in different information channels of the STEM and SPM experiments. Here we have designed an approach based on a combination of sliding window Fast Fourier Transform, Pearson correlation matrix, linear and kernel canonical correlation, to study a relationship between lattice distortions and electron scattering from the SPM data on graphene with defects. Our analysis revealed that the strength of coupling to strain is altered between different scattering channels which can explain coexistence of several quasiparticle interference patterns in the nanoscale regions of interest. In addition, the application of the kernel functions allowed us extracting a non-linear component of the relationship between the lattice strain and scattering intensity in graphene. Lastly, the outlined approach can be further utilized to analyzing correlations in various multi-modal imaging techniques where the information of interest is spatially distributed and has usually a complex multidimensional nature.

36 MATERIALS SCIENCE↗

DOE OSTI2018

Anomalous cluster detection in spatiotemporal meteorological fields

Finding anomalous regions in spatiotemporal climate data is an important problem with a need for greater accuracy. The collective and contextual nature of anomalies (e.g., heat waves) coupled with the real‐valued, seasonal, multimodal, highly correlated, and gridded nature of climate variable observations poses a multitude of challenges. Existing anomaly detection methods have limitations in the specific setting of real‐valued areal spatiotemporal data. In this paper, we develop a method for extreme event detection in meteorological datasets that follows from well known distribution‐based anomaly detection approaches. The method models spatial and temporal correlations explicitly through a piecewise parametric assumption and generalizes the Mahalanobis distance across distributions of different dimensionalities. The result is an effective method to mine contiguous spatiotemporal anomalous regions from meteorological fields which improves upon the current standard approach in climatology. The proposed method has been evaluated on a real global surface temperature dataset and validated using historical records of extreme events.

Ramachandra, Bharathkumar↗

DOE OSTI2018

Predicting the 3D fatigue crack growth rate of small cracks using multimodal data via Bayesian networks: In-situ experiments and crystal plasticity simulations

Small crack propagation accounts for most of the fatigue life of engineering structures subject to high cycle fatigue loading conditions. Determining the fatigue crack growth rate of small cracks propagating into polycrystalline engineering alloys is critical to improving fatigue life predictions, thus lowering cost and increasing safety. In this work, cycle-by-cycle data of a small crack propagating in a beta metastable titanium alloy is available via phase and diffraction contrast tomography. Crystal plasticity simulations are used to supplement experimental data regarding the micromechanical fields ahead of the crack tip. Experimental and numerical results are combined into a multimodal dataset and sampled utilizing a non-local data mining procedure. Furthermore, to capture the propensity of body-centered cubic metals to deform according to the pencil-glide model, a non-local driving force is postulated. The proposed driving force serves as the basis to construct a data-driven probabilistic crack propagation framework using Bayesian networks as building blocks. The spatial correlation between the postulated driving force and experimental observations is obtained by analyzing the results of the proposed framework. Results show that the above correlation increases proportionally to the distance from the crack front until the edge of the plastic zone. Moreover, the predictions of the propagation framework show good agreement with experimental observations. Finally, we studied the interaction of a small crack with grain boundaries (GBs) utilizing various slip transmission criteria, revealing the tendency of a crack to cross a GB by propagating along the slip directions minimizing the residual Burgers vector within the GB.

36 MATERIALS SCIENCE↗

NASA NTRS1986

Airborne Thermal Infrared Multispectral Scanner (TIMS) images over disseminated gold deposits, Osgood Mountains, Humboldt County, Nevada

The U.S. Geological Survey (USGS) acquired airborne Thermal Infrared Multispectral Scanner (TIMS) images over several disseminated gold deposits in northern Nevada in 1983. The aerial surveys were flown to determine whether TIMS data could depict jasperoids (siliceous replacement bodies) associated with the gold deposits. The TIMS data were collected over the Pinson and Getchell Mines in the Osgood Mountains, the Carlin, Maggie Creek, Bootstrap, and other mines in the Tuscarora Mountains, and the Jerritt Canyon Mine in the Independence Mountains. The TIMS data seem to be a useful supplement to conventional geochemical exploration for disseminated gold deposits in the western United States. Siliceous outcrops are readily separable in the TIMS image from other types of host rocks. Different forms of silicification are not readily separable, yet, due to limitations of spatial resolution and spectral dynamic range. Features associated with the disseminated gold deposits, such as the large intrusive bodies and fault structures, are also resolvable on TIMS data. Inclusion of high-resolution thermal inertia data would be a useful supplement to the TIMS data.

Krohn, M. Dennis↗

DOE OSTI2025

Direct experimental constraints on the spatial extent of a neutrino wavepacket

Despite their high relative abundance in our Universe, neutrinos are the least understood fundamental particles of nature. In fact, the quantum properties of neutrinos emitted in experimentally relevant sources are theoretically contested and the spatial extent of the neutrino wavepacket is only loosely constrained by reactor neutrino oscillation data with a spread of 13 orders of magnitude. Here we present a method to directly access this quantity by precisely measuring the energy width of the recoil daughter nucleus emitted in the radioactive decay of beryllium-7. The final state in the decay process contains a recoiling lithium-7 nucleus, which is entangled with an electron neutrino at creation. The lithium-7 energy spectrum is measured to high precision by directly embedding beryllium-7 radioisotopes into a high-resolution superconducting tunnel junction that is operated as a cryogenic sensor. Under this approach, we set a lower limit on the Heisenberg spatial uncertainty of the recoil daughter of 6.2 pm, which implies that the final-state system is localized at a scale more than a thousand times larger than the nucleus itself. From this measurement, the first, to our knowledge, direct lower limit on the spatial extent of a neutrino wavepacket is extracted. These results may have implications in several areas including the theoretical understanding of neutrino properties, the nature of localization in weak nuclear decays and the interpretation of neutrino physics data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2015

PlanetSense: A Real-time Streaming and Spatio-temporal Analytics Platform for Gathering Geo-spatial Intelligence from Open Source Data

Geospatial intelligence has traditionally relied on the use of archived and unvarying data for planning and exploration purposes. In consequence, the tools and methods that are architected to provide insight and generate projections only rely on such datasets. Albeit, if this approach has proven effective in several cases, such as land use identification and route mapping, it has severely restricted the ability of researchers to inculcate current information in their work. This approach is inadequate in scenarios requiring real-time information to act and to adjust in ever changing dynamic environments, such as evacuation and rescue missions. In this work, we propose PlanetSense, a platform for geospatial intelligence that is built to harness the existing power of archived data and add to that, the dynamics of real-time streams, seamlessly integrated with sophisticated data mining algorithms and analytics tools for generating operational intelligence on the fly. The platform has four main components – i) GeoData Cloud – a data architecture for storing and managing disparate datasets; ii) Mechanism to harvest real-time streaming data; iii) Data analytics framework; iv) Presentation and visualization through web interface and RESTful services. Using two case studies, we underpin the necessity of our platform in modeling ambient population and building occupancy at scale.

big data architecture↗

NASA NTRS1990

Mapping alteration in the Goldfield Mining District, Nevada, with the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS)

Analysis of the data acquired by the Airborne Visible/IR Imaging Spectrometer over the Goldfield Mining District, Nevada, demonstrates the unique capabilities of high resolution imaging spectrometers for alteration mapping and identification of mineralogy. The study focuses on the 2-2.45 micron window, as alteration minerals of interest have their distinctive spectral reflectance features in this region. An attempt was made to map the spatial distribution of the individual minerals and produce a mixture maps showing their relative abundance on a pixel-by-pixel basis, focussing on selected subareas. Software and SNR performances limited success in detailed mapping.

Carrere, Veronique↗

DOE OSTI2026

FY 2026 Midyear Report: Seismic Monitoring of Underground Vibration Sources Using Distributed Acoustic Sensing and Seismometers

Safeguards-relevant temporal changes in underground facilities can be observed using geophysical monitoring techniques. Seismic waves, in particular, provide valuable insights into subsurface activities and can serve as an important tool for detecting anomalous events that may indicate containment breaches at geological repositories. This midyear report summarizes ongoing efforts to automatically and rapidly detect and locate anomalous vibration signals that could be indicative of potential containment breaches. Previous work during FY25 focused on compiling continuous seismic datasets from two underground sites and developing a database of continuous waveforms and ground-truth event data derived from multiple sensing modalities. Building on this foundation, we are adapting anomaly detection and geolocation algorithms to explore methods for monitoring underground activities using two relatively low-maintenance sensing technologies: a dense surface geophone array deployed at the Pleasant Gap mine in Pennsylvania, and a three-dimensional fiber-optic cable array for distributed acoustic sensing (DAS) installed in the subsurface at the Sanford Underground Research Facility (SURF) in South Dakota. This report summarizes work conducted during the first two quarters of FY26, during which we refined a dynamic power spectral density (PSD)-based detector, applied it independently to each geophone station, and then combined the per‑station detections with density-based spatial clustering of applications with noise (DBSCAN) to cluster events and produce spatial maps over a nine‑day interval. In addition, we outline plans for a field trial at the Waste Isolation Pilot Plant (WIPP) in New Mexico to compare traditional seismic monitoring approaches with DAS techniques and to evaluate the benefits of combined data analysis. Activities during the past two quarters have included the preparation and submission of a Field Test Plan to WIPP for approval, as well as submission to headquarters for review and feedback.

58 GEOSCIENCES↗

DOE OSTI2012

GIS-and Web-based Water Resource Geospatial Infrastructure for Oil Shale Development

The Colorado School of Mines (CSM) was awarded a grant by the National Energy Technology Laboratory (NETL), Department of Energy (DOE) to conduct a research project en- titled GIS- and Web-based Water Resource Geospatial Infrastructure for Oil Shale Development in October of 2008. The ultimate goal of this research project is to develop a water resource geo-spatial infrastructure that serves as “baseline data” for creating solutions on water resource management and for supporting decisions making on oil shale resource development. The project came to the end on September 30, 2012. This final project report will report the key findings from the project activity, major accomplishments, and expected impacts of the research. At meantime, the gamma version (also known as Version 4.0) of the geodatabase as well as other various deliverables stored on digital storage media will be send to the program manager at NETL, DOE via express mail. The key findings from the project activity include the quantitative spatial and temporal distribution of the water resource throughout the Piceance Basin, water consumption with respect to oil shale production, and data gaps identified. Major accomplishments of this project include the creation of a relational geodatabase, automated data processing scripts (Matlab) for database link with surface water and geological model, ArcGIS Model for hydrogeologic data processing for groundwater model input, a 3D geological model, surface water/groundwater models, energy resource development systems model, as well as a web-based geo-spatial infrastructure for data exploration, visualization and dissemination. This research will have broad impacts of the devel- opment of the oil shale resources in the US. The geodatabase provides a “baseline” data for fur- ther study of the oil shale development and identification of further data collection needs. The 3D geological model provides better understanding through data interpolation and visualization techniques of the Piceance Basin structure spatial distribution of the oil shale resources. The sur- face water/groundwater models quantify the water shortage and better understanding the spatial distribution of the available water resources. The energy resource development systems model reveals the phase shift of water usage and the oil shale production, which will facilitate better planning for oil shale development. Detailed descriptions about the key findings from the project activity, major accomplishments, and expected impacts of the research will be given in the sec- tion of “ACCOMPLISHMENTS, RESULTS, AND DISCUSSION” of this report.

04 OIL SHALES AND TAR SANDS↗