Search NASA⌕ Search

SEARCH · Search NASA

Results for “spatial data mining”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Thermal infrared remote sensing in assessing groundwater and surface-water resources related to Hannukainen mining development site, northern Finland

Mining development sites occasionally host complicated aquifer systems with notable connections to natural surface water (SW) bodies. A low-altitude thermal infrared (TIR) imaging survey was conducted to identify hydraulic connections between aquifers and rivers and to map spatial surface temperature patterns along the subarctic rivers in the proximity of the Hannukainen mining development area, northern Finland. In addition to TIR data, stable isotopic compositions (δ{sup 18}O, δD) and dissolved silica concentrations were used as tracers to verify the observed groundwater (GW) discharge into the river system. Based on the TIR survey, notable GW discharge into the main river channel and its tributaries (61 km altogether) was observed and over 500 GW discharge sites were located. On the basis of the survey, the longitudinal temperature patterns of the studied rivers were found to be highly variable. Hydrological and hydrogeological information is crucial in planning and siting essential mining operations, such as tailing areas, in order to prevent any undesirable environmental impacts. The observed notable GW discharge was taken into consideration in the planning of the Hannukainen mining development area. The results of this study support the use of TIR imagery in GW–SW interaction and environmental studies in extensive and remote areas with special concerns for water-related issues but lacking the baseline research.

58 GEOSCIENCES↗

Technical Advances for Sustainable Remediation: In Situ Monitoring and Climate Resiliency - 18436

Recent advances in sustainable remediation techniques show promise as solutions for contaminant removal in soil and groundwater media. Although passive remediation (or natural attenuation) has gained momentum as an acceptable technique, there are still challenges in regulatory frameworks as well as in public acceptance. Leaving contaminants in subsurface requires increased burden of proof to show that plumes are stable and residual contaminants do not pose a significant health risk. Climate changes and frequent extreme climate events contribute another level of complexity and make it difficult to demonstrate system stability and predict future plume conditions. In this study, we show two coupled approaches to tackle this challenge: (1) in situ groundwater monitoring based on advanced sensor and data analytics technologies (i.e., Big Data), and (2) state-of-art modeling for optimizing monitoring and site closure strategies. In the new monitoring approach, in situ sensors are used to continuously measure the key variables that control contaminant plume mobility and its spatial and temporal distribution (such as pH, redox potential, electrical conductivity, and groundwater level). Coupled with a limited number of groundwater sampling, the data analytics methods - data mining and machine learning - allow us to estimate contaminant concentrations, and also to detect any significant changes associated with the plume mobility. In parallel, the state-of-art numerical flow and reactive transport model - ASCEM software under DOE Office of Environmental Management - provides a physical and mechanistic understanding of the system behavior, and predicts the long-term plume migration for optimizing the monitoring and closure strategies. In particular, we focus on the effects of extreme precipitation or drought on the site closure as well as monitoring strategies. We demonstrate this approach at the Savannah River Site (SRS) F-Area, where groundwater is contaminated by various radionuclides, including uranium, tritium and technetium. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Big Data Analytics Framework for HPC Log Data: Three Case Studies Using the Titan Supercomputer Log

Reliability, availability and serviceability (RAS) logs of high performance computing (HPC) resources, when closely investigated in spatial and temporal dimensions, can provide invaluable information regarding system status, performance, and resource utilization. These data are often generated from multiple logging systems and sensors that cover many components of the system. The analysis of these data for finding persistent temporal and spatial insights faces two main difficulties: the volume of RAS logs makes manual inspection difficult and the unstructured nature and unique properties of log data produced by each subsystem adds another dimension of difficulty in identifying implicit correlation among recorded events. To address these issues, we recently developed a multi-user Big Data analytics framework for HPC log data at Oak Ridge National Laboratory (ORNL). This paper introduces three in-progress data analytics projects that leverage this framework to assess system status, mine event patterns, and study correlations between user applications and system events. We describe the motivation of each project and detail their workflows using three years of log data collected from ORNL's Titan supercomputer.

Park, Byung↗

IRA Energy Community Data Layers

Data, geospatial data resources, and the linked mapping tool and web services reflect data for two types of potentially qualifying energy communities: 1) Census tracts and directly adjoining tracts that have had coal mine closures since 1999 or coal-fired electric generating unit retirements since 2009. These census tracts qualify as energy communities. 2) Metropolitan statistical areas (MSAs) and non-metropolitan statistical areas (non-MSAs) that are energy communities for 2023 and 2024, along with their fossil fuel employment (FFE) status. Additional information on energy communities and related tax credits can be accessed on the Interagency Working Group on Coal & Power Plant Communities & Economic Revitalization Energy Communities website (https://energycommunities.gov/energy-community-tax-credit-bonus/). Use limitations: these spatial data and mapping tool may not be relied upon by taxpayers to substantiate a tax return position or for determining whether certain penalties apply and will not be used by the IRS for examination purposes. The mapping tool does not reflect the application of the law to a specific taxpayer’s situation, and the applicable Internal Revenue Code provisions ultimately control.

Census Tract↗

Public data from three US states provide new insights into well integrity

Significance There are over 900,000 active oil and gas wells in the United States. Estimates of the percentage of these wells that leak during their lifetime have been limited by data availability. We mined publicly available records from state regulatory databases and synthesized the results of various well testing methods into a uniform dataset that describes the integrity of 105,031 wells. Our analysis of the dataset provides insight into regional well leakage frequencies in three US states (Colorado, New Mexico, and Pennsylvania), spatial and temporal leakage trends among vertical and directional wells, and the characteristics of leaked fluids. Our findings demonstrate the value of statewide well testing programs and highlight the challenges of interpreting disparate interjurisdictional well testing data.

04 OIL SHALES AND TAR SANDS↗

Exploring Hardware Support For Scaling Irregular Applications on Multi-node Multi-core Architectures

With the recent emergence of large-scale knowledge dis- covery, data mining and social network analysis, irregular applications have gained renewed interest. Classic cache-based high-performance architectures do not provide optimal performances with such kind of workloads, mainly due to the very low spatial and temporal locality of the irregular control and memory access patterns. In this paper, we present a multi-node, multi-core, fine-grained multi-threaded shared-memory system architecture specifically designed for the execution of large-scale irregular applications, and built on top of three pillars, that we believe are fundamental to support these workloads. First, we offer transparent hardware support for Partitioned Global Address Space (PGAS) to provide a large globally-shared address space with no software library overhead. Second, we employ multi-threaded multi-core processing nodes to achieve the necessary latency tolerance required by accessing global memory, which potentially resides in a remote node. Finally, we devise hardware support for inter-thread synchronization on the whole global address space. We first model the performances by using an analytical model that takes into account the main architecture and application characteristics. We describe the hardware design of the proposed cus- tom architectural building blocks that provide support for the above- mentioned three pillars. Finally, we present a limited-scale evaluation of the system on a multi-board FPGA prototype with typical irregular kernels and benchmarks. The experimental evaluation demonstrates the architecture performance scalability for different configurations of the whole system.

FPGA↗

Pumped-Storage Hydropower using Abandoned Underground Mines (PSH-AUM) as an Innovative Energy Storage Technology for Fossil-Integrated Systems

Pumped-storage hydropower (PSH) provides around 95% of all utility-scale energy storage in the U.S. and globally. Additional deployment of PSH is hampered by excessively long permitting and commissioning requirements and is constrained to locations for which natural topography provides suitable elevation relief between the upper and lower reservoirs (the ΔH challenge). The purpose of this research was to evaluate Pumped-Storage Hydropower using Abandoned Underground Mines (PSH-AUM) as a means to solve the ΔH challenge and initiate the commercialization pathway for a promising new energy storage technology. Four primary tasks were conducted: Screening and ranking of candidate sites for project development; multiphase reservoir modeling to evaluate mine performance; techno-economic analysis and preliminary designs for PSH-AUM systems integrated with fossil-fuel power units; and stakeholder engagement to identify pathways to commercialization of this new technology. Key results were achieved in each of the four primary tasks. Candidate site screening determined that nearly 10,000 underground mines were spatially locatable, of which more than 100 sites appear suitable for integration with existing fossil power plants that are expected to remain in longer-term operation. Mine reservoir models were developed using PNNL’s STOMP simulator and parameterized using candidate site data to evaluate interactions with the surrounding groundwater system and confirm the potential for some mines to accommodate inflows and outflows on the order of 100 m3/s over 8-hour durations (1.6 GWh system) without excessive aqueous pressures. Techno-economic analysis resulted in a project cost optimization scheme to identify key sensitivities and the development of preliminary designs that can minimize overall costs of deployment. Finally, stakeholder engagement with industry, state government, and local economic development leaders confirmed the viability of PSH-AUM as a promising new technology. Our Phase I project results suggest that PSH-AUM technology has a domestic market potential on the order of $100+ Billion with ample space for technology development to commercialization within the next decade.

13 HYDRO ENERGY↗

Spatio-Temporal Surrogates for Interaction of a Jet with High Explosives: Part II - Clustering Extremely High-Dimensional Grid-Based Data

Building an accurate surrogate model for the spatio-temporal outputs of a computer simulation is a challenging task. A simple approach to improve the accuracy of the surrogate is to cluster the outputs based on similarity and build a separate surrogate model for each cluster. This clustering is relatively straightforward when the output at each time step is of moderate size. However, when the spatial domain is represented by a large number of grid points, numbering in the millions, the clustering of the data becomes more challenging. In this report, we consider output data from simulations of a jet interacting with high explosives. These data are available on spatial domains of different sizes, at grid points that vary in their spatial coordinates, and in a format that distributes the output across multiple files at each time step of the simulation. We first describe how we bring these data into a consistent format prior to clustering. Borrowing the idea of random projections from data mining, we reduce the dimension of our data by a factor of thousand, making it possible to use the iterative k-means method for clustering. We show how we can use the randomness of both the random projections, and the choice of initial centroids in k-means clustering, to determine the number of clusters in our data set. Our approach makes clustering of extremely high dimensional data tractable, generating meaningful cluster assignments for our problem, despite the approximation introduced in the random projections.

97 MATHEMATICS AND COMPUTING↗

Reconstruction of global gridded monthly sectoral water withdrawals for 1971–2010 and analysis of their spatiotemporal patterns

Human water withdrawal has increasingly altered the global water cycle in past decades, yet our understanding of its driving forces and patterns is limited. Reported historical estimates of sectoral water withdrawals are often sparse and incomplete, mainly restricted to water withdrawal estimates available at annual and country scales, due to a lack of observations at seasonal and local scales. In this study, through collecting and consolidating various sources of reported data and developing spatial and temporal statistical downscaling algorithms, we reconstruct a global monthly gridded (0.5°) sectoral water withdrawal dataset for the period 1971–2010, which distinguishes six water use sectors, i.e., irrigation, domestic, electricity generation (cooling of thermal power plants), livestock, mining, and manufacturing. Based on the reconstructed dataset, the spatial and temporal patterns of historical water withdrawal are analyzed. Results show that total global water withdrawal has increased significantly during 1971–2010, mainly driven by the increase in irrigation water withdrawal. Regions with high water withdrawal are those densely populated or with large irrigated cropland production, e.g., the United States (US), eastern China, India, and Europe. Seasonally, irrigation water withdrawal in summer for the major crops contributes a large percentage of total annual irrigation water withdrawal in mid- and high-latitude regions, and the dominant season of irrigation water withdrawal is also different across regions. Domestic water withdrawal is mostly characterized by a summer peak, while water withdrawal for electricity generation has a winter peak in high-latitude regions and a summer peak in low-latitude regions. Despite the overall increasing trend, irrigation in the western US and domestic water withdrawal in western Europe exhibit a decreasing trend. Our results highlight the distinct spatial pattern of human water use by sectors at the seasonal and annual timescales. Here, the reconstructed gridded water withdrawal dataset is open access, and can be used for examining issues related to water withdrawals at fine spatial, temporal, and sectoral scales.

54 ENVIRONMENTAL SCIENCES↗

STILGAR End-of-Project Report

The Subsurface Tunnel Imaging LeveraGed by Analysis of Rayleigh wave ellipticity (STILGAR) project demonstrated an integrated geophysical approach for detecting, locating, and characterizing underground structural changes using dense seismic arrays and advanced inversion techniques. Field campaigns were conducted at two operational mines—the Redmond salt mine (Utah) and Graymont Pleasant Gap limestone mine (Pennsylvania)—providing real-world testbeds for monitoring anthropogenic subsurface activity. At the Redmond salt mine, seismic interferometry combined with back-projection inversion successfully identified continuous, low-amplitude signals from mining operations. The approach differentiated stationary from migrating anthropogenic sources, captured daily operational cycles, and validated the potential of passive seismic monitoring for remote detection of underground activity. At the Graymont Pleasant Gap mine, two dense seismic deployments in the spring and fall of 2023 generated over 4 TB of high-resolution data. Key outcomes included the relocation of 199 underground and 8 surface explosions with accuracies within tens of meters and the development of a 3D P-wave velocity model using the triple-difference tomography algorithm (tomoTD) that resolved major structural features such as the mine entrance, low-velocity tunnels, and roof-collapse areas. Ambient noise cross-correlation and back-projection analyses revealed persistent sources linked to ongoing mining activity, whereas horizontal-to-vertical spectral ratio (HVSR) and ellipticity studies confirmed stable site responses across seasons and identified soil thickness trends consistent with regional erosional and depositional processes. Checkerboard and sensitivity tests further validated the robustness of the tomographic results. Overall, the findings emphasize that although significant progress has been made in subsurface imaging, further work is needed to enhance the detection and localization of underground structures. Accurate imaging requires higher frequencies, yet anthropogenic sources tend to dominate the seismic record at those frequencies, and high-frequency surface waves are affected by higher modes that complicate interpretation. The improved detection and localization of human-induced signals enabled detailed temporal and spatial mapping of daily mine operations, demonstrating the feasibility of continuous anthropogenic source monitoring. Sensitivity to signals from nontraditional sources, such as fan operations, highlights the broader applicability of this approach to other industrial environments in which continuous and impulsive signals are present. The field campaigns produced a substantial volume of high-quality seismic data, supporting the development and testing of new methods for seismic source characterization and subsurface imaging. Future deployments should include sensors capable of recording lower frequencies to probe deeper structures, increase bandwidth to enhance resolution and sensitivity to both shallow and deep targets, and collect additional large-scale datasets to refine imaging and source characterization techniques. Moreover, conducting 3D modeling studies of seismic wavefields at higher frequencies will provide a better understanding of wave scattering and cavity–wavefield interactions in complex underground environments. In conclusion, the STILGAR project demonstrated that integrated seismic monitoring can effectively characterize underground operations, capturing both natural and anthropogenic signals. The approaches developed provide a foundation for improved detection, localization, and imaging of subsurface structures and are directly transferable to broader industrial monitoring applications.

58 GEOSCIENCES↗

GX-Means: A model-based divide and merge algorithm for geospatial image clustering

One of the practical issues in clustering is the specification of the appropriate number of clusters, which is not obvious when analyzing geospatial datasets, partly because they are huge (both in size and spatial extent) and high dimensional. In this paper we present a computationally efficient model-based split and merge clustering algorithm that incrementally finds model parameters and the number of clusters. Additionally, we attempt to provide insights into this problem and other data mining challenges that are encountered when clustering geospatial data. The basic algorithm we present is similar to the G-means and X-means algorithms; however, our proposed approach avoids certain limitations of these well-known clustering algorithms that are pertinent when dealing with geospatial data. We compare the performance of our approach with the G-means and X-means algorithms. Experimental evaluation on simulated data and on multispectral and hyperspectral remotely sensed image data demonstrates the effectiveness of our algorithm.

99 GENERAL AND MISCELLANEOUS↗

PRELIMINARY RESULTS FROM NEOWISE: AN ENHANCEMENT TO THE WIDE-FIELD INFRARED SURVEY EXPLORER FOR SOLAR SYSTEM SCIENCE

The Wide-field Infrared Survey Explorer (WISE) has surveyed the entire sky at four infrared wavelengths with greatly improved sensitivity and spatial resolution compared to its predecessors, the Infrared Astronomical Satellite and the Cosmic Background Explorer. NASA's Planetary Science Division has funded an enhancement to the WISE data processing system called 'NEOWISE' that allows detection and archiving of moving objects found in the WISE data. NEOWISE has mined the WISE images for a wide array of small bodies in our solar system, including near-Earth objects (NEOs), Main Belt asteroids, comets, Trojans, and Centaurs. By the end of survey operations in 2011 February, NEOWISE identified over 157,000 asteroids, including more than 500 NEOs and {approx}120 comets. The NEOWISE data set will enable a panoply of new scientific investigations.

79 ASTRONOMY AND ASTROPHYSICS↗

Multi-Level Structural Damage Characterization Using Sparse Acoustic Sensor Networks and Knowledge Transferred Deep Learning

Standard structural health monitoring techniques face well-known difficulties for comprehensive defect diagnosis in real-world structures that have structural, material, or geometric complexity. This motivates the exploration of machine-learning-based structural health monitoring methods in complex structures. However, creating sufficient training data sets with various defects is an ongoing challenge for data-driven machine (deep) learning algorithms. The ability to transfer the knowledge of a trained neural network from one component to another or to other sections of the same component would drastically reduce the required training data set. Also, it would facilitate computationally inexpensive machine learning based inspection systems. In this work, a machine-learning-based multi-level damage characterization is demonstrated with the ability to transfer trained knowledge within the sparse sensor network. A novel network spatial assistance and an adaptive convolution technique are proposed for efficient knowledge transfer within the deep learning algorithm. Proposed structural health monitoring method is experimentally evaluated on an aluminum plate with artificially induced defects. It was observed that the method improves the performance of knowledge transferred damage characterization by 50% during localization and 24% during severity assessment. Further, experiments using time windows with and without multiple edge reflections are studied. Results reveal that multiply scattered waves contain rich and deterministic defect signatures that can be mined using deep learning neural networks, improving the accuracy of both identification and quantification. In the case of a fixed sensor network, using multiply scattered waves shows 100% prediction accuracy at all levels of damage characterization.

36 MATERIALS SCIENCE↗

How Analysts Cognitively “Connect the Dots”

As analysts attempt to make sense of a collection of documents, such as intelligence analysis reports, they may wish to “connect the dots” between pieces of information that may initially seem unrelated. This process of synthesizing information between information requires users to make connections between pairs of documents, creating a conceptual story. We conducted a user study to analyze the process by which users connect pairs of documents and how they spatially arrange information. Users created conceptual stories that connected the dots using organizational strategies that ranged in complexity. We propose taxonomies for cognitive connections and physical structures used when trying to “connect the dots” between two documents. We compared the user-created stories with a data-mining algorithm that constructs chains of documents using co-occurrence metrics. Using the insight gained into the storytelling process, we offer design considerations for the existing data mining algorithm and corresponding tools to combine the power of data mining and the complex cognitive processing of analysts.

data mining↗

Significant DBSCAN+: Statistically Robust Density-based Clustering

Cluster detection is important and widely used in a variety of applications, including public health, public safety, transportation, and so on. Given a collection of data points, we aim to detect density-connected spatial clusters with varying geometric shapes and densities, under the constraint that the clusters are statistically significant. The problem is challenging, because many societal applications and domain science studies have low tolerance for spurious results, and clusters may have arbitrary shapes and varying densities. As a classical topic in data mining and learning, a myriad of techniques have been developed to detect clusters with both varying shapes and densities (e.g., density-based, hierarchical, spectral, or deep clustering methods). However, the vast majority of these techniques do not consider statistical rigor and are susceptible to detecting spurious clusters formed as a result of natural randomness. On the other hand, scan statistic approaches explicitly control the rate of spurious results, but they typically assume a single “hotspot” of over-density and many rely on further assumptions such as a tessellated input space. To unite the strengths of both lines of work, we propose a statistically robust formulation of a multi-scale DBSCAN, namely Significant DBSCAN+, to identify significant clusters that are density connected. As we will show, incorporation of statistical rigor is a powerful mechanism that allows the new Significant DBSCAN+ to outperform state-of-the-art clustering techniques in various scenarios. We also propose computational enhancements to speed-up the proposed approach. Experiment results show that Significant DBSCAN+ can simultaneously improve the success rate of true cluster detection (e.g., 10–20% increases in absolute F1 scores) and substantially reduce the rate of spurious results (e.g., from thousands/hundreds of spurious detections to none or just a few across 100 datasets), and the acceleration methods can improve the efficiency for both clustered and non-clustered data.

Computer Science↗

Data mining graphene: Correlative analysis of structure and electronic degrees of freedom in graphenic monolayers with defects

The link between changes in the material crystal structure and its mechanical, electronic, magnetic, and optical functionalities known as the structure-property relationship is the cornerstone of the contemporary materials science research. The recent advances in scanning transmission electron and scanning probe microscopies (STEM and SPM) have opened an unprecedented path towards examining the materials structure property relationships on the single-impurity and atomic-configuration levels. Lacking, however, are the statistics-based approaches for cross-correlation of structure and property variables obtained in different information channels of the STEM and SPM experiments. Here we have designed an approach based on a combination of sliding window Fast Fourier Transform, Pearson correlation matrix, linear and kernel canonical correlation, to study a relationship between lattice distortions and electron scattering from the SPM data on graphene with defects. Our analysis revealed that the strength of coupling to strain is altered between different scattering channels which can explain coexistence of several quasiparticle interference patterns in the nanoscale regions of interest. In addition, the application of the kernel functions allowed us extracting a non-linear component of the relationship between the lattice strain and scattering intensity in graphene. Lastly, the outlined approach can be further utilized to analyzing correlations in various multi-modal imaging techniques where the information of interest is spatially distributed and has usually a complex multidimensional nature.

36 MATERIALS SCIENCE↗

Anomalous cluster detection in spatiotemporal meteorological fields

Finding anomalous regions in spatiotemporal climate data is an important problem with a need for greater accuracy. The collective and contextual nature of anomalies (e.g., heat waves) coupled with the real‐valued, seasonal, multimodal, highly correlated, and gridded nature of climate variable observations poses a multitude of challenges. Existing anomaly detection methods have limitations in the specific setting of real‐valued areal spatiotemporal data. In this paper, we develop a method for extreme event detection in meteorological datasets that follows from well known distribution‐based anomaly detection approaches. The method models spatial and temporal correlations explicitly through a piecewise parametric assumption and generalizes the Mahalanobis distance across distributions of different dimensionalities. The result is an effective method to mine contiguous spatiotemporal anomalous regions from meteorological fields which improves upon the current standard approach in climatology. The proposed method has been evaluated on a real global surface temperature dataset and validated using historical records of extreme events.

Ramachandra, Bharathkumar↗

Predicting the 3D fatigue crack growth rate of small cracks using multimodal data via Bayesian networks: In-situ experiments and crystal plasticity simulations

Small crack propagation accounts for most of the fatigue life of engineering structures subject to high cycle fatigue loading conditions. Determining the fatigue crack growth rate of small cracks propagating into polycrystalline engineering alloys is critical to improving fatigue life predictions, thus lowering cost and increasing safety. In this work, cycle-by-cycle data of a small crack propagating in a beta metastable titanium alloy is available via phase and diffraction contrast tomography. Crystal plasticity simulations are used to supplement experimental data regarding the micromechanical fields ahead of the crack tip. Experimental and numerical results are combined into a multimodal dataset and sampled utilizing a non-local data mining procedure. Furthermore, to capture the propensity of body-centered cubic metals to deform according to the pencil-glide model, a non-local driving force is postulated. The proposed driving force serves as the basis to construct a data-driven probabilistic crack propagation framework using Bayesian networks as building blocks. The spatial correlation between the postulated driving force and experimental observations is obtained by analyzing the results of the proposed framework. Results show that the above correlation increases proportionally to the distance from the crack front until the edge of the plastic zone. Moreover, the predictions of the propagation framework show good agreement with experimental observations. Finally, we studied the interaction of a small crack with grain boundaries (GBs) utilizing various slip transmission criteria, revealing the tendency of a crack to cross a GB by propagating along the slip directions minimizing the residual Burgers vector within the GB.

36 MATERIALS SCIENCE↗