Search NASA⌕ Search

SEARCH · Search NASA

Results for “spatial data mining”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

Deep Data Analysis of Conductive Phenomena on Complex Oxide Interfaces: Physics from Data Mining

Spatial variability of electronic transport in BiFeO3-CoFe2O4 (BFO-CFO) self-assembled heterostructures is explored using spatially resolved first order reversal curve (FORC) current voltage (IV) mapping. Multivariate statistical analysis of FORC-IV data classifies statistically significant behaviors and maps characteristic responses spatially. In particular, regions of grain, matrix, and grain boundary responses are clearly identified. K-means and Bayesian demixing analysis suggests the characteristic response be separated into four components, with hysteretic type behavior localized at the BFO-CFO tubular interfaces. The conditions under which Bayesian components allow direct physical interpretation are explored, and transport mechanisms at the grain boundaries and individual phases are analyzed. This approach conjoins multivariate statistical analysis with physics-based interpretation, actualizing a robust, universal, data driven approach to problem solving, which can be applied to exploration of local transport and other functional phenomena in other spatially inhomogeneous systems.

big data↗
DOE OSTI2012

Case study of visualizing global user download patterns using Google Earth and NASA World Wind

Geo-visualization is significantly changing the way we view spatial data and discover information. On the one hand, a large number of spatial data are generated every day. On the other hand, these data are not well utilized due to the lack of free and easily used data-visualization tools. This becomes even worse when most of the spatial data remains in the form of plain text such as log files. This paper describes a way of visualizing massive plain-text spatial data at no cost by utilizing Google Earth and NASAWorld Wind. We illustrate our methods by visualizing over 170,000 global download requests for satellite images maintained by the Earth Resources Observation and Science (EROS) Center of U.S. Geological Survey (USGS). Our visualization results identify the most popular satellite images around the world and discover the global user download patterns. The benefits of this research are: 1. assisting in improving the satellite image downloading services provided by USGS, and 2. providing a proxy for analyzing the hot spot areas of research. Most importantly, our methods demonstrate an easy way to geovisualize massive textual spatial data, which is highly applicable to mining spatially referenced data and information on a wide variety of research domains (e.g., hydrology, agriculture, atmospheric science, natural hazard, and global climate change).

Zong, Ziliang↗
DOE OSTI2012

Modeling Spatial Dependencies and Semantic Concepts in Data Mining

Data mining is the process of discovering new patterns and relationships in large datasets. However, several studies have shown that general data mining techniques often fail to extract meaningful patterns and relationships from the spatial data owing to the violation of fundamental geospatial principles. In this tutorial, we introduce basic principles behind explicit modeling of spatial and semantic concepts in data mining. In particular, we focus on modeling these concepts in the widely used classification, clustering, and prediction algorithms. Classification is the process of learning a structure or model (from user given inputs) and applying the known model to the new data. Clustering is the process of discovering groups and structures in the data that are ``similar,'' without applying any known structures in the data. Prediction is the process of finding a function that models (explains) the data with least error. One common assumption among all these methods is that the data is independent and identically distributed. Such assumptions do not hold well in spatial data, where spatial dependency and spatial heterogeneity are a norm. In addition, spatial semantics are often ignored by the data mining algorithms. In this tutorial we cover recent advances in explicitly modeling of spatial dependencies and semantic concepts in data mining.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2011

STPMiner: A Highperformance Spatiotemporal Pattern Mining Toolbox

The volume of spatiotemporal data being generated from scientific simulations and observations from sensors is growing at an astronomical rate. This data explosion is going to pose three challenges to the existing data mining infrastructure: algorithmic, computational, and I/O. Over the years we have implemented several spatiotemporal data mining algorithms including: outliers/anomalies, colocation patterns, change patterns, clustering, classification, and prediction algorithms. In this paper we briefly discuss the core spatiotemporal pattern mining algorithms along with some of the computational and I/O challenges associated with the big data.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2015

Evaluation of Methods for Comparison of Spatiotemporal and Time Series Datasets

Data used by the National Renewable Energy Laboratory (NREL) in energy analysis are often produced by industry and licensed or purchased for analysis. While this practice provides needed flexibility in selecting data for analysis it presents challenges in understanding the differences among multiple, ostensibly similar, datasets. As options for source data become more varied, it is important to be able to articulate why certain datasets were chosen and to ensure those include the data that best meet the boundaries and/or limitations of a particular analysis. This report represents the first of three phases of research intended to develop methods to quantitatively assess and compare both input datasets and the results of analyses performed at NREL. This capability is critical to identifying tipping points in the costs or benefits of achieving high spatial and temporal resolution of input data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Co-location Pattern Mining of Geosocial Data to Characterize Urban Functional Spaces

Spatial Co-location Pattern (SCP) mining continues to play a critical role in understanding the morphology of urban functional spaces of world cities. It requires a large amount of fine-granular data and computing efficiency to handle the combinatorial explosion of co-location patterns. To this end, this work has two main contributions - i) We showcase a novel approach to perform SCP mining to characterize intra-city scale structure of urban functionality or co-located activity patterns using geosocial Points-of-Interest (POI) vector data. ii) We present a generalized and optimized parallel/distributed SCP mining algorithm implemented on a Hadoop MapReduce system and demonstrate the utility of our approach using the city of Berlin (Germany) as an example. The SCPs tend to vary across Berlin's municipal boroughs and at different spatial scales. Our findings on Berlin's functional structure conform to existing urban geography models. Such a data-driven exploration of massive urban POIs using distributed computing is first of its kind and can help better understand the changing dynamics of urban functionality, as well as physical, and social network structure around the world.

Masrur, Arif↗
DOE OSTI2018

Automation of Data Collection Methods for Online Monitoring of Nuclear Power Plants

Maintenance activities in the United States nuclear power industry are mainly centered on preventive and corrective maintenance. Predictive maintenance, which is a variable time basis maintenance strategy that is dependent on the condition of the equipment, is less utilized but potentially more effective. In the current maintenance practices, the nuclear power plants rely on manual processes to supply information to a human decision making process. The plants have several processes that generate information that is not typically used beyond the intended target for collecting that information. This information is a source of data that is manually collected by labor intensive tasks. The data is therefore expensive to collect, yet limited in use. The industry has realized the opportunity present in reducing the labor intensive tasks by automating them and increasing the uses of the data collected by either developing advanced predictive maintenance methods using data-driven decision making that could span from trending to machine learning and artificial intelligence. This shift in maintenance strategy may result in high cost saving impact. In addition to reducing labor requirements and frequency of maintenance activities, this shift in strategy will reduce the materials portion of the operations and maintenance cost as well. The aim of this specific effort is to focus on the automation of data collection process. It is part of a series of planned efforts to target multiple elements of migrating the current preventive maintenance approach in nuclear power plants to a data-driven approach. These elements include data collection, management, analysis, visualization, in addition to value analysis and change enabling. The other five elements of migration were not considered because they are planned to be explicitly studied in multiple parallel efforts. Challenges including regulations requirements or limitations are planned in a future effort that focuses on change enabling. The risk and benefit/cost of the approach shift is planned in another effort targeted towards value. The storage, communication, computational power, data architecture, and protection are part of the information infrastructure and are planned in dedicated data management effort. The best means to present the data for assisted human decision making is planned in a data visualization effort. The data interpretation and patterns recognition for machine decision making is planned through multiple efforts in data analytics over the following years. This work identified seventeen data sources collection methods in nuclear power plants that could be automated for an integrated data platform that enables comprehensive and informed decision making. For each of the identified seventeen data sources, the base, modern, and state of the art states were described. The current state of data collection used by most utilities was identified as the "base state". The current achievable state was identified as the "modern state", a state that has either been achieved by at least some US utilities or in other industries. The future state that requires research and development to reach was identified as the "state of the art" state. The described states used an out-of-the-box thinking approach. This effort found that there is a hug potential for task automation and data fidelity improvements by evolving the current industry data collection methods. The majority of the processes analyzed were found to be manual and labor intensive and fell in the base state. As a result, the modern state often targeted reducing the manual logging efforts by using electronic and semi-intelligent means or complementing the work with sensors and mobile or fixed technologies that can reduce the demand of labor activities. The state of the art state involved applications advanced methods of data correlation, data mining, and machine learning along with increasing the spatial distribution and fidelity of data, coupling multiple data sources, and enabling the use of sophisticated mobile devices and machine comprehension methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Landscape composition and configuration have scale-dependent effects on agricultural pest suppression

Increasing landscape heterogeneity (composition and configuration) can enhance natural enemy populations and support pest suppression in agricultural landscapes. Using a network-based data mining approach, we examined independent gradients of landscape composition and configuration at six spatial scales that were associated with pest suppression services measured at 32 sites in Michigan and Wisconsin, USA. We compared the relative effects of landscape composition and configuration across scales with those of local crop type (corn or grassland). We found that multiple gradients of configurational heterogeneity were independent of composition and strongly associated with pest suppression, with different configuration metrics being predictive of pest suppression depending on the spatial scales and regions considered. Landscapes that were more configurationally heterogeneous at smaller spatial scales consistently supported higher pest suppression. In Michigan, pest suppression increased in landscapes with high edge contrast between annual crops and surrounding habitats and high edge density of grassland within 250-500 m radii. In Wisconsin, pest suppression increased with large core area of grassland and high field density within a 250 m radius. The main compositional effect we found was a positive relationship between grassland cover and pest suppression occurring at larger spatial scales (1000-1500 m) and occurring in Wisconsin but not in Michigan. Our findings demonstrate that effects of landscape composition and configuration on pest suppression differ across spatial scales and vary regionally. The network-based data mining techniques used here could be useful for disentangling intercorrelated landscape metrics in a variety of other contexts in landscape ecology.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

A deep learning approach to anomaly detection in geological carbon sequestration sites using pressure measurements

Carbon capture and storage (CCS) has been extensively investigated as a potential engineering measure to reduce anthropogenic carbon emission to the atmosphere. Real-time monitoring of the safety and integrity of carbon storage reservoirs is a critical aspect of any commercial-scale CCS deployment. Pressure-based sensing is cost effective, suitable for real-time monitoring, and scalable to large monitoring networks. However, questions remain on how to best harness intelligent information from the high-frequency pressure monitoring sensors to support real-time decisions. Here this work presents a deep-learning-based framework for analyzing and detecting anomalies in pressure data streams by using a convolutional long short-term memory (ConvLSTM) neural network model, which allows for the fusion of both static and dynamic reservoir data. In ConvLSTM, the convolutional neural network (CNN) is used for spatial pattern mining and the LSTM is used for temporal pattern recognition. The performance of the ConvLSTM model for real-time anomaly detection is demonstrated using a set of pressure monitoring data collected from Cranfield, Mississippi, an active enhanced-oil-recovery field. The anomaly detection model is trained using bottom-hole pressure data acquired from the base experiment (without leak event) and then tested on pressure data collected during a series of controlled CO 2 release experiments (with artificially created leak events). Results show that the ConvLSTM neural network model successfully detected anomalies in the pressure time series obtained from the controlled release experiments. Inclusion of static information into the model further improves the robustness of ConvLSTM.

13 HYDRO ENERGY↗
DOE OSTI2016

Unsupervised data mining in nanoscale x-ray spectro-microscopic study of NdFeB magnet

Novel developments in X-ray based spectro-microscopic characterization techniques have increased the rate of acquisition of spatially resolved spectroscopic data by several orders of magnitude over what was possible a few years ago. This accelerated data acquisition, with high spatial resolution at nanoscale and sensitivity to subtle differences in chemistry and atomic structure, provides a unique opportunity to investigate hierarchically complex and structurally heterogeneous systems found in functional devices and materials systems. However, handling and analyzing the large volume data generated poses significant challenges. Here we apply an unsupervised data-mining algorithm known as DBSCAN to study a rare-earth element based permanent magnet material, Nd 2 Fe 14 B. We are able to reduce a large spectro-microscopic dataset of over 300,000 spectra to 3, preserving much of the underlying information. Scientists can easily and quickly analyze in detail three characteristic spectra. Our approach can rapidly provide a concise representation of a large and complex dataset to materials scientists and chemists. For instance, it shows that the surface of common Nd 2 Fe 14 B magnet is chemically and structurally very different from the bulk, suggesting a possible surface alteration effect possibly due to the corrosion, which could affect the material’s overall properties.

36 MATERIALS SCIENCE↗
DOE OSTI2024

4D-STEM Mapping of Nanocrystal Reaction Dynamics and Heterogeneity in a Graphene Liquid Cell

Chemical reaction kinetics at the nanoscale are intertwined with heterogeneity in structure and composition. However, mapping such heterogeneity in a liquid environment is extremely challenging. Here, in this work, we integrate graphene liquid cell (GLC) transmission electron microscopy and four-dimensional scanning transmission electron microscopy to image the etching dynamics of gold nanorods in the reaction media. Critical to our experiment is the small liquid thickness in a GLC that allows the collection of high-quality electron diffraction patterns at low dose conditions. Machine learning-based data-mining of the diffraction patterns maps the three-dimensional nanocrystal orientation, groups spatial domains of various species in the GLC, and identifies newly generated nanocrystallites during reaction, offering a comprehensive understanding on the reaction mechanism inside a nanoenvironment. This work opens opportunities in probing the interplay of structural properties such as phase and strain with solution-phase reaction dynamics, which is important for applications in catalysis, energy storage, and self-assembly.

four-dimensional scanning transmission electron mi↗
DOE OSTI2023

Understanding and Improving Energy Efficiency of Regional Mobility Systems Leveraging System-Level Data

Increased congestion required urban Americans to travel 6.8 billion hours more and purchase 3.1 billion gallons of fuel for a congestion cost of $\$$153 billion, according to the 2019 Urban Mobility Report. How to effectively manage the regional mobility system and improve the energy efficiency presents a big challenge to public agencies. Recent years have witnessed massive multi-jurisdictional multi-modal system-level data from various sources, which provides an unprecedented opportunity to improve the mobility system and its energy efficiency. However, implications of system-level data for mobility and energy efficiency are unclear. Those system-level data sets are siloed, spatially and temporally sparse, biased, not unified, and lacking of insights for system management. Consequently, there is a real need to acquire, fuse, mine and learn from multi-source system-level data to prepare public agencies to deal more effectively with large-scale energy efficiency modeling, management and planning. This project proposes to intensively review inexpensive, replicable and openly-accessible data from multi-modal systems, develop a data-driven system-level modeling framework enabled and validated by data, identify the energy inefficiencies of mobility systems from infrastructure, vehicles, passenger systems, and quantify the benefits of system-level strategies to improve mobility/energy efficiency. In addition, this research develops models to effectively estimate energy consumption and emissions from various types of vehicles on the roadway networks, with high granularity and high fidelity. Traditional models often heavily rely on aggregated infrastructure or vehicle/passenger data, for example, the census survey, land-use, and traffic counts of one or several classes, which may lead to research gaps considering the emerging vehicle technologies. Those models do not contain individual vehicular information. We propose an integrated data-driven method that combines multiple network modeling components, featuring the utilization of state-wide vehicle registration data. The additional vehicle registration data improve the model performance, and produce high-resolution vehicle-specific estimates of emissions and network performance metrics. Two case studies on the Pittsburgh and Philadelphia regional network show that the proposed method can efficiently and effectively estimate the emissions of a large-scale network, and provide valuable information for evaluating common management strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Detection of Spatiotemporal Prescription Opioid Hot Spots With Network Scan Statistics: Multistate Analysis

Background: Overuse and misuse of prescription opioids have become significant public health burdens in the United States. About 11.5 million people are estimated to have misused prescription opioids for nonmedical purposes in 2016. This has led to a significant number of drug overdose deaths in the United States. Previous studies have examined spatiotemporal clusters of opioid misuse, but they have been restricted to circular shaped regions. Objective: The goal of this study was to identify spatiotemporal hot spots of opioid users and opioid prescription claims using Medicare data. Methods: We examined spatiotemporal clusters with significantly higher number of beneficiaries and rate of prescriptions for opioids using Medicare payment data from the Centers for Medicare & Medicaid Services. We used network scan statistics to detect significant clusters with arbitrary shapes, the Kulldorff scan statistic to examine the significant clusters for each year (2013, 2014, and 2015) and an expectation-based version to examine the significant clusters relative to past years. Regression analysis was used to characterize the demographics of the counties that are a part of any significant cluster, and data mining techniques were used to discover the specialties of the anomalous providers. Results: We examined anomalous spatial clusters with respect to opioid prescription claims and beneficiary counts and found some common patterns across states: the counties in the most anomalous clusters were fairly stable in 2014 and 2015, but they have shrunk from 2013. In Virginia, a higher percentage of African Americans in a county lower the odds of the county being anomalous in terms of opioid beneficiary counts to about 0.96 in 2015. For opioid prescription claim counts, the odds were 0.92. This pattern was consistent across the 3 states and across the 3 years. A higher number of people in the county with access to Medicaid increased the odds of the county being in the anomalous cluster to 1.16 in both types of counts in Virginia. A higher number of people with access to direct purchase of insurance plans decreased the odds of a county being in an anomalous cluster to 0.85. The expectation-based scan statistic, which captures change over time, revealed different clusters than the Kulldorff statistic. Providers with an unusually high number of opioid beneficiaries and opioid claims include specialties such as physician’s assistant, nurse practitioner, and family practice. Conclusions: Our analysis of the Medicare claims data provides characteristics of the counties and provider specialties that have higher odds of being anomalous. The empirical analysis identifies highly refined spatial hot spots that are likely to encounter prescription opioid misuse and overdose. The methodology is generic and can be applied to monitor providers and their prescription behaviors in regions that are at a high risk of abuse.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2017

Coupling Big Data Analytics and Reactive Transport Modeling for Cost-effective Groundwater Monitoring - 17163

This study presents an innovative approach for sustainable and cost-effective groundwater monitoring. This approach takes advantage of recent advances in various technologies: (1) in situ autonomous sensors, (2) big data analytics, and (3) parallel high-performance computing for flow and reactive transport modeling. In situ sensors are used to periodically measure the key variables (such as pH, redox potential, electrical conductivity, and groundwater level), which control contaminant mobility and the plume spatial and temporal distribution. Based on a limited number of groundwater sampling, the data analytics methods-data mining and machine learning-allow us to identify and quantify the correlations between the in situ-measured variables and contaminant concentrations, and also to detect significant changes associated with the plume mobility. In addition, a state-of-the-art parallel numerical flow and reactive transport simulator Amanzi, and uncertainty quantification software Agni are used to provide an improved physical and mechanistic understanding of the contaminated groundwater system behavior, and to predict the long-term plume distribution for optimizing and adapting the monitoring strategy. Amanzi and Agni were developed as part of the Advanced Simulation Capability for Environmental Management (ASCEM) program of the DOE Office of Environmental Management. Such modeling is critical, particularly, for assessing the impact of climate change and associated hydrological shifts. The developed approach is expected to significantly reduce the groundwater sampling frequency and associated cost. In addition, the real-time information on plume mobility serves as an early warning system, improving the resiliency of contaminated or potentially contaminated sites. We demonstrate this approach using as an example the Savannah River Site (SRS) F-Area, where groundwater is contaminated by various radionuclides, including uranium, tritium and technetium. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

The cosmic DANCe of Perseus

Context. Star-forming regions are excellent benchmarks for testing and validating theories of star formation and stellar evolution. The Perseus star-forming region, being one of the youngest (< 10 Myr), closest (280-320 pc), and most studied in the literature, is a fundamental benchmark. Aims. We aim to study the membership, phase-space structure, mass, and energy (kinetic plus potential) distribution of the Perseus star-forming region using public catalogues (Gaia, APOGEE, 2MASS, and Pan-STARRS). Methods. We used Bayesian methodologies that account for extinction to identify the Perseus physical groups in the phase-space, retrieve their candidate members, derive their properties (age, mass, 3D positions, 3D velocities, and energy), and attempt to reconstruct their origin. Results. We identify 1052 candidate members in seven physical groups (one of them new) with ages between 3 and 10 Myr, dynamical super-virial states, and large fractions of energetically unbounded stars. Their mass distributions are broadly compatible with that of Chabrier for masses ≳0.1 M ⊙ and do not show hints of over-abundance of low-mass stars in NGC 1333 with respect to IC 348. These groups’ ages, spatial structure, and kinematics are compatible with at least three generations of stars. Future work is still needed to clarify if the formation of the youngest was triggered by the oldest. Conclusions. The exquisite Gaia data complemented with public archives and mined with comprehensive Bayesian methodologies allow us to identify 31% more members than previous studies, discover a new physical group (Gorgophone: 7 Myr, 191 members, and 145 M ⊙ ), and confirm that the spatial, kinematic, and energy distributions of these groups support the hierarchical star formation scenario.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2018

Automation Technologies Impact on the Work Process of Nuclear Power Plants

The current cost associated with the work process of nuclear power plants necessities modernizing the work process by augmenting it with automation technologies. This work was performed to assess various automation technologies and the means by which they assimilate into the work process in order to make gains in cost savings in modern nuclear power plants. The goal was to identify key informational items that would be useful to members of industry who are undertaking the large effort to reduce costs through automation by identifying technology maturity levels, recent research, and an analysis of cost impacts of the work process. The technologies cost saving was categorized into low, medium, and high cost savings. Through this effort, a substantive literature review and analysis of recent technological and market trends was performed. The key areas of cost impact were identified through communication with users in industry from operations and maintenance organizations. The results were assembled into a list of work process steps and technologies that are ready be implemented or researched for the automating aspects of that step. This effort aims to present to utilities opportunities of cost saving that are achievable in the short term, and gaps for research organizations and vendors to consider for further research and development. The results of this effort generated a list of technologies that fit each of the three cost saving categories. Electronic work packages remain a high cost saving technology, but data mining and integration, smart scheduling, and dynamic risk models are also indicated to yield a high cost savings. Video applications, spatial mapping, and image processing and identification technologies appear to provide solid cost savings in the medium category, and rounding out the low cost saving areas are deployable technologies such as bar codes, communication tools, and electronic tags.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Multicriteria screening evaluation of geothermal resources on mine lands for direct use heating

Abstract Direct use of geothermal energy is the oldest and most versatile form of utilizing geothermal energy. In the last decade, this utilization has significantly increased, especially with the installation of geothermal (ground-source) heat pumps. Many current and inactive mine land sites across the U.S. could be redeveloped with clean energy technologies such as direct use geothermal, which would revitalize former mining communities, help with reducing greenhouse gas emissions, and accelerate the transition to a clean energy economy. We present a multicriteria screening framework to evaluate various aspects of direct-use geothermal projects on mine lands. The criteria are divided into three categories: (1) technical potential, (2) demand and benefits, and (3) regulatory and permitting. We demonstrate the framework using publicly available data on a national scale (continental U.S.). Then, using an example of abandoned coal mines in Illinois and focusing on resource potential, we illustrate how this evaluation can be applied at the state or more local scales when a region’s characteristics drive spatial variability estimates. The strength of this approach is the ability to combine seemingly disparate parameters and inputs from numerous sources. The framework is very flexible—additional criteria can be easily incorporated and weights modified if input data support them. Vice versa, the framework can also help identify additional data needed for evaluating those criteria. The multicriteria screening evaluation methodology provides a framework for identifying potential candidates for detailed site evaluation and characterization.

15 GEOTHERMAL ENERGY↗