Search NASA⌕ Search

SEARCH · Search NASA

Results for “public data mining”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

An Exploratory Data Mining Investigation for Constructing a Publicly Sourced Dataset of Foreign Hypersonic Tests

This document details a data mining exercise that resulted in an exploratory dataset of publicly reported foreign (non-US) hypersonic vehicle test events. Using a combination of targeted English language searches and country-specific queries, the study aggregates information from digital news media, official press releases, and social media posts. The resulting list of events captures the publicly available accounts of foreign hypersonic tests, although it does not represent an exhaustive record. Limitations such as inconsistent reporting, translation challenges, and the inherently provisional nature of open-source data are acknowledged. This dataset serves as an initial reference point for further inquiries into high-speed atmospheric phenomena and may facilitate future efforts to correlate these events with geophysical measurements.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Identifying schools at high-risk for elevated lead in drinking water using only publicly available data

Estimating the risk of lead contamination of schools' drinking water at the State level is a complex, important, and unexplored challenge. Variable water quality among water systems and changes in water chemistry during distribution affect lead dissolution rates from pipes and fittings. In addition, the locations of lead-bearing plumbing materials are uncertain. We tested the capability of six machine learning models to predict the likelihood of lead contamination of drinking water at the schools' taps using only publicly available datasets. The predictive features used in the models correspond to those with a proven correlation to the dominant, but commonly unavailable, factors that govern lead leaching: the presence of lead-bearing plumbing materials and water quality conducive to lead corrosion. By combining water chemistry data from public reports, socioeconomic information from the US census, and spatial features using Geographic Information Systems, we trained and tested models to estimate the likelihood of lead contaminated tap water in over 8,000 schools across California and Massachusetts. Our best-performing model was a Random Forest, with a 10-fold cross validation score of 0.88 for Massachusetts and 0.78 for California using the average Area Under the Receiver Operating Characteristic Curve (ROC AUC) metric. The model was then used to assign a lead leaching risk category to half of the schools across California (the other half was used for training). There was good agreement between the modeled risk categories and the actual lead leaching outcomes for every school; however, the model overestimated the lead leaching risk in up to 17% of the schools. This model is the first of its kind to offer a tool to predict the risk of lead leaching in schools at the State level. Further use of this model can help deploy limited resources more effectively to prevent childhood lead exposure from school drinking water.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2026

Data Driven Approach to Public Opinion Mining on Autonomous Vehicles: Sentiment Analysis of Social Media Comments Using Large Language Models

In the realm of online identity, social media has emerged as a rich and dynamic source of user-generated content, making it an invaluable resource for understanding public sentiment on a wide range of topics. Individuals often share their raw emotions and candid opinions on these platforms without fear of judgment or backlash. In this study, we conduct a sentiment analysis on user comments collected from various online platforms, with a specific focus on discussions surrounding autonomous vehicles. Leveraging the capabilities of large language models (LLMs), we classify each comment into one of five sentiment categories: Very Negative, Negative, Neutral, Positive, and Very Positive. Our approach demonstrates the effectiveness of LLMs in capturing nuanced contextual sentiment, offering a scalable and state-of-the-art alternative to traditional manual annotation methods. The results reveal key trends and insights into public perception, enabling a deeper understanding of how autonomous vehicle technologies are received by the online community. Our findings underscore the dynamic nature of public sentiment, which is shaped not only by advances in autonomous vehicle technology but also by contextual events such as regulatory developments, political adjustment and safety incidents.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Public data from three US states provide new insights into well integrity

Significance There are over 900,000 active oil and gas wells in the United States. Estimates of the percentage of these wells that leak during their lifetime have been limited by data availability. We mined publicly available records from state regulatory databases and synthesized the results of various well testing methods into a uniform dataset that describes the integrity of 105,031 wells. Our analysis of the dataset provides insight into regional well leakage frequencies in three US states (Colorado, New Mexico, and Pennsylvania), spatial and temporal leakage trends among vertical and directional wells, and the characteristics of leaked fluids. Our findings demonstrate the value of statewide well testing programs and highlight the challenges of interpreting disparate interjurisdictional well testing data.

04 OIL SHALES AND TAR SANDS↗
DOE OSTI2020

BioHackathon 2015: Semantics of data for life sciences and reproducible research

We report on the activities of the 2015 edition of the BioHackathon, an annual event that brings together researchers and developers from around the world to develop tools and technologies that promote the reusability of biological data. We discuss issues surrounding the representation, publication, integration, mining and reuse of biological data and metadata across a wide range of biomedical data types of relevance for the life sciences, including chemistry, genotypes and phenotypes, orthology and phylogeny, proteomics, genomics, glycomics, and metabolomics. We describe our progress to address ongoing challenges to the reusability and reproducibility of research results, and identify outstanding issues that continue to impede the progress of bioinformatics research. We share our perspective on the state of the art, continued challenges, and goals for future research and development for the life sciences Semantic Web.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Data from Rossi-α and Pulsed Neutron Prompt Neutron Time Decay Measurements at the Oak Ridge Critical Experiments Facility

This report briefly describes the prompt neutron decay measurements by the Rossi-α and pulsed neutron methods performed at the Oak Ridge Critical Experiments Facility. It briefly describes the measurement equipment, the type of data, and how to access the actual data from the Laboratory Records Department at Oak Ridge National Laboratory and the International Nuclear Criticality Safety Benchmark Evaluation Program at Idaho National Laboratory. Most of the data was acquired between 1960 and 1975 with weapons-grade enriched uranium metal assemblies. It also includes measurement of these types performed at Los Alamos National Laboratory by Oak Ridge National Laboratory with the JEZEBEL and FLATTOP criticality assemblies and other plutonium metal parts. The purpose of this report is to support future mining of the data for publication of additional information that can be used to verify calculational methods and nuclear cross sections. Present calculational methods can be used to directly calculate the measured data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

The cosmic DANCe of Perseus

Context. Star-forming regions are excellent benchmarks for testing and validating theories of star formation and stellar evolution. The Perseus star-forming region, being one of the youngest (< 10 Myr), closest (280-320 pc), and most studied in the literature, is a fundamental benchmark. Aims. We aim to study the membership, phase-space structure, mass, and energy (kinetic plus potential) distribution of the Perseus star-forming region using public catalogues (Gaia, APOGEE, 2MASS, and Pan-STARRS). Methods. We used Bayesian methodologies that account for extinction to identify the Perseus physical groups in the phase-space, retrieve their candidate members, derive their properties (age, mass, 3D positions, 3D velocities, and energy), and attempt to reconstruct their origin. Results. We identify 1052 candidate members in seven physical groups (one of them new) with ages between 3 and 10 Myr, dynamical super-virial states, and large fractions of energetically unbounded stars. Their mass distributions are broadly compatible with that of Chabrier for masses ≳0.1 M ⊙ and do not show hints of over-abundance of low-mass stars in NGC 1333 with respect to IC 348. These groups’ ages, spatial structure, and kinematics are compatible with at least three generations of stars. Future work is still needed to clarify if the formation of the youngest was triggered by the oldest. Conclusions. The exquisite Gaia data complemented with public archives and mined with comprehensive Bayesian methodologies allow us to identify 31% more members than previous studies, discover a new physical group (Gorgophone: 7 Myr, 191 members, and 145 M ⊙ ), and confirm that the spatial, kinematic, and energy distributions of these groups support the hierarchical star formation scenario.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Text-mined dataset of gold nanoparticle synthesis procedures, morphologies, and size entities

Abstract Gold nanoparticles are highly desired for a range of technological applications due to their tunable properties, which are dictated by the size and shape of the constituent particles. Many heuristic methods for controlling the morphological characteristics of gold nanoparticles are well known. However, the underlying mechanisms controlling their size and shape remain poorly understood, partly due to the immense range of possible combinations of synthesis parameters. Data-driven methods can offer insight to help guide understanding of these underlying mechanisms, so long as sufficient synthesis data are available. To facilitate data mining in this direction, we have constructed and made publicly available a dataset of codified gold nanoparticle synthesis protocols and outcomes extracted directly from the nanoparticle materials science literature using natural language processing and text-mining techniques. This dataset contains 5,154 data records, each representing a single gold nanoparticle synthesis article, filtered from a database of 4,973,165 publications. Each record contains codified synthesis protocols and extracted morphological information from a total of 7,608 experimental and 12,519 characterization paragraphs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Identifying COVID-19 cases and extracting patient reported symptoms from Reddit using natural language processing

We used social media data from “covid19positive” subreddit, from 03/2020 to 03/2022 to identify COVID-19 cases and extract their reported symptoms automatically using natural language processing (NLP). We trained a Bidirectional Encoder Representations from Transformers classification model with chunking to identify COVID-19 cases; also, we developed a novel QuadArm model, which incorporates Question-answering, dual-corpus expansion, Adaptive rotation clustering, and mapping, to extract symptoms. Our classification model achieved a 91.2% accuracy for the early period (03/2020-05/2020) and was applied to the Delta (07/2021–09/2021) and Omicron (12/2021–03/2022) periods for case identification. We identified 310, 8794, and 12,094 COVID-positive authors in the three periods, respectively. The top five common symptoms extracted in the early period were coughing (57%), fever (55%), loss of sense of smell (41%), headache (40%), and sore throat (40%). During the Delta period, these symptoms remained as the top five symptoms with percent authors reporting symptoms reduced to half or fewer than the early period. During the Omicron period, loss of sense of smell was reported less while sore throat was reported more. Our study demonstrated that NLP can be used to identify COVID-19 cases accurately and extracted symptoms efficiently.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Critical review of functionalized silica sorbent strategies for selective extraction of rare earth elements from acid mine drainage

We report the ubiquitous and growing global reliance on rare earth elements (REEs) for modern technology and the need for reliable domestic sources underscore the rising trend in REE-related research. Adsorption-based methods for REE recovery from liquid waste sources are well-positioned to compete with those of solvent extraction, both because of their expected lower negative environmental impact and simpler process operations. Functionalized silica represents a rising category of low cost and stable sorbents for heavy metal and REE recovery. These materials have collectively achieved high capacity and/or high selective removal of REEs from ideal solutions and synthetic or real coal wastewater and other leachate source. These sorbents are competitive with conventional materials, such as ion exchange resins, activated carbon; and novel polymeric materials like ion-imprinted particles and metal organic frameworks (MOFs). This critical review first presents a data mining analysis for rare earth element recovery publications indexed in Web of science, highlighting changes in REE recovery research foci and confirming the sharply growing interest in functionalized silica sorbents. A detailed examination of sorbent formulation and operation strategies to selectively separate heavy (HREE), middle (MREE), and light (LREE) REEs from the aqueous sources is presented. Selectivity values for sorbents were largely calculated from available figure data and gauged the success of the associated strategies, primarily: (1) silane-grafted ligands, (2) impregnated ligands, and (3) bottom-up ligand/silica hybrids. These were often accompanied by successful co-strategies, especially bite angle control, site saturation, and selective REE elution. Recognizing the need to remove competing fouling metals to achieve purified REE “baskets,” we highlight techniques for eliminating these species from acid mine drainage (AMD) and suggest a novel adsorption-based process for purified REE extraction that could be adapted to different water systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Automated electrosynthesis reaction mining with multimodal large language models (MLLMs)

Leveraging the chemical data available in legacy formats such as publications and patents is a significant challenge for the community. Automated reaction mining offers a promising solution to unleash this knowledge into a learnable digital form and therefore help expedite materials and reaction discovery. However, existing reaction mining toolkits are limited to single input modalities (text or images) and cannot effectively integrate heterogeneous data that is scattered across text, tables, and figures. In this work, we go beyond single input modalities and explore multimodal large language models (MLLMs) for the analysis of diverse data inputs for automated electrosynthesis reaction mining. We compiled a test dataset of 65 articles (MERMES-T24 set) and employed it to benchmark five prominent MLLMs against two critical tasks: (i) reaction diagram parsing and (ii) resolving cross-modality data interdependencies. The frontrunner MLLM achieved ≥96% accuracy in both tasks, with the strategic integration of single-shot visual prompts and image pre-processing techniques. We integrate this capability into a toolkit named MERMES (multimodal reaction mining pipeline for electrosynthesis). Our toolkit functions as an end-to-end MLLM-powered pipeline that integrates article retrieval, information extraction and multimodal analysis for streamlining and automating knowledge extraction. This work lays the groundwork for the increased utilization of MLLMs to accelerate the digitization of chemistry knowledge for data-driven research.

Leong, Shi Xuan↗
DOE OSTI2020

Scalable Knowledge Graph Analytics at 136 Petaflop/s

We are motivated by newly proposed methods for data mining large-scale corpora of scholarly publications, such as the full biomedical literature, which may consist of tens of millions of papers spanning decades of research. In this setting, analysts seek to discover how concepts relate to one another. They construct graph representations from annotated text databases and then formulate the relationship-mining problem as one of computing all-pairs shortest paths (APSP), which becomes a significant bottleneck. In this context, we present a new high-performance algorithm and implementation of the Floyd-Warshall algorithm for distributed-memory parallel computers accelerated by GPUs, which we call DSNAPSHOT (Distributed Accelerated Semiring All-Pairs Shortest Path). For our largest experiments, we ran DSNAPSHOT on a connected input graph with millions of vertices using 4, 096nodes (24,576GPUs) of the Oak Ridge National Laboratory's Summit supercomputer system. We find DSNAPSHOT achieves a sustained performance of 136×1015 floating-point operations per second (136petaflop/s) at a parallel efficiency of 90% under weak scaling and, in absolute speed, 70% of the best possible performance given our computation (in the single-precision tropical semiring or “min-plus” algebra). Looking forward, we believe this novel capability will enable the mining of scholarly knowledge corpora when embedded and integrated into artificial intelligence-driven natural language processing workflows at scale.

Kannan, Ramakrishnan {ramki}↗
DOE OSTI2021

Middle Kittanning Coal Waste and Underclay as an Alternative Rare Earth Elements Feedstock

In order to secure domestic sources of rare earth elements (REE) from coal related materials, there must be validation of representative feedstocks. Actively producing coal mines that target the Middle Kittanning coal seam in the Appalachian Basin were compiled. These mines were cross-referenced with publicly available geochemical data such as the U.S. Geological Survey (USGS) Earth Mapping Resources Initiative geochemical data along with samples evaluated and characterized by the National Energy Technology Laboratory (NETL). This work evaluated the extent of elevated Middle Kittanning underclay concentrations of REE in comparison to other underclay formations. Therefore, further up-scaling of research associated with the separation and extraction of REE and other critical minerals can be beneficial to utilizing domestic REE supplies for various technology sectors, to include energy, biomedical, and defense. Numerous current active mines targeting the Middle Kittanning coal seam represent a geographically significant opportunity for shared feedstocks and collaborations to further understand the role of Middle Kittanning underclay as a critical mineral feedstock.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2024

Multicriteria screening evaluation of geothermal resources on mine lands for direct use heating

Abstract Direct use of geothermal energy is the oldest and most versatile form of utilizing geothermal energy. In the last decade, this utilization has significantly increased, especially with the installation of geothermal (ground-source) heat pumps. Many current and inactive mine land sites across the U.S. could be redeveloped with clean energy technologies such as direct use geothermal, which would revitalize former mining communities, help with reducing greenhouse gas emissions, and accelerate the transition to a clean energy economy. We present a multicriteria screening framework to evaluate various aspects of direct-use geothermal projects on mine lands. The criteria are divided into three categories: (1) technical potential, (2) demand and benefits, and (3) regulatory and permitting. We demonstrate the framework using publicly available data on a national scale (continental U.S.). Then, using an example of abandoned coal mines in Illinois and focusing on resource potential, we illustrate how this evaluation can be applied at the state or more local scales when a region’s characteristics drive spatial variability estimates. The strength of this approach is the ability to combine seemingly disparate parameters and inputs from numerous sources. The framework is very flexible—additional criteria can be easily incorporated and weights modified if input data support them. Vice versa, the framework can also help identify additional data needed for evaluating those criteria. The multicriteria screening evaluation methodology provides a framework for identifying potential candidates for detailed site evaluation and characterization.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

Understanding and Improving Energy Efficiency of Regional Mobility Systems Leveraging System-Level Data

Increased congestion required urban Americans to travel 6.8 billion hours more and purchase 3.1 billion gallons of fuel for a congestion cost of $\$$153 billion, according to the 2019 Urban Mobility Report. How to effectively manage the regional mobility system and improve the energy efficiency presents a big challenge to public agencies. Recent years have witnessed massive multi-jurisdictional multi-modal system-level data from various sources, which provides an unprecedented opportunity to improve the mobility system and its energy efficiency. However, implications of system-level data for mobility and energy efficiency are unclear. Those system-level data sets are siloed, spatially and temporally sparse, biased, not unified, and lacking of insights for system management. Consequently, there is a real need to acquire, fuse, mine and learn from multi-source system-level data to prepare public agencies to deal more effectively with large-scale energy efficiency modeling, management and planning. This project proposes to intensively review inexpensive, replicable and openly-accessible data from multi-modal systems, develop a data-driven system-level modeling framework enabled and validated by data, identify the energy inefficiencies of mobility systems from infrastructure, vehicles, passenger systems, and quantify the benefits of system-level strategies to improve mobility/energy efficiency. In addition, this research develops models to effectively estimate energy consumption and emissions from various types of vehicles on the roadway networks, with high granularity and high fidelity. Traditional models often heavily rely on aggregated infrastructure or vehicle/passenger data, for example, the census survey, land-use, and traffic counts of one or several classes, which may lead to research gaps considering the emerging vehicle technologies. Those models do not contain individual vehicular information. We propose an integrated data-driven method that combines multiple network modeling components, featuring the utilization of state-wide vehicle registration data. The additional vehicle registration data improve the model performance, and produce high-resolution vehicle-specific estimates of emissions and network performance metrics. Two case studies on the Pittsburgh and Philadelphia regional network show that the proposed method can efficiently and effectively estimate the emissions of a large-scale network, and provide valuable information for evaluating common management strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

CORE: A Global Aggregation Service for Open Access Papers

This paper introduces CORE, a widely used scholarly service, which provides access to the world’s largest collection of open access research publications, acquired from a global network of repositories and journals. CORE was created with the goal of enabling text and data mining of scientific literature and thus supporting scientific discovery, but it is now used in a wide range of use cases within higher education, industry, not-for-profit organisations, as well as by the general public. Through the provided services, CORE powers innovative use cases, such as plagiarism detection, in market-leading third-party organisations. CORE has played a pivotal role in the global move towards universal open access by making scientific knowledge more easily and freely discoverable. In this paper, we describe CORE’s continuously growing dataset and the motivation behind its creation, present the challenges associated with systematically gathering research papers from thousands of data providers worldwide at scale, and introduce the novel solutions that were developed to overcome these challenges. The paper then provides an in-depth discussion of the services and tools built on top of the aggregated data and finally examines several use cases that have leveraged the CORE dataset and services.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2021

A Taxonomic Classification Approach for Global Spatio-temporal Data

The World Bank, World Health Organization, and other major vendors collectively provide thousands of global time series datasets that focus on issues of the environment, public health, economics, violence, education, and national security. Sorting these data into meaningful information requires the use of data mining techniques to cluster trends into an orderly and manageable number of cases. The World SpatioTemporal Analytics and Mapping (WSTAMP) project database (wstamp.ornl.gov) was developed to spatiotemporally harmonize global vendor data (23,300+ attributes, 200+ locations, 50+ years). Within the WSTAMP analytical environment, Dynamic Time Warping (DTW) has been a highly effective data-driven approach for clustering and mapping these time series into national spatiotemporal behavior maps. Two significant properties have surfaced from this work. First, several recognizable cluster patterns have emerged and persist across a range of locations, attributes, and time frames (e.g., increasing, decreasing, rebounding, peak, oscillating). Secondly, practitioners engaging WSTAMP have noted the explanatory and anticipatory value of these patterns and articulated particular interest in detecting them within the spatiotemporal cube. This need was addressed by shifting DTW-based clustering from an open ended, data-driven implementation to a taxonomic pattern matching approach. This paper presents the method including implementation strategies for visualization and human computer interaction and applies the approach to a sample data set and concludes with next steps.

Stewart, Robert↗
DOE OSTI2019

Identification of Critical Airports from the Perspective of Delay and Disruption Propagation in Air Travel Networks

It is well-known that delays and disruptions that originate at certain airports end up spreading spread on the network to other airports, sometimes straining a large fraction of the system. Hence data-driven modeling of this phenomenon is important from the standpoint of planning and strategy. In this work, utilizing the publicly available data from the Federal Aviation Administration (FAA), we employ the well-known influence maximization paradigm, to mine for the top airports in the US airport network, from the perspective of delay spread. In the process, we develop a diffusion simulator and implement a greedy algorithm to aid our task. We then explore the temporal trends by considering one winter month and one summer month in our analysis. Finally, we characterize the clusters in the US airport network and investigate the patterns of delay spread when airports in each of the clusters are affected.

Visweswara Sathanur, Arun↗