Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data mining”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Spatio-temporal multivariate cluster evolution analysis for detecting and tracking climate impacts

Recent years have seen a growing concern about climate change and its impacts. While Earth System Models (ESMs) can be invaluable tools for studying the impacts of climate change, the complex coupling processes encoded in ESMs and the large amounts of data produced by these models, together with the high internal variability of the Earth system, can obscure important source-to-impact relationships. Here, this paper presents a novel and efficient unsupervised data-driven approach for detecting statistically-significant impacts and tracing spatio-temporal source-impact pathways in the climate through a unique combination of ideas from anomaly detection, clustering and Natural Language Processing (NLP). Using as an exemplar the 1991 eruption of Mount Pinatubo in the Philippines, we demonstrate that the proposed approach is capable of detecting known post-eruption impacts/events. We additionally describe a methodology for extracting meaningful sequences of post-eruption impacts/events by using NLP to efficiently mine frequent multivariate cluster evolutions, which can be used to confirm or discover the chain of physical processes between a climate source and its impact(s).

Anomaly detection↗

New data on guildite

X ray powder and chemical data on monoclinic secondary mineral guildite from mine fire at Jerome site

Laughon, R. B.↗

Geologic remote sensing study of the Hayden pass-Orient Mine Area, Northern Sangre de Cristo Mountains, Colorado

Remote sensor data from a NASA Convair 990 radar flight and Mission 101 and 105 have been interpreted and evaluated. Based on interpretation of the remote sensor data, a geologic map has been prepared and compared with a second geologic map, prepared from interpretation of both remote sensor data and field data. Comparison of the two maps gives one indication of the usefulness and reliability of the remote sensor data. Color and color infrared photography provided the largest amount of valuable information. Multiband photography was of lesser value and side-looking radar imagery provided no new information that was not available on small scale photography. Thermal scanner imagery proved to be a very specialized remote sensing tool that should be applied to areas of low relief and sparse vegetation where geologic features produce known or suspected thermal contrast. Low sun angle photography may be a good alternative to side-looking radar imagery but must be flown with critical timing.

Wychgram, D. C.↗

Application of LANDSAT data and digital image processing

The author has identified the following significant results. Based on LANDSAT 1 and 2 data, applications in the fields of coal mining, lignite exploration, and thematic mapping in geology are demonstrated. The hybrid image processing system, its software, and its utilization for educational purposes is described. A pre-operational European satellite is proposed.

Bodechtel, J.↗

Status and future of lunar geoscience

The Moon is of special interest among the many and diverse bodies of the solar system because it serves as a scientific baseline for understanding the terrestrial planets, its origin is closely tied to the early history of the Earth, and its proximity permits a variety of space applications such as mining and establishment of bases and colonies. Data acquisition and analysis have enabled advances to be made and the remaining questions in many fields of lunar geoscience to be identified. The status and unresolved problems of lunar science are discussed. Immediate needs, new unmanned missions, and a return to the Moon (a lunar base) are examined.

Source record↗

Enabling Model Organism and Commercial Astronaut Data Access Through the NASA Open Science Data Repository

NASA’s Open Science Data Repository (OSDR) brings together omics data from NASA’s GeneLab project and non-omics data, including physiological, phenotypic, imaging, and behavioral data from NASA’s Ames Life Sciences Data Archive (ALSDA) collected from decades of space biology research, providing open and FAIR (findable, accessible, interoperable, and reusable) access of these precious data to scientists world-wide. This rich source of meticulously curated metadata and data from spaceflight and analog studies has been mined by the scientific community resulting in dozens of high impact scientific publications that reveals a complex network of molecular and physiological effects of spaceflight across living systems, from microbes to plants, to mammals. Understanding how these effects translate to the human condition is critical as we move deeper into the era of commercial space travel. However, the integration of data, specifically omics data, from astronauts is particularly challenging due to their sensitive nature. OSDR has risen to this challenge by developing a mechanism to control access to identifiable levels of omics data, such as raw sequence data, while enabling public access to processed, unidentifiable, data and associated metadata that will allow the scientific community to interrogate human astronaut data alongside data from model organisms to begin answering these critical questions. The 2021 SpaceX Inspiration4 (I4) mission collected a comprehensive atlas of biological measurements from four civilian astronauts, providing a wealth of data to characterize the effects of spaceflight on the human body. These data include both non-omics and omics assays such as direct RNA sequencing (RNA-seq), single nuclei ATAC-seq and RNA-seq, metagenomics, proteomics, and comprehensive metabolic and cytokine panels, all of which have been integrated into the OSDR system across no less than 9 studies. Each study has been carefully curated using community-backed OSDR standards for sample and assay level metadata ensuring these data are findable and accessible. In addition to hosting both raw and processed data from the principal investigator team for each assay type, the GeneLab team plans to re-process the I4 omics data using GeneLab’s standard processing pipelines. The GeneLab processed data outputs will allow for comparisons across studies on OSDR and enable visualization of these data through the OSDR data visualization platform thereby enabling data reusability and interoperability. Here we describe the robust privacy and security protocols implemented by OSDR to safeguard sensitive health data from astronauts while facilitating metadata and processed data sharing for research purposes. We further provide a road map for navigating the vast amount of data provided for each I4 study on the OSDR, including experimental design, associated experiments, payloads, and missions, data generation and analysis protocols, and associated scientific articles. Additionally, we illustrate how to interrogate the standardized metadata provided in the sample and assay tables as well as various means to download and access the data including programmatically through the GeneLab Open API (GLOpenAPI). The open access of datasets in NASA’s OSDR provides a unique opportunity for the scientific community, as well as citizen scientists and students, to continue using OSDR resources to further unlock profound insights into the consequences of space travel on the human body. Through implementation of security measures to protect sensitive human data, the OSDR seeks to strengthen the science exchange between the Biological and Physical Sciences Program and the Human Research Program, per recommendation 4-1 of the 2023-2032 Decadal Survey, and encourage further sharing and dissemination of astronaut data to provide the scientific community with the resources needed to lay the groundwork for developing targeted mitigation strategies to help withstand the rigors of long-duration spaceflight.

Amanda Marie Saravia-butler↗

Enabling Model Organism and Commercial Astronaut Data Access Through the NASA Open Science Data Repository

NASA’s Open Science Data Repository (OSDR) brings together omics data from NASA’s GeneLab project and non-omics data, including physiological, phenotypic, imaging, and behavioral data from NASA’s Ames Life Sciences Data Archive (ALSDA) collected from decades of space biology research, providing open and FAIR (findable, accessible, interoperable, and reusable) access of these precious data to scientists world-wide. This rich source of meticulously curated metadata and data from spaceflight and analog studies has been mined by the scientific community resulting in dozens of high impact scientific publications that reveals a complex network of molecular and physiological effects of spaceflight across living systems, from microbes to plants, to mammals. Understanding how these effects translate to the human condition is critical as we move deeper into the era of commercial space travel. However, the integration of data, specifically omics data, from astronauts is particularly challenging due to their sensitive nature. OSDR has risen to this challenge by developing a mechanism to control access to identifiable levels of omics data, such as raw sequence data, while enabling public access to processed, unidentifiable, data and associated metadata that will allow the scientific community to interrogate human astronaut data alongside data from model organisms to begin answering these critical questions. The 2021 SpaceX Inspiration4 (I4) mission collected a comprehensive atlas of biological measurements from four civilian astronauts, providing a wealth of data to characterize the effects of spaceflight on the human body. These data include both non-omics and omics assays such as direct RNA sequencing (RNA-seq), single nuclei ATAC-seq and RNA-seq, metagenomics, proteomics, and comprehensive metabolic and cytokine panels, all of which have been integrated into the OSDR system across no less than 9 studies. Each study has been carefully curated using community-backed OSDR standards for sample and assay level metadata ensuring these data are findable and accessible. In addition to hosting both raw and processed data from the principal investigator team for each assay type, the GeneLab team plans to re-process the I4 omics data using GeneLab’s standard processing pipelines. The GeneLab processed data outputs will allow for comparisons across studies on OSDR and enable visualization of these data through the OSDR data visualization platform thereby enabling data reusability and interoperability. Here we describe the robust privacy and security protocols implemented by OSDR to safeguard sensitive health data from astronauts while facilitating metadata and processed data sharing for research purposes. We further provide a road map for navigating the vast amount of data provided for each I4 study on the OSDR, including experimental design, associated experiments, payloads, and missions, data generation and analysis protocols, and associated scientific articles. Additionally, we illustrate how to interrogate the standardized metadata provided in the sample and assay tables as well as instructions for how to download and access the data. The I4 datasets described here re present the first ever comprehensive collection of commercial astronaut data.

Amanda M Saravia-Butler↗

SEASAT demonstration experiments with the offshore oil, gas and mining industries

Despite its failure, SEASAT-1 acquired a reasonable volume of data that can be used by industrial participants on a non-real-time basis to prove the concept of microwave sensing of the world's oceans from a satellite platform. The amended version of 8 experimental plans are presented, along with a description of the satellite, its instruments, and the data available. Case studies are summarized for the following experiments: (1) Beaufort Sea oil, gas, and Arctic operations; (2) Labrador Sea oil, gas, and sea ice; (3) Gulf of Mexico pipelines; (4) U.S. East Coast offshore oil and gas; (5) worldwide offshore drilling and production operations; (6) Equatorial East Pacific Ocean mining; (7) Bering Sea ice project; and (8) North Sea oil and gas.

Mourad, A. G.↗

Landsat imagery for surface-mine inventory

The feasibility of using Landsat imagery for routine monitoring of surface mining and reclamation was tested in a two-county (1541 sq km) area of western Maryland. Two digital analysis methods were studied. The first, a four-band analysis distinguishing various strip mine associated classes and conditions, proved useful, but has limited extendibility over a seasonal or annual period. In the second approach, a band-ratio method was developed for measuring disturbed surface areas, and it proved to be both temporally and geographically extendible. For mines ranging between 31 and 244 acres, the measurement accuracy of total affected acreage was 92%. The use of Landsat satellite data together with multilevel sampling of aircraft and field verification inspections has shown that multispectral analysis of digital data is an effective means of monitoring the progress of surface mining operations.

Anderson, A. T.↗

ldentifying Episodes of Earth Science Phenomena Using a Big-Data Technology

A significant portion of Earth Science investigations is phenomenon- (or event-) based, such as the studies of Rossby waves, volcano eruptions, tsunamis, mesoscale convective systems, and tropical cyclones. However, except for a few high-impact phenomena, e.g. tropical cyclones, comprehensive records are absent for the occurrences or events of these phenomena. Phenomenon-based studies therefore often focus on a few prominent cases while the lesser ones are overlooked. Without an automated means to gather the events, comprehensive investigation of a phenomenon is at least time-consuming if not impossible. We have constructed a prototype Automated Event Service (AES) system that is used to methodically mine custom-defined events in the reanalysis data sets of atmospheric general circulation models. Our AES will enable researchers to specify their custom, numeric event criteria using a user-friendly web interface to search the reanalysis data sets. Moreover, we have included a social component to enable dynamic formation of collaboration groups for researchers to cooperate on event definitions of common interest and for the analysis of these events. An Earth Science event (ES event) is defined here as an episode of an Earth Science phenomenon (ES phenomenon). A cumulus cloud, a thunderstorm shower, a rogue wave, a tornado, an earthquake, a tsunami, a hurricane, or an El Nino, is each an episode of a named ES phenomenon, and, from the small and insignificant to the large and potent, all are examples of ES events. An ES event has a duration (often finite) and an associated geo-location as a function of time; it's therefore an entity embedded in four-dimensional (4D) spatiotemporal space. Earth Science phenomena with the potential to cause massive economic disruption or loss of life often rivet the attention of researchers. But, broader scientific curiosity also drives the study of phenomena that pose no immediate danger, such as land/sea breezes. Due to Earth System's intricate dynamics, we are continuously discovering novel ES phenomena. We generally gain understanding of a given phenomenon by observing and studying individual events. This process usually begins by identifying the occurrences of these events. Once representative events are identified or found, we must locate associated observed or simulated data prior to commencing analysis and concerted studies of the phenomenon. Knowledge concerning the phenomenon can accumulate only after analysis has started. However, as mentioned previously, comprehensive records only exist for a very limited set of high-impact phenomena; aside from these, finding events and locating associated data currently may take a prohibitive amount of time and effort on the part of an individual investigator. The reason for the lack of comprehensive records for most of the ES phenomena is mainly due to the perception that they do not pose immediate and/or severe threat to life and property. Thus they are not consistently tracked, monitored, and catalogued. Many phenomena even lack precise and/or commonly accepted criteria for definitions. Moreover, various Earth Science observations and data have accumulated to a previously unfathomable volume; NASA Earth Observing System Data Information System (EOSDIS) alone archives several petabytes (PB) of satellite remote sensing data, which are steadily increasing. All of these factors contribute to the difficulty of methodically identifying events corresponding to a given phenomenon and significantly impede systematic investigations. We have not only envisioned AES as an environment for identifying customdefined events but also aspired for it to be an interactive environment with quick turnaround time for revisions of query criteria and results, as well as a collaborative environment where geographically distributed experts may work together on the same phenomena. A Big Data technology is thus required for the realization of such a system. In the following, we first introduce the technology selected for AES in the next section. We then demonstrate the utility of AES using a use case, Blizzard, before we conclude.

Kuo, Kwo-Sen↗

Automated strip-mine and reclamation mapping from ERTS

The author has identified the following significant results. Computer processing techniques were applied to ERTS-1 computer-compatible tape (CCT) data acquired in August 1972 on the Ohio Power Company's coal mining operation in Muskingum County, Ohio. Processing results succeeded in automatically classifying, with an accuracy greater than 90%: (1) stripped earth and major sources of erosion; (2) partially reclaimed areas and minor sources of erosion; (3) water with sedimentation; (4) water without sedimentation; and (5) vegetation. Computer-generated tables listing the area in acres and square kilometers were produced for each target category. Processing results also included geometrically corrected map overlays, one for each target category, drawn on a transparent material by a pen under computer control. Each target category is assigned a distinctive color on the overlay to facilitate interpretation. The overlays, drawn at a scale of 1:250,000 when placed over an AMS map of the same area, immediately provided map locations for each target. These mapping products were generated at a tenth of the cost of conventional mapping techniques.

Rogers, R. H.↗

Investigation of Adaptive-threshold Approaches for Determining Area-Time Integrals from Satellite Infrared Data to Estimate Convective Rain Volumes

The principal goal of this project is to establish relationships that would allow application of area-time integral (ATI) calculations based upon satellite data to estimate rainfall volumes. The research is being carried out as a collaborative effort between the two participating organizations, with the satellite data analysis to determine values for the ATIs being done primarily by the STC-METSAT scientists and the associated radar data analysis to determine the 'ground-truth' rainfall estimates being done primarily at the South Dakota School of Mines and Technology (SDSM&T). Synthesis of the two separate kinds of data and investigation of the resulting rainfall-versus-ATI relationships is then carried out jointly. The research has been pursued using two different approaches, which for convenience can be designated as the 'fixed-threshold approach' and the 'adaptive-threshold approach'. In the former, an attempt is made to determine a single temperature threshold in the satellite infrared data that would yield ATI values for identifiable cloud clusters which are closely related to the corresponding rainfall amounts as determined by radar. Work on the second, or 'adaptive-threshold', approach for determining the satellite ATI values has explored two avenues: (1) attempt involved choosing IR thresholds to match the satellite ATI values with ones separately calculated from the radar data on a case basis; and (2) an attempt involved a striaghtforward screening analysis to determine the (fixed) offset that would lead to the strongest correlation and lowest standard error of estimate in the relationship between the satellite ATI values and the corresponding rainfall volumes.

Smith, Paul L.↗

Williston Basin CORE-CM Initiative Final Report

The University of North Dakota Energy & Environmental Research Center (EERC) is leading the Williston Basin Carbon Ore, Rare Earth, and Critical Minerals (CORE-CM) Initiative to drive the expansion and transformation of coal and coal-based resource usage within the Williston Basin to produce rare-earth elements (REEs), CMs, and nonfuel carbon-based products (CBPs). This project is the first phase in a long-term program and set the stage for future work by assessing resource, market, technology, and infrastructure knowledge; identifying knowledge gaps; developing a series of plans to be carried out in future work; and initiating stakeholder engagement. Composed of several tasks, the project sought to identify, characterize, and assess several necessary aspects vital to make this future work a reality. The project’s fundamental task was to characterize the Williston Basin CORE-CM resources. Over 2500 samples from multiple sources were utilized to begin the assessment. Several locations were identified in western North Dakota where sample analysis identified the total REE (TREE) concentration as being over 500 parts per million (ppm), which is at a concentration level that would be suitable to consider for mining and extraction. Current operating coal mines have sufficient concentrations of TREEs for consideration. However, the current data across the basin are still not adequate to fully characterize REE and CM content nor give reliable estimates of the total resource potential. Waste stream reuse was also considered, and several streams were identified which ranged from potential energy sources to chemicals to material wastes. This includes streams that result from oil and gas production. These streams are not fully characterized, and further data are needed before they can be accurately assessed. Infrastructure within the Williston Basin is suitable for expansion of a new industry to mine, extract, and concentrate REEs and CMs. The development of this industry will not only preserve many existing jobs in the coal-mining industry but produce many new jobs. The supply chain for REEs and CMs is currently controlled outside of the United States in nations such as China, but the potential to develop the supply chain within the basin is considered possible. Processing of the mined materials for REEs and CMs needs further research. The technology and knowhow exist outside of the United States, and within the country much of the knowledge has been lost and must be regained. To develop the supply chain and regain lost processing technology, the creation of technology innovation centers (TICs) is crucial. The Williston Basin contains several similar centers and entrepreneurial assistance for other industries that can be applied in the development of REE and CM innovation centers. Education to develop the new skill sets required is also needed. Outreach is important for the development of the REE and CM industry within the basin. Understanding throughout federal and state governments, state agencies, industry, and resource end users is vital for the industry to form and grow. Through this project these groups have been contacted through bulletins, presentations, webinars, and annual symposiums. The report is a summary of the work conducted and throughout refers to a series of appendixes which contain more thorough and specific information about each section.

01 COAL, LIGNITE, AND PEAT↗

An automated integrated web-based smart tool for open stope design

The Stability Graph is a widely used tool for the design of open stopes in underground mining. Many users of the Stability Graph still apply this design method manually. Although the manual approach has benefits, using multiple graphs and stability number computation charts for each stope surface is time-consuming, even for the experienced mining engineer. Current practice in the use of the method also limits data sharing. This paper presents a StopeSoft web-based tool for open stope stability prediction that is developed on the basis of the Stability Graph method and is available at openstope.com. StopeSoft incorporates flexibility in terms of Stability Graph options and incorporates additional critical factors often overlooked. As a web-based tool, StopeSoft encourages and makes data sharing possible globally, focused on expanding the database and improving the current limitations of the Stability Graph to provide practical, reliable solutions for mining engineers, consultants, and academics. The StopeSoft automated process facilitates the process of open stope stability prediction, saving time and minimizing potential human errors. Statistical treatment of the data accounts for the variability of input parameters to emphasize the probabilistic nature of the Stability Graph method. The probabilistic interpretation of the stability states of stope surfaces eliminates the false feeling of absolute stope performance based on its location on the Stability Graph , as implied by the deterministic approach.

58 GEOSCIENCES↗

Mineral mapping at Cuprite, Nevada with a 63-channel imaging spectrometer

Geophysical and Environmental Research Imaging Spectrometer (GERIS) 63-channel scanner data covering the spectral region 0.4 to 2.5 microns were analyzed for the Cuprite mining district, Esmeralda and Nye Counties, Nevada. Individual and spatially averaged spectra extracted from the GERIS data were used to identify the minerals alunite, kaolinite, buddingtonite, and hematite by their spectral characteristics. The images were classified in the spectral domain to produce color-coded image maps of mineral distribution that clearly show the zoned nature of the hydrothermal system. Comparison of the thematic mineral maps with existing geologic and alteration maps demonstrates the utility of imaging spectrometers for producing detailed maps for mineral exploration.

Kruse, F. A.↗

Remote Sensing Applications to the Pennsylvania Abandoned Mine Reclamation Program

Pennsylvania Abandoned Mine Land Inventory demonstrated the effective use of remote sensing techniques within the context of the Surface Mining Control and Reclamation Act of 1977. The inventory combined data from field work, a literature search, and photointerpretation to fulfill both State and Federal requirements. A primary project objective was to accurately identify and map all surface features and disturbances from abandoned surface and underground mining. Black-and-white aerial photographs were used to record pits, contour benches, highwalls, spoil material, graded and recontoured areas, impounded water, and serious erosion and slide prone areas. In addition, vegetation cover estimates and surrounding land uses were noted. The inventory data base provides Pennsylvania with a valuable resource management tool that should be systematically updated. The utilization of remotely sensed data from SPOT or LANDSAT-D satellites may prove valuable in the anticipated updating and monitoring of the Pennsylvania AML inventory over the next several years.

Clemens, E.↗

ChemEcho v1.0

ChemEcho is a tool that converts tandem mass spectra into embeddings used to build machine learning (ML) models with fully explainable predictions. It provides an API for transforming raw tandem mass spectral data into embeddings, along with functions for training and validating ML models. Additionally, it includes utilities for retrieving and cleaning training data. ChemEcho is broadly applicable in ML pipelines that use tandem mass spectra for a variety of tasks, such as chemical classification or bioactivity mining. While there are existing methods to generate embeddings from fragmentation data, ChemEcho's approach ensures that predictions remain interpretable, enabling experts to evaluate results and generate hypotheses about the underlying data.

Harwood, Thomas [Lawrence Berkeley National Labora↗

First results from the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS)

After engineering flights aboard the NASA U-2 research aircraft in the winter of 1986 to 1987 and spring of 1987, extensive data collection across the United States was begun with the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) in the summer of 1987 in support of a NASA data evaluation and technology assessment program. This paper presents some of the first results obtained from AVIRIS. Examples of spectral imagery acquired over Mountain View and Mono Lake, California, and the Cuprite Mining District in western Nevada are presented. Sensor performance and data quality are described, and in the final section of this paper, plans for the future are discussed.

Vane, Gregg↗