Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction pipelines”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Detecting Dwarf Galaxies Around NGC 55

In order to improve our understanding of the satellite populations of low-mass galaxies, the DECam Local Volume Exploration (DELVE) – DEEP Survey is performing a search for satellites around the isolated, low-mass galaxy, NGC 55. As part of this search, we characterize our dwarf galaxy detection sensitivity by injecting artificial dwarf galaxies into our data set and measuring the fraction that we can recover. Additionally, we inject and recover artificial dwarfs to test how the blending of resolved stars affects the detection of dwarf galaxies. We inject 650 artificial dwarfs across 26 DELVE-DEEP coadded images of the NGC 55 halo and use the software tool, Source Extractor, to perform source recovery. A dwarf-search pipeline is then run on our dwarf-injected catalogs, utilizing the photutils function, find peaks, and detections are recorded as a function of dwarf size and luminosity. Our results demonstrate that we are most sensitive to large, bright dwarf galaxies, and our sensitivity begins to decrease as we approach DELVE-DEEP’s detection limit or blending causes significant reductions in recovered magnitude. We also find that our results are hindered by the limitations of star-galaxy separation applied to distant, faint sources, which is possibly a consequence of the blending of small star clusters within dwarf galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Design Optimization of Innovative High-Level Waste Pipeline Unplugging Technologies - 13341

Florida International University (FIU) is currently working on the development and optimization of two innovative pipeline unplugging methods: the asynchronous pulsing system (APS) and the peristaltic crawler system (PCS). Experiments were conducted on the APS to determine how air in the pipeline influences the system's performance as well as determine the effectiveness of air mitigation techniques in a pipeline. The results obtained during the experimental phase of the project, including data from pipeline pressure pulse tests along with air bubble compression tests are presented. Single-cycle pulse amplification caused by a fast-acting cylinder piston pump in 21.8, 30.5, and 43.6 m pipelines were evaluated. Experiments were conducted on fully flooded pipelines as well as pipelines that contained various amounts of air to evaluate the system's performance when air is present in the pipeline. Also presented are details of the improvements implemented to the third generation crawler system (PCS). The improvements include the redesign of the rims of the unit to accommodate a camera system that provides visual feedback of the conditions inside the pipeline. Visual feedback allows the crawler to be used as a pipeline unplugging and inspection tool. Tests conducted previously demonstrated a significant reduction of the crawler speed with increasing length of tether. Current improvements include the positioning of a pneumatic valve manifold system that is located in close proximity to the crawler, rendering tether length independent of crawler speed. Additional improvements to increase the crawler's speed were also investigated and presented. Descriptions of the test beds, which were designed to emulate possible scenarios present on the Department of Energy (DOE) pipelines, are presented. Finally, conclusions and recommendations for the systems are provided. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Enabling and Enhancing Space Mission Success and Reduction of Risk through the Application of an Integrated Data Architecture

The engineering phases of design, development, test, and evaluation (DDT and E) and subsequent planning, preparation, and operation (Ops) of space vehicles in a complex and distributed environment requires massive and continuous flows of information across the enterprise and across temporal stages of the vehicle lifecycle. The resulting capabilities at each subsequent stage depend in part on the capture, preparation, storage, and subsequent provision of information from prior stages. The United States National Aeronautics and Space Administration (NASA) is currently designing a fleet of new vehicles that will replace the Space Shuttle and expand space operations and exploration capabilities. This includes the 2 stage human rated lift vehicle Ares 1 and its associated crew vehicle the Orion, and a service module; the heavy lift cargo vehicle, Ares 5, and an associated cargo stage known as the Earth Departure Stage; and a Lunar Lander vehicle that contains a descent stage, and ascent stage, and a habitation module. A variety of concurrent assorted ground operations infrastructure including software and facilities are also being developed, assorted technology and assembly designs and development for equipment such as EVA suits, life support systems, command and control technologies are also in the pipeline. The development is occurring in a distributed manner, with project deliverables being contributed by a large and diverse assortment of vendors and most space faring nations. Critical information about all of the components, software, and procedures must be shared during the DDT and E phases and then made readily available to the mission operations staff for access during the planning, preparation, and operations phases, and also need to be readily available for system to system interactions. The Constellation Data Systems Project (CxDS) is identifying the needs, and designing and deploying systems and processes to support these needs. This paper details the steps and processes that NASA is applying within the Constellation Program to manage this data and information, and to insure that the correct information is available, correctly annotated, and can be provisioned digitally to enhance response times, and support engineering analysis and anomaly resolution.

Brummett, Robert C.↗

Progressive Tree-Based Compression of Large-Scale Particle Data

Scientific simulations and observations using particles have been creating large datasets that require effective and efficient data reduction to store, transfer, and analyze. However, current approaches either compress only small data well while being inefficient for large data, or handle large data but with insufficient compression. Toward effective and scalable compression/decompression of particle positions, we introduce new kinds of particle hierarchies and corresponding traversal orders that quickly reduce reconstruction error while being fast and low in memory footprint. Our solution to compression of large-scale particle data is a flexible block-based hierarchy that supports progressive, random-access, and error-driven decoding, where error estimation heuristics can be supplied by the user. For low-level node encoding, we introduce new schemes that effectively compress both uniform and densely structured particle distributions. Our proposed methods thus target all three phases of a tree-based particle compression pipeline, namely tree construction, tree traversal, and node encoding. In conclusion, the improved efficacy and flexibility of these methods over existing compressors are demonstrated through extensive experimentation, using a wide range of scientific particle datasets.

97 MATHEMATICS AND COMPUTING↗

On the Feasibility of Using Reduced-Precision Tensor Core Operations for Graph Analytics

Today’s data-driven analytics and machine learning workload have been largely driven by the General-PurposeGraphics Processing Units (GPGPUs). To accelerate dense matrix multiplications on the GPUs, Tensor Core Units (TCUs) have been introduced in recent years. In this paper, we study linear-algebra-based and vertex-centric algorithms for various graph kernels on the GPUs with an objective of applying this new hardware feature to graph applications. We identify the potential stages in these graph kernels that can be executed on the Tensor Core Units. In particular, we leverage the reformulation of the reduction and scan operations in terms of matrix multiplication [1]on the TCUs. We demonstrate that executing these operations on the TCUs, available inside different graph kernels, can assist in establishing an end-to-end pipeline on the GPGPUs without depending on hand-tuned external libraries and still can deliver comparable performance for various graph analytics.

Graph algorithms, GPU computing↗

Inductive predictions of hydrologic events using a Long Short-Term Memory network and the Soil and Water Assessment Tool

We present machine learning methods to predict hydrologic features such as streamflow and soil moisture from spatially and temporally varying hydrological and meteorological data. Here, we used a temporal reduction technique to reduce computation and memory requirements and trained a Long Short-Term Memory (LSTM) network to predict soil moisture and streamflow over multiple watersheds. We show LSTM networks can be trained in a fraction of the time required by complex process-based and attention-based models such as Soil and Water Assessment Tool (SWAT) and GeoMAN without sacrificing accuracy. We also demonstrate that outside data - sourced from a watershed other than the target - can be used to train LSTM to comparable or even superior prediction accuracy. The success of LSTM in such spatially-inductive settings shows hydrologic features can be predicted with minimal prior knowledge of the watershed in question. Finally, we make all methodologies of this work publicly available as an end-to-end software pipeline that facilitates rapid prototyping of hydrologic learners.

97 MATHEMATICS AND COMPUTING↗

KEPLER ECLIPSING BINARY STARS. III. CLASSIFICATION OF KEPLER ECLIPSING BINARY LIGHT CURVES WITH LOCALLY LINEAR EMBEDDING

We present an automated classification of 2165 Kepler eclipsing binary (EB) light curves that accompanied the second Kepler data release. The light curves are classified using locally linear embedding, a general nonlinear dimensionality reduction tool, into morphology types (detached, semi-detached, overcontact, ellipsoidal). The method, related to a more widely used principal component analysis, produces a lower-dimensional representation of the input data while preserving local geometry and, consequently, the similarity between neighboring data points. We use this property to reduce the dimensionality in a series of steps to a one-dimensional manifold and classify light curves with a single parameter that is a measure of 'detachedness' of the system. This fully automated classification correlates well with the manual determination of morphology from the data release, and also efficiently highlights any misclassified objects. Once a lower-dimensional projection space is defined, the classification of additional light curves runs in a negligible time and the method can therefore be used as a fully automated classifier in pipeline structures. The classifier forms a tier of the Kepler EB pipeline that pre-processes light curves for the artificial intelligence based parameter estimator.

79 ASTRONOMY AND ASTROPHYSICS↗

Active Flash: Out-of-core Data Analytics on Flash Storage

Next generation science will increasingly come to rely on the ability to perform efficient, on-the-fly analytics of data generated by high-performance computing (HPC) simulations, modeling complex physical phenomena. Scientific computing workflows are stymied by the traditional chaining of simulation and data analysis, creating multiple rounds of redundant reads and writes to the storage system, which grows in cost with the ever-increasing gap between compute and storage speeds in HPC clusters. Recent HPC acquisitions have introduced compute node-local flash storage as a means to alleviate this I/O bottleneck. We propose a novel approach, Active Flash, to expedite data analysis pipelines by migrating to the location of the data, the flash device itself. We argue that Active Flash has the potential to enable true out-of-core data analytics by freeing up both the compute core and the associated main memory. By performing analysis locally, dependence on limited bandwidth to a central storage system is reduced, while allowing this analysis to proceed in parallel with the main application. In addition, offloading work from the host to the more power-efficient controller reduces peak system power usage, which is already in the megawatt range and poses a major barrier to HPC system scalability. We propose an architecture for Active Flash, explore energy and performance trade-offs in moving computation from host to storage, demonstrate the ability of appropriate embedded controllers to perform data analysis and reduction tasks at speeds sufficient for this application, and present a simulation study of Active Flash scheduling policies. These results show the viability of the Active Flash model, and its capability to potentially have a transformative impact on scientific data analysis.

99 GENERAL AND MISCELLANEOUS↗

Size Matters: Assessing Optimum Soil Sample Size for Fungal and Bacterial Community Structure Analyses Using High Throughput Sequencing of rRNA Gene Amplicons

We examined the effect of different soil sample sizes obtained from an agricultural field, under a single cropping system uniform in soil properties and aboveground crop responses, on bacterial and fungal community structure and microbial diversity indices. DNA extracted from soil sample sizes of 0.25, 1, 5, and 10 g using MoBIO kits and from 10 and 100 g sizes using a bead-beating method (SARDI) were used as templates for high-throughput sequencing of 16S and 28S rRNA gene amplicons for bacteria and fungi, respectively, on the Illumina MiSeq and Roche 454 platforms. Sample size significantly affected overall bacterial and fungal community structure, replicate dispersion and the number of operational taxonomic units (OTUs) retrieved. Richness, evenness and diversity were also significantly affected. The largest diversity estimates were always associated with the 10 g MoBIO extractions with a corresponding reduction in replicate dispersion. For the fungal data, smaller MoBIO extractions identified more unclassified Eukaryota incertae sedis and unclassified glomeromycota while the SARDI method retrieved more abundant OTUs containing unclassified Pleosporales and the fungal genera Alternaria and Cercophora. Overall, these findings indicate that a 10 g soil DNA extraction is most suitable for both soil bacterial and fungal communities for retrieving optimal diversity while still capturing rarer taxa in concert with decreasing replicate variation.

59 BASIC BIOLOGICAL SCIENCES↗

Use cases of lossy compression for floating-point data in scientific data sets

Architectural and technological trends of systems used for scientific computing call for a significant reduction of scientific data sets that are composed mainly of floating-point data. Here, this article surveys and presents experimental results of currently identified use cases of generic lossy compression to address the different limitations of scientific computing systems. The article shows from a collection of experiments run on parallel systems of a leadership facility that lossy data compression not only can reduce the footprint of scientific data sets on storage but also can reduce I/O and checkpoint/restart times, accelerate computation, and even allow significantly larger problems to be run than without lossy compression. In conclusion, these results suggest that lossy compression will become an important technology in many aspects of high performance scientific computing. Because the constraints for each use case are different and often conflicting, this collection of results also indicates the need for more specialization of the compression pipelines.

97 MATHEMATICS AND COMPUTING↗

Robust and synthesizable photocatalysts for CO2 reduction: a data-driven materials discovery

The photocatalytic conversion of the greenhouse gas CO2 to chemical fuels such as hydrocarbons and alcohols continues to be a promising technology for renewable generation of energy. Major advancements have been made in improving the efficiencies and product selectiveness of currently known CO2 reduction electrocatalysts, nonetheless, materials discovery is needed to enable economically viable, industrial-scale CO2 reduction. We report here the largest CO2 photocathode search to date, starting with 68860 candidate materials, using a rational first-principles computation-based screening strategy to evaluate synthesizability, corrosion resistance, visible-light absorption, and compatibility of the electronic structure with fuel synthesis. The results confirm the observation of the literature that few materials meet the stringent CO2 photocathode requirements, with only 52 materials meeting all requirements. The results are well validated with respect to the literature, with 9 of these materials having been studied for CO2 reduction, and the remaining 43 materials are discoveries from our pipeline that merit further investigation.

03 NATURAL GAS↗

Open‐source photovoltaic model pipeline validation against well‐characterized system data

Abstract All freely available plane‐of‐array (POA) transposition models and photovoltaic (PV) temperature and performance models in pvlib‐python and pvpltools‐python were examined against multiyear field data from Albuquerque, New Mexico. The data include different PV systems composed of crystalline silicon modules that vary in cell type, module construction, and materials. These systems have been characterized via IEC 61853‐1 and 61853‐2 testing, and the input data for each model were sourced from these system‐specific test results, rather than considering any generic input data (e.g., manufacturer's specification [spec] sheets or generic Panneau Solaire [PAN] files). Six POA transposition models, 7 temperature models, and 12 performance models are included in this comparative analysis. These freely available models were proven effective across many different types of technologies. The POA transposition models exhibited average normalized mean bias errors (NMBEs) within ±3%. Most PV temperature models underestimated temperature exhibiting mean and median residuals ranging from −6.5°C to 2.7°C; all temperature models saw a reduction in root mean square error when using transient assumptions over steady state. The performance models demonstrated similar behavior with a first and third interquartile NMBEs within ±4.2% and an overall average NMBE within ±2.3%. Although differences among models were observed at different times of the day/year, this study shows that the availability of system‐specific input data is more important than model selection. For example, using spec sheet or generic PAN file data with a complex PV performance model does not guarantee a better accuracy than a simpler PV performance model that uses system‐specific data.

14 SOLAR ENERGY↗

Workflows Community Summit 2022: A Roadmap Revolution

Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from the execution of a cloud-based data preprocessing pipeline to multi-facility instrument-to-edge-to-HPC computational workflows. Given the changing landscape of scientific computing (often referred to as a computing continuum) and the evolving needs of emerging scientific applications, it is paramount that the development of novel scientific workflows and system functionalities seek to increase the efficiency, resilience, and pervasiveness of existing systems and applications. Specifically, the proliferation of machine learning/artificial intelligence (ML/AI) workflows, need for processing large-scale datasets produced by instruments at the edge, intensification of near real-time data processing, support for long-term experiment campaigns, and emergence of quantum computing as an adjunct to HPC, have significantly changed the functional and operational requirements of workflow systems. Workflow systems now need to, for example, support data streams from the edge-to-cloud-to-HPC, enable the management of many small-sized files, allow data reduction while ensuring high accuracy, orchestrate distributed services (workflows, instruments, data movement, provenance, publication, etc.) across computing and user facilities, among others. Further, to accelerate science, it is also necessary that these systems implement specifications/standards and APIs for seamless (horizontal and vertical) integration between systems and applications, as well as enable the publication of workflows and their associated products according to the FAIR principles.

97 MATHEMATICS AND COMPUTING↗

Industry Partnerships & Their Role In Reducing Natural Gas Supply Chain Greenhouse Gas Emissions – Phase 2

This analysis is the product of collaboration between Our Nation’s Energy Future (ONE Future) and the United States (U.S.) Department of Energy (DOE) National Energy Technology Laboratory (NETL). This analysis is an update to Phase 1 of the collaboration between ONE Future and NETL. Phase 1 had three objectives: 1. Calculate a greenhouse gas (GHG) emission profile representative of ONE Future’s supply chain, including methane (CH 4 ) emission rates. 2. Compare ONE Future’s emission profile to the emission profile for the U.S. natural gas supply chain. 3. Evaluate specific emission reduction opportunities. Phase 2 has two key enhancements over Phase 1: 1. The reporting year of the data is updated from 2016 to 2017. 2. The emission profiles and the specific emission reduction opportunities are regionalized for the ONE Future supply chain. The ONE Future supply chain is based on data provided by ONE Future members for all their U.S. onshore assets. ONE Future’s data are mostly representative of their participation in the Greenhouse Gas Reporting Program (GHGRP) administered by the Environmental Protection Agency (EPA) and is supplemented by ONE Future facilities that are not required to report to GHGRP. The U.S. scenario is based on NETL’s life cycle analysis (LCA) of natural gas extraction and power generation, which also uses data from the GHGRP (but does not include non-GHGRP facilities). In addition to the data from these sources, NETL accounted for uncertainty due to data variability, data limitations, and variability in liquids unloading frequency and event duration. This report is a re-issue of the 2020 study (published on July 28, 2020). It revises the device count in the mitigation strategy “pipeline pump-down before maintenance” in the Marginal Abatement Cost (MAC) Analysis section of the report (Section 7). Please see the addendum for more details on this revision and resultant changes. This revision does not change most of our conclusions and recommendations. It only changes the total methane reduced from all the mitigation opportunities (low cost and high cost) from 6.5 Bcf CH 4 /yr to 4.8 Bcf CH 4 /yr.

03 NATURAL GAS↗

Sustainability Assessment of Coal-Fired Power Plants with Carbon Capture and Storage

Carbon capture and sequestration (CCS) has the ability to dramatically reduce carbon dioxide (CO2) emissions from power production. Most studies find the potential for 70 to 80 percent reductions in CO2 emissions on a life-cycle basis, depending on the technology. Because of this potential, utilities and policymakers are considering the wide-spread implementation of CCS technology on new and existing coal plants to dramatically curb greenhouse gas (GHG) emissions from the power generation sector. However, the implementation of CCS systems will have many other social, economic, and environmental impacts beyond curbing GHG emissions that must be considered to achieve sustainable energy generation. For example, emissions of nitrogen oxides (NOx), sulfur oxides (SOx), and particulate matter (PM) are also important environmental concerns for coal-fired power plants. For example, several studies have shown that eutrophication is expected to double and acidification would increase due to increases in NOx emissions for a coal plant with CCS provided by monoethanolamine (MEA) scrubbing. Potential for human health risks is also expected to increase due to increased heavy metals in water from increased coal mining and MEA hazardous waste, although there is currently not enough information to relate this potential to actual realized health impacts. In addition to environmental and human health impacts, supply chain impacts and other social, economic, or strategic impacts will be important to consider. A thorough review of the literature for life-cycle analyses of power generation processes using CCS technology via the MEA absorption process, and other energy generation technologies as applicable, yielded large variability in methods and core metrics. Nonetheless, a few key areas of impact for CCS were developed from the studies that we reviewed. These are: the impact of MEA generation on increased eutrophication and acidification from ammonia emissions and increased toxicity from MEA production and the impact of increased coal use including the increased generation of NOx from combustion and transportation, impacts of increased mining of coal and limestone, and the disposal of toxic fly ash and boiler ash waste streams. Overall, the implementing CCS technology could contribute to a dramatic decrease in global GHG emissions, while most other environmental and human health impact categories increase only slightly on a global scale. However, the impacts on human toxicity and ecotoxicity have not been studied as extensively and could have more severe impacts on a regional or local scale. More research is needed to draw strong conclusions with respect to the specific relative impact of different CCS technologies. Specifically, a more robust data set that disaggregates data in terms of component processes and treats a more comprehensive set of environmental impacts categories from a life-cycle perspective is needed. In addition, the current LCA framework lacks the required temporal and spatial scales to determine the risk of environmental impact from carbon sequestration. Appropriate factors to use when assessing the risk of water acidification (groundwater/oceans/aquifers depending on sequestration site), risk of increased human toxicity impact from large accidental releases from pipeline or wells, and the legal and public policy risk associated with licensing CO2 sequestration sites are also not currently addressed. In addition to identifying potential environmental, social, or risk-related issues that could impede the large-scale deployment of CCS, performing LCA-based studies on energy generation technologies can suggest places to focus our efforts to achieve technically feasible, economically viable, and environmentally conscious energy generation technologies for maximum impact.

01 COAL, LIGNITE, AND PEAT↗

Singleton Sieving: Overcoming the Memory/Speed Trade-Off in Exascale k-mer Analysis

Traditional filter data structures, such as Bloom filters, do not offer necessary features that modern high-performance data analytics applications need in order to efficiently perform complex data analysis tasks. For example, MetaHipMer, a de novo metagenome assembler, can use filters to weed out singleton k-mers and reduce memory usage by 30%-70%. However, the filter needs the ability to associate values with k-mers in order to perform the analysis in a single communication pass. Bloom filters do not support value associations and cause the application to perform an extra communication pass, thereby increasing the run time. Therefore, MetaHipMer faces a trade off between memory and speed due to the limited capabilities of traditional filters. In this paper, we overcome the memory and speed trade off in MetaHipMer by integrating a GPU-based feature-rich filter, the Two-Choice filter (TCF), in the MetaHipMer pipeline. The TCF uses key-value association to approximately store k-mers with extensions. This allows MetaHipMer to perform k-mer analysis on the GPUs in a single communication pass. Our empirical analysis shows a 50% reduction in memory usage in k-mer analysis on each node in MetaHipMer without any effect on the overall run time or assembly quality. The memory reduction in turn results in a 43% reduction in the number of nodes required to assemble datasets and enables MetaHipMer to scale to much larger datasets.

McCoy, Hunter↗

THE CDF ARCHIVE: HERSCHEL PACS AND SPIRE SPECTROSCOPIC DATA PIPELINE AND PRODUCTS FOR PROTOSTARS AND YOUNG STELLAR OBJECTS

We present the COPS-DIGIT-FOOSH (CDF) Herschel spectroscopy data product archive, and related ancillary data products, along with data fidelity assessments, and a user-created archive in collaboration with the Herschel-PACS and SPIRE ICC groups. Our products include datacubes, contour maps, automated line fitting results, and best 1D spectra products for all protostellar and disk sources observed with PACS in RangeScan mode for two observing programs: the DIGIT Open Time Key Program (KPOT-nevans-1 and SDP-nevans-1; PI: N. Evans), and the FOOSH Open Time Program (OT1-jgreen02-2; PI: J. Green). In addition, we provide our best SPIRE-FTS spectroscopic products for the COPS Open Time Program (OT2-jgreen02-6; PI: J. Green) and FOOSH sources. We include details of data processing, descriptions of output products, and tests of their reliability for user applications. We identify the parts of the data set to be used with caution. The resulting absolute flux calibration has improved in almost all cases. Compared to previous reductions, the resulting rotational temperatures and numbers of CO molecules have changed substantially in some sources. On average, however, the rotational temperatures have not changed substantially (<2%), but the number of warm (T{sub rot} ∼ 300 K) CO molecules has increased by about 18%.

79 ASTRONOMY AND ASTROPHYSICS↗

Sulfide Generation by Dominant Halanaerobium Microorganisms in Hydraulically Fractured Shales

ABSTRACT Hydraulic fracturing of black shale formations has greatly increased United States oil and natural gas recovery. However, the accumulation of biomass in subsurface reservoirs and pipelines is detrimental because of possible well souring, microbially induced corrosion, and pore clogging. Temporal sampling of produced fluids from a well in the Utica Shale revealed the dominance of Halanaerobium strains within the in situ microbial community and the potential for these microorganisms to catalyze thiosulfate-dependent sulfidogenesis. From these field data, we investigated biogenic sulfide production catalyzed by a Halanaerobium strain isolated from the produced fluids using proteogenomics and laboratory growth experiments. Analysis of Halanaerobium isolate genomes and reconstructed genomes from metagenomic data sets revealed the conserved presence of rhodanese-like proteins and anaerobic sulfite reductase complexes capable of converting thiosulfate to sulfide. Shotgun proteomics measurements using a Halanaerobium isolate verified that these proteins were more abundant when thiosulfate was present in the growth medium, and culture-based assays identified thiosulfate-dependent sulfide production by the same isolate. Increased production of sulfide and organic acids during the stationary growth phase suggests that fermentative Halanaerobium uses thiosulfate to remove excess reductant. These findings emphasize the potential detrimental effects that could arise from thiosulfate-reducing microorganisms in hydraulically fractured shales, which are undetected by current industry-wide corrosion diagnostics. IMPORTANCE Although thousands of wells in deep shale formations across the United States have been hydraulically fractured for oil and gas recovery, the impact of microbial metabolism within these environments is poorly understood. Our research demonstrates that dominant microbial populations in these subsurface ecosystems contain the conserved capacity for the reduction of thiosulfate to sulfide and that this process is likely occurring in the environment. Sulfide generation (also known as “souring”) is considered deleterious in the oil and gas industry because of both toxicity issues and impacts on corrosion of the subsurface infrastructure. Critically, the capacity for sulfide generation via reduction of sulfate was not detected in our data sets. Given that current industry wellhead tests for sulfidogenesis target canonical sulfate-reducing microorganisms, these data suggest that new approaches to the detection of sulfide-producing microorganisms may be necessary.

04 OIL SHALES AND TAR SANDS↗