Search NASA⌕ Search

SEARCH · Search NASA

Results for “big data transfer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Fast and effective reordering of columns within supernodes using partition refinement

In this paper, we consider the problem of computing a triangular factorization of a sparse symmetric matrix using Gaussian elimination. We assume that the sparse matrix has been permuted using a fill-reducing ordering algorithm. When the matrix is symmetric positive definite, the sparsity structure of the triangular factor can be determined once the fill-reducing ordering has been computed. Thus, an efficient numerical factorization scheme can be designed so that only the nonzero entries are stored and operated on. On modern architectures, the positions of the nonzero entries in the triangular factor play a big role in determining the efficiency. It is desirable to have dense blocks in the factor so that the computation can be cast in terms of level-3 BLAS as much as possible. On architectures with GPUs, for example, it is also desirable for these dense blocks to be as large as possible in order to reduce the times to transfer data between the main CPU and the GPUs. We address the problem of locally refining the ordering so that the number of dense blocks is reduced and the sizes of these dense blocks are increased in the triangular factor.

Jacquelin, Mathias↗

Improvements on Low-Density Parity-Check (LDPC) Codes and High-Performance Neuromorphic Engineering for Communication Systems

Belief propagation (BP) on LDPC codes is an iterative decoding algorithm that performs information transfer on the Tanner graph, which represents the code. In each iteration, the algorithm exchanges information (LLR) between variable nodes and check nodes through the edges of the graph. LLR values represent the probability that a given bit in a transmitted codeword equals 0 or 1, given a received word. In the hardware part, recent advancements in intelligent technologies, such as artificial intelligence, big data analytics, autonomous vehicles, and speech/image recognition, have heightened the demand for faster calculations and reduced energy consumption.

Danilo Barrionuevo↗

DeepFreeze: Towards Scalable Asynchronous Checkpointing of Deep Learning Models

In the age of big data, deep learning has emerged as a powerful tool to extract insight and exploit its value, both in industry and scientific applications. One common pattern emerging in such applications is frequent checkpointing of the state of the learning model during training, needed in a variety of scenarios: analysis of intermediate states to explain features and correlations with training data, exploration strategies involving alternative models that share a common ancestor, knowledge transfer, resilience, etc. However, with increasing size of the learning models and popularity of distributed data-parallel training approaches, simple checkpointing techniques used so far face several limitations: low serialization performance, blocking I/O, stragglers due to the fact that only a single process is involved in checkpointing. This paper proposes a checkpointing technique specifically designed to address the aforementioned limitations, introducing efficient asynchronous techniques to hide the overhead of serialization and I/O, and distribute the load over all participating processes. Experiments with two deep learning applications (CANDLE and ResNet) on a pre-Exascale HPC platform (Theta) shows significant improvement over state-of-art, both in terms of checkpointing duration and runtime overhead.

checkpointing↗

Engineering Ralstonia eutropha for Production of Isobutanol (IBT) Motor Fuel from Carbon Dioxide, Hydrogen, and Oxygen Project Final Report

This research project is a collaboration between the Sinskey laboratory at MIT and the Worden laboratory at Michigan State University. The goal of the project is to produce Isobutanol (IBT), a branched-chain alcohol that can serve as a drop-in transportation fuel, through the engineered microbial biosynthesis of Carbon Dioxide, Hydrogen, and Oxygen using a novel bioreactor. This final technical report presents the findings of both the biological engineering work at MIT that extended the native branched-chain amino acid pathway of the wild type Ralstonia eutropha H16 to perform this biosynthesis, as well as the unique design, modeling, and construction of a bioreactor for incompatible gasses at Michigan State that enabled the operational testing of the complete system. This 105 page technical report summarizing the three years of research includes 72 figures and 11 tables of findings. Ralstonia eutropha (also known as Cupriavidus necator) is a Gram-negative, facultatively chemolithoautotrophic bacteria. It has been the principle organism used for the study of polyhydroxybutyrate (PHB) polymer biosynthesis. The wild-type Ralstonia eutropha H16 produces PHB as an intracellular carbon storage material while under nutrient stress in the presence of excess carbon. Under this stress, it can accumulate approximately 80 % of its cell dry weight (CDW) as this intracellular polymer. With the restoration of the required nutrients, the cells are then able to catabolize this polymer. If extracted from the cell, this PHB polymer can be processed into biodegradable and biocompatible plastics, however for this research, it is the efficient metabolic pathway channeling the captured carbon that is of interest. R. eutropha is further unique in that it contains two carbon-fixation Calvin–Benson–Bassham cycle operons, two oxygen-tolerant hydrogenases, and several formate dehydrogenases. It has also been much studied for its ability in the presence of oxygen, to fix carbon dioxide into complex cellular molecules using the energy from hydrogen. In this research project, engineered strains of R. eutropha redirected the excess carbon from PHB storage into the production of isobutanol and 3-methyl-1-butanol (branched-chain higher alcohols). These branched-chain higher alcohols can be used directly as substitutes for fossil-based fuels and are seen as alternative biofuels to ethanol and biodiesel. Importantly, these alcohols have approximately 98 % of the energy content of gasoline, 17 % higher than the current gasoline additive ethanol, without impacting corn market production for feed or food. Unlike ethanol, these branched-chain alcohols have low vapor pressure, hygroscopicity, and water solubility, which make them readily compatible with the existing pipelines, gasoline pumps, and engines in our transportation infrastructure. While the use of alternative energies from solar, wind, geothermal, and hydroelectric has spread for stationary power applications, these energy sources cannot be effectively or efficiently employed in current or future transportation systems. With the ongoing concerns of fossil fuel availability and price stability over the long term, alternative biofuels like branched-chain higher alcohols hold promise as a suitable transportation fuel in the future. We showed in our research that various mutant strains of R. eutropha with isobutyraldehyde dehydrogenase activity, in combination with the overexpression of plasmid-borne, native branched-chain amino acid biosynthesis pathway genes and the overexpression of heterologous ketoisovalerate decarboxylase gene, would produce isobutanol and 3-methyl-1-butanol when initiated during nitrogen or phosphorus limitation. Early on, we isolated one mutant R. eutropha strain which produced over 180 mg/L branched-chain alcohols in flask culture while being more tolerant of isobutanol toxicity. After the targeted elimination of genes encoding several potential carbon sinks (ilvE, bkdAB, and aceE), the production titer of the improved to 270 mg/L isobutanol and 40 mg/L 3-methyl-1-butanol. Semicontinuous flask cultivation supplied the cells with sufficient nutrients while minimizing the toxicity caused by isobutanol. Under this cultivation, the R. eutropha mutant grew and produced more than 14 g/L branched-chain alcohols over the duration of 50 days. These results demonstrate that R. eutropha carbon flux can be redirected from PHB to branched-chain alcohols and that engineered R. eutropha can be cultivated over prolonged periods of time for product biosynthesis. While this bioengineering work was being done at the Sinskey laboratory at MIT, the researchers at the Worden laboratory at Michigan State were working on the design and construction of the required specialty bioreactor for incompatible gasses (BIG) that would allow the safe feeding of microbes on Carbon Dioxide, Hydrogen, and Oxygen without explosive results. The early design and assembly work in year 1 incorporated a novel microbubble generator to maximize the bioavailability of gasses within the system comprised of small scale hollow fiber reactors. The early success of the microbubble generator eliminated the need to investigate potentially toxic surfactants within the system. For operational control, the system design incorporated a Opto22-based control network. The researchers also selected the specific hollow fiber material suitable for the bioreactor application. A variety of commercially available hollow fiber membranes were compared with regard to their pore sizes, cell affinity, and potential interference to cell viability assays. The selected membrane with its spongy layer was then tested for diffusivity of O2 and CO2. The instrumented system was then fully assembled for experimentally measuring the heterotrophic growth rate of immobilized R. eutropha cells. The requisite procedures for inoculation, measurement, and cleaning were established enabling the system performance to be validated under controlled laboratory conditions. In year 2, the researchers completed the Opto22 based cross-platform control network, and the system’s communications across the Sartorius fermentation system and Bruker gas chromatograph was established via open platform communications (OPC) protocol. Using the revised system, measurements were taken of the R.eutropha cell growth rate and substrate mass transfer rate in the hollow fiber membrane. Several IBT recovery strategies were explored and resin adsorption was determined to be optimal solution for lab scale operations. The adsorption capacity of the resin column was then measured and IBT desorption using methanol has been demonstrated. With the growing body of experimental data in hand, mathematical models were constructed to demonstrate and map the cellular kinetics, mass transfer of heterotrophic and autotrophic substrates in the hollow fiber, and the adsorption process in the resin column. A structured kinetic model was constructed to describe the competition between cell mass generation and IBT production. The reactor was then scaled up from single fiber to a membrane area of 180 cm2 and then further to 1 ft2. In Year 3 of the research, the IBT mass transfer across the membrane was characterized within the system with experiments to empirically measure the IBT diffusion coefficient in the BIG spongy layer. Using the refined mathematical models, the researchers are now able to explain the experimental observations and predict bioreactor performance under a wide range of experimental conditions. The Big system is able to demonstrate continuous controlled operations with the integrated IBT recovery system. Both heterotrophic and autotrophic production have been shown during continuous operation with heterotrophic and autotrophic stages. Performance of BIG system has been measured during continuous run with alternating heterotrophic growth on fructose and autotrophic product formation on H2, CO2, and O2. Volumetric productivities of IBT at 325 mg/(L day) and of 3M1B at 50 mg/(L day) were achieved, which were comparable to that achieved under heterotrophic conditions. Using the mathematical model, researchers are able to predict system performance for scaled-up BIG system. The apparent diffusion coefficient of IBT in the spongy layer of XM-50 hollow fiber membranes has been measured at various lumen liquid flow rates. The experiment is simulated in COMSOL to validate the results. The constructed COMSOL model is able to simulate BIG system performance in both batch and continuous mode. Mathematical simulations of the system performance have been run to identify the most crucial operational conditions, identifying the rate-limiting factors in autotrophic production of IBT, and quantitating the rate of IBT catabolism. Investigations of the productivity of the production system have suggested and the modeling of the system has revealed a particular sensitivity to the catabolism of the produced IBT by the engineered R. eutropha. Experiments have been designed and executed to quantify the IBT catabolism of R. eutropha, which open up possibilities for further system improvements through future, targeted bioengineering of the strain. Finally, the researchers at Michigan State performed an economic analysis of the system, based on the collective results, and their findings are presented in full within the report.

08 HYDROGEN↗

THE MISSING CAVITIES IN THE SEEDS POLARIZED SCATTERED LIGHT IMAGES OF TRANSITIONAL PROTOPLANETARY DISKS: A GENERIC DISK MODEL

Transitional circumstellar disks around young stellar objects have a distinctive infrared deficit around 10 {mu}m in their spectral energy distributions, recently measured by the Spitzer Infrared Spectrograph (IRS), suggesting dust depletion in the inner regions. These disks have been confirmed to have giant central cavities by imaging of the submillimeter continuum emission using the Submillimeter Array (SMA). However, the polarized near-infrared scattered light images for most objects in a systematic IRS/SMA cross sample, obtained by HiCIAO on the Subaru telescope, show no evidence for the cavity, in clear contrast with SMA and Spitzer observations. Radiative transfer modeling indicates that many of these scattered light images are consistent with a smooth spatial distribution for {mu}m-sized grains, with little discontinuity in the surface density of the {mu}m-sized grains at the cavity edge. Here we present a generic disk model that can simultaneously account for the general features in IRS, SMA, and Subaru observations. Particularly, the scattered light images for this model are computed, which agree with the general trend seen in Subaru data. Decoupling between the spatial distributions of the {mu}m-sized dust and mm-sized dust inside the cavity is suggested by the model, which, if confirmed, necessitates a mechanism, such as dust filtration, for differentiating the small and big dust in the cavity clearing process. Our model also suggests an inwardly increasing gas-to-dust ratio in the inner disk, and different spatial distributions for the small dust inside and outside the cavity, echoing the predictions in grain coagulation and growth models.

79 ASTRONOMY AND ASTROPHYSICS↗

Towards a robust out-of-the-box neural network model for genomic data

The accurate prediction of biological features from genomic data is paramount for precision medicine and sustainable agriculture. For decades, neural network models have been widely popular in fields like computer vision, astrophysics and targeted marketing given their prediction accuracy and their robust performance under big data settings. Yet neural network models have not made a successful transition into the medical and biological world due to the ubiquitous characteristics of biological data such as modest sample sizes, sparsity, and extreme heterogeneity. Here, we investigate the robustness, generalization potential and prediction accuracy of widely used convolutional neural network and natural language processing models with a variety of heterogeneous genomic datasets. Mainly, recurrent neural network models outperform convolutional neural network models in terms of prediction accuracy, overfitting and transferability across the datasets under study. While the perspective of a robust out-of-the-box neural network model is out of reach, we identify certain model characteristics that translate well across datasets and could serve as a baseline model for translational researchers.

59 BASIC BIOLOGICAL SCIENCES↗

Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach

Chemically accurate and comprehensive studies of the virtual space of all possible molecules are severely limited by the computational cost of quantum chemistry. Here we introduce a composite strategy that adds machine learning corrections to computationally inexpensive approximate legacy quantum methods. After training, highly accurate predictions of enthalpies, free energies, entropies, and electron correlation energies are possible, for significantly larger molecular sets than used for training. For thermochemical properties of up to 16k isomers of C 7 H 10 O 2 we present numerical evidence that chemical accuracy can be reached. We also predict electron correlation energy in post Hartree-Fock methods, at the computational cost of HartreeFock, and we establish a qualitative relationship between molecular entropy and electron correlation. The transferability of our approach is demonstrated, using semiempirical quantum chemistry and machine learning models trained on 1 and 10% of 134k organic molecules, to reproduce enthalpies of all remaining molecules at density functional theory level of accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Scalable tuning of building models to hourly data

Energy models of existing buildings are unreliable unless calibrated so they correlate well with actual energy usage. Manual tuning requires a skilled professional, is prohibitively expensive for small projects, imperfect, non-repeatable, non-transferable, and not scalable to the dozens of sensor channels that smart meters, smart appliances, and cheap/ubiquitous sensors are beginning to make available today. A scalable, automated methodology is needed to quickly and intelligently calibrate building energy models to all available data, increase the usefulness of those models, and facilitate speed-and-scale penetration of simulation-based capabilities into the marketplace for actualized energy savings. The "Autotune'' project is a novel, model-agnostic methodology which leverages supercomputing, large simulation ensembles, and big data mining with multiple machine learning algorithms to allow automatic calibration of simulations that match measured experimental data in a way that is deployable on commodity hardware. This paper shares several methodologies employed to reduce the combinatorial complexity to a computationally tractable search problem for hundreds of input parameters. Furthermore, accuracy metrics are provided which quantify model error to measured data for either monthly or hourly electrical usage from a highly-instrumented, emulated-occupancy research home.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

GeoThermalCloud: Cloud Fusion of Big Data and Multi-Physics Models using Machine Learning for Discovery, Exploration, and Development of Hidden Geothermal Resources

The primary goals of this project are exploring hidden geothermal resources in the U.S.A. and designing profitable enhanced geothermal systems (EGS). Many processes and parameters control geothermal exploration and energy production from geothermal fields. Diverse datasets (e.g., geology, geochemistry, geophysics, satellite, airborne geophysics) are available to help characterize subsurface geothermal conditions. Sparse and multi-scale characteristics of these datasets prohibit properly leveraging these datasets for geothermal exploration and profitable EGS design. Recent advancements in machine learning (ML) promise to resolve these issues. The tremendous challenges and risks of geothermal exploration and production bring the demand for novel ML methods and tools that can (1) analyze large field datasets, (2) assimilate model simulations (large inputs and outputs), (3) process sparse datasets, (4) perform transfer learning (between sites with different exploratory levels), (5) extract hidden geothermal signatures in the field and simulation data, (6) label geothermal resources and processes, (7) identify high-value data acquisition targets, and (8) guide geothermal exploration and production by selecting optimal exploration, production, and drilling strategies. To address these necessities, ML-based geothermal resources exploration and enhanced geothermal systems (EGS) design tools have been developed. The exploration tool is called GeoThermalCloud and EGS design tool is called GeoDT-ML. GeoThermalCloud (https://github.com/SmartTensors/GeoThermalCloud.jl) utilizes a LANL unsupervised ML platform called SmartTensors (https://tensors.lanl.gov/) to automate data analyses and interpretations by extracting hidden signatures to identify geothermal prospects. Also, it enables the identification of critical measurements needed to identify geothermal resource signatures. Alternatively, GeoDT-ML (https://github.com/SmartTensors/GeoThermalCloud.jl/tree/master/EGS) is an ML-based alternative to GeoDT (https://github.com/GeoDesignTool/GeoDT.git), a fast, simplified multi-physics solver to evaluate EGS project designs in uncertain geologic systems. GeoDT-ML leverages recent advances in deep learning and high-performance computing. It is a faster and simpler version of GeoDT. To make this project a success, we used capabilities of LANL, PNNL, Google, Stanford, and Julia Computing. We analyzed eight datasets of the U.S.A. using GeothermalCloud and demonstrated potential highly prospective geothermal resources and identified key factors defining highly prospective sites. The first data set includes 44 locations in southwest New Mexico and 18 geological, hydrogeological, geophysical, geothermal, geochemical attributes. We defined low- and medium-temperature hydrothermal systems and discovered a new highly prospective site. The second data set analyzed 18 shallow water chemistry attributes at 14,342 locations in the Great Basin. It demarcated modestly, moderately, and highly prospective sites including key attributes for each type of prospectivity. The third data set analyzed Utah FORGE data including satellite (InSAR), geophysical (gravity, seismic), geochemical, and geothermal attributes. Here, we performed prospectivity analysis to identify future drilling locations using geological, geochemical, and geophysical attributes. Maps of temperature at depth and heat flow are constructed based on the available data. Prospectivity maps were generated, and drilling locations were proposed for future geothermal field exploration. The fourth data set analyzed 21 attributes at 120 locations in Tularosa Basin, New Mexico; data comes from past play fairway analyses in this region. ML analyses identified geothermal signatures associated with modestly, moderately, and highly hydrothermal systems. We also defined dominant attributes and spatial distribution of the geothermal signatures. The fifth, sixth, seventh, and eighth datasets include Tohatchi Springs, New Mexico, Hawaii, Brady site, Nevada, and EGS Collab, respectively. Moreover, we coupled GeothermalCloud and magnetotellurics data to pinpoint drilling locations for developing geothermal projects in the Tularosa Basin, New Mexico. GeothermalCloud found potential prospective locations for geothermal resources near White Sands Missile Range and McGregor Range at Fort Bliss. Magnetotellurics data determined the potential depth (~1800m) of geothermal prospects at McGregor Range based on apparent resistivity structures/layers in the subsurface. The McGregor Range consists of three resistivity layers and two resistivity structures. Magnetotellurics data also helps identify that the western portion of the McGregor Range has thick and low-resistivity earth materials. The low resistivity to the west is most likely for a fault system. Assuming temperature is consistent with a geothermal reservoir, the west-central part of the McGregor Range has the highest geothermal potential because of the increase in porosity and associated permeability attributed to the interpreted fault system. Also, we devised a coupling strategy between a process model and GeothermalCloud to characterize hydrogeological conditions and geothermal conditions, respectively. The process model characterizes hydrogeological and geothermal conditions on highly prospective geothermal sites provided by GeothermalCloud. We developed a physics-informed neural network (PINN) version of the Burns equation that can be easily coupled with GeothermalCloud. Furthermore, we performed an optimal design decision maximizing the economic value of an EGS power plant. This study optimized the range of well spacing between injection and production wells maximizing net present value in dollars (NPV). For this task, we used the GeoDT to simulate the Utah FORGE EGS development cycle from the initial well design to the end of production. Next, we accomplished another crucial task, which is predicting permeability of geothermal reservoirs. Predicting permeability of geothermal reservoirs is a non-trivial task because of huge computational runtime of simulation and lack of measurements. To avoid these limitations, we used easy-to-measure chemical concentrations in the subsurface as measurement data and convolutional neural network based ML model of a high-fidelity model. Next, we predicted permeability using Markov chain Monte Carlo simulation. We found that Markov chain Monte Carlo simulation predicts permeability with a high certainty if the prediction zone in the simulation area has chemical concentration data. Finally, we analyzed the DOE funded INGENIOUS and GeoDAWN projects data. For discovering hidden geothermal systems in the Great Basin, the INGENIOUS project accumulated old data, collected new data, and released them in 2022. The dataset includes a total of 24 geological, geophysical, and geochemical attributes. Data resolution and scale significantly vary prohibiting an appropriate usage. To avoid such limitations, we brought all data in the same resolution and scale by applying the inverse distance weighting interpolation technique for predicting data in unsampled locations. Subsequently, we analyzed LiDAR data of the GeoDAWN project. We received data in tiles format. The DOE’s overarching goal is to use ML on LiDAR data for finding favorable geological structures (e.g., step up faults in Brady, Nevada). To serve the purpose, we need to label favorable geologic structures that correspond to LiDAR data. We wrote an algorithm to label the LiDAR data with the favorable geologic structures.

15 GEOTHERMAL ENERGY↗

Big Data Challenges at CCMC

Like other research centers, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) at NASA Goddard Space Flight Center (GSFC) is also experiencing the big data challenges. CCMC hosts over 80 space weather models for Runs On Request (ROR), Continuous Runs and Instant Runs simulation services for the research community. In addition, CCMC has started to support simulation output onboarding in response to the Open Science initiative. Overall, we have accumulated over petabytes of simulation output data and are rapidly growing. In this presentation, we will discuss our data and storage challenges. We will present our attempts to address our challenges and any associated lessons learned. CCMC uses Apache Airflow to ensure data transfer is consistent. We will give a brief overview on how we leverage Apache Airflow to enhance our environment.

space weather↗

Big Data Challenges at the Community Coordinated Modeling Center (CCMC)

Like other research centers, the Community Coordinated Modeling Center (CCMC, https://ccmc.gsfc.nasa.gov) at NASA Goddard Space Flight Center (GSFC) is also experiencing the big data challenges. CCMC hosts over 80 space weather models for Runs On Request (ROR), Continuous Runs and Instant Runs simulation services for the research community. In addition, CCMC has started to support simulation output onboarding in response to the Open Science initiative. Overall, we have accumulated over petabytes of simulation output data and are rapidly growing. In this presentation, we will discuss our data and storage challenges. We will present our attempts to address our challenges and any associated lessons learned. CCMC uses Apache Airflow to ensure data transfer is consistent. We will give a brief overview on how we leverage Apache Airflow to enhance our environment.

space weather↗

Near real-time streaming analysis of big fusion data

Experiments on fusion plasmas produce high-dimensional data time series with ever-increasing magnitude and velocity, but turn-around times for analysis of this data have not kept up. For example, many data analysis tasks are often performed in a manual, ad-hoc manner some time after an experiment. In this article, we introduce the Delta framework that facilitates near real-time streaming analysis of big and fast fusion data. By streaming measurement data from fusion experiments to a high-performance compute center, Delta allows computationally expensive data analysis tasks to be performed in between plasma pulses. This article describes the modular and expandable software architecture of Delta and presents performance benchmarks of individual components as well as of an example workflow. Focusing on a streaming analysis workflow where electron cyclotron emission imaging (ECEi) data is measured at KSTAR on the National Energy Research Scientific Computing Center's (NERSC's) supercomputer we routinely observe data transfer rates of about 4 Gigabit per second. In NERSC, a demanding turbulence analysis workflow effectively utilizes multiple nodes and graphical processing units and executes them in under 5 min. We further discuss how Delta uses modern database systems and container orchestration services to provide web-based real-time data visualization. For the case of ECEi data we demonstrate how data visualizations can be augmented with outputs from machine learning models. Here, by providing session leaders and physics operators, results of higher-order data analysis using live visualizations may make more informed decisions on how to configure the machine for the next shot.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Cosmological constraints on dark matter interactions with ordinary matter

Dark matter interactions with electrons or protons during the early Universe leave imprints on the cosmic microwave background and the matter power spectrum, and can be probed through cosmological and astrophysical observations. These interactions lead to momentum and heat exchange between the ordinary and dark matter components, which in turn results in a transfer of pressure from the ordinary to the dark matter. We explore these interactions using a diverse suite of data: cosmic microwave background anisotropies, baryon acoustic oscillations, the Lyman-α forest, and the abundance of Milky-Way subhalos. We derive constraints using model-independent parameterizations of the dark matter–electron and dark matter–proton interaction cross sections and map these constraints onto concrete dark matter models. Our constraints are complementary to other probes of dark matter interactions with ordinary matter, such as direct detection, big bang nucleosynthesis, various astrophysical systems, and accelerator based experiments. They exclude sufficiently large cross sections for a large range of dark matter masses, which cannot be accessed by direct-detection experiments due to the overburden from the Earth’s atmosphere or crust.

Manuel A. Buen-Abad↗

Cosmological constraints on dark matter interactions with ordinary matter

Dark matter interactions with electrons or protons during the early Universe leave imprints on the cosmic microwave background and the matter power spectrum, and can be probed through cosmological and astrophysical observations. These interactions lead to momentum and heat exchange between the ordinary and dark matter components, which in turn results in a transfer of pressure from the ordinary to the dark matter. Here, we explore these interactions using a diverse suite of data: cosmic microwave background anisotropies, baryon acoustic oscillations, the Lyman-α forest, and the abundance of Milky-Way subhalos. We derive constraints using model-independent parameterizations of the dark matter–electron and dark matter–proton interaction cross sections and map these constraints onto concrete dark matter models. Our constraints are complementary to other probes of dark matter interactions with ordinary matter, such as direct detection, big bang nucleosynthesis, various astrophysical systems, and accelerator-based experiments. They exclude sufficiently large cross sections for a large range of dark matter masses, which cannot be accessed by direct-detection experiments due to the overburden from the Earth’s atmosphere or crust.

79 ASTRONOMY AND ASTROPHYSICS↗

Geo Thermal Cloud: Cloud Fusion of Big Data and Multi-Physics Models using Machine Learning for Discovery, Exploration, and Development of Hidden Geothermal Resources

The project is motivated by the challenges, risks, and costs associated with geothermal exploration and production. Many processes and parameters impacting geothermal conditions are poorly understood. Diverse datasets are available to help characterize subsurface geothermal conditions (public and proprietary; satellite, airborne surveys, vegetation/water sampling, geological, geophysical, etc.). Yet, it is not clear how to properly leverage these datasets for geothermal exploration due to an incomplete understanding of how physical processes impacting subsurface geothermal conditions are represented in these observations. Recent advancements in machine learning (ML) provide great promise to resolve these issues. The tremendous challenges and risks of geothermal exploration and production bring the demand for novel ML methods and tools that can (1) analyze large field datasets, (2) assimilate model simulations (large inputs and outputs), (3) process sparse datasets, (4) perform transfer learning (between sites with different exploratory levels), (5) extract hidden geothermal signatures in the field and simulation data, (6) label geothermal resources and processes, (7) identify high-value data acquisition targets, and (8) guide geothermal exploration and production by selecting optimal exploration, production, and drilling strategies. Our goals and work under Phases 1 and 2 (as proposed) of this project address all these needs.

15 GEOTHERMAL ENERGY↗

Improving the Accessibility and Usability of Geothermal Information with Data Lakes and Data Pipelines on the Geothermal Data Repository

The Geothermal Data Repository (GDR) provides universal access to data and information resulting from research and development activities funded by the Department of Energy (DOE). The GDR has extended this universal access to big data through integration with data lakes developed by the Open Energy Data Initiative (OEDI). Previously, large datasets such as seismic waveform or distributed acoustic sensing (DAS) data could only be accessed by institutions with high performance data storage and compute capabilities, effectively limiting the accessibility of big data to national labs, larger universities, and major corporations. Moreover, the time and resources needed to transport big data and configure them can produce additional barriers to use. Many of the standard formats used for structured data models (also known as content models) are incapable of handling big data and can introduce additional usability problems, often requiring data to be reformatted prior to use. This paper will explore how recent integrations between the GDR and the OEDI data lake have improved the accessibility and usability of geothermal data in a big way, making the data available to a broader audience, and enabling collaborative analysis and innovation across the greater geothermal industry.

access↗

A hybrid computational strategy to address WGS variant analysis in >5000 samples

Abstract Background The decreasing costs of sequencing are driving the need for cost effective and real time variant calling of whole genome sequencing data. The scale of these projects are far beyond the capacity of typical computing resources available with most research labs. Other infrastructures like the cloud AWS environment and supercomputers also have limitations due to which large scale joint variant calling becomes infeasible, and infrastructure specific variant calling strategies either fail to scale up to large datasets or abandon joint calling strategies. Results We present a high throughput framework including multiple variant callers for single nucleotide variant (SNV) calling, which leverages hybrid computing infrastructure consisting of cloud AWS, supercomputers and local high performance computing infrastructures. We present a novel binning approach for large scale joint variant calling and imputation which can scale up to over 10,000 samples while producing SNV callsets with high sensitivity and specificity. As a proof of principle, we present results of analysis on Cohorts for Heart And Aging Research in Genomic Epidemiology (CHARGE) WGS freeze 3 dataset in which joint calling, imputation and phasing of over 5300 whole genome samples was produced in under 6 weeks using four state-of-the-art callers. The callers used were SNPTools, GATK-HaplotypeCaller, GATK-UnifiedGenotyper and GotCloud. We used Amazon AWS, a 4000-core in-house cluster at Baylor College of Medicine, IBM power PC Blue BioU at Rice and Rhea at Oak Ridge National Laboratory (ORNL) for the computation. AWS was used for joint calling of 180 TB of BAM files, and ORNL and Rice supercomputers were used for the imputation and phasing step. All other steps were carried out on the local compute cluster. The entire operation used 5.2 million core hours and only transferred a total of 6 TB of data across the platforms. Conclusions Even with increasing sizes of whole genome datasets, ensemble joint calling of SNVs for low coverage data can be accomplished in a scalable, cost effective and fast manner by using heterogeneous computing platforms without compromising on the quality of variants.

59 BASIC BIOLOGICAL SCIENCES↗