Search NASA⌕ Search

SEARCH · Search NASA

Results for “Community Scale”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Providing a Flexible and Comprehensive Software Stack Via Spack, an Extreme-Scale Scientific Software Stack, and Software Development Kits

To manage the complex demands of modern high-performance computing (HPC), software applications increasingly depend on software developed by other teams, often at other institutions. An HPC software ecosystem approach is required to support dependencies on third-party scientific software. An ecosystem approach provides layers of activity above the individual software product level that promote interoperability, quality improvement, porting, testing, and deployment. The U.S. Exascale Computing Project (ECP) developed its HPC software ecosystem using a three-pronged approach. First, the ECP adopted and invested in Spack, a package manager designed to handle complex HPC package dependencies. Second, the ECP created the Extreme Scale Scientific Software Stack, an effort that supports developing, deploying, and running scientific applications on HPC platforms. Third, the ECP supported software product communities, or software development kits, to develop and promote best practices, improve software interoperability, and other collaborative efforts. This article describes ECP contributions to HPC software ecosystem challenges.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

PubDAS: A PUBlic Distributed Acoustic Sensing Datasets Repository for Geosciences

During the past few years, distributed acoustic sensing (DAS) has become an invaluable tool for recording high-fidelity seismic wavefields with great spatiotemporal resolutions. However, the considerable amount of data generated during DAS experiments limits their distribution with the broader scientific community. Such a bottleneck inherently slows down the pursuit of new scientific discoveries in geosciences. Here, we introduce PubDAS—the first large-scale open-source repository where several DAS datasets from multiple experiments are publicly shared. PubDAS currently hosts eight datasets covering a variety of geological settings (e.g., urban centers, underground mines, and seafloor), spanning from several days to several years, offering both continuous and triggered active source recordings, and totaling up to ~90 TB of data. Here this article describes these datasets, their metadata, and how to access and download them. Some of these datasets have only been shallowly explored, leaving the door open for new discoveries in Earth sciences and beyond.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

2023 Operational Assessment Report: Argonne Leadership Computing Facility

In 2004, the U.S. Department of Energy’s (DOE’s) Advanced Scientific Computing Research (ASCR) program established the Leadership Computing Facility (LCF) with a mission to provide the world’s most advanced computational resources to the open science community. The LCF is a huge investment in the nation’s scientific and technological future, inspired by a growing demand for large-scale computing and its impact on science and engineering. The LCF operates two world-class centers in support of open science at Argonne National Laboratory (Argonne) and at Oak Ridge National Laboratory (Oak Ridge) and deploys diverse machines that are among the most powerful systems in the world today. The LCF ranks among the top U.S. scientific facilities delivering impactful science. The work performed at these centers informs policy decisions and advances innovations in far-reaching areas such as energy assurance, ecological sustainability, and global security. The leadership-class systems at Argonne and Oak Ridge operate around the clock every day of the year. The high level of services these centers provide and the exceptional science they produce justify their existence to the DOE Office of Science and the U.S. Congress

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Investigation of the 176 Yb Interference Correction during Determination of the 176 Hf/ 177 Hf Ratio by Laser Ablation and Solution Analysis on the Neoma MC-ICP-MS

We utilized the Neoma™, a recently released MC-ICP-MS platform offered by ThermoFisher Scientific, to assess the behavior of the Lu-Yb-Hf system during laser ablation analyses of various zircon standards as well as solution-based analyses of the JMC-475 Hf standard doped with varying quantities of Yb and Lu. The primary goal of this work was to characterize the behavior of the Yb interference correction on the Neoma™ platform since this is one of the biggest issues in the Hf isotope analysis community and because the Neoma™ platform will supplant the Neptune™ series instrument. During laser ablation analysis, we found that the overall data quality scales proportionally with the total Hf signal intensity, with higher signal analyses producing extremely accurate (within 1 ε Hf unit) and precise (sub ε Hf unit within-run standard errors) data. At low Yb signals (<0.1 V 173 Yb), we were not able to produce an accurate internal Yb mass bias factor. However, utilizing an empirical approach allows for the application of session-specific relationships between the Yb and Hf mass bias factors, determined by analysis of standards of varying Yb content, to produce accurate ε Hf values from zircons with higher Yb/Hf ratios even where the total Hf signal intensity is relatively low. Similar behavior was observed in the solution analyses. Lastly, while the behavior of the Yb interference correction on the Neoma™ platform appears comparable to the Neptune™ series MC-ICP-MS, further work will help refine the understanding of the controls on mass bias behavior, oxide formation, session-to-session stability, etc.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Enhancing Cluster Identification in Atom Probe Tomography Data Using Transfer Learning

Atom probe tomography (APT) has enabled the direct visualization of solute clusters, providing valuable insights into material structures. This clustering is crucial for understanding the nanoscale composition and behavior of materials, which can significantly influence their mechanical and physical properties. However, the widely used clustering methods in the APT community face challenges such as subjective parametric selection and limited applicability, particularly in dealing with overlapping clusters, nested clusters, and artifacts across different scales, such as precipitates and dislocations. To address these challenges, we present a framework based on density-based cluster analysis that aims to be less dependent on user input, reproducible, and robust.

Density-based clustering↗
DOE OSTI2023

The Impact of Model Resolution on the Southern Hemisphere in Community Climate System Model Version 4 Idealized Climate Simulations

Model resolution plays a large role in accurately simulating the Southern Hemisphere circulation in both the ocean and atmosphere. Resolving the mesoscale field is important as it has been shown to have a significant impact on the large-scale climate in eddy-rich regions, which are regions of large CO2 absorption. The presence of ocean and atmospheric mesoscale features can affect sea surface temperatures, the strength and location of storm tracks, and many other air-sea processes. Additionally, with an improvement in resolution, the eddy kinetic energy in the ocean can be expected to change considerably. The significance model resolution has on the Southern Hemisphere is examined using the Community Climate System Model, Version 4, eddy-parameterizing and eddy-resolving simulations. The CO2 concentrations and ozone levels are specified independently to better understand how the mesoscale field responds to extreme changes in external forcing and the resulting climate impacts. Overall, in the eddy-parameterizing simulations, the ozone forcing is found to be more important than the changes in CO2 concentrations. However, in the case of the eddy-resolving simulations, the CO2 concentrations are found to be more dominant, especially in eddy-rich regions. These results demonstrate the need for an increase in model resolution for climate prediction.

Daher, Houraa (ORCID:0000000200177346)↗
DOE OSTI2025

Nannochloropsis oceanica IMET1 and its bacterial symbionts for carbon capture, utilization, and storage: biomass and calcium carbonate production under high pH and high alkalinity

ABSTRACT To combat the increasing levels of carbon dioxide (CO 2 ) released from the combustion of fossil fuels, microalgae have emerged as a promising strategy for biological carbon capture, utilization, and storage. This study used a marine microalgal strain, Nannochloropsis oceanica IMET1, which thrives in high CO 2 concentrations. A high-pH, high-alkalinity culture was designed for CO 2 capture through algal biomass production as well as permanent sequestration through calcium carbonate (CaCO 3 ) precipitation. This was accomplished by timed pH elevation and the addition of sodium bicarbonate to cultures of N. oceanica grown at lab scale (1 L) and pilot scale (500 L) with 10% and 5% CO 2 , respectively. Our data showed that 0.02 M NaHCO 3 promoted algal growth and that sparging cultures with ambient air after 12 days raised pH and created favorable CaCO 3 formation conditions. At the 1 L scale, we reached 1.52 g L −1 biomass after 12 days and an extra 9.3% CO 2 was captured in the form of CaCO 3 precipitates. At the 500 L pilot scale, an extra 60% CO 2 was captured (Day 40) with a maximum CO 2 capture rate of 63.2 g m −2 day −1 (Day 35). Bacterial communities associated with the microalgae were dominated by two novel Patescibacteria. Functional analysis revealed that genes for several plant growth-promotion traits (PGPTs) were enriched within this group. The microalgal-bacterial coculture system offers advantages for enhanced carbon mitigation through biomass production and simultaneous precipitation of recalcitrant CaCO 3 for long-term CO 2 storage. IMPORTANCE Capturing carbon dioxide (CO 2 ) released from fossil fuel combustion is of the utmost importance as the impacts of climate change continue to worsen. Microalgae can remove CO 2 through their natural photosynthetic pathways and are additionally able to convert CO 2 into a stable, recalcitrant form as calcium carbonate (CaCO 3 ). We demonstrate that microalgae-based carbon capture systems can be greatly improved with high pH and high alkalinity by providing optimal conditions for carbonate precipitation. Our results with the microalga, Nannochloropsis oceanica strain IMET1, show an extra 9.3% CO 2 captured as CaCO 3 at the 1 L scale and an extra 60% CO 2 captured at the 500 L (pilot) scale. Our optimized system provides a novel approach to capture CO 2 through two mechanisms: (i) as organic carbon within microalgal biomass and (ii) as inorganic carbon stored permanently in the form of CaCO 3.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2021

Integrating CVMix into GOTM (v6.0): a consistent framework for testing, comparing, and applying ocean mixing schemes

Abstract. The General Ocean Turbulence Model (GOTM) is a one-dimensional water column model, including a set of state-of-the-art turbulence closure models, and has widely been used in various applications in the ocean modeling community. Here, we extend GOTM to include a set of newly developed ocean surface vertical mixing parameterizations of Langmuir turbulence via coupling with the Community Vertical Mixing Project (CVMix). A Stokes drift module is also implemented in GOTM to provide the necessary ocean surface waves information to the Langmuir turbulence parameterizations, as well as to facilitate future development and evaluation of new Langmuir turbulence parameterizations. In addition, a streamlined workflow with Python and Jupyter notebooks is also described, enabled by the newly developed and more flexible configuration capability of GOTM. The newly implemented Langmuir turbulence parameterizations are evaluated against theoretical scalings and available observations in four test cases, including an idealized wind-driven entrainment case and three realistic cases at Ocean Station Papa, the northern North Sea, and the central Baltic Sea, and compared with the existing general length scale scheme in GOTM. The results are consistent with previous studies. This development extends the capability of GOTM towards including the effects of ocean surface waves and provides useful toolsets for the ocean modeling community to further study the effects of Langmuir turbulence in a broader scope.

58 GEOSCIENCES↗
DOE OSTI2023

ESnet Requirements Review Program Through the IRI Lens: A Meta-Analysis of Workflow Patterns Across DOE Office of Science Programs (Final Report)

The Department of Energy (DOE) ensures America’s security and prosperity by addressing its energy, environmental, and nuclear challenges through transformative science and technology solutions. The DOE’s Office of Science (SC) delivers groundbreaking scientific discoveries and major scientific tools that transform our understanding of nature and advance the energy, economic, and national security of the United States. The SC’s programs advance DOE mission science across a wide range of disciplines and have developed the research infrastructure needed to remain at the forefront of scientific discovery. The DOE SC’s world-class research infrastructure — exemplified by the 28 SC scientific user facilities — provides the research community with premier observational, experimental, computational, and network capabilities. Each user facility is designed to provide unique capabilities to advance core DOE mission science for its sponsor SC program and to stimulate a rich discovery and innovation ecosystem. Research communities gather and flourish around each user facility, bringing together diverse perspectives. A hallmark of many facilities is the large population of students, postdoctoral researchers, and early-career scientists who contribute as full-fledged users. These facility staff and users collaborate over years to devise new approaches to utilizing the user facility’s core capabilities. The history of the SC user facilities has many examples of wildly inventive researchers challenging operational orthodoxy to pioneer new vistas of discovery; for example, the use of the synchrotron X-ray light sources for study of proteins and other large biological molecules. This continual reinvention of the practice of science — as users and staff forge novel approaches expressed in research workflows — unlocks new discoveries and propels scientific progress. Within this research ecosystem, the high-performance computing (HPC) and networking user facilities stewarded by SC’s Advanced Scientific Computing Research (ASCR) program play a dynamic cross-cutting role, enabling complex workflows demanding high performance data, networking, and computing solutions. The DOE SC’s three HPC user facilities and the Energy Sciences Network (ESnet) high-performance research network serve all of the SC’s programs as well as the global research community. Argonne Leadership Computing Facility (ALCF), the National Energy Research Scientific Computing Center (NERSC), and Oak Ridge Leadership Computing Facility (OLCF) conceive, build, and provide access to a range of supercomputing, advanced computing, and large-scale data-infrastructure platforms, while ESnet interconnects DOE SC research infrastructure and enables seamless exchange of scientific data. All four facilities operate testbeds to expand the frontiers of computing and networking research. Together, the ASCR facilities enterprise seeks to understand and meet the needs and requirements across SC and DOE domain science programs and priority efforts, highlighted by the formal requirements reviews (RRs) methodology. In recent years, the research communities around the SC user facilities have begun experimenting with and demanding solutions integrated with HPC and data infrastructure. This rise of integrated-science approaches is documented in many community and high-level government reports. At the dawn of the era of exascale science and the acceleration of artificial intelligence (AI) innovation, there is a broad need for integrated computational, data, and networking solutions. In response to these drivers, DOE has developed a vision for an Integrated Research Infrastructure (IRI): To empower researchers to meld DOE’s world-class research tools, infrastructure, and user facilities seamlessly and securely in novel ways to radically accelerate discovery and innovation.

42 ENGINEERING↗
DOE OSTI2021

Final Technical Report-WestSmart EV: Western Smart Plug-in Electric Vehicle Community Partnership

The WestSmartEV (WSEV) project has accelerated adoption of plug-in electric vehicles (PEV) throughout the PacifiCorp/Rocky Mountain Power’s (RMP) service territory in the intermountain west by developing a large-scale, sustainable PEV charging infrastructure network with coordinated PEV adoption programs. The project objectives have strategically deployed 79 DC fast charging to create two primary electric interstate highway corridors along I-15 and I-80; incentivized installation of Level 2 AC chargers at workplace locations; incentivized the purchase of PEVs; provided all electric solutions for first-mile and last-mile trips, including electrified mobility service; provided centralized data collection, analysis, modeling, and tool development to inform investment and policy decisions; and developed education outreach materials and conducted workshops across the WSEV region.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Data for The Role of Social Support on Midwestern Farmers’ Willingness to Grow Perennial Bioenergy Crops

The lack of farmers’ willingness to grow perennial bioenergy crops (PBCs) presents a critical barrier to the emergence of cellulosic biofuel production. The willingness relies on a complex network of economic, environmental, and social drivers, among which the influence of social factors (e.g., the influence of neighborhood, community, and communication) is less understood. This study addresses this knowledge gap via a survey analysis of midwestern farmers. The survey data are analyzed through ordinary least square regression and structural equation model, which together investigate the individual and interactive impacts of multiple factors on farmers’ decisions to adopt PBCs. Based on a farm-scale analysis, six statistically significant predictors of farmer willingness to grow PBCs are identified: perception of PBCs’ environment benefits, education level, willingness to take risks, familiarity with PBCs, portion of peers already growing PBCs, and support of biorefineries locating in the local community. Among these, the latter three predictors are social support variables. It is found that familiarity with the crops is the most significant predictor of willingness; familiarity is also an important intermediate variable that mediates the influence of many other predictors. In addition, peer adoption can both directly and indirectly affect willingness via its influence on familiarity. These findings suggest that it is a pressing need to improve farmers’ knowledge of PBCs to promote the adoption of such crops.

Economics↗
DOE OSTI2021

Evaluation of the Large-Scale and Regional Climatic Response Across North Africa to Natural Variability in Oceanic Modes and Terrestrial Vegetation Among the CMIP5 Models

Hydrologic variability is a serious threat to the poverty-stricken regions of North Africa. Meanwhile, the scientific community struggles to attribute these extreme climatic episodes to specific oceanic and land drivers. Prior modeling studies have not assessed simulated feedbacks over North Africa against an established observational benchmark, so their results are considered as untested, model-specific findings. The Coupled Model Intercomparison Project Phase Five (CMIP5) archive represents the state-of-the-art in climate projections, with most CMIP5 models now containing interactive vegetation phenology; however, there have been no studies to date of their simulated vegetation feedbacks. The capability of CMIP5 models at accurately simulating the forcing of both sea-surface temperature (SST) and regional leaf area index (LAI) anomalies on North African climate needs to be a key consideration in assessing the models’ overall credibility and determining appropriate model weighting for developing climate projections. The Generalized Equilibrium Feedback Assessment (GEFA) is a promising statistical method, which can be applied to either model output or observations, for isolating the local and remote impacts of individual oceanic or terrestrial forcings on regional climate. We performed a combined observational and modeling assessment of land-ocean-atmosphere interactions across the distinct ecological and moisture gradients of North Africa. We evaluated and demonstrated the reliability of the GEFA statistical method over North Africa using the Community Earth System Model (CESM), applied GEFA to observational data to quantify the observed forcing of ocean basin SST anomalies and regional LAI anomalies on North African climate, evaluated the CMIP5 models’ performance in terms of representing these key observed feedbacks, and formulated CMIP5 feedback performance metrics for weighting North African climate projections. Our study represented the first attempt to separate the observed roles of oceanic and vegetation feedbacks across North Africa, the first systematic assessment and intercomparison of land-ocean-atmosphere feedbacks in CMIP5, and the first exploration of vegetation feedbacks among CMIP5 models. The following work was accomplished. (1) The team generated 14 scientific publications and 30 presentations based on the DOE-funded research. (2) A stepwise version of the GEFA statistical method was developed in which unimportant forcings were dropped to increase the reliability of the results. (3) SGEFA was successfully validated through experiments with CESM in terms of its ability to isolate the atmospheric responses to individual oceanic or land forcings. (4) Observational evidence was revealed for the Sahel’s positive vegetation-rainfall feedback on the seasonal to interannual time scale, and it was attributed to a moisture recycling mechanism rather than an albedo mechanism. (5) An approach with SGEFA was developed in which the individual contributions of soil moisture versus vegetation forcings could be separated, revealing that the former forcing outweighed the latter for sub-Saharan Africa. (6) Tropical ocean temperatures were found to be key regulators of pan-tropical vegetation variability, especially for arid and semi-arid regions, including sub-Saharan Africa. (7) The CMIP5 models largely underestimated the importance of land feedbacks across the Sahel. (8) The general consensus among CMIP5 models indicates, for the late 21st century, a diminished seasonal predictability of sub-Saharan African regional climate and an elevated role of the land surface compared to oceanic drivers in regulating regional climate variability. (9) Land-ocean-atmosphere interactions were demonstrated to be key contributors to the seasonal predictability of African wildfire activity. (10) The El Djouf was determined to be of greater importance than the Bodélé depression in terms of providing trans-Atlantic dust transport to the Americas.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A case study on parallel HDF5 dataset concatenation for high energy physics data analysis

In High Energy Physics (HEP), experimentalists generate large volumes of data that, when analyzed, helps us better understand the fundamental particles and their interactions. This data is often captured in many files of small size, creating a data management challenge for scientists. In order to better facilitate data management, transfer, and analysis on large scale platforms, it is advantageous to aggregate data further into a smaller number of larger files. However, this translation process can consume significant time and resources, and if performed incorrectly the resulting aggregated files can be inefficient for highly parallel access during analysis on large scale platforms. In this paper, we present our case study on parallel I/O strategies and HDF5 features for reducing data aggregation time, making effective use of compression, and ensuring efficient access to the resulting data during analysis at scale. We focus on NOvA detector data in this case study, a large-scale HEP experiment generating many terabytes of data. Here, the lessons learned from our case study inform the handling of similar datasets, thus expanding community knowledge related to this common data management task.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

GronOR: Scalable and Accelerated Nonorthogonal Configuration Interaction for Molecular Fragment Wave Functions

GronOR is a program package for nonorthogonal configuration interaction calculations. Electronic wave functions are constructed in terms of antisymmetrized products of multiconfiguration molecular fragment wave functions. The computational complexity of the nonorthogonal methodologies implemented in GronOR applied to large molecular assemblies requires a design that takes full advantage of massively parallel supercomputer architectures and accelerator technologies. This work describes the implementation strategy and resulting performance characteristics. In addition to parallelization and acceleration, the software development strategy includes aspects of fault resiliency and heterogeneous computing. The program was designed for large-scale supercomputers but also runs effectively on small clusters and workstations for small molecular systems. GronOR is available as open source to the scientific community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Integrating Ultra-Coarse-Grained Protein Models into Accessible Workflows for Multiscale Molecular Dynamics

To capture protein conformational transitions using molecular dynamics (MD), several simulation resolutions covering different spatial and temporal scales are typically needed. All-atom (AA) simulations provide fine resolution, but are computationally infeasible for large systems over longer durations. Coarse-grained (CG) and ultra-coarse-grained (UCG) models have a lower resolution and computational cost while still being able to conserve essential protein features. Prior work on a Multiscale Machinelearned Modeling Infrastructure (MuMMI) combined both AA and CG simulations to study RAS-RAF protein interactions, leveraging CG models for longer time scales and using AA to investigate unusual conformations in greater detail. However, MuMMI is still resource-intensive, and this study aims to maximize exploration of the protein conformational space while reducing computational cost. In this paper, we build on prior work that integrates UCG models based on heterogeneous elastic network modeling (hENM) into the MuMMI workflow. We demonstrate that UCG models enable accurate sampling of protein conformations, focusing on simulating RAS-RAF protein interactions. Using higher-resolution CG Martini simulation data, we can automatically refine intramolecular interactions in UCG models. We present a scalable Python package that uses fluctuations observed in higher-resolution CG Martini simulations to estimate bond coefficients of the UCG model. We built novel machine learning-based backmapping methods to recover more detailed CG Martini structures from UCG structures, using diffusion models to learn the mapping between scales. Finally, we present UCG-mini-MuMMI, an accessible and less compute-intensive version of MuMMI as a resource for the scientific community. Incorporating UCG models into MD studies is applicable to a broad range of systems and proteins, and our study offers insights into the advantages and limitations of these methods.

Chemical structure↗
DOE OSTI2022

High impact of bacterial predation on cyanobacteria in soil biocrusts

Diverse bacteria lead a life as pathogens or predators of other bacteria in many environments. However, their impact on emerging ecological processes in natural settings remains to be assessed. Here we describe a novel type of obligate, intracellular predatory bacterium of widespread distribution that preys on soil cyanobacteria in biocrusts. The predator, Candidatus Cyanoraptor togatus, causes localized, cm-sized epidemics that are visible to the naked eye, obliterates cyanobacterial net primary productivity, and severely impacts crucial biocrust properties like nitrogen cycling, dust trapping and moisture retention. The combined effects of high localized morbidity and areal incidence result in decreases approaching 10% of biocrust productivity at the ecosystem scale. Our findings show that bacterial predation can be an important loss factor shaping not only the structure but also the function of microbial communities.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Spatial turnover of soil viral populations and genotypes overlain by cohesive responses to moisture in grasslands

Viruses shape microbial communities, food web dynamics, and carbon and nutrient cycling in diverse ecosystems. However, little is known about the patterns and drivers of viral community composition, particularly in soil, precluding a predictive understanding of viral impacts on terrestrial habitats. To investigate soil viral community assembly processes, here we analyzed 43 soil viromes from a rainfall manipulation experiment in a Mediterranean grassland in California. We identified 5,315 viral populations (viral operational taxonomic units [vOTUs] with a representative sequence ≥10 kbp) and found that viral community composition exhibited a highly significant distance–decay relationship within the 200-m 2 field site. This pattern was recapitulated by the intrapopulation microheterogeneity trends of prevalent vOTUs (detected in ≥90% of the viromes), which tended to exhibit negative correlations between spatial distance and the genomic similarity of their predominant allelic variants. Although significant spatial structuring was also observed in the bacterial and archaeal communities, the signal was dampened relative to the viromes, suggesting differences in local assembly drivers for viruses and prokaryotes and/or differences in the temporal scales captured by viromes and total DNA. Despite the overwhelming spatial signal, evidence for environmental filtering was revealed in a protein-sharing network analysis, wherein a group of related vOTUs predicted to infect actinobacteria was shown to be significantly enriched in low-moisture samples distributed throughout the field. Overall, our results indicate a highly diverse, dynamic, active, and spatially structured soil virosphere capable of rapid responses to changing environmental conditions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

CoSim: A Simulator for Co-Scheduling of Batch and On-Demand Jobs in HPC Datacenters

The increasing scale and complexity of scientific applications are rapidly transforming the ecosystem of tools, methods, and workflows adopted by the high-performance computing (HPC) community. Big data analytics and deep learning are gaining traction as essential components in this ecosystem in a variety of scenarios, such as, steering of experimental instruments , acceleration of high-fidelity simulations through surrogate computations, and guided ensemble searches. In this context, the batch job model traditionally adopted by the supercomputing in-frastructures needs to be complemented with support to schedule opportunistic on-demand analytics jobs, leading to the problem of efficient preemption of batch jobs with minimum loss of progress. In this paper, we design and implement a simulator, CoSim, that enables on-the-fly analysis of the trade-offs arising between delaying the start of opportunistic on-demand jobs, which leads to longer analytics latency, and loss of progress due to preemption of batch jobs, which is necessary to make room for on-demand jobs. To this end, we propose an algorithm based on dynamic programming with predictable performance and scalability that enables supercomputing infrastructure schedulers to analyze the aforementioned trade-off and take decisions in near real-time. Compared with other state-of-art approaches using traces of the Theta pre-Exascale machine, our approach is capable of finding the optimal solution, while achieving high performance and scalability.

batch job preemption↗