Search NASA⌕ Search

SEARCH · Search NASA

Results for “community test”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Contrasting effects of land-use and local disturbance on plant and pollinator communities in wetlands

While pollinators and wetlands both provide important ecosystem services (e.g., the pollination of flowering plants and improving water quality), the relationship between the two is not well understood. Both biotic and abiotic effects can mediate the local wetland flower and pollinator community. In this study, we investigated how land use, including a land use gradient at five different radii, from 250 m to 2 km, along with anthropogenic disturbance affected pollinators in wetland ecosystems. We surveyed the abundance and diversity of plant-pollinator communities in fifteen different wetlands across two years. We also tested the relationship between water quality and temperature, and the abundance and diversity of flowering plants and pollinating insects. Our results suggest that increasing temperature, which was strongly associated with developed land use, had a negative effect on the floral display of wetland plants, as well as the abundance of all flower visitors and hover flies. Hover fly abundance was also positively associated with agricultural land use and total nitrogen in the water. Meanwhile, the abundance of female bees was affected by an interaction between temperature and disturbance: female bees were most abundant when temperatures were lower in areas of low disturbance. In contrast, pollinator species richness increased with temperature when developed land use was low, and floral diversity was strongly affected by several interactions between disturbance, land use, and water quality. Finally, the community composition of both plants and insects varied significantly among low, medium, and high disturbance categories, with weedier, non-native species being significantly associated with areas of higher disturbance and in sites with greater anthropogenic land use. We demonstrate that ecological communities shift significantly in response to anthropogenic change. Our work also illustrates the importance of quantifying interactions between land use and local disturbance with abiotic factors such as temperature and water quality on ecological systems.

Disturbance↗
DOE OSTI2023

Life history strategies among soil bacteria—dichotomy for few, continuum for many

Abstract Study of life history strategies may help predict the performance of microorganisms in nature by organizing the complexity of microbial communities into groups of organisms with similar strategies. Here, we tested the extent that one common application of life history theory, the copiotroph-oligotroph framework, could predict the relative population growth rate of bacterial taxa in soils from four different ecosystems. We measured the change of in situ relative growth rate to added glucose and ammonium using both 18O–H2O and 13C quantitative stable isotope probing to test whether bacterial taxa sorted into copiotrophic and oligotrophic groups. We saw considerable overlap in nutrient responses across most bacteria regardless of phyla, with many taxa growing slowly and few taxa that grew quickly. To define plausible life history boundaries based on in situ relative growth rates, we applied Gaussian mixture models to organisms’ joint 18O–13C signatures and found that across experimental replicates, few taxa could consistently be assigned as copiotrophs, despite their potential for fast growth. When life history classifications were assigned based on average relative growth rate at varying taxonomic levels, finer resolutions (e.g., genus level) were significantly more effective in capturing changes in nutrient response than broad taxonomic resolution (e.g., phylum level). Our results demonstrate the difficulty in generalizing bacterial life history strategies to broad lineages, and even to single organisms across a range of soils and experimental conditions. We conclude that there is a continued need for the direct measurement of microbial communities in soil to advance ecologically realistic frameworks.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

NFPA Distributed Energy Resources Safety Training (DERST) For Emergency Responders

The National Fire Protection Association, with support from the Department of Energy, executed a multi-year initiative to develop, enhance, and disseminate Distributed Energy Resources Safety Training (DERST) tools for U.S. emergency responders. As Distributed Energy Resources (DER)—such as solar photovoltaics, battery energy storage systems (ESS), electric vehicles (EVs), and associated infrastructure—become increasingly prevalent, the NFPA identified a critical need for up-to-date standardized, accessible, and effective safety training tailored for the fire service and related public safety professionals. The project delivered a comprehensive suite of educational resources to improve responders’ abilities to safely manage DER-related incidents. This included: • Revised Modular Training Courses: Updated classroom-based DER safety courses, now modular and accessible nationwide through fire academies and the North American Fire Training Directors (NAFTD) network. • Live Burn Testing & Research: A full-scale controlled burn of a DER-equipped residential structure provided real-world data and insights, forming the basis for updated best practices. • A Gamified Simulation Tool – Firefighters Incident Response Simulation Tool (FIRST): A first-of-its-kind, multiplayer, scenario-based simulation using the Unreal Engine 5.0 to train responders in a realistic virtual, multi-DER incident environment. • Field Familiarization Software Tools & Prop Guide: Digital DER field familiarization evolutions software guide and a prop development manual to support field-based DER training exercises, enhancing responders' hands-on familiarity with DER infrastructure and collaboration on virtual incident responses. • National Dissemination Strategy: Strategic partnerships with NAFTD, Vector Solutions, and others enabled wide-scale distribution, with over 5,000 departments accessing resources and 1,100+ departments adopting the simulator in the first seven months. Also provided a web portal for easy access to all training and simulation programs developed under this grant for the U.S. responder community. Key findings from the project—particularly from the burn test—led to paradigm shifts in fire response tactics. For example, traditional approaches to garage fires may be hazardous if DERs are present, due to explosive off gassing and thermal runaway risks. The new training emphasizes scene assessment, stand-off approaches, thermal imaging verification, and careful post-incident cooling of DER components to prevent reignition. This initiative has had a significant national impact, raising awareness, enhancing preparedness, and supporting safer DER incident response practices. Significant engagement from the media, public safety organizations, and PBS coverage has further amplified the reach and adoption of NFPA’s DER safety training, tools, and simulations.

14 SOLAR ENERGY↗
DOE OSTI2026

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger↗
DOE OSTI2022

Mitigation of SARS-CoV-2 transmission at a large public university

In Fall 2020, universities saw extensive transmission of SARS-CoV-2 among their populations, threatening health of the university and surrounding communities, and viability of in-person instruction. Here we report a case study at the University of Illinois at Urbana-Champaign, where a multimodal “SHIELD: Target, Test, and Tell” program, with other non-pharmaceutical interventions, was employed to keep classrooms and laboratories open. The program included epidemiological modeling and surveillance, fast/frequent testing using a novel low-cost and scalable saliva-based RT-qPCR assay for SARS-CoV-2 that bypasses RNA extraction, called covidSHIELD, and digital tools for communication and compliance. In Fall 2020, we performed >1,000,000 covidSHIELD tests, positivity rates remained low, we had zero COVID-19-related hospitalizations or deaths amongst our university community, and mortality in the surrounding Champaign County was reduced more than 4-fold relative to expected. This case study shows that fast/frequent testing and other interventions mitigated transmission of SARS-CoV-2 at a large public university.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Laboratory Evaluation of Commercial Utility Microgrid Controller Test Results

The functional requirements of many microgrid controllers (MGCs) are expanding and evolving to meet growing utility and community needs. At a high level, the utility microgrid controller serves resilience and reliability use cases by coordinating transitions between grid-connected and islanded states and by managing the system during island operations. This includes control scenarios that require the microgrid controller to use flexible microgrid boundaries, maintain energy balance, coordinate with peer systems, and manage grid-forming (GFM) and grid-following (GFL) distributed energy resources (DER). In order to evaluate these functional enhancements, microgrid controller test plans must also be developed to ensure that the implemented controllers provide adequate performance. This report provides MGC test plans for both island operation and transition functions. The functions covered in this report include feeder level energy management, island constraint management, secondary voltage and frequency control, black start, and synchronized reconnection. This second edition update also includes results from applying the tests to a commercial utility microgrid controller. These results evaluate the performance and reliability of the controller under various operational scenarios. It identifies specific areas where the controller excels and highlights gaps that need to be addressed for future enhancements. The application of these test plans on real-world system behavior provides insights on commercial equipment readiness for field deployment. These test cases can be applied to utility-managed microgrid controllers that exclusively manage utility-owned equipment; the tests also apply to third-party managed microgrid controllers that coordinate with utility- and customer-owned equipment. The report can also be used by technology developers and project developers in industry to evaluate control strategies and performance characteristics for community microgrid controllers.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Bridging the length scales on mechanical property evaluation (Final Report)

The development of small-scale mechanical testing in combination with microstructural investigation is of great interest to the nuclear materials community for both materials development and monitoring applications. Dramatically reducing the sample sizes to reduce radioactivity and obtaining mechanical properties of irradiated samples is truly intriguing. Moreover, such studies promise a range of benefits including cost reduction, fundamental insight in structure-property relationships, increased statistics on less sample material, and reinvestigation of prior irradiated and tested reactor samples while simultaneously enabling the generation of mechanical test data on ion beam irradiated materials with limited penetration depths. Small scale materials testing on sub-sized samples has been studied for several decades, though it has only been after the development of micro-testing based on Focused Ion Beam (FIB) sample manufacturing in that orders of magnitude smaller samples could really be investigated in a quantitative manner. In recent years, small scale mechanical testing techniques at a number of length scales has been developed for both unirradiated and irradiated (ion and neutron) materials. Technological advances made in this field have enabled ex-situ and in-situ transmission electron microscopy (TEM) and scanning electron microscopy (SEM) examination, thus leading to more accurate measurements as well as additional mechanistic information. A recent review of the benefits of these techniques show that these techniques are at a stage to tackle multi-scale ranges of materials investigations and can be utilized to obtain fundamental science-based understanding of nuclear materials. Considering the tremendous advances made, one can see how small-scale mechanical testing techniques combined with modeling can enable true small scale to bulk scale mechanical property correlations. However, for the engineering community to adapt this approach fully, one needs to demonstrate that a) that these techniques can produce results with high fidelity and reproducibility, b) generate engineering stress-strain data that one can utilize to understand bulk behavior, and c) generate new insight into relevant phenomena fostering the true understanding of radiation damage and microstructure in materials for nuclear applications. It is the objective of this proposal to bridge the length scale between macro- and micro- scale mechanical testing of unirradiated and irradiated materials. This involves the development and demonstration of procedures for multi-scale mechanical testing that enable high fidelity reproducibility of data and the generation bulk property data from small-scale mechanical tests. Through this, the proposal aims to enhance the confidence in the obtained data at the smaller length scales and enhance the insight provided from these techniques for bulk scale applications on both unirradiated and irradiated materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Tidal Turbine Benchmarking Project: Stage I - Steady Flow Blind Predictions: Preprint

This paper presents the first blind prediction stage of the Tidal Turbine Benchmarking Project being conducted and funded by the UK's EPSRC and Supergen ORE Hub. In this first stage, only steady flow conditions, at low and elevated turbulence (3.1%) levels, were considered. Prior to the blind prediction stage, a large laboratory scale experiment was conducted in which a highly instrumented 1.6m diameter tidal rotor was towed through a large towing tank in well-defined flow conditions with and without an upstream turbulence grid. Details of the test campaign and rotor design were released as part of this community blind prediction exercise. Participants were invited to use a range of engineering modelling approaches to simulate the performance and loads of the turbine. 26 submissions were received from 12 groups from across academia and industry using solution techniques ranging from blade resolved computational fluid dynamics through actuator line, boundary integral element methods, vortex methods to engineering Blade Element Momentum methods. The comparisons between experiments and blind predictions were extremely positive helping to provide validation and uncertainty estimates for the models, but also validating the experimental tests themselves. The exercise demonstrated that the experimental turbine data provides a robust data set against which researchers and design engineers can test their models and implementations to ensure robustness in their processes, helping to reduce uncertainty and provide increased confidence in engineering processes. Furthermore, the data set provides the basis by which modellers can evaluate and refine approaches.

benchmarking↗
DOE OSTI2024

Climate, food and humans predict communities of mammals in the United States

Abstract Aim The assembly of species into communities and ecoregions is the result of interacting factors that affect plant and animal distribution and abundance at biogeographic scales. Here, we empirically derive ecoregions for mammals to test whether human disturbance has become more important than climate and habitat resources in structuring communities. Location Conterminous United States. Time Period 2010–2021. Major Taxa Studied Twenty‐five species of mammals. Methods We analysed data from 25 mammal species recorded by camera traps at 6645 locations across the conterminous United States in a joint modelling framework to estimate relative abundance of each species. We then used a clustering analysis to describe 8 broad and 16 narrow mammal communities. Results Climate was the most important predictor of mammal abundance overall, while human population density and agriculture were less important, with mixed effects across species. Seed production by forests also predicted mammal abundance, especially hard‐mast tree species. The mammal community maps are similar to those of plants, with an east–west split driven by different dominant species of deer and squirrels. Communities vary along gradients of temperature in the east and precipitation in the west. Most fine‐scale mammal community boundaries aligned with established plant ecoregions and were distinguished by the presence of regional specialists or shifts in relative abundance of widespread species. Maps of potential ecosystem services provided by these communities suggest high herbivory in the Rocky Mountains and eastern forests, high invertebrate predation in the subtropical south and greater predation pressure on large vertebrates in the west. Main Conclusions Our results highlight the importance of climate to modern mammals and suggest that climate change will have strong impacts on these communities. Our new empirical approach to recognizing ecoregions has potential to be applied to expanded communities of mammals or other taxa.

Kays, Roland↗
DOE OSTI2023

The 2022 Hunga eruption exercises the nuclear explosion monitoring community

The 2022 Hunga eruption was a global event recorded by all three Comprehensive Test Ban Treaty Organization (CTBTO) International Monitoring System (IMS) geophysical waveform sensor technologies: seismic, infrasound, and hydroacoustic. Large volcanic eruptions are rare and additionally present an opportunity to test seismoacoustic detection, location, and identification methods for nuclear explosion monitoring.

58 GEOSCIENCES↗
DOE OSTI2026

Predicting Li-Ion Battery Capacity Fade Using Early-Life Data and a Hybrid Data-Driven Gaussian Process-Bayesian Regression Approach

Accurately predicting Li-ion battery capacity trajectories using early-life data can dramatically improve battery-life understandings and be used to rapidly evaluate design/cost/performance trade-offs when developing new battery materials. Accurate early-life predictions enable researchers to quickly iterate over cell designs and material precursor properties without consistently cycling cells to failure. To this end, we present a toolbox that uses a combined Gaussian Process and Bayesian regression approach that capitalizes on signals other than just capacity (e.g., dQ/dV, voltage drops) to rapidly predict capacity-fade trajectories. The prediction tool uses Bayesian regression to fit functional forms, e.g., power law, sigmoids, etc., to predict capacity-fade dynamics. By fitting functional forms, the capacity fade can be interrogated at any point in the future, allowing for early cell-failure prediction. Additionally, Bayesian regression allows for accurate uncertainty estimates that account for cell-to-cell variability (aleatoric uncertainty) and the lack of observation data (epistemic uncertainty). By only using early cycle data to predict the capacity fade trajectory, uncertainty bounds at end-of-life can be extremely large. The large uncertainty bounds are further exacerbated because there is no systematic way to define the prior distribution of the functional forms' parameters. We improve our the predicted trajectory confidence interval of our predicted trajectory using two methods. First, we shows that a small amount of held-out cycling data is sufficientuse some train cells, that have been cycled to failure to derive information regarding the appropriate prior distributions for the functional forms' parameters of the functional form, effectively leading to data-driven priors.. We propose constructing the data-driven priors by first running a Bayesian regression starting with uninformed priors to generate intermediate cell-specific posterior parameter distributions. These posterior distributions are combined using a Ggaussian mixture model for each parameter to create the data-driven priors. These mixture models serve as the data-driven prior distributions for the parameters for. Second, we derive multiple features, e.g., C_dchg 0.5 DoD 0.5, log (|mean(dQ/dV_(w_3-w_0 ) (V)|), etc., from the train cellsheld-out cycling data, identify which the features are that best predicting capacity at early/mid-life cycles, and then create Ggaussian process regression models that are used for predicting capacity at early/mid-life cycles for the test cells (see blue dots with error bars in Fig 1b). Finally, these predicted data-points are used in addition to the actual early cycle data capacity fade to construct the Bayesian regression trajectory for the test cell s. Notably. We note that these two methods are complementary and can be combined with each other. We evaluate the performance of our proposed method on an testing open-source dataset from Iowa State University and Iowa Lakes Community College (ISU-ILCC). This dataset comprises of 251 nickel-manganese-cobalt/graphite Lithium-ion cells that are cycled under 63 different conditions. We compute the mean average percentage error (MAPE) and negative log predictive density (NLPD) to quantify the efficacy of our method. Our initial findings suggest that, when only few observations are available, for test cells, when using only Bayesian regression with uninformed priors, a power law functional provides the most accurate predictions. with very few data points. However, asHowever, a the number of data points increases, a twin sigmoidal function becomes more accurate as the number of observations further increases. We also find that using as little as 10% of the data set towards generating data-driven priors can lead to significant improvement in prediction accuracy when using early cycle data. Lastly, we found that augmenting early-cycle data with Gaussian process-predicted capacity data for Bayesian regression greatly improves the prediction accuracy. We will present a comprehensive comparison of our methods to other methods available in the literature and apply this method to additional battery datasets.

42 ENGINEERING↗
DOE OSTI2021

Coupling Surface Flow with High-performance Subsurface Reactive Flow and Transport Code PFLOTRAN

Water exchange between the surface and subsurface is important for both water resource management and environmental protection. In this paper, we develop coupled surface and subsurface flow simulation capability in a parallel subsurface flow and reactive transport code PFLOTRAN. We sequentially couple the diffusion wave-based surface flow with the subsurface flow governedby the Richards equation in PFLOTRAN. These two flow domains are linked with a boundary condition switching method that ensures continuity of pressure and flux at the surface-subsurface interface. We verify the coupled code against other existing hydrologic models and observation data using a number of numerical experiments. The coupled hydrological model exhibits good performance in strong parallel scaling tests. The new coupled surface and subsurface simulator significantly advance community simulation capability towards improving integrated hydrologic and biogeochemical understanding of complex systems such as watersheds and river corridors. Keywords: Surface flow, Integrated hydrological modeling, Boundary condition switching, Parallel computing

Wu, Runjian↗
DOE OSTI2022

COVID-19 Exposure Assessment Tool (CEAT): Exposure quantification based on ventilation, infection prevalence, group characteristics, and behavior

The coronavirus disease 2019 (COVID-19) Exposure Assessment Tool (CEAT) allows users to compare respiratory relative risk to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) for various scenarios, providing understanding of how combinations of protective measures affect risk. CEAT incorporates mechanistic, stochastic, and epidemiological factors including the (i) emission rate of virus, (ii) viral aerosol degradation and removal, (iii) duration of activity/exposure, (iv) inhalation rates, (v) ventilation rates (indoors/outdoors), (vi) volume of indoor space, (vii) filtration, (viii) mask use and effectiveness, (ix) distance between people (taking into account both near-field and far-field effects of proximity), (x) group size, (xi) current infection rates by variant, (xii) prevalence of infection and immunity in the community, (xiii) vaccination rates, and (xiv) implementation of COVID-19 testing procedures. CEAT applied to published studies of COVID-19 transmission events demonstrates the model’s accuracy. We also show how health and safety professionals at NASA Ames Research Center used CEAT to manage potential risks posed by SARS-CoV-2 exposures.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Launching a saliva-based SARS-CoV-2 surveillance testing program on a university campus

Regular surveillance testing of asymptomatic individuals for SARS-CoV-2 has been center to SARS-CoV-2 outbreak prevention on college and university campuses. Here we describe the voluntary saliva testing program instituted at the University of California, Berkeley during an early period of the SARS-CoV-2 pandemic in 2020. The program was administered as a research study ahead of clinical implementation, enabling us to launch surveillance testing while continuing to optimize the assay. Results of both the testing protocol itself and the study participants’ experience show how the program succeeded in providing routine, robust testing capable of contributing to outbreak prevention within a campus community and offer strategies for encouraging participation and a sense of civic responsibility.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Synthesis and Characterization of Superconductor Diodes

In the era of modern computing, quantum bits (or qubits) are extensively researched due to their ability to perform computations exponentially faster than classical computers. One promising method for synthesizing qubits on a macroscopic scale is through superconductor diodes (SDs). Unfortunately, SDs are currently limited by their dependence on extremely low temperatures (T ≈ 0K), which restricts their practical usability at larger scales. To address this limitation, researchers are exploring new materials and methods to identify superconductors with higher critical temperatures. My research at the Lawrence Livermore National Laboratory (LLNL) focuses on synthesizing and characterizing superconductor diodes to determine their efficiency for quantum computing applications. Bismuth thin films were synthesized with magnetron sputtering with separate thicknesses which provides information on methods to alter their resistivity. Bismuth was characterized as the topological insulator used in the diode, and its resistivity was measured using a standard four-point probe technique with 1 mA current. Bismuth (99.99% pure) was then purified in a tubular furnace at 400C to use within a Josephson junction as a topological insulator. Niobium and Tantalum Josephson junctions were then synthesized, and they were characterized using a lock-in amplifier four-point probe technique. Materials such as niobium and tantalum are used in high-entropy alloy research, which is a relatively new class of material that has little research within the superconductor diode community, yet the current research shows promise. We anticipate that testing high-entropy superconductors will reveal crucial factors, potentially leading to the development of high-temperature superconductors in the future.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A Parameter-masked Mock Data Challenge for Beyond-two-point Galaxy Clustering Statistics

The past few years have seen the emergence of a wide array of novel techniques for analyzing high-precision data from upcoming galaxy surveys, which aim to extend the statistical analysis of galaxy clustering data beyond the linear regime and the canonical two-point (2pt) statistics. We test and benchmark some of these new techniques in a community data challenge named “Beyond-2pt,” initiated during the Aspen 2022 Summer Program “Large-Scale Structure Cosmology beyond 2-Point Statistics,” whose first round of results we present here. The challenge data set consists of high-precision mock galaxy catalogs for clustering in real space, in redshift space, and on a light cone. Participants in the challenge have developed end-to-end pipelines to analyze mock catalogs and extract unknown (“masked”) cosmological parameters of the underlying ΛCDM models with their methods. The methods represented are density-split clustering, nearest neighbor statistics, BACCO power spectrum emulator, void statistics, LEFTfield field-level inference using effective field theory (EFT), and joint power spectrum and bispectrum analyses using both EFT and simulation-based inference. In this work, we review the results of the challenge, focusing on problems solved, lessons learned, and future research needed to perfect the emerging beyond-2pt approaches. The unbiased parameter recovery demonstrated in this challenge by multiple statistics and the associated modeling and inference frameworks supports the credibility of cosmology constraints from these methods. The challenge data set is publicly available, and we welcome future submissions from methods that are not yet represented.

Krause, Elisabeth [Univ. of Arizona, Tucson, AZ (U↗
DOE OSTI2024

Using containers to speed up development, to run integration tests and to teach about distributed systems

GlideinWMS is a workload manager provisioning resources for many experiments including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we’ll talk about what differentiates workspaces from other containers. We’ll describe our base system composed of three containers. A one-node cluster including a compute element and a batch system. A GlideinWMS Factory controlling pilot jobs. And a scheduler and Frontend, to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop and we’ll share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we’ll talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system also when offline. They simplified the training and onboarding of new team members and Summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco↗
DOE OSTI2025

Using Containers to Speed Up Development, to Run Integration Tests and to Teach About Distributed Systems

GlideinWMS is a workload manager provisioning resources for many experiments, including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development, we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we will talk about what differentiates workspaces from other containers. We will describe our base system, composed of three containers: a one-node cluster including a compute element and a batch system, a GlideinWMS Factory controlling pilot jobs, and a scheduler and Frontend to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop, and we will share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we will talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system even when offline. They simplified the training and onboarding of new team members and summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗