Search NASA⌕ Search

SEARCH · Search NASA

Results for “Containerization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Creating Apptainer Workflows with Docker-Compose-like Utilities

Creating Apptainer Workflows with Docker-Compose-like Utilities In this presentation, I will explore the utilization of a tool called process-compose, inspired by docker-compose, to create Apptainer-based services. This approach allows for easy deployment and management of fully containerized applications on High Performance Computing (HPC) systems without requiring elevated privileges. Benefits to the Ecosystem: By incorporating process-compose and Apptainer, I aim to address several key challenges in the HPC ecosystem: Simplified Workflow Management: Process-compose provides a user-friendly interface for defining and managing complex containerized application services, reducing the setup time and lowering the barrier to entry for new users. Enhanced Portability: Apptainer ensures that containerized applications can run consistently across different HPC environments, promoting greater portability and reducing compatibility issues. Process-compose is also a single binary that does not need to be installed by admin level users. Community Driven Solutions: This approach aligns with the goals of the High Performance Software Foundation (HPSF) to advance community-driven solutions. By sharing our experiences and insights, I hope to foster collaboration and innovation within the HPC community. Increased Productivity: The combination of process-compose and Apptainer streamlines the serve deployment process, allowing researchers and developers to focus more on their scientific work rather than the intricacies of system or service administration. Through this presentation, attendees will gain valuable insights into the practical implementation of containerized workflows on HPC systems, learn about the benefits of using process-compose and Apptainer, and understand how these tools can contribute to a more efficient HPC ecosystem.

97 - MATHEMATICS AND COMPUTING↗

The HPC Container Experience on the Summit Supercomputer

Containers are seeing widespread use in the world of High Performance Computing, with many HPC Centers either providing their own containerization solution or adopting existing ones like Singularity and Apptainer. The demand for containerization options come from users who want to take advantage of the portability and reproducibility containers can provide, as well as being able to build and use applications that are only distributed in container form or are otherwise unsuited to natively run in an HPC environment. The users served by the Oak Ridge Leadership Computing Facility are no exception. We go over the past and current containerization offerings at the Oak Ridge Leadership Computing Facility, mainly focusing on the Summit supercomputer. We arrive at using a combination of Podman and Singularity to allow users to build and run containers directly on Summit, without requiring external resources or hardware for any step of the process. We look at a couple of projects running on Summit that greatly benefited from being able to use containers on Summit. And we compare benchmarks running natively and in containers on Summit at different scales, observing minimal performance difference and consistent behavior across all tests.

Abraham, Subil↗

Effects of Time, Heat, and Oxygen on K Basin Sludge Agglomeration, Strength, and Solids Volume

Sludge disposition will be managed in two phases under the K Basin Sludge Treatment Project. The first phase is to retrieve the sludge that currently resides in engineered containers in the K West (KW) Basin pool at ~10 to 18°C. The second phase is to retrieve the sludge from interim storage in the sludge transport and storage containers (STSCs) and treat and package it in preparation for eventual shipment to the Waste Isolation Pilot Plant. The work described in this report was conducted to gain insight into how sludge may change during long-term containerized storage in the STSCs. To accelerate potential physical and chemical changes, the tests were performed at temperatures and oxygen partial pressures significantly greater than those expected in the T Plant canyon cells where the STSCs will be stored. Tests were conducted to determine the effects of 50°C oxygenated water exposure on settled quiescent uraninite (UO2) slurry and a full simulant of KW containerized sludge to determine the effects of oxygen and heat on the composition and mechanical properties of sludge. Shear-strength measurements by vane rheometry also were conducted for UO2 slurry, mixtures of UO2 and metaschoepite (UO3•2H2O), and for simulated KW containerized sludge. The results from these tests and related previous tests are compared to determine whether the settled solids in the K Basin sludge materials change in volume because of oxidation of UO2 by dissolved atmospheric oxygen to form metaschoepite. The test results also are compared to determine if heating or other factors alter sludge volumes and to determine the effects of sludge composition and settling times on sludge shear strength. It has been estimated that the sludge volume will increase with time because of a uranium metal → uraninite → metaschoepite oxidation sequence. This increase could increase the number of containers required for storage and increase overall costs of sludge management activities. However, the volume might decrease because of decreases in the water-volume fraction caused by sludge solid reactions, compaction, or intergrowth and recrystallization of metaschoepite. In that case, fewer STSCs may be needed, but the shear strength would increase, and this could challenge recovery by water jet erosion and require more aggressive retrieval methods. Overall, the tests described herein indicate that the settled solids volume remains the same or decreases with time. The only case for which the sludge solids volumes increase with time is for the expansion factor attendant upon the anoxic corrosion of uranium metal to produce UO2 and subsequent reaction with oxygen to form equimolar UO2.25 and UO3•2H2O.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Using Pilot Jobs and CernVM File System for Simplified Use of Containers and Software Distribution

High Energy Physics (HEP) experiments entail an abundance of computing resources, i.e. sites, to run simulations and analyses by processing data. This requirement is fulfilled by local batch farms, grid sites, private/commercial clouds, and supercomputing centers via High Throughput Computing (HTC). The growing needs of such experiments and resources being prone to trends of heterogeneity make it difficult for physicists to handle these resources directly. Additionally, HEP collaborations heavily rely on data and software releases, typically in the order of tens of gigabytes, while conducting simulations and analyses. Hence, aspects of scalability, reliability, and maintenance become crucial with regards to the distribution of the necessary data and software stack. The GlideinWMS [4] framework helps with the resource management problem by using pilot jobs, aka Glideins, to provision reliable elastic virtual clusters. Glideins are submitted to unreliable heterogeneous resources which are validated and customized by the Glideins to make the worker nodes available for end-user job execution. On the other hand, the CernVM File System (CernVM-FS or CVMFS) [1] helps with data distribution. It is a write-once, read-everywhere filesystem used to deploy scientific software to thousands of nodes on a worldwide distributed computing infrastructure. CVMFS is based on the Hyper Text Transfer Protocol and has been widely used within the particle physics community for (1) distributing experiment software and data such as calibrations, and (2) facilitating containerization by efficiently hosting container images along with providing containerization software, especially Singularity [3] GlideinWMS relies on CVMFS installed locally on the computing resources to satisfy the experiments' software needs. This requires system administrators' effort to install and maintain CVMFS at the sites and limits the use of sites, especially HPC resources, that do not have CVMFS installed. This poster presents a solution, taking advantage of Glideins to provide CVMFS at most sites without the need for a local installation. Doing so expands the pool of resources available for HEP experiments and reduces the effort of system administrators for current resources. Additionally, the proposed solution allows GlideinWMS to also start Singularity [3], a containerization software that can run unprivileged, on sites where neither CVMFS nor Singularity are available, including HPC sites. The benefits provided by this solution are: (1) lower overhead for site administrators in that they have less software to install, (2) an expanded pool of resources that run user jobs with easy access to software and data provided by CVMFS, thus making life easier for the scientists, and (3) improved flexibility to use HPC resources by enabling GlideinWMS pilot jobs to support HPC sites.

Urs, Namratha↗

Y-12 ARRA Project Listed Waste Determination Old Salvage Yard Project

The Old Salvage Yard received scrap metal from various plant operations, store liquid hazardous wastes, and de-headed and crushed drums from the early 1950s until October 1999. The acceptance of non-containerized scrap metal for outdoor storage was routine until 1995, when scrap metal received at the site was placed in containers. All scrap metal (containerized and non containerized) stored and handled at the OSY is considered non-classified. There are 5 scrap metal waste piles and approximately 1,100 waste containers, many stacked 2-high within the confines of the OSY.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Growth of longleaf and loblolly pine planted on South Carolina Sandhill sites.

Performance of longleaf (Pinus palustris Mill.) and loblolly pine (P. taeda L.) were compared 15–19 years after outplanting on 10 different sites in the sandhillsof South Carolina. The study was established from 1988 to 1992 with bareroot seedlings artificially inoculated with Pisolithus tinctorius (Pt) or naturally inoculated with mycorrhizae in the nursery. A containerized longleaf pine treatment with and without Pt inoculation was added to two sites in 1992. Effects of the Pt nursery treatment were mixed, with a decrease in survival of bareroot longleaf pine on two sites and an increase in survival on another site. The containerized longleaf pine treatment substantially increased survival, which led to greater volume compared with bareroot longleaf pine. Loblolly pine yielded more volume than longleaf pine on all sites but one, where survival was negatively affected by fire. Depth of sandy surface horizon affected mean annual height growth of both loblolly and longleaf pine. Height growth per year decreased with an increase in sand depth for both species. Multiple regression analysis of volume growth(ft3/ac per year) for both species indicated a strong relationship to depth of sandy soil and survival. After 15–19 years, loblolly pine has been more productive than longleaf pine, although longleaf pine productivity may be equal to or greater than that of loblolly pine on the soils with the deepest sandy surface layers over longer rotations.

60 APPLIED LIFE SCIENCES↗

Decomprolute is a benchmarking platform designed for multiomics-based tumor deconvolution

Tumor deconvolution is a reliable way to disentangle the diverse cell types that comprise solid tumors. To date, however, both the algorithms developed to deconvolve tumor samples, and the gold standard datasets used to assess the algorithms are geared toward the analysis of gene expression (e.g., RNA-seq) rather than protein levels in tumor cells. While gene expression is less expensive to measure, protein levels provide a more accurate view of immune markers. To facilitate the development as well as improve the reproducibility and reusability of multi-omic deconvolution algorithms, we introduce Decomprolute, a Common Workflow Language framework that leverages containerization to compare tumor deconvolution algorithms across multiomic data sets. Decomprolute incorporates the large-scale multiomic data sets produced by the Clinical Proteomic Tumor Analysis Consortium (CPTAC), which include matched mRNA expression and proteomic data from thousands of tumors across multiple cancer types to build a fully open-source, containerized proteogenomic tumor deconvolution benchmarking platform. The platform consists of modular architecture and it comes with well-defined input and output formats at each module. As a result, it is robust and extendable easily with additional algorithms or analyses. The platform is available for access and use at http://pnnl-compbio.github.io/decomprolute.

60 APPLIED LIFE SCIENCES↗

Hydra: An AI-Based Framework for Interpretable and Portable Data Quality Monitoring

Hydra is an advanced framework designed for training and managing AI models for near real time data quality monitoring at Jefferson Lab. Deployed in all four experimental halls, Hydra has analyzed over 2 million images and has extended its capabilities to offline monitoring and validation. Hydra utilizes computer vision to continually analyze sets of images of monitoring plots generated 24/7 during experiments. Generally, these sets of images are produced at a rate and quantity that is exceedingly difficult for shift crews to effectively monitor. Significant effort has been devoted to enhancing Hydra’s user interface, to ensure that it provides clear, actionable insights for shift workers and other users. Gradient Weighted Class Activation Maps (GradCAM) provide added interpretability, allowing users to visualize important regions of the image for classification. Hydra has been containerized to enable the creation of portable demos and seamless integration with container-based technologies such as Kubernetes and Docker. With the user interface enhancements and containerization, Hydra can be rapidly deployed for new use cases and experiments. This talk will describe the Hydra framework, its user interface and experience, and the challenges inherent in its design and deployment.

Britton, Thomas [Thomas Jefferson National Acceler↗

Osprey Framework v0.2.2

The Alpha Berkeley Framework is a software architecture for building agentic AI systems that coordinate multi-step workflows in scientific and industrial environments. It is based on a plan-first orchestration model, where natural language requests are translated into execution plans with explicit dependencies and optional human approval. The framework includes capability classification, which selects relevant tools on a per-task basis to keep orchestration efficient as the number of available tools grows. It incorporates task extraction methods that compress conversational context and integrate external resources such as databases, APIs, and knowledge bases into structured, machine-readable tasks. Execution is supported by modular services with checkpointing, artifact management, and error handling, allowing workflows to be paused, inspected, and resumed. The system is designed for deployment in production environments, supporting both local and containerized execution as well as integration with HPC clusters. Interfaces include command-line tools, browser-based workflows, and containerized services. The framework has been demonstrated in tutorial examples and deployed at the Advanced Light Source, where it coordinates accelerator control and analysis workflows.

Hellert, Thorsten [Lawrence Berkeley National Labo↗

Accelerating Control Systems with GitOps: A Path to Automation and Reliability

GitOps is a foundational approach for modernizing infrastructure by leveraging Git as the single source of truth for declarative configurations. The poster explores how GitOps transforms traditional control system infrastructure, services and applications by enabling fully automated, auditable, and version-controlled infrastructure management. Cloud-native and containerized environments are shifting the ecosystem not only in the IT industry but also within the computational science field, as is the case of CERN and Diamond Light Source among other Accelerator/Science facilities which are slowly shifting towards modern software and infrastructure paradigms. The ACORN project, which aims to modernize Fermilab’s control system infrastructure and software is implementing proven best-practices and cutting-edge technology standards including GitOps, containerization, infrastructure as code and modern data pipelines for control system data acquisition and the inclusion of AI/ML in our accelerator complex.

Gonzalez, M. [Fermilab]↗

Transuranic Waste Facility: Evaluation of Material-at-Risk Limits

The purpose of this analysis was to provide an evaluation and justification of the differences in the safety-basis parameters of Area G and the proposed TRU Waste Facility (TWF) in response to a request from the Los Alamos Field Office. Many of the differences in safety parameters stem from physical attributes such as facility location, size, and updated safety-basis requirements, etc. However, the primary safety-basis parameter that LANL and the Los Alamos Field Office can control for the proposed TWF is the required MAR limit. Based on the following analysis, LANL has proposed to reduce the overall facility MAR from 30,000 PE Ci to 21,400 PE Ci, and the waste storage buildings from 4,550 PE Ci to 3,200 PE Ci. The recommendation balances program requirements, operational considerations, facility construction cost, and container costs. To implement the reduced MAR strategy above, the Los Alamos Field Office and LANL will need to work with WIPP to ensure two characterization/shipment campaigns are scheduled each year. The analysis in this document included a review of historical trends and potential future scenarios in activity for enduring waste containers to define the expected normal operating range. The first part of the MAR analysis resulted in a newly defined range of activity of 10.5-18.0 PE Ci per DE2= expected for the design life of the new TWF. However, for accident scenario analysis, containers will use the WIPP WAC limits because there are no other individual container controls. Specifically, accident scenarios involving less than the building MAR will use the 80-PE Ci WIPP-WAC limit for drums. The accident analyses are intended to bound the potential impacts, and are not intended to be based on normal operational ranges. The Field Office also requested that LANL evaluate a potential reduction of the waste storage building MAR Limit by a factor of two to three. LANL used the newly defined MAR range of 10.5-18.0 PE Ci/DE to define upper and lower MAR boundary requirements using three containerization scenarios. The result of the analysis showed that the most probable scenario of future operations that balances costs, drum packaging efficiency, and shipment efficiency will routinely require the use of one-third to two-thirds of the MAR limit for each building. This result, paired with scenarios that could potentially provide short-term MAR increases, demonstrates that the MAR cannot be reduced by a factor as large as two to three, but can be reduced from 4,550 PE Ci to 3,200 PE Ci for waste storage buildings (a reduction of 30%). The TWF PDSA submittal contained combustibility values for enduring waste that appeared relatively large compared to Area G. The analysis provided the basis for the initial combustibility values established in the PDSA. Although the recent data provided combustibility values that were much lower than the PDSA assumptions (27% versus 80% in PDSA), the analysis shows that there is variability in combustible loading over time. For safety-basis accident scenarios, the material composition distribution for waste containers will be included in the MAR requirement by assuming all waste is combustible instead of applying a control for combustible loading. For operations and programs, it is better to assume 100% combustibles and maintain flexibility for waste generator containerization rather than to maintain a requirement for administrative controls of combustible loading. Controlling MAR through administrative controls is difficult for both the generator and waste management operations.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Distributed Resources for the Earth System Grid Advanced Management (DREAM)

The DREAM project was funded more than 3 years ago to design and implement a next-generation ESGF (Earth System Grid Federation) architecture which would be suitable for managing and accessing data and services resources on a distributed and scalable environment. In particular, the project intended to focus on the computing and visualization capabilities of the stack, which at the time were rather primitive. At the beginning, the team had the general notion that a better ESGF architecture could be built by modularizing each component, and redefining its interaction with other components by defining and exposing a well defined API. Although this was still the high level principle that guided the work, the DREAM project was able to accomplish its goals by leveraging new practices in IT that started just about 3 or 4 years ago: the advent of containerization technologies (specifically, Docker), the development of frameworks to manage containers at scale (Docker Swarm and Kubernetes), and their application to the commercial Cloud. Thanks to these new technologies, DREAM was able to improve the ESGF architecture (including its computing and visualization services) to a level of deployability and scalability beyond the original expectations. Overall, during its three-year lifespan, DREAM has undertaken innovative research work and prototyping: many of its solutions (the new containerized architecture, the Visus visualization engine, the Solr Cloud based search service) were handed over to the ESGF collaboration, which will make them operational and use them as their future software basis.

42 ENGINEERING↗

VA EDH Advanced Software Pipeline Framework Report: Enhancing Automation and Scalability

The VA Environmental Determinants of Health (EDH) Advanced Software Pipeline Framework is designed to enhance the efficiency, scalability, and security of geospatial data processing workflows. This framework integrates modern data orchestration and containerization technologies, including Prefect for workflow automation, Docker for containerization, and PostgreSQL/PostGIS for geospatial data storage and analysis. It ensures standardized, reproducible, and automated data processing, supporting VA objectives related to substance use risk assessment and recovery research. The pipeline addresses key scalability and performance challenges through horizontal and vertical scaling, high-performance computing (HPC) integration, parallel processing, task caching, and dynamic resource allocation. These optimizations improve throughput and reduce latency, allowing the system to efficiently manage large and complex datasets. Additionally, security and compliance measures—such as data encryption (SSL), Role-Based Access Control (RBAC), and adherence to GDPR and HIPAA standards—safeguard sensitive information throughout data transmission and storage. A key implementation of this framework includes the automation of shelter list geolocation workflows, ensuring that up-to-date data is readily available for VA decision-making. Lessons learned from this project include the transition from in-memory processing to incremental storage writes, improving resource management and reliability. Future enhancements aim to expand automation, integrate AI-driven anomaly detection, and incorporate high-performance computing resources. This framework provides a scalable, secure, and adaptable solution for managing geospatial datasets, reinforcing the VA’s ability to support clinical and strategic initiatives through data-driven decision-making.

97 MATHEMATICS AND COMPUTING↗

An Evaluation of Long-Term Performance of Liner Systems for Low-Level Waste Disposal Facilities

Traditional liner systems consisting of a geosynthetic membrane underlying a waste disposal facility coupled with a leachate collection system have been proposed as a means of containing releases of low-level radioactive waste within the confines of the disposal facility and thereby eliminating migration of radionuclides into the vadose zone and groundwater. However, this type of hydraulic containment liner system is only effective as long as the leachate collection system remains functional or an overlying cover limits the total infiltration to the volumetric pore space of the disposal system. If either the leachate collection system fails, or the overlying cover becomes less effective during the 1,000’s of years of facility lifetime, the liner may fill with water and release contaminated water in a preferential or focused manner. If the height of the liner extends above the waste, the waste will become submerged which could increase the release rate and concentration of the leachate. If the liner extends near land surface, there is the potential for contamination reaching land surface creating a direct exposure pathway. Alternative protective liner systems can be engineered that eliminate radionuclide releases to the vadose zone during operations and minimizing long term migration of radionuclides from the disposal facility into the vadose zone and aquifer. Non-traditional systems include waste containerization in steel or composite materials. This type of system would promote drainage of clean infiltrating water through the facility without contacting the waste. Other alternatives include geochemical barriers designed to transmit water while adsorbing radionuclides beneath the facility. Facility performance for a hypothetical disposal facility has been compared for the hydraulic and steel containerization liner alternatives. Results were compared in terms of meeting the DOE Order 435.1 low-level waste performance objective of 25 mrem/yr all-pathways dose during the 1) institutional control period (0-100 years), compliance period (0-1000 years) and post-compliance period (>1000 years). Evaluation of the all pathway dose included the dose from ingestion and irrigation of contaminated groundwater extracted from a well 100 meters downgradient, in addition to the dose received from direct contact of radionuclides deposited near the surface resulting from facility overflow. Depending on the disposal facility radionuclide inventory, facility design, cover performance, and the location and environment where the facility is situated, the dose from exposure via direct contact of near surface deposited radionuclides can be much greater than the dose received via transport to the groundwater and subsequent ingestion.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Virtual Framework for Science Federations with Instruments Access and Control

Experimental science workflows require federations of geographically dispersed science instruments and computing systems connected over a wide-area network. We develop a Virtual Infrastructure Twin (VIT) framework, which is a digital twin of the physical infrastructure that utilizes network virtualization and containerization technologies to support the development and testing of science workflow codes. Using VIT, we illustrate the access to instruments via EPICS system and the orchestration of containerized computations across federation computing systems. We also present a machine learning method to convert VIT throughput measurements to closely match the corresponding physical testbed measurements.

Rao, Nageswara↗