Search NASA⌕ Search

SEARCH · Search NASA

Results for “Containerization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Strategies to Deploy and Scale Deep Learning on the Summit Supercomputer

The rapid growth and wide applicability of Deep Learning (DL) frameworks poses challenges to computing centers which need to deploy and support the software, and also to domain scientists who have to keep up with the system environment and scale up scientific exploration through DL. We offer recommendations for deploying and scaling DL frameworks on the Summit supercomputer, currently atop the Top500 list, at the Oak Ridge National Laboratory Leadership Computing Facility (OLCF). We discuss DL software deployment in the form of containers, and compare performance of native-built frameworks and containerized deployment. Software containers show no noticeable negative performance impact and exhibit faster Python loading times and promise easier maintenance. To explore strategies for scaling up DL model training campaigns, we assess DL compute kernel performance, discuss and recommend I/O data formats and staging, and identify communication needs for scalable message exchange for DL runs at scale. We recommend that users take a step-wise tuning approach beginning with algorithmic kernel choice, node I/O configuration, and communications tuning as best-practice. We present baseline examples of scaling efficiency 87% for a DL run of ResNet50 running on 1024 nodes (6144 V100 GPUs).

Yin, Junqi↗

VAC: A Software Approach to Resilient SCADA Automation

To better secure critical infrastructure, especially power systems, this paper introduces a virtual SCADA automation controller. The automation controller is a gateway into a power subsystem, making it a valuable target for cyber-attacks that could cut it off from the control center and cause a loss of view and control. To prevent this, the Virtual Automation Controller (VAC) is a backup device that mirrors the capabilities of the physical controller. It can communicate via Modbus and DNP3 and is containerized so it can be deployed on a variety of platforms. Furthermore, it utilizes software-defined networking to quickly disconnect a failed automation controller and preserve its state for forensics. The VAC gives system operators time to replace the failed controller and prevents dangerous and costly damage to power systems. The VAC is compared against the SEL 3505-3 RTAC and shown to have the necessary features to act as a failover controller.

Johnson, Jordan↗

Virtual Framework for Development and Testing of Federation Software Stack

Softwarization of networked infrastructures combined with containerization of codes promises unprecedented computing capabilities distributed across the federations of computing systems and physical instruments. The development and testing of a software stack that implements these capabilities over an expensive physical production infrastructure is not cost-effective, and in the early stages, may potentially cause service disruptions. To address these aspects, we develop the Virtual Federated Science Instrument Environment (VFSIE), a digital twin of the physical infrastructure that emulates a multi-site federation. Each federated site is emulated using containers and virtual hosts that are connected over local-area networks, and the sites, in turn, are connected over an emulated wide-area network. We describe the framework design and implementation details. We also illustrate its application by emulating a federation of four laboratories that use Jupyter Notebook for computations and the EPICS software system for instrument control.

Al Najjar, Anees↗

Deciphering Discrepancies: A Comparative Analysis of Docker Image Security

As the use of microservices continues to grow and become a foundational approach to architecting software solutions, ensuring the security of microservices is paramount. Docker images have emerged as the predominant solution to containerize microservices–and thus, Docker images are becoming a large attack surface. Thus, reducing vulnerabilities in Docker images will reduce microservice cyberattacks. A common way to find vulnerabilities in Docker images employs static analysis tools like Trivy and Grype. However, these tools frequently generate disparate vulnerability reports when analyzing the same Docker image, thus causing uncertainty in tool selection. We collected 927 Docker images, analyzed them with Trivy and Grype, and compared the vulnerabilities reported in each image. Among the 865 images found to have vulnerabilities, Trivy and Grype disagreed on both the number of vulnerabilities and the vulnerability IDs found therein. Since both tools interface with external vulnerability databases, some discrepancies can be attributed to how the tools interface with these external resources. The external vulnerability databases partially overlap and frequently contradict one another, thereby creating challenges for static analysis tool developers and end users alike. This New Ideas and Emerging Results (NIER) study contains new and critical information that practitioners need for selecting and using static analysis tools–given that increases in the use of Docker technologies means increases in the size of the attack surfaces.

Boles, Brittany [Montana State University]↗

shifter

Shifter enables application virtualization or containerization in large-scale HPC environments. This technology decreases the effort to port applications to or between HPC sites while increasing reproducibility and scientific productivity. Shifter works by converting application/container images to a common format, and then leverages basic Linux functionality to make that image available to batch jobs run in the HPC environment.

Jacobsen, Douglas↗

Gene Tuples ArraNGed in overLapping Elements

GENTANGLE is a high performance containerized pipeline for the computational design of two overlapping genes translated in different reading frames of the genome that can be used to design and test gene entanglements for new microbial engineering projects using arbitrary sets of user specified gene pairs.

Leonard, SeanP↗

Productivity frameworks for HPC

Productivity Frameworks for HPC will include container recipes, build recipes, continuous integration scripts, and other software aimed at testing the portability of containerized HPC software across platforms and interconnects. In particular, it tests the utility of bind-mounting at the MPI layer (rather than the underlying fabric layer) to leverage a standardized protocol and avoid various technical debt and vendor lock-in. Since MPIs are often ABI-incompatible, trampolines such as the open-source Wi4MPI will be tested when such cases arise.

Hanford, Nathan↗

Platform for Integrated Land use And Transportation Experiments and Simulation (PILATES) v1.0

PILATES allows for flexibly and at-scale coupling of multiple models to allow for multi-scale and multi-resolution simulation of regional-scale transport networks. In particular, it couples the MATSim-derived transportation modeling framework for Behavior, Energy, Autonomy and Mobility (BEAM) with other models operating at different time scales. Rather than tightly coupling supply and demand models using shared agents and memory within the same software process, PILATES orchestrates different model runs in a containerized framework. This structure requires passing information from the demand models to BEAM in the format of a synthetic population and agent plans, and from BEAM to the demand models in terms or origin/destination tables (also known as "skims"). This allows it to take advantage of the behavioral sophistication of existing activity-based models as well as the reinforcement learning structure of MATSim replanning and adopted by BEAM, in a way that requires minimal changes to existing models. It also takes advantage of the computational performance of BEAM, which allows for simulations with millions of agents to complete in reasonable time as well as allowing for detailed mechanistic simulation of the operation of on-demand modes.

Needell, Zachary↗

Janus v1.0

Janus provides a software framework for lightweight container management and orchestration. It's primary use cases are around deploying containerized services for high-performance data movement needs. Thus, Janus differentiates itself from systems like Kubernetes by tailoring the deployment of containers around network, storage, and host tuning optimizations. Janus uses the concept of profiles to capture repeatable deployment patterns and applies them to container execution across one or more endpoints. A Janus Agent component provides remote host tuning and monitoring capabilities.

Essiari, Abdelilah [Lawrence Berkeley National Lab↗

AQDrop Quantum Service (AQDrop) v1.0

AQDrop is a job management system designed to streamline access to the Advanced Quantum Testbed (AQT) at NERSC (National Energy Research Scientific Computing Center). It serves as a centralized middleware layer between researchers and quantum processing hardware. Key Features: AQDrop provides a FastAPI-based server backed by PostgreSQL for job submission, queue management, and role-based access control (members, operators, and administrators). Users submit Qiskit circuits via JSON payloads, which are queued, dispatched to the QPU through the Qubic API, and returned as measurement counts. A Python client library and web dashboard round out the interface options. Primary Use: Researchers submit quantum circuit jobs from a laptop or login node; an operator client executes those jobs on the AQT's physical QPU and returns results — all coordinated through the central API. Advantages: Compared to ad-hoc or direct hardware access, AQDrop adds structured queue management, auditable job-status tracking and OAuth2 authentication — reducing scheduling conflicts and unauthorized access. Its containerized deployment also improves reproducibility and scalability. Overall, AQDrop functions as a purpose-built quantum job broker tailored to NERSC's specific hardware and institutional access requirements.

Caplinger, Evan [Lawrence Berkeley National Labora↗

If We Build Them, They Will Run: Automated HPC Apps Deployment and Profiling with eBPF in Cloud

The high performance computing (HPC) community is in a period of transition. The rise of AI/ML coupled with a changing landscape of resources deems portability a new metric of performance, and methods to move between on-premises and cloud environments and assess compatibility are paramount. Here we design and test a strategy for bridging the gap between traditional HPC and Kubernetes environments – first containerizing applications, providing automated orchestration to run studies, and packaging the setup with automated means to assess performance using low overhead eXtended Berkeley Packet Filter (eBPF) programs. We first assess different designs for eBPF collection, demonstrating a tradeoff between number of programs deployed on a node and overhead added. We develop 5 low overhead eBPF programs that combine with streaming ML models to assess CPU, futex, TCP, shared memory, and file access across four different builds of an HPC application for CPU and GPU. We use eBPF data to generate insights into the possible underlying etiology of scaling issues. We then assess compatibility of a well-known benchmark, HPCG, across matrices of micro-architectures and optimization levels (217 containers across 24 instance types and over 7500 runs). We provide to the community 30 applications to deploy in our automated setup and perform a scaling study from 4 to a maximum of 256 nodes for both CPU and GPU applications. Finally, we use our gained knowledge about performance to generate compatibility artifacts that are used by a newly developed Kubernetes controller to intelligently select instance type based on optimizing a figure of merit. Along with insights to scaling in this environment with a collection of applications and templates to work from, we provide an overall strategy for approaching HPC application deployment and image selection based on compatibility in cloud.

Computer science↗

AmeriFlux US-HB3 Hobcaw Barony Longleaf Pine Restoration

This is the AmeriFlux version of the carbon flux data for the site US-HB3 Hobcaw Barony Longleaf Pine Restoration. Site Description - A mixed forest that was clearcut, herbicided and planted in containerized longleaf pine seedlings

Forsythe, Jeremy D.↗

AmeriFlux FLUXNET-1F US-HB3 Hobcaw Barony Longleaf Pine Restoration

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-HB3 Hobcaw Barony Longleaf Pine Restoration. This is the FLUXNET version of the carbon flux data for the site US-HB3 Hobcaw Barony Longleaf Pine Restoration produced by applying the standard ONEFlux (1F) software. Site Description - A mixed forest that was clearcut, herbicided and planted in containerized longleaf pine seedlings

Forsythe, Jeremy D.↗

Chemical Recommender System: Replacement Suggestions for Small Molecules

The Chemical Recommender System (CRS) is an open-source, high-performance toolkit that enables real-time similarity searches across the complete PubChem database (over 50 million molecules) using commodity hardware. The CRS addresses critical limitations in existing chemical informatics platforms through a novel vector database infrastructure, extensible model integration capabilities, and complete algorithmic transparency. The system implements a vector database deployment with partitioned indexing that achieves a ~60x speedup over traditional approaches. A containerized model integration framework allows researchers to seamlessly incorporate custom predictive models into the full-scale search and scoring pipeline, while complete configurability of search parameters, filtering logic, and scoring functions provides capabilities not available in existing black-box solutions. Beyond structural similarity, the CRS integrates OPERA QSAR models for thermophysical and toxicity predictions, RDKit synthetic accessibility scoring, and user-defined models to compute weighted final replacement scores. The complete system is accessible through an interactive web application supporting real-time progress monitoring, post-processing score re-weighting, automated PDF reporting, and batch processing capabilities.

Nair, Parthiv Anand [Sandia National Laboratories ↗

Seaborne Delivery Interdiction of Weapons of Mass Destruction (WMD)

Over the next 10-20 years, the probability of a terrorist attack using a weapon of mass destruction (WMD) on the United States is projected to increase. At some point over the next few decades, it may be inevitable that a terrorist group will have access to a WMD. The economic and social impact of an attack using a WMD anywhere in the world would be catastrophic. For weapons developed overseas, the routes of entry are air and sea with the maritime vector as the most porous. Providing a system to track, perform a risk assessment and inspect all inbound marine traffic before it reaches US coastal cities thereby mitigating the threat has long been a goal for our government. The challenge is to do so effectively without crippling the US economy. The Portunus Project addresses only the maritime threat and builds on a robust maritime domain awareness capability. It is a process to develop the technologies, policies and practices that will enable the US to establish a waypoint for the inspection of international marine traffic, screen 100% of containerized and bulk cargo prior to entry into the US if deemed necessary, provide a palatable economic model for transshipping, grow the US economy, and improve US environmental quality. The implementation strategy is based on security risk, and the political and economic constraints of implementation. This article is meant to provide a basic understanding of how and why this may be accomplished.

99 GENERAL AND MISCELLANEOUS↗

Mitigation of Hydrogen Gas Generation from the Reaction of Uranium Metal with Water in K Basin Sludge and Sludge Waste Forms

Prior laboratory testing identified sodium nitrate and nitrite to be the most promising agents to minimize hydrogen generation from uranium metal aqueous corrosion in Hanford Site K Basin sludge. Of the two, nitrate was determined to be better because of higher chemical capacity, lower toxicity, more reliable efficacy, and fewer side reactions than nitrite. The present lab tests were run to determine if nitrate’s beneficial effects to lower H2 generation in simulated and genuine sludge continued for simulated sludge mixed with agents to immobilize water to help meet the Waste Isolation Pilot Plant (WIPP) waste acceptance drainable liquid criterion. Tests were run at ~60°C, 80°C, and 95°C using near spherical high-purity uranium metal beads and simulated sludge to emulate uranium-rich KW containerized sludge currently residing in engineered containers KW-210 and KW-220. Immobilization agents tested were Portland cement (PC), a commercial blend of PC with sepiolite clay (Aquaset II H), granulated sepiolite clay (Aquaset II G), and sepiolite clay powder (Aquaset II). In all cases except tests with Aquaset II G, the simulated sludge was mixed intimately with the immobilization agent before testing commenced. For the granulated Aquaset II G clay was added to the top of the settled sludge/solution mixture according to manufacturer application directions. The gas volumes and compositions, uranium metal corrosion mass losses, and nitrite, ammonia, and hydroxide concentrations in the interstitial solutions were measured. Uranium metal corrosion rates were compared with rates forecast from the known uranium metal anoxic water corrosion rate law. The ratios of the forecast to the observed rates were calculated to find the corrosion rate attenuation factors. Hydrogen quantities also were measured and compared with quantities expected based on non-attenuated H2 generation at the full forecast anoxic corrosion rate to arrive at H2 attenuation factors. The uranium metal corrosion rates in water alone and in simulated sludge were near or slightly below the metal-in-water rate while nitrate-free sludge/Aquaset II decreased rates by about a factor of 3. Addition of 1 M nitrate to simulated sludge decreased the corrosion rate by a factor of ~5 while 1 M nitrate in sludge/Aquaset II mixtures decreased the corrosion rate by ~2.5 compared with the nitrate-free analogues. Mixtures of simulated sludge with Aquaset II treated with 1 M nitrate had uranium corrosion rates about a factor of 8 to 10 lower than the water-only rate law. Nitrate was found to provide substantial hydrogen mitigation for immobilized simulant sludge waste forms containing Aquaset II or Aquaset II G clay. Hydrogen attenuation factors of 1000 or greater were determined at 60°C for sludge-clay mixtures at 1 M nitrate. Hydrogen mitigation for tests with PC and Aquaset II H (which contains PC) were inconclusive because of suspected failure to overcome induction times and fully enter into anoxic corrosion. Lessening of hydrogen attenuation at ~80°C and ~95°C for simulated sludge and Aquaset II was observed with attenuation factors around 100 to 200 at 1 M nitrate. Valuable additional information has been obtained on the ability of nitrate to attenuate hydrogen gas generation from solution, simulant K Basin sludge, and simulant sludge with immobilization agents. Details on characteristics of the associated reactions were also obtained. The present testing confirms prior work which indicates that nitrate is an effective agent to attenuate hydrogen from uranium metal corrosion in water and simulated K Basin sludge to show that it is also effective in potential candidate solidified K Basin waste forms for WIPP disposal. The hydrogen mitigation afforded by nitrate appears to be sufficient to meet the hydrogen generation limits for shipping various sludge waste streams based on uranium metal concentrations and assumed waste form loadings.

08 HYDROGEN↗

Options assessment report: Treatment of nitrate salt waste at Los Alamos National Laboratory

This report documents the methodology used to select a method of treatment for the remediated nitrate salt (RNS) and unremediated nitrate salt (UNS) waste containers at Los Alamos National Laboratory (LANL). The method selected should treat the containerized waste in a manner that renders the waste safe and suitable for transport and final disposal in the Waste Isolation Pilot Plant (WIPP) repository, under specifications listed in the WIPP Waste Acceptance Criteria (DOE/CBFO, 2013). LANL recognized that the results must be thoroughly vetted with the New Mexico Environment Department (NMED) and the a modification to the LANL Hazardous Waste Facility Permit is a necessary step before implementation of this or any treatment option. Likewise, facility readiness and safety basis approvals must be received from the Department of Energy (DOE). This report presents LANL's preferred option, and the documentation of the process for reaching the recommended treatment option for RNS and UNS waste, and is presented for consideration by NMED and DOE.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗