Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cluster Computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Maskman

SAND2025-04369O Maskman is a user-friendly tool designed to create hex masks, which are essential for optimizing application performance in high-performance computing environments. By converting a list of integers into binary and then hex masks, Maskman simplifies the process of setting application affinity. This ensures that software runs efficiently on specific nodes within a computing cluster. Ideal for researchers and developers, Maskman streamlines the preparation of inputs for HPC schedulers, enhancing resource management and improving overall system performance. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Pase, Douglas [Sandia National Lab. (SNL-CA), Live↗
DOE OSTI2019

SEPATH: benchmarking the search for pathogens in human tissue whole genome sequence data leads to template pipelines

Background: Human tissue is increasingly being whole genome sequenced as we transition into an era of genomic medicine. With this arises the potential to detect sequences originating from microorganisms, including pathogens amid the plethora of human sequencing reads. In cancer research, the tumorigenic ability of pathogens is being recognized, for example, Helicobacter pylori and human papillomavirus in the cases of gastric non-cardia and cervical carcinomas, respectively. As of yet, no benchmark has been carried out on the performance of computational approaches for bacterial and viral detection within host-dominated sequence data. Results: We present the results of benchmarking over 70 distinct combinations of tools and parameters on 100 simulated cancer datasets spiked with realistic proportions of bacteria. mOTUs2 and Kraken are the highest performing individual tools achieving median genus-level F1 scores of 0.90 and 0.91, respectively. mOTUs2 demonstrates a high performance in estimating bacterial proportions. Employing Kraken on unassembled sequencing reads produces a good but variable performance depending on post-classification filtering parameters. These approaches are investigated on a selection of cervical and gastric cancer whole genome sequences where Alphapapillomavirus and Helicobacter are detected in addition to a variety of other interesting genera. Conclusions: We provide the top-performing pipelines from this benchmark in a unifying tool called SEPATH, which is amenable to high throughput sequencing studies across a range of high-performance computing clusters. SEPATH provides a benchmarked and convenient approach to detect pathogens in tissue sequence data helping to determine the relationship between metagenomics and disease.

Viral↗
DOE OSTI2021

PHYSICS-BASED AUTOMATED REASONING FOR HEALTH MONITORING: SENSOR SET SELECTION

This paper addresses the problem of how to select a sensor set for equipment health monitoring that meets the needs of advanced O&M tasks that target cost reduction. They include maintenance optimization and asset management for the existing fleet and near-autonomous operation as currently envisioned for advanced reactors. The method uses physics-based automated reasoning to provide for a more “explainable” diagnosis. The algorithm is described along with its implementation on a computational cluster. Preliminary results for application to a use case in the current fleet are described.

diagnosis↗
DOE OSTI2024

Competitiveness Assessment of Decarbonizing Electricity and Process Heat Supply to a Campus with a Small Nuclear Reactor

This paper analyzes the competitiveness of siting a small nuclear reactor to support decarbonization of sites requiring tens of MW of electricity and/or process heat to support centralized heating and cooling system. This paper focuses on campuses as representative of sites with collections of buildings and research facilities with decarbonization needs represented by buildings heating, and electricity consumption by electrical loads which may include cooling via chilled water (e.g., for air conditioning and to cool down computer clusters). A nuclear reactor can be considered to decarbonize a site’s high-temperature steam generation used mostly for building heating needs, climate control, and hot water, by supplying process heat capabilities, while electricity decarbonization would be achieved mostly by the grid. However, a secondary application can be considered to maximize reactor utilization and avoid ramping down the reactor if the steam demand varies significantly throughout the year. Chilled water generation through steam-driven systems was identified as an attractive secondary option for the site analyzed, due to potential for plant design simplification, while electricity generation could be considered as well to reduce electricity purchases for a wider range of site applications. For a campus with peak 60MW thermal power demand, a small nuclear reactor with similar thermal power rating would almost eliminate CO2 emissions from steam generation and reduce electricity imports for chilled water production. A preliminary techno-economic feasibility study shows that a small nuclear reactor design that is optimized to support process heat can represent an economically feasible option when compared with other decarbonization alternatives.

Stauff, Nicolas E.↗
DOE OSTI2014

Advanced Artificial Science. The development of an artificial science and engineering research infrastructure to facilitate innovative computational modeling, analysis, and application to interdisciplinary areas of scientific investigation.

This is a final report of the DOE award DE-SC0001132, Advanced Artificial Science. The development of an artificial science and engineering research infrastructure to facilitate innovative computational modeling, analysis, and application to interdisciplinary areas of scientific investigation. This document describes the achievements of the goals, and resulting research made possible by this award.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Subcritical Multiplication Ex-Core Calculations with Shift

This report details the development and testing of Virtual Environment for Reactor Applications (VERA) as applied to full core subcritical multiplication ex-core calculations with Shift. The limiting factor in being able to run these detector calculations with Monte Carlo is the amount of computational memory used by a fully-loaded full core problem. The main development features added to VERA in this effort were enabling source biasing and separable weight windows and integrating multithreading in Shift. With these capabilities, a subcritical multiplication detector response calculation on a full core Watts Bar Nuclear Plant Unit 1 (WBN1) ex-core model was successfully run on a moderately sized computing cluster.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

External Release of Organic Scintillator DRiFT Software - Technology Evaluation and Demonstration Project Accomplishments [Slides]

Overview and Objectives: DRiFT post processes radiation transport output from MCNP, and generates realistic nuclear instrumentation response; Organic scintillator response has been developed, tested, and validated with measurements, these instruments are widely used in nuclear safeguards. At the beginning of this project, DRiFT was only available to LANL employees with access to yellow High Performance Computing clusters. Additionally, there are many complicated external software dependencies. Our TED project request proposed using funds to: Comment and clean up code, friendly testing, generating test suites and examples; Expansion of scintillator types natively supported by DRiFT; External release of DRiFT accompanied by documentation. We accomplished all objectives (and many others), they are highlighted in these slides.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Computational Fluid Dynamics Modeling to Simulate a Combined Reforming Process for Syngas and Hydrogen Production

An Oxygen Transport Membrane (OTM) combined reforming technology for producing syngas and hydrogen integrates the advantages of multiple processes—steam methane reforming (SMR), autothermal reforming (ATR), an air separation unit (ASU)—into a single integrated technology. The OTM consists of a primary reforming tube, in which desulfurized natural gas is partially reformed by steam at high pressure in the presence of a metal catalyst. This process is followed in series by a ceramic OTM with a secondary reformer, in which residual methane reforms and O 2 - ions react with a portion of the CO and H 2 fuel to provide the heat to support both primary and secondary reforming. Although the OTM combined reformer technology for syngas and H 2 production has been substantially developed in the last decade, several challenges that affect the overall production efficiency and reliability are yet to be fully understood, addressed, and resolved. Therefore, developing Computational Fluid Dynamics (CFD) models that incorporate fluid dynamics, mass transport, kinetics, heat transport, and structural mechanics is critical to understanding and minimizing the probability of tube failures during the startup and operation. In this report, an exhaustive literature review was performed to survey the current state of technology for producing syngas and H 2 using either conventional or renewable energy sources. The feedstocks reviewed include natural gas and coal for the conventional technologies, whereas biomass, solar, wind, and nuclear energy for the renewable technologies. The existing industry-grade COMSOL multiphysics models of OTM were upgraded for the latest software release. In addition, they were improved to help achieve grid and solver independence and were successfully ported on the ORNL high-performance computing clusters to speed up their run times. A 42% reduction in the simulation run time was achieved. A new higher-fidelity CFD model of an OTM tube was developed in the StarCCM+ simulation platform. This new model was designed to simulate various physics using first principles, e.g., turbulent flow, heat transfer, and chemical reactions while avoiding unnecessary simplifications. The resulting predictions were qualitatively assessed and provided useful insights into the multiphysics complexity of an OTM tube.

08 HYDROGEN↗
DOE OSTI2023

JIRIAF: JLAB Integrated Research Infrastructure Acros Facilities

The JIRIAF project aims to combine geographically diverse computing facilities into an integrated science infrastructure. This project starts by dynamically evaluating temporarily unallocated or idled compute resources from multiple providers. These resources are integrated to handle additional workloads without affecting local running jobs. This paper describes our approach to launch best-effort batch tasks which exploit these underutilized resources. Our system measures the real-time behavior of jobs running on a machine and learns to distinguish typical performance from outliers. Unsupervised ML techniques are used to analyze hardware-level performance measures, followed by a real-time cross-correlation analysis to determine which applications cause performance degradation. We then ameliorate bad behavior by throttling these processes. We demonstrate that problematic performance interference can be detected and acted on, which makes it possible to continue to share resources between applications and simultaneously maintain high utilization levels in a computing cluster. We relocate the CLAS12 data processing workflow to a remote data center for a case study, preventing file migration and temporal data persistency.

Lawrence, David↗
DOE OSTI2022

EJFAT: Towards Intelligent Compute Destination Load Balancing

To handle increased data flow, Jefferson Lab (JLab) is partnering with ESnet for development of an AI/ML directed compute work Load Balancer (LB) of UDP streamed data. The LB is FPGA based featuring dynamically configurable, low latency and high throughput destination address switching. The LB provides integration of edge and core computing to support JLab experimental programs, the Electron-Ion Collider, as well as data centers of the future. In the ESnet/JLab FPGA Accelerated Transport (EJFAT) initiative, the function of the LB Data Plane (DP) is to redirect data streams to selectable (but unknown to sender) destination hosts based on current worload and within that host to destination ports as a function of sub- stream id. This effects hierarchical scaling, first across compute machines for processing over a series of events and second, across ports so different data source sub-streams may be assigned to different processors for further parallelization. The LB Control Plane (CP) programs the DP using compute farm telemetry to direct and balance workloads across a compute cluster as the operating conditions require. While Proportional/Integrative/Derivative (PID) controllers are often seen in similar applications, here we investigate the feasibility of a Reinforcement Learning (RL) based schedule manager running in the CP to provide dynamic updates to the DP scheduling policy.

Lawrence, David↗
DOE OSTI2024

Predicting Mechanical Properties from Microstructure Images in Fiber-Reinforced Polymers Using Convolutional Neural Networks

Evaluating the mechanical response of fiber-reinforced composites can be extremely time-consuming and expensive. Machine learning (ML) techniques offer a means for faster predictions via models trained on existing input–output pairs and have exhibited success in composite research. This paper explores a fully convolutional neural network modified from StressNet, which was originally used for linear elastic materials, and extended here for a non-linear finite element (FE) simulation to predict the stress field in 2D slices of segmented tomography images of a fiber-reinforced polymer specimen. The network was trained and evaluated on data generated from the FE simulations of the exact microstructure. The testing results show that the trained network accurately captures the characteristics of the stress distribution, especially on fibers, solely from the segmented microstructure images. The trained model can make predictions within seconds in a single forward pass on an ordinary laptop, given the input microstructure, compared to 92.5 h to run the full FE simulation on a high-performance computing cluster. These results show promise in using ML techniques to conduct fast structural analysis for fiber-reinforced composites and suggest a corollary that the trained model can be used to identify the location of potential damage sites in fiber-reinforced polymers.

Sun, Yixuan (ORCID:0000000311093380)↗
DOE OSTI2016

Task-Based Crowd Simulation for Heterogeneous Architectures

Industry trends in the coming years imply the availability of cluster computing with hundreds to thousands of cores per chip, as well as the use of accelerators. Programming presents a challenge due to this heterogeneous architecture; thus, using novel programming models that facilitate this process is necessary. In this chapter, the case of simulation and visualization of crowds is presented. The authors analyze and compare the use of two programming models: OmpSs and CUDA. OmpSs allows to take advantage of all the resources available per node by combining the CPU and GPU while automatically taking care of memory management, scheduling, communications and synchronization. Experimental results obtained from Fermi, Kepler and Maxwell GPU architectures are presented, and the different modes used for visualizing the results are described, as well.

Perez, Hugo↗
DOE OSTI2015

pcircle - A Suite of Scalable Parallel File System Tools

Most of the software related to file system are written for conventional local file system, they are serialized and can't take advantage of the benefit of a large scale parallel file system. "pcircle" software builds on top of ubiquitous MPI in cluster computing environment and "work-stealing" pattern to provide a scalable, high-performance suite of file system tools. In particular - it implemented parallel data copy and parallel data checksumming, with advanced features such as async progress report, checkpoint and restart, as well as integrity checking.

WANG, FEIYI↗
DOE OSTI2016

Matrix Factorizations at Scale: a Comparison of Scientific Data Analytics in Spark and C+MPI Using Three Case Studies

We explore the trade-offs of performing linear algebra using Apache Spark, compared to traditional C and MPI implementations on HPC platforms. Spark is designed for data analytics on cluster computing platforms with access to local disks and is optimized for data-parallel tasks. We examine three widely-used and important matrix factorizations: NMF (for physical plausibility), PCA (for its ubiquity) and CX (for data interpretability). We apply these methods to 1.6TB particle physics, 2.2TB and 16TB climate modeling and 1.1TB bioimaging data. The data matrices are tall-and-skinny which enable the algorithms to map conveniently into Spark’s data parallel model. We perform scaling experiments on up to 1600 Cray XC40 nodes, describe the sources of slowdowns, and provide tuning guidance to obtain high performance.

Gittens, Alex↗
DOE OSTI2019

A Case Study of MPI Over Long Distance Connections

Scientific workflows are increasingly being distributed across wide-area networks, and their code executions are expected to span across geographically dispersed computing systems. MPI has been extensively used to support communications for distributed computations, typically, over compute clusters and high-performance systems within a single facility. We present a case study of performance of MPI basic operations over long distance connections, wherein TCP is used for the underlying transport. We present measurements of execution times of MPI codes that utilize MPI Sendrecv operations over emulated 10Gbps connections with 0-366ms round-trip times, including the longest one spanning the globe. They demonstrate that basic MPI codes can be sustained over long distance connections under external packet loss rates up to 10%. They also highlight the qualitative effects of losses which manifest as increased execution times as a consequence of TCP’s loss recovery process.

Rao, Nageswara S.↗
DOE OSTI2021

PandAna: A Python Analysis Framework for Scalable High Performance Computing in High Energy Physics

Modern experiments in high energy physics analyze millions of events recorded in particle detectors to select the events of interest and make measurements of physics parameters. These data can often be stored as tabular data in files with detector information and reconstructed quantities. Current techniques for event selection in these files lack the scalability needed for high performance computing environments. We describe our work to develop a high energy physics analysis framework suitable for high performance computing. This new framework utilizes modern tools for reading files and implicit data parallelism. Framework users analyze tabular data using standard, easy-to-use data analysis techniques in Python while the framework handles the file manipulations and parallelism without the user needing advanced experience in parallel programming. In future versions, we hope to provide a framework that can be utilized on a personal computer or a high performance computing cluster with little change to the user code.

Groh, Micah↗
DOE OSTI2021

Modeling of Thermal Decomposition of TATB-Based Explosive for Safety Analysis

We investigate and model the cook-off behavior of LX-17 to understand the response of explosive systems in abnormal thermal environments. Decomposition has been explored via conventional ODTX (One-Dimensional Time-to-eXplosion), PODTX (ODTX with pressure-measurement), TGA (Thermo-Gravimetric Analysis), and DSC (Differential Scanning Calorimetry) experiments under isothermal and ramped temperature profiles. The data were used to fit reaction rate parameters for proposed schemes in an ALE3D computational model. This model includes chemical reactions, thermo- and hydro-dynamics, and material properties, including thermal expansion, compressibility, and strength. These parameterizations were carried out utilizing a Python evolutionary optimization method on LLNL’s high-performance computing clusters. Additional experiments are being developed to further characterize and monitor decomposition intermediates to improve the model. Once experimentally validated, this model will be scalable to several applications involving LX-17. Furthermore, the optimization methodology developed herein should be applicable to other high explosive materials.

Chemistry - Chemical explosives↗