Search NASA⌕ Search

SEARCH · Search NASA

Results for “Darshan”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Analyzing File Access Patterns on Large-Scale HPC Systems: Opportunities for File Prefetching

This paper explores the potential opportunities for implementing file prefetching techniques on large-scale high-performance computing (HPC) systems. Specifically, we investigate the file access patterns of various applications across multiple scientific domains using two years' worth of Darshan I/O traces obtained from the Summit supercomputer. We identify recurring trends and patterns which indicate that prefetching can be effectively leveraged to improve data access performance on HPC systems. This study serves as a valuable reference for system architects and developers in the HPC community, providing insights into the opportunities and challenges associated with enabling file prefetching on large-scale HPC systems.

Karimi, Ahmad Maroof↗

Understanding data motion in the modern HPC data center

The utilization and performance of storage, compute, and network resources within HPC data centers have been studied extensively, but much less work has gone toward characterizing how these resources are used in conjunction to solve larger scientific challenges. To address this gap, we present our work in characterizing workloads and workflows at a data-center-wide level by examining all data transfers that occurred between storage, compute, and the external network at the National Energy Research Scientific Computing Center over a three-month period in 2019. Using a simple abstract representation of data transfers, we analyze over 100 million transfer logs from Darshan, HPSS user interfaces, and Globus to quantify the load on data paths between compute, storage, and the wide-area network based on transfer direction, user, transfer tool, source, destination, and time. We show that parallel I/O from user jobs, while undeniably important, is only one of several major I/O workloads that occurs throughout the execution of scientific workflows. We also show that this approach can be used to connect anomalous data traffic to specific users and file access patterns, and we construct time-resolved user transfer traces to demonstrate that one can systematically identify coupled data motion for individual workflows.

Lockwood, GK↗

Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms

Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.

Dask↗

Machine Learning Assisted HPC Workload Trace Generation for Leadership Scale Storage Systems

Monitoring and analyzing a wide range of I/O activities in an HPC cluster is important in maintaining mission-critical performance in a large-scale, multi-user, parallel storage system. Center-wide I/O traces can provide high-level information and fine-grained activities per application or per user running in the system. Studying such large-scale traces can provide helpful insights into the system. It can be used to develop predictive methods for making predictive decisions, adjusting scheduling policies, or providing decisions for the design of next-generation systems. However, sharing real-world I/O traces to expedite such research efforts leaves a few concerns; i) the cost of sharing the large traces is expensive due to this large size, and ii) privacy concern is an issue.We address such issues by building an end-to-end machine learn- ing (ML) workflow that can generate I/O traces for large-scale HPC applications. We leverage ML based feature selection and gener- ative models for I/O trace generation. The generative models are trained on I/O traces collected by the darshan I/O characterization tool over a period of one year. We present a two-step generation process consisting of two deep-learning models, called the feature generator and the trace generator. The combination of two-step generative models provides robustness by reducing the bias of the model and accounting for the stochastic nature of the I/O traces across different runs of an application. We evaluate the performance of the generative models and show that the two-step model can generate time-series I/O traces with less than 20% root mean square error.

Paul, Arnab↗

DXT Explorer v0.1

DTX Explorer is a tool to generate interactive data visualizations of Darshan I/O traces collected from HPC applications. Its goal is to provide an easy and interactive way for researchers and developers to explore their application's I/O behavior and detect possible I/O bottlenecks that are impacting performance.

Bez, Jean Luca↗

DXT Explorer v2.0

DTX Explorer is a tool to generate interactive data visualizations of Darshan I/O traces collected from HPC applications. Its goal is to provide an easy and interactive way for researchers and developers to explore their application's I/O behavior and detect possible I/O bottlenecks that are impacting performance.

Bez, JeanLuca↗

Transient Liquid Phase Bonding of AlN to AlSiC for Durable Power Electronic Packages

Conventional power electronic modules employ a direct bonded copper (DBC) substrate and multiple interface layers to dissipate heat. However, reliability issues arise due to the coefficient of thermal expansion (CTE) mismatch that exists between the metal, ceramic, and semiconductor materials in the conventional module. Significant performance enhancement can be achieved by eliminating the DBC and developing an integrated substrate/cold plate with a low CTE mismatch throughout the package. To address this need, we have demonstrated the ability to directly bond the aluminum nitride (AlN) substrate to an AlSiC heat sink through transient liquid phase bonding using a Cu-Al binary system. Fabricated samples are found to have good interfacial adhesion. The novel bond material exhibits properties analogous to AlSiC and is analyzed for thermal, mechanical, and metallographic properties. The novel structure demonstrated in this work will enable smaller, lighter, and more reliable power modules, when compared to traditional configurations.

42 ENGINEERING↗

Green and Cost Effective Synthesis of Fluorescent Carbon Quantum Dots for Dopamine Detection

Carbon quantum dots (CQDs) due to its high fluorescent output is evolving as novel sensing material and is considered as future building blocks for nano sensing devices. Hence, in this investigation we report microwave assisted preparation and multi sensing application of CQDs. The microwave derived CQDs are characterized by Dynamic Light Scattering (DLS) experiment and Fourier Infrared spectra (FTIR) to investigate the size distribution and chemical purity respectively. Fluorescent emission spectra recorded at varying pH shows varying fluorescence emission intensities. Further, emission spectra recorded at different temperatures shows that fluorescence emission of CQDs greatly depends on temperature. Therefore, we demonstrate the pH and temperature sensing characteristics of CQDs by fluorescence quenching behaviour. In addition, the interaction and sensing behaviour of CQDs for dopamine is also presented in this work with a detection limit of 0.2 mM. The steady state and time-resolved methods have been employed in fluorescence quenching methods for sensing dopamine through CQDs at room temperature. The bimolecular quenching rate constants for different concentration have been measured. The interaction between CQDs and dopamine indicates fluorescence quenching method is an elegant process for detecting dopamine through CQDs.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Scaled-up fabrication of durable and porous adsorbent-coated minichannels on aluminum for CO 2 separation

A method was developed to fabricate zeolite 13X adsorbent-coated minichannels on aluminum for CO₂ adsorption applications in this study. It emphasizes the innovative use of aluminum as a substrate, which offers airtight assembly, paving the way for highly efficient adsorption systems. An optimized coating process was developed using a slurry of Zeolite 13X, yeast, sugar, and xanthan gum, resulting in durable and highly porous layers that enhance CO₂ capture performance. A PETG peeler was designed to remove the top layer of the yeast-engineered adsorbent coatings, revealing a super porous and foamy structure. The teeth of the peeler were designed and fabricated for high repeatability and rapid prototyping. Breakthrough experiments were conducted on the scaled-up adsorbent bed using gas mixtures of 80% CO₂, 20% N₂, and 20% CO₂, 80% N₂ to represent different industrial scenarios. The performance of the bed was evaluated at flow rates of 160 and 190 cm³ min -1 using a Raman Laser Gas Analyzer (RLGA), demonstrating stable adsorption without degradation across multiple cycles. Computational modeling of integral transport phenomena under the chosen experimental conditions was pursued using gPROMS ProcessBuilder™, and the modeling results were compared with those from the tests for adsorption time, which resulted in an error margin of 2% to 9% for the breakthrough time, confirming the easy reproducibility of the design through modeling. This research advances CO₂ capture technologies by providing an effective and scalable solution for producing aluminum-based adsorbent coated beds, supporting industrial carbon capture efforts.

CO2 capture↗

Fabrication of yeast engineered porous 13X adsorbent layers for CO 2 capture

This study investigates a novel environmentally friendly coating technique using yeast fermentation to obtain super porous Zeolite 13X adsorbent layers through freeze-drying technique for CO 2 capture applications. Several mass ratios of sugar to yeast were used to control the porosity and pore sizes in the adsorbent layer. A unique peeling process was integrated to obtain foamy, hollow structures to have deeper layer accessibility of adsorbent for adsorption applications. These coated adsorbent layers were experimentally characterized as a function of the mass ratio of sugar to yeast and adsorbent solid fraction. Scanning electron microscopy (SEM), energy-dispersive X-ray spectroscopy (EDS), and Fourier-transform infrared spectroscopy (FT-IR) are used to analyze the coated layers. Here, the void fraction for coated samples is found to vary between 0.48 and 0.56, making the samples applicable for adsorption applications. Adsorption performance experiments are performed to test the coated samples' performance compared to 13X powder. Due to their simplistic fabrication, cost-effectiveness, rapid pore formation, and high adsorption capacity, these porous 13X layers hold potential for large-scale fabrication and CO 2 capture applications.

Adsorbent coating↗