SEARCH · Search NASA

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Integrated transmission electron microscope

An integrated transmission electron microscope comprising multiple electron sources for tuned beams of ultrafast, scanning probe, and parallel illumination in varied beam energies can be alternated within sub-microseconds onto a sample with dynamic ‘transient state’ processes to acquire atomic-scale structural/chemical data with site specificity. The various electron sources and condenser optics enable high-resolution imaging, high-temporal resolution imaging, and chemical imaging, using fast-switching magnets to direct the different electron beams onto a single maneuverable objective pole piece where the sample resides. Such multimodal in situ characterization tools housed in a single microscope have the potential to revolutionize materials science.

Jungjohann, Katherine L.↗

DOE OSTI2023

Airport Infrastructure Planning Using Multi-Stage Stochastic Programming

The Athena project, funded by the Department of Energy, has worked to identify the critical infrastructure at Dallas Fort Worth (DFW) Airport which influences mobility between the airport and the surrounding city of Dallas. Using scalable methods that can leverage HPC resources we have developed a multi-stage stochastic infrastructure expansion model for determining parking and curb modifications to the DFW Airport over a 20-year horizon. Additionally, we have explored the impacts of congestion pricing in conjunction with infrastructure modifications. Our multi-stage stochastic model is implemented using the mpi-sppy software and solved in parallel using progressive hedging on the National Renewable Energy Laboratory's HPC system Eagle. In this talk we present results from solving this model at scale.

airport planning↗

DOE OSTI2020

Massively parallel transport sweeps on meshes with cyclic dependencies

When solving the first-order form of the linear Boltzmann equation, a common misconception is that the matrix-free computational method of “sweeping the mesh”, used in conjunction with the Discrete Ordinates method, is too complex or does not scale well enough to be implemented in modern high performance computing codes. This has led to considerable efforts in the development of matrix-based methods that are computationally expensive and is partly driven by the requirements placed on modern spatial discretizations. In particular, modern transport codes are required to support higher order elements, a concept that invariably adds a lot of complexity to sweeps because of the introduction of cyclic dependencies with curved mesh cells. In this article we will present a comprehensive implementation of sweeping, to a piecewise-linear DFEM spatial discretization with particular focus on handling cyclic dependencies and possible extensions to higher order spatial discretizations. We find that these methods are implemented in a new C++ simulation framework called Chi-Tech (). We present some typical simulation results with some performance aspects that one can expect during real world simulations, we also present a scaling study to >100k processes where Chi-Tech maintains greater than 80% efficiency solving a total of 87.7 trillion angular flux unknowns for a 116 group simulation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2024

Pilot microbial electrolysis cell closes the hydrogen loop for hydrothermal wet waste conversion to jet fuel

The global shift toward net-zero emissions necessitates resource recovery from wet waste. In this study, we demonstrate the first feasibility of combining pilot-scale microbial electrolytic cells (MECs) with hydrothermal liquefaction (HTL) for simultaneous post-hydrothermal liquefaction wastewater (PHW) treatment and efficient hydrogen (H₂) production to meet biocrude upgrading requirements. Long-term single reactor operation revealed that fixed anode potential enabled rapid startup, and low catholyte pH and high salinity were effective in suppression of cathodic methanogenesis and acetogenesis – resulting in high current density of 16.6 A m –2 and 9.3 A m –2 when feeding synthetic wastewater and PHW respectively. Additionally, the anode biofilm exhibited spatial variations in response to local environmental conditions. In conclusion, onsite parallel or serial operations of multiple MECs showed good performance using actual PHW with a record-high H 2 production rate of 0.5 L L R day –1 for MEC over 10 liters scale, and the optimal chemical oxygen demand (COD)-to-H 2 yield reached 0.127 kg-H 2 per kg-COD, supporting a self-sufficient, closed-loop upgrade to jet fuel.

08 HYDROGEN↗

DOE OSTI2023

Numerical modeling of chemical looping oxidative dehydrogenation of ethane in parallel packed beds

Chemical looping oxidative dehydrogenation (CL-ODH) of ethane has the potential to be a highly efficient alternative to steam cracking for ethylene production. Accurate reactor modeling is of critical importance to efficiently scale up and optimize this new technology. This study reports a one-dimensional, heterogeneous packed bed model to simulate the CL-ODH of ethane to ethylene with a Na 2 MoO 4 -promoted CaTi 0.1 Mn 0.9 O 3 redox catalyst. Here, the overall reaction kinetics was well-described by coupling the gas-phase steam cracking of ethane with the reduction kinetics of the redox catalyst by H 2 and C 2 H 4 . The impact of H 2 on the formation rate of CO 2 byproduct from C 2 H 4 conversion was also thoroughly investigated to validate the applicability of the kinetic model under operational environments. The temperature variation within the different CL-ODH steps and the temperature distribution along the bed were also carefully considered. The accuracy of the model was validated by experiments conducted in a large lab-scale packed bed reactor (200 g catalyst loading), with an average deviation of 2.8% in terms of ethane conversion and ethylene yield. The model was subsequently used to optimize the operating parameters of the CL-ODH reactor, indicating that up to 63.7% single-pass C 2 +olefin yield can be achieved with the current redox catalyst bed whereas further optimization of the redox catalyst to inhibit C 2 H 4 activation can result in 69.4% single-pass C 2 +yield while maintaining low CO 2 selectivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2019

Exploring small-scale chemostats to scale up microbial processes: 3-hydroxypropionic acid production in S. cerevisiae

The physiological characterization of microorganisms provides valuable information for bioprocess development. Chemostat cultivations are a powerful tool for this purpose, as they allow defined changes to one single parameter at a time, which is most commonly the growth rate. The subsequent establishment of a steady state then permits constant variables enabling the acquisition of reproducible data sets for comparing microbial performance under different conditions. We performed physiological characterizations of a 3-hydroxypropionic acid (3-HP) producing Saccharomyces cerevisiae strain in a miniaturized and parallelized chemostat cultivation system. The physiological conditions under investigation were various growth rates controlled by different nutrient limitations (C, N, P). Based on the cultivation parameters obtained subsequent fed-batch cultivations were designed.We report technical advancements of a small-scale chemostat cultivation system and its applicability for reliable strain screening under different physiological conditions, i.e. varying dilution rates and different substrate limitations (C, N, P). Exploring the performance of an engineered 3-HP producing S. cerevisiae strain under carbon-limiting conditions revealed the highest 3-HP yields per substrate and biomass of 16.6 %C-mol and 0.43 g gCDW -1 , respectively, at the lowest set dilution rate of 0.04 h -1 . 3-HP production was further optimized by applying N- and P-limiting conditions, which resulted in a further increase in 3-HP yields revealing values of 21.1 %C-mol and 0.50 g gCDW -1 under phosphate-limiting conditions. The corresponding parameters favoring an increased 3-HP production, i.e. dilution rate as well as C- and P-limiting conditions, were transferred from the small-scale chemostat cultivation system to 1-L bench-top fermenters operating in fed-batch conditions, revealing 3-HP yields of 15.9 %C-mol and 0.45 g gCDW -1 under C-limiting, as well as 25.6 %C-mol and 0.50 g gCDW -1 under phosphate-limiting conditions. Small-scale chemostat cultures are well suited for the physiological characterization of microorganisms, particularly for investigating the effect of changing cultivation parameters on microbial performance. In our study, optimal conditions for 3-HP production comprised (i) a low dilution rate of 0.04 h -1 under carbon-limiting conditions and (ii) the use of phosphate-limiting conditions. Similar 3-HP yields were achieved in chemostat and fed-batch cultures under both C- and P-limiting conditions proving the growth rate as robust parameter for process transfer and thus the small-scale chemostat system as powerful tool for process optimization.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2019

Direct Numerical Simulation of Hypersonic Turbulent Boundary Layer Flow using SPARC: Initial Evaluation

This report documents the initial testing of the Sandia Parallel Aerodynamics and Reentry Code (SPARC) to directly simulate hypersonic, turbulent boundary layer flow over a sharp 7- degree half-angle cone. This type of computation involves a tremendously large range of scales both in time and space, requiring a large number of grid cells and the efficient utilization of a large pool of resources. The goal of the simulation is to mimic and verify a wind tunnel experiment that seeks to measure the turbulent surface pressure fluctuations. These data are necessary for building a model to predict random vibration loading in the reentry flight environment. A low-dissipation flux scheme in SPARC is used on a 2.7 billion cell mesh to capture the turbulent fluctuations in the boundary layer flow. The grid is divided into 115200 partitions and simulated using the Knight's Landings (KNL) partition of the Trinity system. The parallel performance of SPARC is explored on the Trinity system, as well as some of the other new architectures. Extracting data from the simulation shows good agreement with the experiment as well as a colleague's simulation. The data provide a guide for which a new model can be built for better prediction of the reentry random vibration loads.

42 ENGINEERING↗

DOE OSTI2022

Pore-Scale Simulation of Spectral Induced Polarization

A new model was developed to simulate spectral induced polarization (SIP) in porous media. The model is based on a pore-network approximation of the soil or rock, in which bonds between pores are represented by equivalent circuits. In the circuit model, electrolytic and surface conduction occur in parallel, with the electrolyte behaving as a single resistor, and the mineral surface behaving as a resistor and capacitor in series. Based on the pore geometry, fluid conductivity, and mineral surface conductivity, an impedance network is generated. SIP spectra are calculated by solving the sinusoidal steady-state electrical problem for a range of frequencies. The new model provides a tool to bridge the gap between (1) our fundamental understanding of polarization processes at the scale of a single pore or grains and (2) existing simulation capabilities for macroscale systems that do not account for pore-scale properties. The model is implemented in Matlab and can solve two-dimensional and three-dimensional (2D and 3D) networks. Examples for regular cubic lattices are presented, but the method and code are flexible with respect to pore geometries and allow for future leveraging of existing open-source capabilities for generation of pore networks and extraction of network geometries from micro imaging of core samples.

58 GEOSCIENCES↗

DOE OSTI2017

PSelInv – A distributed memory parallel algorithm for selected inversion: The non-symmetric case

This paper generalizes the parallel selected inversion algorithm called PSelInv to sparse non-symmetric matrices. We assume a general sparse matrix A has been decomposed as $PAQ$ = $LU$ on a distributed memory parallel machine, where L, U are lower and upper triangular matrices, and P, Q are permutation matrices, respectively. The PSelInvmethod computes selected elements of $A$ -1 . The selection is confined by the sparsity pattern of the matrix A T . Here our algorithm does not assume any symmetry properties of A, and our parallel implementation is memory efficient, in the sense that the computed elements of $A$ -T overwrites the sparse matrix $L + U$ in situ . PSelInv involves a large number of collective data communication activities within different processor groups of various sizes. In order to minimize idle time and improve load balancing, tree-based asynchronous communication is used to coordinate all such collective communication. Numerical results demonstrate that PSelInv can scale efficiently to 6,400 cores for a variety of matrices.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Deer Vigilance and Movement Behavior Are Affected by Edge Density and Connectivity

ABSTRACT Animal behavior is an important component of individual, population, and community responses to anthropogenic habitat alteration. For example, antipredator behavior (e.g., vigilance) and animal movement behavior may both be important behavioral responses to the increased density of habitat edges and changes in patch connectivity that characterize highly modified habitats. Importantly, edge density and connectivity might interact, and this interaction is likely to mediate animal behavior: linear, edge‐rich landscape features often provide structural connectivity between patches, but the functional connectedness of patches for animal use could depend upon how edge density modifies animal vigilance and movement. Using remote cameras in large‐scale experimental landscapes that manipulate edge density (high‐ vs. low‐density edges) and patch connectivity (isolated or connected patches), we examined the effects of edge density and connectivity on the antipredator behavior and movement behavior of white‐tailed deer ( Odocoileus virginianus ). Deer vigilance was 1.38 times greater near high‐density edges compared to low‐density edges, regardless of whether patches were connected or isolated. Deer were also more likely to move parallel to connected high‐density edges than all other edge types, suggesting that connectivity promotes movement along high‐density edges. These results suggest that increases in edge density that accompany human fragmentation of existing habitats may give rise to large‐scale changes in the antipredator behavior of deer. These results also suggest that conservation strategies that simultaneously manipulate edge density and connectivity (i.e., habitat corridors) may have multiple effects on different aspects of deer behavior: linear habitat corridors were areas of high vigilance, but also areas where deer movement behavior implied increased movement along the habitat edge.

Bartel, Savannah L. [University of Wisconsin‐Madis↗

DOE OSTI2022

mesoflow [SWR-22-56]

Mesoflow is a continuum scale simulation tool developed specifically for modeling transport and chemistry at the mesoscale. Our solver utilizes Cartesian block-structured adaptive mesh refinement to resolve complex surface morphologies (of catalysts/biomass particles among others) directly obtained from X-ray tomography data. An immersed boundary based formulation enables rapid representation of complex geometries prevalent in most mesoporous interfaces. The solver is developed on top of open-source performance portable library, AMReX, providing parallel execution capabilities on current and upcoming high-performance-computing (HPC) architectures. Our flexible software framework enables integration of complex chemical mechanisms at heterogenous interfaces and time-split algorithms for circumventing highly disparate reaction and flow time-scales. Our current studies indicate a ten-fold performance gain by using graphics-processing-units (GPU) compared to a single processor for representative problem sizes (2 million cell mesh).

Sitaraman, Hariswaran↗

DOE OSTI2025

Leveraging Pre-Built Catalogs and Object-Level Scheduling to Eliminate I/O Bottlenecks in HPC Environments

Modern High-Performance Computing (HPC) environments face mounting challenges due to the shift from large to small file datasets, along with an increasing number of users and parallelized applications. As HPC systems rely on Parallel File Systems (PFS), such as Lustre for data processing, performance bottlenecks stemming from Object Storage Target (OST) contention have become a significant concern. Existing solutions, such as LADS with its object-level scheduling approach, fall short in large-scale HPC environments due to their inability to effectively address metadata I/O bottlenecks and the growing number of I/O processes. This study highlights the pressing need for a comprehensive solution that tackles both OST contention and metadata I/O challenges in diverse HPC workloads. To address these challenges, we propose SwiftLoad, an object-level I/O scheduling framework that leverages a metadata catalog to enhance the performance and efficiency of parallel HPC utilities. The adoption of the metadata catalog mitigates the metadata I/O bottlenecks that commonly occur in HPC utilities, a challenge that is particularly pronounced in object-level I/O scheduling. SwiftLoad addresses OST contention and the uneven distribution of I/O processes across different OSTs through mathematical modeling and incorporates a Loader Configuration Module to regulate the number of I/O processes. Evaluated with two representative utilities—data deduplication profiling and data augmentation—SwiftLoad achieved performance improvements of up to 5.63x and 11.0x, respectively, on a production supercomputer.

HPC↗

DOE OSTI2018

Analyzing the Impact of System Reliability Events on Applications in the Titan Supercomputer

Extreme-scale computing systems employ Reliability, Availability and Serviceability (RAS) mechanisms and infrastructure to log events from multiple system components. In this paper, we analyze RAS logs in conjunction with the application placement and scheduling database, in order to understand the impact of common RAS events on application performance. This study conducted on the records of about 2 million applications executed on Titan supercomputer provides important insights for system users, operators and computer science researchers. Specifically, we investigate the impact of RAS events on application performance and its variability by comparing cases where events are recorded with corresponding cases where no events are recorded. Such a statistical investigation is possible since we observed that system users tend to execute their applications multiple times. Our analysis reveals that most RAS events do impact application performance, although not always. We also find that different system components affect application performance differently. In particular, our investigation includes the following components: parallel file system processor, memory, graphics processing units, system and user software issues. Our work establishes the importance of providing feedback to system users for increasing operational efficiency of extreme-scale systems.

Ashraf, Rizwan↗

DOE OSTI2024

QRCODE: Massively parallelized real-time time-dependent density functional theory for periodic systems

We present a new software module, QRCODE (Quantum Research for Calculating Optically Driven Excitations), for massively parallelized real-time time-dependent density functional theory (RT-TDDFT) calculations of periodic systems in the open-source Qbox software package. Our approach utilizes a custom implementation of a fast Fourier transformation scheme that significantly reduces inter-node message passing interface (MPI) communication of the major computational kernel and shows impressive scaling up to 16,344 CPU cores. In addition to improving computational performance, QRCODE contains a suite of various time propagators for accurate RT-TDDFT calculations. As benchmark applications of QRCODE, we calculate the current density and optical absorption spectra of hexagonal boron nitride (h-BN) and photo-driven reaction dynamics of the ozone-oxygen reaction. We also calculate the second and higher harmonic generation of monolayer and multi-layer boron nitride structures as examples of large material systems. Our optimized implementation of RT-TDDFT in QRCODE enables large-scale calculations of real-time electron dynamics of chemical and material systems with enhanced computational performance and impressive scaling across several thousand CPU cores.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2017

A Dynamical and Statistical Characterization of U.S. Extreme Precipitation Events and Their Associated Large-Scale Meteorological Patterns

Abstract Regional patterns of extreme precipitation events occurring over the continental United States are identified via hierarchical cluster analysis of observed daily precipitation for the period 1950–2005. Six canonical extreme precipitation patterns (EPPs) are isolated for the boreal warm season and five for the cool season. The large-scale meteorological pattern (LMP) inducing each EPP is identified and used to create a “base function” for evaluating a climate model’s potential for accurately representing the different patterns of precipitation extremes. A parallel analysis of the Community Climate System Model, version 4 (CCSM4), reveals that the CCSM4 successfully captures the main U.S. EPPs for both the warm and cool seasons, albeit with varying degrees of accuracy. The model’s skill in simulating each EPP tends to be positively correlated with its capability in representing the associated LMP. Model bias in the occurrence frequency of a governing LMP is directly related to the frequency bias in the corresponding EPP. In addition, however, discrepancies are found between the CCSM4’s representation of LMPs and EPPs over regions such as the western United States and Midwest, where topographic precipitation influences and organized convection are prominent, respectively. In these cases, the model representation of finer-scale physical processes appears to be at least equally important compared to the LMPs in driving the occurrence of extreme precipitation.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2016

Extreme-scale Algorithms and Solver Resilience

A widening gap exists between the peak performance of high-performance computers and the performance achieved by complex applications running on these platforms. Over the next decade, extreme-scale systems will present major new challenges to algorithm development that could amplify this mismatch in such a way that it prevents the productive use of future DOE Leadership computers due to the following; Extreme levels of parallelism due to multicore processors; An increase in system fault rates requiring algorithms to be resilient beyond just checkpoint/restart; Complex memory hierarchies and costly data movement in both energy and performance; Heterogeneous system architectures (mixing CPUs, GPUs, etc.); and Conflicting goals of performance, resilience, and power requirements.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Dynamic Ride-Matching for Large-Scale Transportation Systems

Efficient dynamic ride-matching (DRM) in large-scale transportation systems is a key driver in transport simulations to yield answers to challenging problems. Although the DRM problem is simple to solve, it quickly becomes a computationally challenging problem in large-scale transportation system simulations. Therefore, this study thoroughly examines the DRM problem dynamics and proposes an optimization-based solution framework to solve the problem efficiently. To benefit from parallel computing and reduce computational times, the problem’s network is divided into clusters utilizing a commonly used unsupervised machine learning algorithm along with a linear programming model. Then, these sub-problems are solved using another linear program to finalize the ride-matching. At the clustering level, the framework allows users adjusting cluster sizes to balance the trade-off between the computational time savings and the solution quality deviation. A case study in the Chicago Metropolitan Area, U.S., illustrates that the framework can reduce the average computational time by 58% at the cost of increasing the average pick up time by 26% compared with a system optimum, that is, non-clustered, approach. Another case study in a relatively small city, Bloomington, Illinois, U.S., shows that the framework provides quite similar results to the system-optimum approach in approximately 62% less computational time.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

Sparse Linear Solvers for Large-scale Electromagnetic Transient Simulations

Linear solvers form the basis for electromagnetic transient (EMT) simulations. There is a need to speed up EMT simulations as larger regions are analyzed using EMT simulations. For the same, the performance of linear solvers plays an important role. Exploiting the sparsity of the matrices generated in EMT simulations could assist with speed-up. Scalability is also crucial as power grids expand, demanding solutions capable of accommodating the increasing system size. Recent studies from the North American Electric Reliability Corporation (NERC) increasingly emphasize that EMT simulation models of the power grid will grow larger with the inclusion of power electronics components. Parallelisms in sparsity patterns exploit modern central processing units (CPUs), multi-core CPUs, and graphics processing units (GPUs) architectures in sparse solver designs. Therefore, this paper explores publicly available existing linear solvers and investigates their efficiency in large-scale power grid simulations. A large-scale power grid is developed by increasing the size of the IEEE 39 bus test system to up to 39000 bus systems.

Hsu, Kuan-Chieh↗