Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel, scaling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Towards Generic Parallel Programming in Computer Science Education with Kokkos

Parallel patterns, views, and spaces are promising abstractions to capture the programmer's intent as well as the contextual information that can be used by an underlying runtime to efficiently map software to parallel hardware. These abstractions can be valuable in cases where an algorithm must accommodate requirements of code and performance portability across hardware architectures and vendor programming models. Kokkos is a parallel programming model for host- and accelerator architectures that relies on these abstractions and targets these requirements. It consists of a pure C++ interface, a specification, and a programming library. The programming library exposes patterns and types and maps them to an underlying abstract machine model. The abstract machine model offers a generic view of parallel hardware. While Kokkos is gaining popularity in large-scale HPC applications at some DOE laboratories, we believe that the implemented concepts are of interest to a broader audience including academia as they may contribute to a generic, vendor, and architecture-independent education of parallel programming. In this work, we give an insight into the design considerations of this programming model and list important abstractions. Further, we document best practices obtained from giving virtual classes on Kokkos and give pointers to resources that the reader may consider valuable for a lecture on generic parallel programming for students with preexisting knowledge on this matter.

Ciesko, Jan↗
DOE OSTI2025

A Parallel Alternative for Energy-Efficient Neural Network Training and Inferencing

Energy efficiency of training and inferencing with large neural network models is a critical challenge facing the future of sustainable large-scale machine learning workloads. This paper introduces an alternative strategy, called phantom parallelism, to minimize the net energy consumption of traditional tensor (model) parallelism, the most energy-inefficient component of large neural network training. The approach is presented in the context of feed-forward network architectures as a preliminary, but comprehensive, proof-of-principle study of the proposed methodology. We derive new forward and backward propagation operators for phantom parallelism, implement them as custom autograd operations within an end-to-end phantom parallel training pipeline and compare its parallel performance and energy-efficiency against those of conventional tensor parallel training pipelines. Formal analyses that predict lower bandwidth and FLOP counts are presented with supporting empirical results on up to 256 GPUs that corroborate these gains. Experiments are shown to deliver ∼50% reduction in the energy consumed to train FFNs using the proposed phantom parallel approach when compared with conventional tensor parallel methods. Additionally, the proposed approach is shown to train smaller phantom models to the same model loss on smaller GPU counts as larger tensor parallel models on larger GPU counts offering the possibility for even greater energy savings.

Seal, Sudip [ORNL] (ORCID:0000000332330656)↗
NASA NTRS1991

Mesoscale and large-scale variability of the Antarctic circumpolar current

This investigation of the physical oceanography of the Southern Ocean will carry out two parallel efforts during the years preceding the launch of TOPEX/POSEIDON. First, the Geosat data will be used to develop a preliminary descriptive picture of the mesoscale and large-scale, low-frequency surface circulation of the Southern Ocean. Some of this analysis of Geosat data has already begun. For example, as a measure of the geographical distribution of mesoscale variability, a color-coded map of the standard deviation of sea level from two years of Geosat data is shown. Efforts are presently under way to investigate the seasonal and year-to-year variability of this mesoscale energy. The data are also being used to generate low-pass filtered fields of sea level from which the temporal evolution of large-scale variability in the Southern Ocean may be investigated. The second parallel effort is the development and test of modeling and data assimilation techniques that will later be applied to TOPEX/POSEIDON data during the postlaunch phase. One objective of the modeling and data assimilation is to investigate the relation between mesoscale sea level variations and eddy flux in the Southern Ocean. Uncertainties in present estimates of the various components of meridional oceanic heat transport are large. The evidence presented indicates that the very energetic mesoscale variability in the ACC apparently accounts for much of the estimated 0.45x10(exp 15) watts of poleward heat transport across the ACC required to balance the heat budget. Eddy variability is strongly coherent vertically in the ACC, at least in the vicinity of Drake Passage where nearly all of the historical in situ data have been collected.

Chelton, Dudley B.↗
DOE OSTI2018

Accelerating nuclear configuration interaction calculations through a preconditioned block iterative eigensolver

We describe a number of recently developed techniques for improving the performance of large-scalenuclear configuration interaction calculations on high performance parallel computers. We show thebenefit of using a preconditioned block iterative method to replace the Lanczos algorithm that hastraditionally been used to perform this type of computation. The rapid convergence of the block iterativemethod is achieved by a proper choice of starting guesses of the eigenvectors and the construction of aneffective preconditioner. These acceleration techniques take advantage of special structure of the nuclearconfiguration interaction problem which we discuss in detail. The use of a block method also allows usto improve the concurrency of the computation, and take advantage of the memory hierarchy of modernmicroprocessors to increase the arithmetic intensity of the computation relative to data movement. Wealso discuss the implementation details that are critical to achieving high performance on massivelyparallel multi-core supercomputers, and demonstrate that the new block iterative solver is two to threetimes faster than the Lanczos based algorithm for problems of moderate sizes on a Cray XC30 system.

Shao, Meiyue↗
DOE OSTI2025

Optical neural engine for solving scientific partial differential equations

Abstract Solving partial differential equations (PDEs) is the cornerstone of scientific research and development. Data-driven machine learning (ML) approaches are emerging to accelerate time-consuming and computation-intensive numerical simulations of PDEs. Although optical systems offer high-throughput and energy-efficient ML hardware, their demonstration for solving PDEs is limited. Here, we present an optical neural engine (ONE) architecture combining diffractive optical neural networks for Fourier space processing and optical crossbar structures for real space processing to solve time-dependent and time-independent PDEs in diverse disciplines, including Darcy flow equation, the magnetostatic Poisson’s equation in demagnetization, the Navier-Stokes equation in incompressible fluid, Maxwell’s equations in nanophotonic metasurfaces, and coupled PDEs in a multiphysics system. We numerically and experimentally demonstrate the capability of the ONE architecture, which not only leverages the advantages of high-performance dual-space processing for outperforming traditional PDE solvers and being comparable with state-of-the-art ML models but also can be implemented using optical computing hardware with unique features of low-energy and highly parallel constant-time processing irrespective of model scales and real-time reconfigurability for tackling multiple tasks with the same architecture. The demonstrated architecture offers a versatile and powerful platform for large-scale scientific and engineering computations.

Tang, Yingheng (ORCID:0009000153622546)↗
DOE OSTI2023

Theory of the ion–electron temperature relaxation rate in strongly magnetized plasmas

Recent works have shown that strongly magnetized plasmas characterized by having a gyrofrequency greater than the plasma frequency exhibit novel transport properties. One example is that the friction force on a test charge shifts, obtaining components perpendicular to its velocity in addition to the typical stopping power component antiparallel to its velocity. Here, we apply a recent generalization of the Boltzmann equation for strongly magnetized plasmas to calculate the ion–electron temperature relaxation rate. Strong magnetization is generally found to increase the temperature relaxation rate perpendicular to the magnetic field and to cause the temperatures parallel and perpendicular to the magnetic field to not relax at equal rates. This, in turn, causes a temperature anisotropy to develop during the equilibration. Strong magnetization also breaks the symmetry of independence of the sign of the charges of the interacting particles on the collision rate, commonly known as the “Barkas effect.” Furthermore, it is found that the combination of oppositely charged interaction and strong magnetization causes the ion–electron parallel temperature relaxation rate to be significantly suppressed, scaling inversely proportional to the magnetic field strength.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Solid structure of Li 2 BeF 4 (FLiBe) from room temperature to melting studied by neutron and X-ray diffraction

Molten fluoride salts such as Li 2 BeF 4 (FLiBe) are used in molten salt reactors, fluoride-salt-cooled high-temperature reactors and fusion reactors as a fuel solvent, coolant and/or tritium breeding medium. In engineered systems that use molten salt, solid-state material will be present during melting and freezing scenarios, and therefore the temperature-dependent properties of the solid and solid/liquid phase transition merit investigation. To observe the behavior of the solid state of Li 2 BeF 4 from room temperature to melting, this work used neutron and X-ray diffraction to measure the changes in the lattice parameters and volume of the crystalline unit cell and compared the results with prior low-temperature data for solid Li 2 BeF 4 . From neutron diffraction data it is also possible to identify anisotropy: centimetre-scaled crystals align preferentially with the a axes parallel to the direction of freezing front propagation, and the c axes expand 54% more than the a axes. This work provides the lattice constants as a function of temperature, quantifies the thermal expansion, and determines the equation describing the change in density for solid Li 2 BeF 4 from room temperature to 459°C to be ρ solid (kg m −3 ) = 2182 (3) − 0.115 (2) T (°C) and the volume expansion upon melting to be less than 5%. This density changes depending on molecular weight and enrichment.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Characterizing Machine Learning I/O Workloads on Leadership Scale HPC Systems

High performance computing (HPC) is no longer solely limited to traditional workloads such as simulation and modeling. With the increase in the popularity of machine learning (ML) and deep learning (DL) technologies, we are observing that an increasing number of HPC users are incorporating ML methods into their workflow and scientific discovery processes, across a wide spectrum of science domains such as biology, earth science, and physics. This gives rise to a diverse set of I/O patterns than the traditional checkpoint/restart-based HPC I/O behavior. The details of the I/O characteristics of such ML I/O workloads have not been studied extensively for large-scale leadership HPC systems. This paper aims to fill that gap by providing an in-depth analysis to gain an understanding of the I/O behavior of ML I/O workloads using darshan - an I/O characterization tool designed for lightweight tracing and profiling. We study the darshan logs of more than 23, 000 HPC ML I/O jobs over a time period of one year running on Summit - the second-fastest supercomputer in the world. This paper provides a systematic I/O characterization of ML I/O jobs running on a leadership scale supercomputer to understand how the I/O behavior differs across science domains and the scale of workloads, and analyze the usage of parallel file system and burst buffer by ML I/O workloads.

Paul, Arnab↗
DOE OSTI2021

Cyber-Power Co-Simulation for End-to-End Synchrophasor Network Analysis and Applications

The resiliency, reliability and security of the next generation cyber-power smart grid depend upon efficiently leveraging advanced communication and computing technologies. Also, developing real-time data-driven applications is critical to enable wide-area monitoring and control of the cyber-power grid given high-resolution data from Phasor Measurement Units (PMUs). North American Synchrophasor Initiative Network (NASPlnet) provides guidance for PMU data exchanges. With the advancement in networking and grid operation, it is necessary to evaluate the performance of different data flow architectures suggested by NASPInet and analyze the impact on applications. Therefore, we need a cyber-power co-simulation framework that supports very large-scale co-simulation capable of running in parallel, high-performance computing platforms and capturing real-life network behavior. This work presents an end-to-end automated and user-driven cyber-power co-simulation using NS3 to model communication networks, GridPACK to model the power grid, and HELICS as a co-simulation engine. Comparative analysis of latency in synchrophasor networks and a performance evaluation of a power system stabilizer application utilizing PMU data in an IEEE 39 bus test system is presented using this cosimulation testbed.

Mustafa, Hussain M.↗
DOE OSTI2025

Orthogonal chemical genomics approaches reveal genomic targets for increasing anaerobic chemical tolerance in Zymomonas mobilis

Genetically engineered microbes have the potential to increase efficiency in the bioeconomy by overcoming growth-limiting production stress. Screens of gene perturbation libraries against production stressors can identify high-value engineering targets, but follow-up experiments needed to guard against false positives are slow and resource-intensive. In principle, the use of orthogonal gene perturbation approaches could increase recovery of true positives over false positives because the strengths of one technique compensate for the weaknesses of the other, but, in practice, two parallel screens are rarely performed at the genome scale. Here, we screen genome-scale CRISPRi (CRISPR interference) knockdown and transposon insertion libraries of the bioenergy-relevant Alphaproteobacterium, Zymomonas mobilis, against growth inhibitors commonly found in deconstructed plant material. Integrating data from the two gene perturbation techniques, we established an approach for defining engineering targets with high specificity. This allowed us to identify all known genes in the cytochrome bc1 and cytochrome c synthesis pathway as potential targets for engineering resistance to phenolic acids under anaerobic conditions, a subset of which we validated using precise gene deletions. Strikingly, this finding is specific to the cytochrome bc1 and cytochrome c pathway and does not extend to other branches of the electron transport chain. We further show that exposure of Z. mobilis to ferulic acid causes substantial remodeling of the cell envelope proteome, as well as the downregulation of TonB-dependent transporters. Our work provides a generalizable strategy for identifying high-value engineering targets from gene perturbation screens that is broadly applicable.

CRISPRi↗
DOE OSTI2023

PFLOTRAN 5

PFLOTRAN leverages massively parallel, high performance computing to simulate large-scale non-isothermal multiphase flow, multicomponent reactive transport and electrical resistivity tomography (ERT) problems in the subsurface environment. Researchers have employed PFLOTRAN to simulate these Earth system processes on leadership class supercomputers for over two decades. The code is designed to predict the future estate of environmental systems and better inform stakeholders in the regulatory decision making process (e.g., fate of contaminants, long-term stewardship for nuclear waste, impact of climate change, etc.). A diverse team of scientists oversees PFLOTRAN development and maintenance under an open-source licensing agreement and manages contributions from an international community of researchers.

Hammond, Glenn↗
DOE OSTI2022

End-to-end Analytics for Grid Arch Design & All-hazard Assessment

Resiliency, reliability, and security of the next-generation smart grid depend upon leveraging advanced communication and computing technologies, integrating them with physical power systems, and developing real-time, fast, data-based applications to help in wide-area monitoring and control of the grid. Using a high sampling data rate from phasor measurement units (PMUs) to develop applications has opened the door to achieving the next-generation grid requirements. The North American Synchrophasor Initiative Network (NASPlnet) was developed in 2007-09 to create a standard and guide for PMU data exchanges. With the advancement in both networking and grid requirements, it is necessary to evaluate the performance of different NASPInet versions and their impact on applications. Therefore, we need a cyber-power cosimulation framework that supports very large-scale co-simulation capable of running in parallel, high-performance computing platforms and capturing real-life network behavior. This work presents a cyber-physical co-simulation testbed using NS3 to model the communication network, GridPACK to model the power grid, and HELICS as a co-simulation engine. Comparative analysis of latency in synchrophasor networks and a performance evaluation of a power system stabilizer application based on PMU data in an Institute of Electrical and Electronics Engineers 39-bus test system is presented using this co-simulation testbed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1981

Planetary magnetospheres

A concise overview is presented of our understanding of planetary magnetospheres (and in particular, of that of the Earth), as of the end of 1981. Emphasis is placed on processes of astrophysical interest, e.g., on particle acceleration, collision-free shocks, particle motion, parallel electric fields, magnetic merging, substorms, and large scale plasma flows. The general morphology and topology of the Earth's magnetosphere are discussed, and important results are given about the magnetospheres of Jupiter, Saturn and Mercury, including those derived from the Voyager 1 and 2 missions and those related to Jupiter's satellite Io. About 160 references are cited, including many reviews from which additional details can be obtained.

Stern, D. P.↗
NASA NTRS1981

Observations of the magnetic field and plasma flow in Jupiter's magnetosheath

A comprehensive description is given of the Jovian MS magnetic fields, and explanations of these phenomena are proposed. While emphasizing Voyager 1 and 2 magnetic field observations and their relations to the plasma observations, it is also shown that the same phenomena are present in the Pioneer 10 magnetic field data. An unusually high occurrence of nearly north or south fields is observed in the outbound MS, especially in the vicinity of the MP. It is noted that the outbound MS fields and their variations tend to occur in a plane parallel to the local MP, according to large scale MP models.

Lepping, R. P.↗
NASA NTRS1984

A numerical study of the vertical transport of momentum in a tropical rainband

The vertical transport of horizontal momentum in a convective tropical rainband is studied using a two-dimensional cloud ensemble model. Twelve simulations are made under the same large-scale conditions. The vertical transports of v momentum (parallel to the rainband) are essentially the same in all of the simulations, even though the structure of the clouds is different in each of the runs. The magnitude of the v-momentum transport by clouds is fairly large. It takes only half of a day to smooth out the tropical low-level easterly jet parallel to the rainband if no other processes are operating. The vertical transports of u momentum (perpendicular to the rainband) are quite different in all of the simulations. This difference can be explained by the dissimilarities in the distributions of horizontal momentum associated with various cloud configurations. The simulated vertical transports of horizontal momentum are compared with those computed with the Schneider and Lindzen scheme. The results suggest that their scheme is basically correct and usable if some improvements are made.

Soong, S.-T.↗